Jul 24 21:12:50.011810 ip-10-0-137-226 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 24 21:12:50.011823 ip-10-0-137-226 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 24 21:12:50.011832 ip-10-0-137-226 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 24 21:12:50.012137 ip-10-0-137-226 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 24 21:12:59.480111 ip-10-0-137-226 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 24 21:12:59.480129 ip-10-0-137-226 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 271fbb28ba0d450d892fcd2543ac1641 --
Jul 24 21:14:43.458495 ip-10-0-137-226 systemd[1]: Starting Kubernetes Kubelet...
Jul 24 21:14:43.778622 ip-10-0-137-226 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 21:14:43.778622 ip-10-0-137-226 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 24 21:14:43.778622 ip-10-0-137-226 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 21:14:43.778622 ip-10-0-137-226 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 24 21:14:43.778622 ip-10-0-137-226 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 21:14:43.779984 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.779902    2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 24 21:14:43.783516 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783501    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 21:14:43.783516 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783516    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 21:14:43.783577 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783520    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 21:14:43.783577 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783524    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 21:14:43.783577 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783527    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 21:14:43.783577 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783530    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 21:14:43.783577 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783533    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 21:14:43.783577 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783536    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 21:14:43.783577 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783539    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 21:14:43.783577 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783541    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 21:14:43.783577 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783544    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 21:14:43.783577 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783548    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 21:14:43.783577 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783550    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 21:14:43.783577 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783553    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 21:14:43.783577 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783555    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 21:14:43.783577 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783558    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 21:14:43.783577 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783561    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 21:14:43.783577 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783563    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 21:14:43.783577 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783568    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 21:14:43.783577 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783571    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 21:14:43.783577 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783574    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 21:14:43.784030 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783577    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 21:14:43.784030 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783579    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 21:14:43.784030 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783583    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 21:14:43.784030 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783586    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 21:14:43.784030 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783589    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 21:14:43.784030 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783593    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 21:14:43.784030 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783597    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 21:14:43.784030 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783600    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 21:14:43.784030 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783602    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 21:14:43.784030 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783605    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 21:14:43.784030 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783608    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 21:14:43.784030 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783611    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 21:14:43.784030 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783614    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 21:14:43.784030 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783616    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 21:14:43.784030 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783620    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 21:14:43.784030 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783622    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 21:14:43.784030 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783625    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 21:14:43.784030 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783628    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 21:14:43.784030 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783631    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 21:14:43.784030 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783633    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 21:14:43.784561 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783636    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 21:14:43.784561 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783638    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 21:14:43.784561 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783641    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 21:14:43.784561 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783643    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 21:14:43.784561 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783646    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 21:14:43.784561 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783649    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 21:14:43.784561 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783652    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 21:14:43.784561 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783655    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 21:14:43.784561 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783657    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 21:14:43.784561 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783659    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 21:14:43.784561 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783662    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 21:14:43.784561 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783664    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 21:14:43.784561 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783667    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 21:14:43.784561 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783670    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 21:14:43.784561 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783673    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 21:14:43.784561 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783676    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 21:14:43.784561 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783678    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 21:14:43.784561 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783681    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 21:14:43.784561 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783683    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 21:14:43.784561 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783685    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 21:14:43.785054 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783688    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 21:14:43.785054 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783690    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 21:14:43.785054 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783693    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 21:14:43.785054 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783695    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 21:14:43.785054 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783698    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 21:14:43.785054 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783700    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 21:14:43.785054 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783703    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 21:14:43.785054 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783705    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 21:14:43.785054 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783708    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 21:14:43.785054 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783710    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 21:14:43.785054 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783713    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 21:14:43.785054 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783716    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 21:14:43.785054 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783718    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 21:14:43.785054 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783723    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 21:14:43.785054 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783727    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 21:14:43.785054 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783730    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 21:14:43.785054 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783733    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 21:14:43.785054 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783736    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 21:14:43.785054 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783739    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 21:14:43.785523 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783741    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 21:14:43.785523 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783744    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 21:14:43.785523 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783747    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 21:14:43.785523 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783749    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 21:14:43.785523 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783752    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 21:14:43.785523 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783754    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 21:14:43.785523 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783757    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 21:14:43.785523 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783761    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 21:14:43.785523 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783763    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 21:14:43.785523 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783766    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 21:14:43.785523 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783768    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 21:14:43.785523 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783771    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 21:14:43.785523 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783773    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 21:14:43.785523 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783776    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 21:14:43.785523 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783779    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 21:14:43.785523 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783781    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 21:14:43.785523 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783783    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 21:14:43.785523 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783786    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 21:14:43.785523 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.783789    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 21:14:43.785523 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785146    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 21:14:43.785984 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785153    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 21:14:43.785984 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785157    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 21:14:43.785984 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785161    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 21:14:43.785984 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785163    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 21:14:43.785984 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785167    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 21:14:43.785984 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785169    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 21:14:43.785984 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785172    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 21:14:43.785984 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785175    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 21:14:43.785984 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785177    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 21:14:43.785984 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785180    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 21:14:43.785984 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785182    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 21:14:43.785984 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785185    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 21:14:43.785984 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785187    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 21:14:43.785984 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785190    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 21:14:43.785984 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785192    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 21:14:43.785984 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785195    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 21:14:43.785984 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785198    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 21:14:43.785984 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785201    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 21:14:43.785984 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785203    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 21:14:43.785984 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785206    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 21:14:43.786501 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785209    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 21:14:43.786501 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785211    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 21:14:43.786501 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785214    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 21:14:43.786501 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785216    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 21:14:43.786501 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785219    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 21:14:43.786501 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785236    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 21:14:43.786501 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785239    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 21:14:43.786501 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785241    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 21:14:43.786501 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785244    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 21:14:43.786501 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785246    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 21:14:43.786501 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785249    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 21:14:43.786501 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785251    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 21:14:43.786501 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785254    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 21:14:43.786501 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785257    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 21:14:43.786501 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785259    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 21:14:43.786501 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785261    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 21:14:43.786501 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785264    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 21:14:43.786501 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785275    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 21:14:43.786501 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785278    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 21:14:43.786966 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785281    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 21:14:43.786966 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785285    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 21:14:43.786966 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785288    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 21:14:43.786966 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785291    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 21:14:43.786966 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785294    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 21:14:43.786966 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785296    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 21:14:43.786966 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785299    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 21:14:43.786966 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785302    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 21:14:43.786966 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785305    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 21:14:43.786966 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785307    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 21:14:43.786966 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785310    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 21:14:43.786966 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785313    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 21:14:43.786966 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785315    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 21:14:43.786966 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785318    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 21:14:43.786966 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785320    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 21:14:43.786966 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785323    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 21:14:43.786966 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785325    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 21:14:43.786966 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785329    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 21:14:43.786966 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785331    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 21:14:43.787543 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785334    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 21:14:43.787543 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785336    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 21:14:43.787543 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785339    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 21:14:43.787543 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785341    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 21:14:43.787543 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785343    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 21:14:43.787543 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785346    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 21:14:43.787543 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785348    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 21:14:43.787543 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785351    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 21:14:43.787543 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785353    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 21:14:43.787543 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785355    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 21:14:43.787543 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785358    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 21:14:43.787543 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785362    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 21:14:43.787543 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785370    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 21:14:43.787543 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785373    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 21:14:43.787543 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785375    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 21:14:43.787543 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785378    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 21:14:43.787543 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785380    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 21:14:43.787543 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785383    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 21:14:43.787543 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785385    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 21:14:43.787543 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785388    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 21:14:43.788065 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785391    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 21:14:43.788065 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785395    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 21:14:43.788065 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785397    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 21:14:43.788065 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785400    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 21:14:43.788065 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785403    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 21:14:43.788065 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785405    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 21:14:43.788065 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785408    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 21:14:43.788065 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785410    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 21:14:43.788065 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785413    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 21:14:43.788065 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785415    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 21:14:43.788065 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785417    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 21:14:43.788065 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785421    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 21:14:43.788065 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785425    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 21:14:43.788065 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785428    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 21:14:43.788065 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785430    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 21:14:43.788065 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785433    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 21:14:43.788065 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785436    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 21:14:43.788065 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785438    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 21:14:43.788065 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785441    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 21:14:43.788065 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785443    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 21:14:43.788590 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785819    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 21:14:43.788590 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785824    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 21:14:43.788590 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785826    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 21:14:43.788590 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785829    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 21:14:43.788590 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785832    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 21:14:43.788590 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785835    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 21:14:43.788590 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785837    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 21:14:43.788590 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785841    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 21:14:43.788590 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785845    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 21:14:43.788590 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785847    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 21:14:43.788590 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785850    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 21:14:43.788590 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785853    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 21:14:43.788590 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785855    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 21:14:43.788590 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785858    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 21:14:43.788590 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785861    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 21:14:43.788590 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785863    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 21:14:43.788590 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785866    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 21:14:43.788590 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785869    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 21:14:43.788590 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785871    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 21:14:43.788590 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785874    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 21:14:43.789072 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785877    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 21:14:43.789072 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785879    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 21:14:43.789072 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785882    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 21:14:43.789072 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785884    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 21:14:43.789072 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785887    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 21:14:43.789072 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785889    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 21:14:43.789072 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785892    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 21:14:43.789072 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785894    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 21:14:43.789072 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785896    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 21:14:43.789072 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785899    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 21:14:43.789072 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785901    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 21:14:43.789072 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785904    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 21:14:43.789072 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785906    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 21:14:43.789072 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785909    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 21:14:43.789072 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785911    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 21:14:43.789072 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785913    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 21:14:43.789072 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785916    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 21:14:43.789072 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785918    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 21:14:43.789072 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785921    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 21:14:43.789072 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785923    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 21:14:43.789579 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785926    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 21:14:43.789579 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785928    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 21:14:43.789579 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785930    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 21:14:43.789579 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785933    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 21:14:43.789579 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785936    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 21:14:43.789579 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785938    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 21:14:43.789579 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785941    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 21:14:43.789579 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785944    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 21:14:43.789579 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785946    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 21:14:43.789579 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785949    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 21:14:43.789579 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785952    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 21:14:43.789579 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785954    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 21:14:43.789579 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785957    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 21:14:43.789579 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785959    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 21:14:43.789579 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785961    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 21:14:43.789579 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785964    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 21:14:43.789579 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785966    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 21:14:43.789579 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785968    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 21:14:43.789579 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785971    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 21:14:43.789579 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785973    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 21:14:43.790101 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785976    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 21:14:43.790101 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785979    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 21:14:43.790101 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785981    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 21:14:43.790101 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785984    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 21:14:43.790101 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785986    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 21:14:43.790101 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785989    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 21:14:43.790101 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785992    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 21:14:43.790101 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785994    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 21:14:43.790101 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785997    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 21:14:43.790101 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.785999    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 21:14:43.790101 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786002    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 21:14:43.790101 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786006    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 21:14:43.790101 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786009    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 21:14:43.790101 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786012    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 21:14:43.790101 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786014    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 21:14:43.790101 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786019    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 21:14:43.790101 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786022    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 21:14:43.790101 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786025    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 21:14:43.790101 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786027    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 21:14:43.790572 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786029    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 21:14:43.790572 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786032    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 21:14:43.790572 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786034    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 21:14:43.790572 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786037    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 21:14:43.790572 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786039    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 21:14:43.790572 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786042    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 21:14:43.790572 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786045    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 21:14:43.790572 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786048    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 21:14:43.790572 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786050    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 21:14:43.790572 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786054    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 21:14:43.790572 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786057    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 21:14:43.790572 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786060    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 21:14:43.790572 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786063    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 21:14:43.790572 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786066    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 21:14:43.790572 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786068    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 21:14:43.790572 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786071    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 21:14:43.790572 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786074    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 21:14:43.790572 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786076    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 21:14:43.790572 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786079    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 21:14:43.791021 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786082    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 21:14:43.791021 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786145    2561 flags.go:64] FLAG: --address="0.0.0.0"
Jul 24 21:14:43.791021 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786152    2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 24 21:14:43.791021 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786160    2561 flags.go:64] FLAG: --anonymous-auth="true"
Jul 24 21:14:43.791021 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786165    2561 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 24 21:14:43.791021 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786169    2561 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 24 21:14:43.791021 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786172    2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 24 21:14:43.791021 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786176    2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 24 21:14:43.791021 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786180    2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 24 21:14:43.791021 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786187    2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 24 21:14:43.791021 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786190    2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 24 21:14:43.791021 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786193    2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 24 21:14:43.791021 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786196    2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 24 21:14:43.791021 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786199    2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 24 21:14:43.791021 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786202    2561 flags.go:64] FLAG: --cgroup-root=""
Jul 24 21:14:43.791021 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786206    2561 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 24 21:14:43.791021 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786208    2561 flags.go:64] FLAG: --client-ca-file=""
Jul 24 21:14:43.791021 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786211    2561 flags.go:64] FLAG: --cloud-provider="external"
Jul 24 21:14:43.791021 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786214    2561 flags.go:64] FLAG: --cluster-dns="[]"
Jul 24 21:14:43.791021 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786219    2561 flags.go:64] FLAG: --cluster-domain=""
Jul 24 21:14:43.791021 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786236    2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 24 21:14:43.791021 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786239    2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 24 21:14:43.791021 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786242    2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 24 21:14:43.791021 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786245    2561 flags.go:64] FLAG: --container-log-max-files="5"
Jul 24 21:14:43.791641 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786249    2561 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 24 21:14:43.791641 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786252    2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 24 21:14:43.791641 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786254    2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 24 21:14:43.791641 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786258    2561 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 24 21:14:43.791641 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786261    2561 flags.go:64] FLAG: --contention-profiling="false"
Jul 24 21:14:43.791641 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786263    2561 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 24 21:14:43.791641 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786267    2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 24 21:14:43.791641 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786270    2561 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 24 21:14:43.791641 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786273    2561 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 24 21:14:43.791641 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786277    2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 24 21:14:43.791641 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786280    2561 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 24 21:14:43.791641 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786283    2561 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 24 21:14:43.791641 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786285    2561 flags.go:64] FLAG: --enable-load-reader="false"
Jul 24 21:14:43.791641 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786288    2561 flags.go:64] FLAG: --enable-server="true"
Jul 24 21:14:43.791641 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786292    2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 24 21:14:43.791641 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786296    2561 flags.go:64] FLAG: --event-burst="100"
Jul 24 21:14:43.791641 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786299    2561 flags.go:64] FLAG: --event-qps="50"
Jul 24 21:14:43.791641 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786304    2561 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 24 21:14:43.791641 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786307    2561 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 24 21:14:43.791641 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786309    2561 flags.go:64] FLAG: --eviction-hard=""
Jul 24 21:14:43.791641 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786313    2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 24 21:14:43.791641 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786316    2561 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 24 21:14:43.791641 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786319    2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 24 21:14:43.791641 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786322    2561 flags.go:64] FLAG: --eviction-soft=""
Jul 24 21:14:43.791641 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786325    2561 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 24 21:14:43.792285 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786328    2561 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 24 21:14:43.792285 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786338    2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 24 21:14:43.792285 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786341    2561 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 24 21:14:43.792285 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786343    2561 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 24 21:14:43.792285 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786346    2561 flags.go:64] FLAG: --fail-swap-on="true"
Jul 24 21:14:43.792285 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786348    2561 flags.go:64] FLAG: --feature-gates=""
Jul 24 21:14:43.792285 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786352    2561 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 24 21:14:43.792285 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786355    2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 24 21:14:43.792285 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786358    2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 24 21:14:43.792285 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786361    2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 24 21:14:43.792285 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786364    2561 flags.go:64] FLAG: --healthz-port="10248"
Jul 24 21:14:43.792285 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786367    2561 flags.go:64] FLAG: --help="false"
Jul 24 21:14:43.792285 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786370    2561 flags.go:64] FLAG: --hostname-override="ip-10-0-137-226.ec2.internal"
Jul 24 21:14:43.792285 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786373    2561 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 24 21:14:43.792285 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786375    2561 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 24 21:14:43.792285 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786378    2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 24 21:14:43.792285 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786381    2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 24 21:14:43.792285 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786384    2561 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 24 21:14:43.792285 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786387    2561 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 24 21:14:43.792285 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786390    2561 flags.go:64] FLAG: --image-service-endpoint=""
Jul 24 21:14:43.792285 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786392    2561 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 24 21:14:43.792285 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786395    2561 flags.go:64] FLAG: --kube-api-burst="100"
Jul 24 21:14:43.792285 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786399    2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 24 21:14:43.792873 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786402    2561 flags.go:64] FLAG: --kube-api-qps="50"
Jul 24 21:14:43.792873 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786406    2561 flags.go:64] FLAG: --kube-reserved=""
Jul 24 21:14:43.792873 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786409    2561 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 24 21:14:43.792873 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786411    2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 24 21:14:43.792873 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786414    2561 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 24 21:14:43.792873 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786417    2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 24 21:14:43.792873 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786420    2561 flags.go:64] FLAG: --lock-file=""
Jul 24 21:14:43.792873 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786422    2561 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 24 21:14:43.792873 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786425    2561 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 24 21:14:43.792873 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786428    2561 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 24 21:14:43.792873 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786433    2561 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 24 21:14:43.792873 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786436    2561 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 24 21:14:43.792873 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786438    2561 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 24 21:14:43.792873 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786441    2561 flags.go:64] FLAG: --logging-format="text"
Jul 24 21:14:43.792873 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786444    2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 24 21:14:43.792873 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786447    2561 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 24 21:14:43.792873 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786449    2561 flags.go:64] FLAG: --manifest-url=""
Jul 24 21:14:43.792873 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786452    2561 flags.go:64] FLAG: --manifest-url-header=""
Jul 24 21:14:43.792873 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786456    2561 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 24 21:14:43.792873 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786459    2561 flags.go:64] FLAG: --max-open-files="1000000"
Jul 24 21:14:43.792873 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786463    2561 flags.go:64] FLAG: --max-pods="110"
Jul 24 21:14:43.792873 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786466    2561 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 24 21:14:43.792873 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786468    2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 24 21:14:43.792873 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786471    2561 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 24 21:14:43.792873 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786474    2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 24 21:14:43.793498 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786477    2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 24 21:14:43.793498 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786480    2561 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 24 21:14:43.793498 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786482    2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 24 21:14:43.793498 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786489    2561 flags.go:64] FLAG: --node-status-max-images="50"
Jul 24 21:14:43.793498 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786492    2561 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 24 21:14:43.793498 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786495    2561 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 24 21:14:43.793498 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786498    2561 flags.go:64] FLAG: --pod-cidr=""
Jul 24 21:14:43.793498 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786501    2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 24 21:14:43.793498 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786508    2561 flags.go:64] FLAG: --pod-manifest-path=""
Jul 24 21:14:43.793498 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786512    2561 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 24 21:14:43.793498 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786516    2561 flags.go:64] FLAG: --pods-per-core="0"
Jul 24 21:14:43.793498 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786518    2561 flags.go:64] FLAG: --port="10250"
Jul 24 21:14:43.793498 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786522    2561 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 24 21:14:43.793498 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786525    2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f050212718f4e3c0"
Jul 24 21:14:43.793498 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786528    2561 flags.go:64] FLAG: --qos-reserved=""
Jul 24 21:14:43.793498 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786530    2561 flags.go:64] FLAG: --read-only-port="10255"
Jul 24 21:14:43.793498 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786533    2561 flags.go:64] FLAG: --register-node="true"
Jul 24 21:14:43.793498 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786536    2561 flags.go:64] FLAG: --register-with-taints=""
Jul 24 21:14:43.793498 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786540    2561 flags.go:64] FLAG: --registry-burst="10"
Jul 24 21:14:43.793498 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786542    2561 flags.go:64] FLAG: --registry-qps="5"
Jul 24 21:14:43.793498 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786545    2561 flags.go:64] FLAG: --reserved-cpus=""
Jul 24 21:14:43.793498 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786547    2561 flags.go:64] FLAG: --reserved-memory=""
Jul 24 21:14:43.793498 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786551    2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 24 21:14:43.793498 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786554    2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 24 21:14:43.793498 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786556    2561 flags.go:64] FLAG: --rotate-certificates="false"
Jul 24 21:14:43.794097 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786559    2561 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 24 21:14:43.794097 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786562    2561 flags.go:64] FLAG: --runonce="false"
Jul 24 21:14:43.794097 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786564    2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 24 21:14:43.794097 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786567    2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 24 21:14:43.794097 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786570    2561 flags.go:64] FLAG: --seccomp-default="false"
Jul 24 21:14:43.794097 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786572    2561 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 24 21:14:43.794097 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786575    2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 24 21:14:43.794097 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786578    2561 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 24 21:14:43.794097 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786581    2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 24 21:14:43.794097 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786584    2561 flags.go:64] FLAG: --storage-driver-password="root"
Jul 24 21:14:43.794097 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786586    2561 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 24 21:14:43.794097 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786589    2561 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 24 21:14:43.794097 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786596    2561 flags.go:64] FLAG: --storage-driver-user="root"
Jul 24 21:14:43.794097 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786598    2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 24 21:14:43.794097 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786601    2561 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 24 21:14:43.794097 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786606    2561 flags.go:64] FLAG: --system-cgroups=""
Jul 24 21:14:43.794097 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786610    2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 24 21:14:43.794097 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786616    2561 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 24 21:14:43.794097 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786618    2561 flags.go:64] FLAG: --tls-cert-file=""
Jul 24 21:14:43.794097 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786621    2561 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 24 21:14:43.794097 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786625    2561 flags.go:64] FLAG: --tls-min-version=""
Jul 24 21:14:43.794097 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786628    2561 flags.go:64] FLAG: --tls-private-key-file=""
Jul 24 21:14:43.794097 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786630    2561 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 24 21:14:43.794097 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786633    2561 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 24 21:14:43.794097 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786636    2561 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 24 21:14:43.794733 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786638    2561 flags.go:64] FLAG: --v="2"
Jul 24 21:14:43.794733 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786642    2561 flags.go:64] FLAG: --version="false"
Jul 24 21:14:43.794733 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786645    2561 flags.go:64] FLAG: --vmodule=""
Jul 24 21:14:43.794733 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786649    2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 24 21:14:43.794733 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.786652    2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 24 21:14:43.794733 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786770    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 21:14:43.794733 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786774    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 21:14:43.794733 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786777    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 21:14:43.794733 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786780    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 21:14:43.794733 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786783    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 21:14:43.794733 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786786    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 21:14:43.794733 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786788    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 21:14:43.794733 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786791    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 21:14:43.794733 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786794    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 21:14:43.794733 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786796    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 21:14:43.794733 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786799    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 21:14:43.794733 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786801    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 21:14:43.794733 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786804    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 21:14:43.794733 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786806    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 21:14:43.794733 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786808    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 21:14:43.794733 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786811    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 21:14:43.795372 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786813    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 21:14:43.795372 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786817    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 21:14:43.795372 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786822    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 21:14:43.795372 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786824    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 21:14:43.795372 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786827    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 21:14:43.795372 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786829    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 21:14:43.795372 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786832    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 21:14:43.795372 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786834    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 21:14:43.795372 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786837    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 21:14:43.795372 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786839    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 21:14:43.795372 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786842    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 21:14:43.795372 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786844    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 21:14:43.795372 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786847    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 21:14:43.795372 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786849    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 21:14:43.795372 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786852    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 21:14:43.795372 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786854    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 21:14:43.795372 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786857    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 21:14:43.795372 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786859    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 21:14:43.795372 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786861    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 21:14:43.795372 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786864    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 21:14:43.795849 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786866    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 21:14:43.795849 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786868    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 21:14:43.795849 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786871    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 21:14:43.795849 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786873    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 21:14:43.795849 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786876    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 21:14:43.795849 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786878    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 21:14:43.795849 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786881    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 21:14:43.795849 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786883    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 21:14:43.795849 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786885    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 21:14:43.795849 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786888    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 21:14:43.795849 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786891    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 21:14:43.795849 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786893    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 21:14:43.795849 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786896    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 21:14:43.795849 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786900    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 21:14:43.795849 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786904    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 21:14:43.795849 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786907    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 21:14:43.795849 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786909    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 21:14:43.795849 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786911    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 21:14:43.795849 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786914    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 21:14:43.795849 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786916    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 21:14:43.796509 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786919    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 21:14:43.796509 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786921    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 21:14:43.796509 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786924    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 21:14:43.796509 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786926    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 21:14:43.796509 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786930    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 21:14:43.796509 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786933    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 21:14:43.796509 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786935    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 21:14:43.796509 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786938    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 21:14:43.796509 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786940    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 21:14:43.796509 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786943    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 21:14:43.796509 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786945    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 21:14:43.796509 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786947    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 21:14:43.796509 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786950    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 21:14:43.796509 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786952    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 21:14:43.796509 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786955    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 21:14:43.796509 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786957    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 21:14:43.796509 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786959    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 21:14:43.796509 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786962    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 21:14:43.796509 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786964    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 21:14:43.796509 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786967    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 21:14:43.797220 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786969    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 21:14:43.797220 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786973    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 21:14:43.797220 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786977    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 21:14:43.797220 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786980    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 21:14:43.797220 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786982    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 21:14:43.797220 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786986    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 21:14:43.797220 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786989    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 21:14:43.797220 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786992    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 21:14:43.797220 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786995    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 21:14:43.797220 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.786997    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 21:14:43.797220 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.787000    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 21:14:43.797220 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.787002    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 21:14:43.797220 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.787004    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 21:14:43.797220 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.787007    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 21:14:43.797220 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.787009    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 21:14:43.797220 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.787012    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 21:14:43.797220 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.787016    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 21:14:43.797220 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.787019    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 21:14:43.797220 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.787022    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 21:14:43.797706 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.787024    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 21:14:43.797706 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.787027    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 21:14:43.797706 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.787030    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 21:14:43.797706 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.787032    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 21:14:43.797706 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.787041    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 21:14:43.797706 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.793717    2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 24 21:14:43.797706 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.793730    2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 24 21:14:43.797706 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.794481    2561 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 24 21:14:43.797706 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.794492    2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 24 21:14:43.797706 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794546    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 21:14:43.797706 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794551    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 21:14:43.797706 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794554    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 21:14:43.797706 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794557    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 21:14:43.797706 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794561    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 21:14:43.797706 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794563    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 21:14:43.798077 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794566    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 21:14:43.798077 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794568    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 21:14:43.798077 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794571    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 21:14:43.798077 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794574    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 21:14:43.798077 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794576    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 21:14:43.798077 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794578    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 21:14:43.798077 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794581    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 21:14:43.798077 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794584    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 21:14:43.798077 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794587    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 21:14:43.798077 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794589    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 21:14:43.798077 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794592    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 21:14:43.798077 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794595    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 21:14:43.798077 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794597    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 21:14:43.798077 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794600    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 21:14:43.798077 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794602    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 21:14:43.798077 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794604    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 21:14:43.798077 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794607    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 21:14:43.798077 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794610    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 21:14:43.798077 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794613    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 21:14:43.798077 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794615    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 21:14:43.798611 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794617    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 21:14:43.798611 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794620    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 21:14:43.798611 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794622    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 21:14:43.798611 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794627    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 21:14:43.798611 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794629    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 21:14:43.798611 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794632    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 21:14:43.798611 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794634    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 21:14:43.798611 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794637    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 21:14:43.798611 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794640    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 21:14:43.798611 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794642    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 21:14:43.798611 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794645    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 21:14:43.798611 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794648    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 21:14:43.798611 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794652    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 21:14:43.798611 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794654    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 21:14:43.798611 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794657    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 21:14:43.798611 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794659    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 21:14:43.798611 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794662    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 21:14:43.798611 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794664    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 21:14:43.798611 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794667    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 21:14:43.799068 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794670    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 21:14:43.799068 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794672    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 21:14:43.799068 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794674    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 21:14:43.799068 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794677    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 21:14:43.799068 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794679    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 21:14:43.799068 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794682    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 21:14:43.799068 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794684    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 21:14:43.799068 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794687    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 21:14:43.799068 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794689    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 21:14:43.799068 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794692    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 21:14:43.799068 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794694    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 21:14:43.799068 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794696    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 21:14:43.799068 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794700    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 21:14:43.799068 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794704    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 21:14:43.799068 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794706    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 21:14:43.799068 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794709    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 21:14:43.799068 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794712    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 21:14:43.799068 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794715    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 21:14:43.799068 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794718    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 21:14:43.799555 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794720    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 21:14:43.799555 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794722    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 21:14:43.799555 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794725    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 21:14:43.799555 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794729    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 21:14:43.799555 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794732    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 21:14:43.799555 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794735    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 21:14:43.799555 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794738    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 21:14:43.799555 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794741    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 21:14:43.799555 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794744    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 21:14:43.799555 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794747    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 21:14:43.799555 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794750    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 21:14:43.799555 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794752    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 21:14:43.799555 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794755    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 21:14:43.799555 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794757    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 21:14:43.799555 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794760    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 21:14:43.799555 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794762    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 21:14:43.799555 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794764    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 21:14:43.799555 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794767    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 21:14:43.799555 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794769    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 21:14:43.799555 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794772    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 21:14:43.800052 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794774    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 21:14:43.800052 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794776    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 21:14:43.800052 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794778    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 21:14:43.800052 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794781    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 21:14:43.800052 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794783    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 21:14:43.800052 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794785    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 21:14:43.800052 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794788    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 21:14:43.800052 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794791    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 21:14:43.800052 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794794    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 21:14:43.800052 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794796    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 21:14:43.800052 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794799    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 21:14:43.800052 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794802    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 21:14:43.800052 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794804    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 21:14:43.800052 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794807    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 21:14:43.800052 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794810    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 21:14:43.800527 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.794815    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 21:14:43.800527 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794924    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 21:14:43.800527 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794929    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 21:14:43.800527 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794932    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 21:14:43.800527 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794934    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 21:14:43.800527 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794937    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 21:14:43.800527 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794940    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 21:14:43.800527 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794942    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 21:14:43.800527 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794946    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 21:14:43.800527 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794948    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 21:14:43.800527 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794951    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 21:14:43.800527 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794953    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 21:14:43.800527 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794955    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 21:14:43.800527 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794958    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 21:14:43.800877 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794960    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 21:14:43.800877 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794963    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 21:14:43.800877 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794965    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 21:14:43.800877 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794968    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 21:14:43.800877 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794970    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 21:14:43.800877 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794972    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 21:14:43.800877 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794975    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 21:14:43.800877 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794977    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 21:14:43.800877 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794979    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 21:14:43.800877 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794982    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 21:14:43.800877 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794984    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 21:14:43.800877 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794987    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 21:14:43.800877 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794990    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 21:14:43.800877 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794992    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 21:14:43.800877 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794995    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 21:14:43.800877 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.794997    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 21:14:43.800877 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795000    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 21:14:43.800877 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795002    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 21:14:43.800877 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795005    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 21:14:43.800877 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795007    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 21:14:43.801474 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795010    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 21:14:43.801474 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795012    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 21:14:43.801474 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795014    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 21:14:43.801474 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795016    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 21:14:43.801474 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795019    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 21:14:43.801474 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795021    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 21:14:43.801474 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795024    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 21:14:43.801474 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795026    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 21:14:43.801474 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795028    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 21:14:43.801474 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795031    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 21:14:43.801474 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795033    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 21:14:43.801474 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795036    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 21:14:43.801474 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795038    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 21:14:43.801474 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795040    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 21:14:43.801474 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795043    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 21:14:43.801474 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795045    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 21:14:43.801474 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795048    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 21:14:43.801474 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795050    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 21:14:43.801474 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795053    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 21:14:43.801474 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795055    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 21:14:43.801955 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795057    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 21:14:43.801955 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795060    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 21:14:43.801955 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795062    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 21:14:43.801955 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795065    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 21:14:43.801955 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795067    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 21:14:43.801955 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795070    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 21:14:43.801955 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795073    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 21:14:43.801955 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795075    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 21:14:43.801955 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795084    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 21:14:43.801955 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795088    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 21:14:43.801955 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795091    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 21:14:43.801955 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795094    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 21:14:43.801955 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795097    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 21:14:43.801955 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795099    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 21:14:43.801955 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795102    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 21:14:43.801955 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795104    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 21:14:43.801955 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795107    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 21:14:43.801955 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795109    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 21:14:43.801955 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795112    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 21:14:43.801955 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795114    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 21:14:43.802466 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795117    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 21:14:43.802466 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795119    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 21:14:43.802466 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795122    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 21:14:43.802466 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795126    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 21:14:43.802466 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795128    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 21:14:43.802466 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795131    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 21:14:43.802466 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795133    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 21:14:43.802466 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795136    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 21:14:43.802466 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795138    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 21:14:43.802466 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795141    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 21:14:43.802466 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795143    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 21:14:43.802466 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795147    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 21:14:43.802466 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795150    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 21:14:43.802466 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795153    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 21:14:43.802466 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795155    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 21:14:43.802466 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795158    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 21:14:43.802466 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795161    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 21:14:43.802466 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795164    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 21:14:43.802466 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795167    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 21:14:43.802930 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795169    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 21:14:43.802930 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795172    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 21:14:43.802930 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795175    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 21:14:43.802930 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795178    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 21:14:43.802930 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795181    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 21:14:43.802930 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795184    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 21:14:43.802930 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:43.795186    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 21:14:43.802930 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.795191    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 21:14:43.802930 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.795301    2561 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 24 21:14:43.802930 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.798336    2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 24 21:14:43.802930 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.799697    2561 server.go:1019] "Starting client certificate rotation"
Jul 24 21:14:43.802930 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.799794    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 21:14:43.802930 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.799831    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 21:14:43.803307 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.802254    2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 21:14:43.803504 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.803491    2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 21:14:43.810116 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.810098    2561 log.go:25] "Validated CRI v1 runtime API"
Jul 24 21:14:43.811997 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.811975    2561 log.go:25] "Validated CRI v1 image API"
Jul 24 21:14:43.812718 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.812705    2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 24 21:14:43.815506 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.815489    2561 fs.go:135] Filesystem UUIDs: map[72c21388-7d6b-4d78-9953-423d2a2dfbcd:/dev/nvme0n1p3 734e4125-e9ec-458d-9b6d-49bab55f5072:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 24 21:14:43.815552 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.815507    2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 24 21:14:43.820321 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.820208    2561 manager.go:216] Machine: {Timestamp:2026-07-24 21:14:43.81960058 +0000 UTC m=+0.264192333 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101046 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2deecea9851bf1961f54dd8619a6a2 SystemUUID:ec2deece-a985-1bf1-961f-54dd8619a6a2 BootID:271fbb28-ba0d-450d-892f-cd2543ac1641 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:56:47:24:63:a7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:56:47:24:63:a7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:b9:2b:47:15:a2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 24 21:14:43.820321 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.820318    2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 24 21:14:43.820414 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.820387    2561 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 24 21:14:43.822972 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.822949    2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 24 21:14:43.823107 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.822980    2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-226.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 24 21:14:43.823658 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.823648    2561 topology_manager.go:138] "Creating topology manager with none policy"
Jul 24 21:14:43.823688 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.823661    2561 container_manager_linux.go:309] "Creating device plugin manager"
Jul 24 21:14:43.823688 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.823668    2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 21:14:43.824302 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.824292    2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 21:14:43.825111 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.825102    2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 24 21:14:43.828071 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.828060    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 21:14:43.828179 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.828170    2561 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 24 21:14:43.828718 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.828708    2561 kubelet.go:486] "Attempting to sync node with API server"
Jul 24 21:14:43.828754 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.828727    2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 24 21:14:43.828754 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.828741    2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 24 21:14:43.828754 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.828750    2561 kubelet.go:398] "Adding apiserver pod source"
Jul 24 21:14:43.828861 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.828758    2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 24 21:14:43.829102 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.829086    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 21:14:43.829177 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.829106    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 21:14:43.831496 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.831452    2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 24 21:14:43.833362 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.833345    2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 24 21:14:43.833443 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.833381    2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 24 21:14:43.834760 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.834748    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 24 21:14:43.834825 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.834764    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 24 21:14:43.834825 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.834771    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 24 21:14:43.834825 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.834776    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 24 21:14:43.834825 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.834785    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 24 21:14:43.834825 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.834790    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 24 21:14:43.834825 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.834798    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 24 21:14:43.834825 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.834803    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 24 21:14:43.834825 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.834809    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 24 21:14:43.834825 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.834815    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 24 21:14:43.834825 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.834823    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 24 21:14:43.834825 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.834828    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 24 21:14:43.835405 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.835396    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 24 21:14:43.835405 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.835405    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 24 21:14:43.838462 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.838450    2561 server.go:1268] "Started kubelet"
Jul 24 21:14:43.838605 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.838560    2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 24 21:14:43.838669 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.838626    2561 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 24 21:14:43.838718 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.838683    2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 24 21:14:43.839189 ip-10-0-137-226 systemd[1]: Started Kubernetes Kubelet.
Jul 24 21:14:43.840207 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.840122    2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 24 21:14:43.840488 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.840471    2561 server.go:310] "Adding debug handlers to kubelet server"
Jul 24 21:14:43.843609 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:43.843573    2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 24 21:14:43.843770 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.843753    2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-226.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 21:14:43.843856 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:43.843818    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 21:14:43.843965 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:43.843937    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-226.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 21:14:43.844599 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:43.843852    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-226.ec2.internal.18c5564580f3335a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-226.ec2.internal,UID:ip-10-0-137-226.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-226.ec2.internal,},FirstTimestamp:2026-07-24 21:14:43.838423898 +0000 UTC m=+0.283015619,LastTimestamp:2026-07-24 21:14:43.838423898 +0000 UTC m=+0.283015619,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-226.ec2.internal,}"
Jul 24 21:14:43.846463 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.846450    2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 24 21:14:43.846510 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.846462    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 24 21:14:43.846591 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:43.846508    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-226.ec2.internal\" not found"
Jul 24 21:14:43.847197 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.846988    2561 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 24 21:14:43.847197 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.847004    2561 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 24 21:14:43.847197 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.846990    2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 24 21:14:43.847197 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.847119    2561 reconstruct.go:97] "Volume reconstruction finished"
Jul 24 21:14:43.847197 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.847127    2561 reconciler.go:29] "Reconciler: start to sync state"
Jul 24 21:14:43.847622 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.847216    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 21:14:43.847622 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.847251    2561 factory.go:55] Registering systemd factory
Jul 24 21:14:43.847622 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.847266    2561 factory.go:223] Registration of the systemd container factory successfully
Jul 24 21:14:43.847622 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.847455    2561 factory.go:153] Registering CRI-O factory
Jul 24 21:14:43.847622 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.847468    2561 factory.go:223] Registration of the crio container factory successfully
Jul 24 21:14:43.847622 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.847511    2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 24 21:14:43.847622 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.847532    2561 factory.go:103] Registering Raw factory
Jul 24 21:14:43.847622 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.847547    2561 manager.go:1196] Started watching for new ooms in manager
Jul 24 21:14:43.847970 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.847964    2561 manager.go:349] Starting recovery of all containers
Jul 24 21:14:43.848427 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:43.848403    2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-226.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 24 21:14:43.848503 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:43.848467    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 21:14:43.858976 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.857665    2561 manager.go:354] Recovery completed
Jul 24 21:14:43.863348 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.863335    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 21:14:43.868110 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.868092    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 21:14:43.868163 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.868132    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 21:14:43.868163 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.868149    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasSufficientPID"
Jul 24 21:14:43.868711 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.868695    2561 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 24 21:14:43.868789 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.868712    2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 24 21:14:43.868789 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.868703    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 21:14:43.868789 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.868729    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 21:14:43.869369 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.869351    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 21:14:43.869434 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.869382    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 21:14:43.869434 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.869392    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasSufficientPID"
Jul 24 21:14:43.871359 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.871347    2561 policy_none.go:49] "None policy: Start"
Jul 24 21:14:43.871392 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.871364    2561 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 24 21:14:43.871392 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.871374    2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 24 21:14:43.873409 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.873395    2561 policy_none.go:47] "Start"
Jul 24 21:14:43.874247 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.874214    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gqdbd"
Jul 24 21:14:43.878136 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:43.877975    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-226.ec2.internal.18c5564582b838e8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-226.ec2.internal,UID:ip-10-0-137-226.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-226.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-226.ec2.internal,},FirstTimestamp:2026-07-24 21:14:43.868113128 +0000 UTC m=+0.312704855,LastTimestamp:2026-07-24 21:14:43.868113128 +0000 UTC m=+0.312704855,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-226.ec2.internal,}"
Jul 24 21:14:43.879955 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:43.879894    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-226.ec2.internal.18c5564582b8a299  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-226.ec2.internal,UID:ip-10-0-137-226.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-226.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-226.ec2.internal,},FirstTimestamp:2026-07-24 21:14:43.868140185 +0000 UTC m=+0.312731909,LastTimestamp:2026-07-24 21:14:43.868140185 +0000 UTC m=+0.312731909,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-226.ec2.internal,}"
Jul 24 21:14:43.882685 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.882670    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gqdbd"
Jul 24 21:14:43.889060 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:43.889009    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-226.ec2.internal.18c5564582b8dbf6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-226.ec2.internal,UID:ip-10-0-137-226.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-226.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-226.ec2.internal,},FirstTimestamp:2026-07-24 21:14:43.86815487 +0000 UTC m=+0.312746590,LastTimestamp:2026-07-24 21:14:43.86815487 +0000 UTC m=+0.312746590,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-226.ec2.internal,}"
Jul 24 21:14:43.915809 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.915786    2561 manager.go:337] "Starting Device Plugin manager"
Jul 24 21:14:43.915901 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:43.915836    2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 24 21:14:43.915901 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.915850    2561 server.go:87] "Starting device plugin registration server"
Jul 24 21:14:43.916097 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.916084    2561 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 24 21:14:43.916157 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.916102    2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 24 21:14:43.916218 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.916204    2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 24 21:14:43.916326 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.916299    2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 24 21:14:43.916326 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.916326    2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 24 21:14:43.916701 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:43.916680    2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 24 21:14:43.916794 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:43.916736    2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-226.ec2.internal\" not found"
Jul 24 21:14:43.946051 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.946016    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 24 21:14:43.954379 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.947336    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 24 21:14:43.954379 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.947372    2561 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 24 21:14:43.954379 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.947391    2561 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 24 21:14:43.954379 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:43.947428    2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 24 21:14:43.954379 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:43.949398    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 21:14:44.016521 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.016500    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 21:14:44.017324 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.017308    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 21:14:44.017396 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.017338    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 21:14:44.017396 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.017349    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasSufficientPID"
Jul 24 21:14:44.017396 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.017383    2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-226.ec2.internal"
Jul 24 21:14:44.022685 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.022670    2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-226.ec2.internal"
Jul 24 21:14:44.022735 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:44.022690    2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-226.ec2.internal\": node \"ip-10-0-137-226.ec2.internal\" not found"
Jul 24 21:14:44.033512 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:44.033472    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-226.ec2.internal\" not found"
Jul 24 21:14:44.048083 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.048064    2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-226.ec2.internal"]
Jul 24 21:14:44.048136 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.048118    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 21:14:44.049089 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.049077    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 21:14:44.049136 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.049104    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 21:14:44.049136 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.049118    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasSufficientPID"
Jul 24 21:14:44.051561 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.051547    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 21:14:44.051690 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.051678    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal"
Jul 24 21:14:44.051725 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.051706    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 21:14:44.052256 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.052240    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 21:14:44.052326 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.052266    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 21:14:44.052326 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.052273    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 21:14:44.052326 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.052283    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasSufficientPID"
Jul 24 21:14:44.052326 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.052291    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 21:14:44.052326 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.052300    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasSufficientPID"
Jul 24 21:14:44.054571 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.054552    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-226.ec2.internal"
Jul 24 21:14:44.054629 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.054580    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 21:14:44.055216 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.055200    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 21:14:44.055328 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.055248    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 21:14:44.055328 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.055263    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasSufficientPID"
Jul 24 21:14:44.071822 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:44.071792    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-226.ec2.internal\" not found" node="ip-10-0-137-226.ec2.internal"
Jul 24 21:14:44.076083 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:44.076068    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-226.ec2.internal\" not found" node="ip-10-0-137-226.ec2.internal"
Jul 24 21:14:44.133595 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:44.133578    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-226.ec2.internal\" not found"
Jul 24 21:14:44.148443 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.148425    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/65ffcbac9baa2903604c87255a496c3c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal\" (UID: \"65ffcbac9baa2903604c87255a496c3c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal"
Jul 24 21:14:44.148564 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.148456    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65ffcbac9baa2903604c87255a496c3c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal\" (UID: \"65ffcbac9baa2903604c87255a496c3c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal"
Jul 24 21:14:44.148564 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.148474    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e4f17126843a86705fdd26207b6a7db0-config\") pod \"kube-apiserver-proxy-ip-10-0-137-226.ec2.internal\" (UID: \"e4f17126843a86705fdd26207b6a7db0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-226.ec2.internal"
Jul 24 21:14:44.234437 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:44.234407    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-226.ec2.internal\" not found"
Jul 24 21:14:44.248734 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.248710    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e4f17126843a86705fdd26207b6a7db0-config\") pod \"kube-apiserver-proxy-ip-10-0-137-226.ec2.internal\" (UID: \"e4f17126843a86705fdd26207b6a7db0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-226.ec2.internal"
Jul 24 21:14:44.248734 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.248727    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e4f17126843a86705fdd26207b6a7db0-config\") pod \"kube-apiserver-proxy-ip-10-0-137-226.ec2.internal\" (UID: \"e4f17126843a86705fdd26207b6a7db0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-226.ec2.internal"
Jul 24 21:14:44.248870 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.248772    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/65ffcbac9baa2903604c87255a496c3c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal\" (UID: \"65ffcbac9baa2903604c87255a496c3c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal"
Jul 24 21:14:44.248870 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.248826    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65ffcbac9baa2903604c87255a496c3c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal\" (UID: \"65ffcbac9baa2903604c87255a496c3c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal"
Jul 24 21:14:44.248870 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.248831    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/65ffcbac9baa2903604c87255a496c3c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal\" (UID: \"65ffcbac9baa2903604c87255a496c3c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal"
Jul 24 21:14:44.248973 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.248872    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65ffcbac9baa2903604c87255a496c3c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal\" (UID: \"65ffcbac9baa2903604c87255a496c3c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal"
Jul 24 21:14:44.335218 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:44.335152    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-226.ec2.internal\" not found"
Jul 24 21:14:44.374652 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.374626    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal"
Jul 24 21:14:44.379809 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.379792    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-226.ec2.internal"
Jul 24 21:14:44.435402 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:44.435368    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-226.ec2.internal\" not found"
Jul 24 21:14:44.535907 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:44.535870    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-226.ec2.internal\" not found"
Jul 24 21:14:44.636521 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:44.636445    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-226.ec2.internal\" not found"
Jul 24 21:14:44.736972 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:44.736944    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-226.ec2.internal\" not found"
Jul 24 21:14:44.799439 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.799413    2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 24 21:14:44.799913 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.799589    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 21:14:44.837895 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:44.837865    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-226.ec2.internal\" not found"
Jul 24 21:14:44.872419 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.872398    2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 21:14:44.875956 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:44.875506    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65ffcbac9baa2903604c87255a496c3c.slice/crio-f9946769c8299327fdc07746e431223b80ccce0c9cbada1d6890e980e9ea056f WatchSource:0}: Error finding container f9946769c8299327fdc07746e431223b80ccce0c9cbada1d6890e980e9ea056f: Status 404 returned error can't find the container with id f9946769c8299327fdc07746e431223b80ccce0c9cbada1d6890e980e9ea056f
Jul 24 21:14:44.876921 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:44.876900    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4f17126843a86705fdd26207b6a7db0.slice/crio-b163aa82e87fba5b97074738a4018c46caf86366a33bcf902cd235db0a50c650 WatchSource:0}: Error finding container b163aa82e87fba5b97074738a4018c46caf86366a33bcf902cd235db0a50c650: Status 404 returned error can't find the container with id b163aa82e87fba5b97074738a4018c46caf86366a33bcf902cd235db0a50c650
Jul 24 21:14:44.880776 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.880761    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 21:14:44.888491 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.888430    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 21:09:44 +0000 UTC" deadline="2028-01-11 22:16:28.278893815 +0000 UTC"
Jul 24 21:14:44.888491 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.888461    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12865h1m43.390435588s"
Jul 24 21:14:44.946898 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.946873    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-226.ec2.internal"
Jul 24 21:14:44.951022 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.950965    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal" event={"ID":"65ffcbac9baa2903604c87255a496c3c","Type":"ContainerStarted","Data":"f9946769c8299327fdc07746e431223b80ccce0c9cbada1d6890e980e9ea056f"}
Jul 24 21:14:44.952109 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.952092    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-226.ec2.internal" event={"ID":"e4f17126843a86705fdd26207b6a7db0","Type":"ContainerStarted","Data":"b163aa82e87fba5b97074738a4018c46caf86366a33bcf902cd235db0a50c650"}
Jul 24 21:14:44.956563 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.956550    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 21:14:44.957971 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.957959    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal"
Jul 24 21:14:44.967285 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:44.967268    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 21:14:45.049721 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.049702    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 21:14:45.258997 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.258927    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 21:14:45.830115 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.830086    2561 apiserver.go:52] "Watching apiserver"
Jul 24 21:14:45.838139 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.838112    2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 24 21:14:45.839449 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.839422    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-25fb5","openshift-ovn-kubernetes/ovnkube-node-z4l6m","kube-system/konnectivity-agent-jmzq6","kube-system/kube-apiserver-proxy-ip-10-0-137-226.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmlgz","openshift-image-registry/node-ca-jnddc","openshift-multus/multus-8rtjq","openshift-multus/multus-additional-cni-plugins-jhsvn","openshift-network-diagnostics/network-check-target-l4zhw","openshift-network-operator/iptables-alerter-m9952","kube-system/global-pull-secret-syncer-zb8df","openshift-cluster-node-tuning-operator/tuned-nwlgt","openshift-dns/node-resolver-5jw4h","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal"]
Jul 24 21:14:45.842034 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.842015    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m9952"
Jul 24 21:14:45.844436 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.844403    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5jw4h"
Jul 24 21:14:45.844914 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.844711    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 24 21:14:45.844914 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.844835    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 24 21:14:45.844914 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.844835    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 24 21:14:45.844914 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.844884    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4smmh\""
Jul 24 21:14:45.847027 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.846746    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 24 21:14:45.847027 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.846798    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jmzq6"
Jul 24 21:14:45.847575 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.847555    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 24 21:14:45.847787 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.847770    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 24 21:14:45.847830 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.847803    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fg6bz\""
Jul 24 21:14:45.849478 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.849444    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 24 21:14:45.849576 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.849562    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 24 21:14:45.849929 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.849634    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-t8pgs\""
Jul 24 21:14:45.849929 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.849563    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jhsvn"
Jul 24 21:14:45.852037 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.852017    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 24 21:14:45.852171 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.852116    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 24 21:14:45.852415 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.852398    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nj8nx\""
Jul 24 21:14:45.852517 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.852472    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 24 21:14:45.852596 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.852406    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 24 21:14:45.852709 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.852690    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 24 21:14:45.852796 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.852774    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmlgz"
Jul 24 21:14:45.854940 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.854875    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jnddc"
Jul 24 21:14:45.855369 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.855350    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mlzpv\""
Jul 24 21:14:45.855469 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.855452    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 24 21:14:45.855770 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.855747    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 24 21:14:45.855851 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.855838    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 24 21:14:45.857262 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.857241    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 24 21:14:45.857405 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.857388    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4zhw"
Jul 24 21:14:45.857515 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:45.857480    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4zhw" podUID="35503db5-115c-40a6-a785-ca16352ed1b2"
Jul 24 21:14:45.858751 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.858730    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 24 21:14:45.858966 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.858949    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 24 21:14:45.859232 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.859208    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qc5z8\""
Jul 24 21:14:45.859482 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.859456    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/92b9098e-caea-4f9b-bfb6-d6757c2d19d6-cnibin\") pod \"multus-additional-cni-plugins-jhsvn\" (UID: \"92b9098e-caea-4f9b-bfb6-d6757c2d19d6\") " pod="openshift-multus/multus-additional-cni-plugins-jhsvn"
Jul 24 21:14:45.859568 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.859496    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b1b822a6-97f4-48cb-8de9-20e36637d53b-agent-certs\") pod \"konnectivity-agent-jmzq6\" (UID: \"b1b822a6-97f4-48cb-8de9-20e36637d53b\") " pod="kube-system/konnectivity-agent-jmzq6"
Jul 24 21:14:45.859568 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.859519    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b1b822a6-97f4-48cb-8de9-20e36637d53b-konnectivity-ca\") pod \"konnectivity-agent-jmzq6\" (UID: \"b1b822a6-97f4-48cb-8de9-20e36637d53b\") " pod="kube-system/konnectivity-agent-jmzq6"
Jul 24 21:14:45.859568 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.859540    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/92b9098e-caea-4f9b-bfb6-d6757c2d19d6-system-cni-dir\") pod \"multus-additional-cni-plugins-jhsvn\" (UID: \"92b9098e-caea-4f9b-bfb6-d6757c2d19d6\") " pod="openshift-multus/multus-additional-cni-plugins-jhsvn"
Jul 24 21:14:45.859568 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.859557    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/92b9098e-caea-4f9b-bfb6-d6757c2d19d6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jhsvn\" (UID: \"92b9098e-caea-4f9b-bfb6-d6757c2d19d6\") " pod="openshift-multus/multus-additional-cni-plugins-jhsvn"
Jul 24 21:14:45.859746 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.859573    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/92b9098e-caea-4f9b-bfb6-d6757c2d19d6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jhsvn\" (UID: \"92b9098e-caea-4f9b-bfb6-d6757c2d19d6\") " pod="openshift-multus/multus-additional-cni-plugins-jhsvn"
Jul 24 21:14:45.859746 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.859595    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/115c393f-0d8f-4d21-8247-546a7f0bef21-tmp-dir\") pod \"node-resolver-5jw4h\" (UID: \"115c393f-0d8f-4d21-8247-546a7f0bef21\") " pod="openshift-dns/node-resolver-5jw4h"
Jul 24 21:14:45.859746 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.859620    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s42kf\" (UniqueName: \"kubernetes.io/projected/115c393f-0d8f-4d21-8247-546a7f0bef21-kube-api-access-s42kf\") pod \"node-resolver-5jw4h\" (UID: \"115c393f-0d8f-4d21-8247-546a7f0bef21\") " pod="openshift-dns/node-resolver-5jw4h"
Jul 24 21:14:45.859746 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.859647    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/92b9098e-caea-4f9b-bfb6-d6757c2d19d6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jhsvn\" (UID: \"92b9098e-caea-4f9b-bfb6-d6757c2d19d6\") " pod="openshift-multus/multus-additional-cni-plugins-jhsvn"
Jul 24 21:14:45.859746 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.859715    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c38305ec-8b35-4d35-861e-381f6d679ae9-host-slash\") pod \"iptables-alerter-m9952\" (UID: \"c38305ec-8b35-4d35-861e-381f6d679ae9\") " pod="openshift-network-operator/iptables-alerter-m9952"
Jul 24 21:14:45.859746 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.859731    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/115c393f-0d8f-4d21-8247-546a7f0bef21-hosts-file\") pod \"node-resolver-5jw4h\" (UID: \"115c393f-0d8f-4d21-8247-546a7f0bef21\") " pod="openshift-dns/node-resolver-5jw4h"
Jul 24 21:14:45.859746 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.859746    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/92b9098e-caea-4f9b-bfb6-d6757c2d19d6-os-release\") pod \"multus-additional-cni-plugins-jhsvn\" (UID: \"92b9098e-caea-4f9b-bfb6-d6757c2d19d6\") " pod="openshift-multus/multus-additional-cni-plugins-jhsvn"
Jul 24 21:14:45.859965 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.859762    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/92b9098e-caea-4f9b-bfb6-d6757c2d19d6-cni-binary-copy\") pod \"multus-additional-cni-plugins-jhsvn\" (UID: \"92b9098e-caea-4f9b-bfb6-d6757c2d19d6\") " pod="openshift-multus/multus-additional-cni-plugins-jhsvn"
Jul 24 21:14:45.859965 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.859788    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sd2k\" (UniqueName: \"kubernetes.io/projected/92b9098e-caea-4f9b-bfb6-d6757c2d19d6-kube-api-access-4sd2k\") pod \"multus-additional-cni-plugins-jhsvn\" (UID: \"92b9098e-caea-4f9b-bfb6-d6757c2d19d6\") " pod="openshift-multus/multus-additional-cni-plugins-jhsvn"
Jul 24 21:14:45.859965 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.859812    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c38305ec-8b35-4d35-861e-381f6d679ae9-iptables-alerter-script\") pod \"iptables-alerter-m9952\" (UID: \"c38305ec-8b35-4d35-861e-381f6d679ae9\") " pod="openshift-network-operator/iptables-alerter-m9952"
Jul 24 21:14:45.859965 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.859834    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6sz4\" (UniqueName: \"kubernetes.io/projected/c38305ec-8b35-4d35-861e-381f6d679ae9-kube-api-access-v6sz4\") pod \"iptables-alerter-m9952\" (UID: \"c38305ec-8b35-4d35-861e-381f6d679ae9\") " pod="openshift-network-operator/iptables-alerter-m9952"
Jul 24 21:14:45.860399 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.860375    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:45.862627 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.862609    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:45.864652 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.863730    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 21:14:45.864652 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.864093    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 24 21:14:45.864652 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.864393    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hp4xl\""
Jul 24 21:14:45.865288 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.865049    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kll2l\""
Jul 24 21:14:45.865288 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.865073    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 24 21:14:45.867185 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.865870    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25fb5"
Jul 24 21:14:45.867185 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:45.865952    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25fb5" podUID="4ff19854-c536-4ba4-b2fc-29a8f87ff1a7"
Jul 24 21:14:45.867185 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.866343    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 24 21:14:45.867185 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.866599    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 24 21:14:45.867185 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.866818    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 24 21:14:45.867185 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.866910    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 24 21:14:45.867185 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.866966    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 24 21:14:45.868581 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.868559    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zb8df"
Jul 24 21:14:45.868671 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:45.868641    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zb8df" podUID="78033d56-f0fa-4c50-be00-b86a2e8667e6"
Jul 24 21:14:45.871169 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.871148    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:45.873711 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.873691    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 24 21:14:45.874006 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.873990    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 24 21:14:45.874092 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.874037    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vwb2d\""
Jul 24 21:14:45.882146 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.882122    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lsfmp"
Jul 24 21:14:45.889899 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.889881    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lsfmp"
Jul 24 21:14:45.948854 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.948832    2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 24 21:14:45.960041 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.960010    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-node-log\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:45.960167 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.960050    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-host-cni-bin\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:45.960167 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.960079    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/687a4418-4e3f-473c-82e6-f7c6e963a3df-device-dir\") pod \"aws-ebs-csi-driver-node-tmlgz\" (UID: \"687a4418-4e3f-473c-82e6-f7c6e963a3df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmlgz"
Jul 24 21:14:45.960167 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.960104    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f85fa254-5b39-4c72-878d-8743bdaead48-sys\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:45.960167 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.960134    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/92b9098e-caea-4f9b-bfb6-d6757c2d19d6-system-cni-dir\") pod \"multus-additional-cni-plugins-jhsvn\" (UID: \"92b9098e-caea-4f9b-bfb6-d6757c2d19d6\") " pod="openshift-multus/multus-additional-cni-plugins-jhsvn"
Jul 24 21:14:45.960167 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.960161    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s42kf\" (UniqueName: \"kubernetes.io/projected/115c393f-0d8f-4d21-8247-546a7f0bef21-kube-api-access-s42kf\") pod \"node-resolver-5jw4h\" (UID: \"115c393f-0d8f-4d21-8247-546a7f0bef21\") " pod="openshift-dns/node-resolver-5jw4h"
Jul 24 21:14:45.960422 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.960186    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0f7f530a-6040-4754-b0c9-f08325ec5b2e-cni-binary-copy\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:45.960422 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.960198    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/92b9098e-caea-4f9b-bfb6-d6757c2d19d6-system-cni-dir\") pod \"multus-additional-cni-plugins-jhsvn\" (UID: \"92b9098e-caea-4f9b-bfb6-d6757c2d19d6\") " pod="openshift-multus/multus-additional-cni-plugins-jhsvn"
Jul 24 21:14:45.960422 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.960212    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-host-var-lib-kubelet\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:45.960422 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.960267    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ff19854-c536-4ba4-b2fc-29a8f87ff1a7-metrics-certs\") pod \"network-metrics-daemon-25fb5\" (UID: \"4ff19854-c536-4ba4-b2fc-29a8f87ff1a7\") " pod="openshift-multus/network-metrics-daemon-25fb5"
Jul 24 21:14:45.960422 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.960347    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f85fa254-5b39-4c72-878d-8743bdaead48-etc-sysctl-conf\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:45.960422 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.960383    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/92b9098e-caea-4f9b-bfb6-d6757c2d19d6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jhsvn\" (UID: \"92b9098e-caea-4f9b-bfb6-d6757c2d19d6\") " pod="openshift-multus/multus-additional-cni-plugins-jhsvn"
Jul 24 21:14:45.960422 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.960410    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-etc-openvswitch\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:45.960677 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.960505    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c360c906-f525-4df3-9776-9b9b6cea64c6-ovnkube-config\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:45.960677 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.960536    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/687a4418-4e3f-473c-82e6-f7c6e963a3df-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tmlgz\" (UID: \"687a4418-4e3f-473c-82e6-f7c6e963a3df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmlgz"
Jul 24 21:14:45.960677 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.960568    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h78c2\" (UniqueName: \"kubernetes.io/projected/687a4418-4e3f-473c-82e6-f7c6e963a3df-kube-api-access-h78c2\") pod \"aws-ebs-csi-driver-node-tmlgz\" (UID: \"687a4418-4e3f-473c-82e6-f7c6e963a3df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmlgz"
Jul 24 21:14:45.960677 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.960582    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/92b9098e-caea-4f9b-bfb6-d6757c2d19d6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jhsvn\" (UID: \"92b9098e-caea-4f9b-bfb6-d6757c2d19d6\") " pod="openshift-multus/multus-additional-cni-plugins-jhsvn"
Jul 24 21:14:45.960677 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.960592    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-system-cni-dir\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:45.960677 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.960617    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-multus-socket-dir-parent\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:45.960677 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.960633    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c360c906-f525-4df3-9776-9b9b6cea64c6-env-overrides\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:45.960677 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.960667    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/687a4418-4e3f-473c-82e6-f7c6e963a3df-etc-selinux\") pod \"aws-ebs-csi-driver-node-tmlgz\" (UID: \"687a4418-4e3f-473c-82e6-f7c6e963a3df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmlgz"
Jul 24 21:14:45.960981 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.960694    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7ccx\" (UniqueName: \"kubernetes.io/projected/35503db5-115c-40a6-a785-ca16352ed1b2-kube-api-access-r7ccx\") pod \"network-check-target-l4zhw\" (UID: \"35503db5-115c-40a6-a785-ca16352ed1b2\") " pod="openshift-network-diagnostics/network-check-target-l4zhw"
Jul 24 21:14:45.960981 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.960720    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-cnibin\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:45.960981 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.960746    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-host-var-lib-cni-bin\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:45.960981 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.960785    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs9kl\" (UniqueName: \"kubernetes.io/projected/4ff19854-c536-4ba4-b2fc-29a8f87ff1a7-kube-api-access-fs9kl\") pod \"network-metrics-daemon-25fb5\" (UID: \"4ff19854-c536-4ba4-b2fc-29a8f87ff1a7\") " pod="openshift-multus/network-metrics-daemon-25fb5"
Jul 24 21:14:45.960981 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.960824    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78033d56-f0fa-4c50-be00-b86a2e8667e6-original-pull-secret\") pod \"global-pull-secret-syncer-zb8df\" (UID: \"78033d56-f0fa-4c50-be00-b86a2e8667e6\") " pod="kube-system/global-pull-secret-syncer-zb8df"
Jul 24 21:14:45.960981 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.960841    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f85fa254-5b39-4c72-878d-8743bdaead48-etc-sysconfig\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:45.960981 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.960863    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/53ed5a58-5ef1-4847-9a34-a06435831d4a-host\") pod \"node-ca-jnddc\" (UID: \"53ed5a58-5ef1-4847-9a34-a06435831d4a\") " pod="openshift-image-registry/node-ca-jnddc"
Jul 24 21:14:45.960981 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.960888    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-host-run-netns\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:45.960981 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.960923    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-run-openvswitch\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:45.960981 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.960945    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f85fa254-5b39-4c72-878d-8743bdaead48-var-lib-kubelet\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:45.960981 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.960976    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/92b9098e-caea-4f9b-bfb6-d6757c2d19d6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jhsvn\" (UID: \"92b9098e-caea-4f9b-bfb6-d6757c2d19d6\") " pod="openshift-multus/multus-additional-cni-plugins-jhsvn"
Jul 24 21:14:45.961537 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961002    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/115c393f-0d8f-4d21-8247-546a7f0bef21-tmp-dir\") pod \"node-resolver-5jw4h\" (UID: \"115c393f-0d8f-4d21-8247-546a7f0bef21\") " pod="openshift-dns/node-resolver-5jw4h"
Jul 24 21:14:45.961537 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961021    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-host-kubelet\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:45.961537 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961037    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-run-ovn\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:45.961537 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961052    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-multus-conf-dir\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:45.961537 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961068    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/78033d56-f0fa-4c50-be00-b86a2e8667e6-kubelet-config\") pod \"global-pull-secret-syncer-zb8df\" (UID: \"78033d56-f0fa-4c50-be00-b86a2e8667e6\") " pod="kube-system/global-pull-secret-syncer-zb8df"
Jul 24 21:14:45.961537 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961095    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8htqg\" (UniqueName: \"kubernetes.io/projected/f85fa254-5b39-4c72-878d-8743bdaead48-kube-api-access-8htqg\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:45.961537 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961122    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c38305ec-8b35-4d35-861e-381f6d679ae9-host-slash\") pod \"iptables-alerter-m9952\" (UID: \"c38305ec-8b35-4d35-861e-381f6d679ae9\") " pod="openshift-network-operator/iptables-alerter-m9952"
Jul 24 21:14:45.961537 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961148    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/115c393f-0d8f-4d21-8247-546a7f0bef21-hosts-file\") pod \"node-resolver-5jw4h\" (UID: \"115c393f-0d8f-4d21-8247-546a7f0bef21\") " pod="openshift-dns/node-resolver-5jw4h"
Jul 24 21:14:45.961537 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961173    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-os-release\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:45.961537 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961205    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0f7f530a-6040-4754-b0c9-f08325ec5b2e-multus-daemon-config\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:45.961537 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961231    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f85fa254-5b39-4c72-878d-8743bdaead48-etc-tuned\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:45.961537 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961272    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f85fa254-5b39-4c72-878d-8743bdaead48-tmp\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:45.961537 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961298    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/92b9098e-caea-4f9b-bfb6-d6757c2d19d6-cni-binary-copy\") pod \"multus-additional-cni-plugins-jhsvn\" (UID: \"92b9098e-caea-4f9b-bfb6-d6757c2d19d6\") " pod="openshift-multus/multus-additional-cni-plugins-jhsvn"
Jul 24 21:14:45.961537 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961334    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c38305ec-8b35-4d35-861e-381f6d679ae9-iptables-alerter-script\") pod \"iptables-alerter-m9952\" (UID: \"c38305ec-8b35-4d35-861e-381f6d679ae9\") " pod="openshift-network-operator/iptables-alerter-m9952"
Jul 24 21:14:45.961537 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961350    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/53ed5a58-5ef1-4847-9a34-a06435831d4a-serviceca\") pod \"node-ca-jnddc\" (UID: \"53ed5a58-5ef1-4847-9a34-a06435831d4a\") " pod="openshift-image-registry/node-ca-jnddc"
Jul 24 21:14:45.961537 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961379    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-run-systemd\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:45.961537 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961396    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:45.962229 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961411    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-host-run-netns\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:45.962229 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961430    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-host-var-lib-cni-multus\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:45.962229 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961453    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-etc-kubernetes\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:45.962229 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961478    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c360c906-f525-4df3-9776-9b9b6cea64c6-ovnkube-script-lib\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:45.962229 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961516    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/92b9098e-caea-4f9b-bfb6-d6757c2d19d6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jhsvn\" (UID: \"92b9098e-caea-4f9b-bfb6-d6757c2d19d6\") " pod="openshift-multus/multus-additional-cni-plugins-jhsvn"
Jul 24 21:14:45.962229 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961519    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/92b9098e-caea-4f9b-bfb6-d6757c2d19d6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jhsvn\" (UID: \"92b9098e-caea-4f9b-bfb6-d6757c2d19d6\") " pod="openshift-multus/multus-additional-cni-plugins-jhsvn"
Jul 24 21:14:45.962229 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961540    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-host-run-multus-certs\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:45.962229 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961559    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f85fa254-5b39-4c72-878d-8743bdaead48-etc-systemd\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:45.962229 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961576    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-systemd-units\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:45.962229 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961598    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6grh\" (UniqueName: \"kubernetes.io/projected/c360c906-f525-4df3-9776-9b9b6cea64c6-kube-api-access-j6grh\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:45.962229 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961631    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/687a4418-4e3f-473c-82e6-f7c6e963a3df-registration-dir\") pod \"aws-ebs-csi-driver-node-tmlgz\" (UID: \"687a4418-4e3f-473c-82e6-f7c6e963a3df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmlgz"
Jul 24 21:14:45.962229 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961651    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-host-run-k8s-cni-cncf-io\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:45.962229 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961669    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-hostroot\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:45.962229 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961697    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f85fa254-5b39-4c72-878d-8743bdaead48-etc-modprobe-d\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:45.962229 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961713    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f85fa254-5b39-4c72-878d-8743bdaead48-etc-sysctl-d\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:45.962229 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961732    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f85fa254-5b39-4c72-878d-8743bdaead48-lib-modules\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:45.962865 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961748    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/92b9098e-caea-4f9b-bfb6-d6757c2d19d6-os-release\") pod \"multus-additional-cni-plugins-jhsvn\" (UID: \"92b9098e-caea-4f9b-bfb6-d6757c2d19d6\") " pod="openshift-multus/multus-additional-cni-plugins-jhsvn"
Jul 24 21:14:45.962865 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961770    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f85fa254-5b39-4c72-878d-8743bdaead48-etc-kubernetes\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:45.962865 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961792    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/92b9098e-caea-4f9b-bfb6-d6757c2d19d6-cnibin\") pod \"multus-additional-cni-plugins-jhsvn\" (UID: \"92b9098e-caea-4f9b-bfb6-d6757c2d19d6\") " pod="openshift-multus/multus-additional-cni-plugins-jhsvn"
Jul 24 21:14:45.962865 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961833    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-host-cni-netd\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:45.962865 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961837    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/115c393f-0d8f-4d21-8247-546a7f0bef21-tmp-dir\") pod \"node-resolver-5jw4h\" (UID: \"115c393f-0d8f-4d21-8247-546a7f0bef21\") " pod="openshift-dns/node-resolver-5jw4h"
Jul 24 21:14:45.962865 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961874    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/687a4418-4e3f-473c-82e6-f7c6e963a3df-sys-fs\") pod \"aws-ebs-csi-driver-node-tmlgz\" (UID: \"687a4418-4e3f-473c-82e6-f7c6e963a3df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmlgz"
Jul 24 21:14:45.962865 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961891    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f85fa254-5b39-4c72-878d-8743bdaead48-run\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:45.962865 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.961914    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b1b822a6-97f4-48cb-8de9-20e36637d53b-agent-certs\") pod \"konnectivity-agent-jmzq6\" (UID: \"b1b822a6-97f4-48cb-8de9-20e36637d53b\") " pod="kube-system/konnectivity-agent-jmzq6"
Jul 24 21:14:45.962865 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.962042    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/92b9098e-caea-4f9b-bfb6-d6757c2d19d6-os-release\") pod \"multus-additional-cni-plugins-jhsvn\" (UID: \"92b9098e-caea-4f9b-bfb6-d6757c2d19d6\") " pod="openshift-multus/multus-additional-cni-plugins-jhsvn"
Jul 24 21:14:45.962865 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.962095    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/92b9098e-caea-4f9b-bfb6-d6757c2d19d6-cnibin\") pod \"multus-additional-cni-plugins-jhsvn\" (UID: \"92b9098e-caea-4f9b-bfb6-d6757c2d19d6\") " pod="openshift-multus/multus-additional-cni-plugins-jhsvn"
Jul 24 21:14:45.962865 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.962142    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b1b822a6-97f4-48cb-8de9-20e36637d53b-konnectivity-ca\") pod \"konnectivity-agent-jmzq6\" (UID: \"b1b822a6-97f4-48cb-8de9-20e36637d53b\") " pod="kube-system/konnectivity-agent-jmzq6"
Jul 24 21:14:45.962865 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.962162    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmlq6\" (UniqueName: \"kubernetes.io/projected/53ed5a58-5ef1-4847-9a34-a06435831d4a-kube-api-access-xmlq6\") pod \"node-ca-jnddc\" (UID: \"53ed5a58-5ef1-4847-9a34-a06435831d4a\") " pod="openshift-image-registry/node-ca-jnddc"
Jul 24 21:14:45.962865 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.962184    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-multus-cni-dir\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:45.962865 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.962204    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/78033d56-f0fa-4c50-be00-b86a2e8667e6-dbus\") pod \"global-pull-secret-syncer-zb8df\" (UID: \"78033d56-f0fa-4c50-be00-b86a2e8667e6\") " pod="kube-system/global-pull-secret-syncer-zb8df"
Jul 24 21:14:45.962865 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.962445    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c38305ec-8b35-4d35-861e-381f6d679ae9-iptables-alerter-script\") pod \"iptables-alerter-m9952\" (UID: \"c38305ec-8b35-4d35-861e-381f6d679ae9\") " pod="openshift-network-operator/iptables-alerter-m9952"
Jul 24 21:14:45.962865 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.962539    2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 24 21:14:45.962865 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.962787    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c38305ec-8b35-4d35-861e-381f6d679ae9-host-slash\") pod \"iptables-alerter-m9952\" (UID: \"c38305ec-8b35-4d35-861e-381f6d679ae9\") " pod="openshift-network-operator/iptables-alerter-m9952"
Jul 24 21:14:45.963783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.962834    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/92b9098e-caea-4f9b-bfb6-d6757c2d19d6-cni-binary-copy\") pod \"multus-additional-cni-plugins-jhsvn\" (UID: \"92b9098e-caea-4f9b-bfb6-d6757c2d19d6\") " pod="openshift-multus/multus-additional-cni-plugins-jhsvn"
Jul 24 21:14:45.963783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.962913    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/115c393f-0d8f-4d21-8247-546a7f0bef21-hosts-file\") pod \"node-resolver-5jw4h\" (UID: \"115c393f-0d8f-4d21-8247-546a7f0bef21\") " pod="openshift-dns/node-resolver-5jw4h"
Jul 24 21:14:45.963783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.963210    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/92b9098e-caea-4f9b-bfb6-d6757c2d19d6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jhsvn\" (UID: \"92b9098e-caea-4f9b-bfb6-d6757c2d19d6\") " pod="openshift-multus/multus-additional-cni-plugins-jhsvn"
Jul 24 21:14:45.963783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.963272    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-host-slash\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:45.963783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.963300    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-log-socket\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:45.963783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.963345    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sd2k\" (UniqueName: \"kubernetes.io/projected/92b9098e-caea-4f9b-bfb6-d6757c2d19d6-kube-api-access-4sd2k\") pod \"multus-additional-cni-plugins-jhsvn\" (UID: \"92b9098e-caea-4f9b-bfb6-d6757c2d19d6\") " pod="openshift-multus/multus-additional-cni-plugins-jhsvn"
Jul 24 21:14:45.963783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.963370    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6sz4\" (UniqueName: \"kubernetes.io/projected/c38305ec-8b35-4d35-861e-381f6d679ae9-kube-api-access-v6sz4\") pod \"iptables-alerter-m9952\" (UID: \"c38305ec-8b35-4d35-861e-381f6d679ae9\") " pod="openshift-network-operator/iptables-alerter-m9952"
Jul 24 21:14:45.963783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.963389    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-host-run-ovn-kubernetes\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:45.963783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.963417    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c360c906-f525-4df3-9776-9b9b6cea64c6-ovn-node-metrics-cert\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:45.963783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.963432    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/687a4418-4e3f-473c-82e6-f7c6e963a3df-socket-dir\") pod \"aws-ebs-csi-driver-node-tmlgz\" (UID: \"687a4418-4e3f-473c-82e6-f7c6e963a3df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmlgz"
Jul 24 21:14:45.963783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.963451    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2db6\" (UniqueName: \"kubernetes.io/projected/0f7f530a-6040-4754-b0c9-f08325ec5b2e-kube-api-access-m2db6\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:45.963783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.963472    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f85fa254-5b39-4c72-878d-8743bdaead48-host\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:45.963783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.963498    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-var-lib-openvswitch\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:45.963783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.963432    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b1b822a6-97f4-48cb-8de9-20e36637d53b-konnectivity-ca\") pod \"konnectivity-agent-jmzq6\" (UID: \"b1b822a6-97f4-48cb-8de9-20e36637d53b\") " pod="kube-system/konnectivity-agent-jmzq6"
Jul 24 21:14:45.966394 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.966376    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b1b822a6-97f4-48cb-8de9-20e36637d53b-agent-certs\") pod \"konnectivity-agent-jmzq6\" (UID: \"b1b822a6-97f4-48cb-8de9-20e36637d53b\") " pod="kube-system/konnectivity-agent-jmzq6"
Jul 24 21:14:45.971025 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.971002    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s42kf\" (UniqueName: \"kubernetes.io/projected/115c393f-0d8f-4d21-8247-546a7f0bef21-kube-api-access-s42kf\") pod \"node-resolver-5jw4h\" (UID: \"115c393f-0d8f-4d21-8247-546a7f0bef21\") " pod="openshift-dns/node-resolver-5jw4h"
Jul 24 21:14:45.971907 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.971886    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6sz4\" (UniqueName: \"kubernetes.io/projected/c38305ec-8b35-4d35-861e-381f6d679ae9-kube-api-access-v6sz4\") pod \"iptables-alerter-m9952\" (UID: \"c38305ec-8b35-4d35-861e-381f6d679ae9\") " pod="openshift-network-operator/iptables-alerter-m9952"
Jul 24 21:14:45.979854 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:45.979835    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sd2k\" (UniqueName: \"kubernetes.io/projected/92b9098e-caea-4f9b-bfb6-d6757c2d19d6-kube-api-access-4sd2k\") pod \"multus-additional-cni-plugins-jhsvn\" (UID: \"92b9098e-caea-4f9b-bfb6-d6757c2d19d6\") " pod="openshift-multus/multus-additional-cni-plugins-jhsvn"
Jul 24 21:14:46.063965 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.063917    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-host-var-lib-cni-bin\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:46.063965 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.063963    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs9kl\" (UniqueName: \"kubernetes.io/projected/4ff19854-c536-4ba4-b2fc-29a8f87ff1a7-kube-api-access-fs9kl\") pod \"network-metrics-daemon-25fb5\" (UID: \"4ff19854-c536-4ba4-b2fc-29a8f87ff1a7\") " pod="openshift-multus/network-metrics-daemon-25fb5"
Jul 24 21:14:46.064198 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.063991    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78033d56-f0fa-4c50-be00-b86a2e8667e6-original-pull-secret\") pod \"global-pull-secret-syncer-zb8df\" (UID: \"78033d56-f0fa-4c50-be00-b86a2e8667e6\") " pod="kube-system/global-pull-secret-syncer-zb8df"
Jul 24 21:14:46.064198 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064013    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f85fa254-5b39-4c72-878d-8743bdaead48-etc-sysconfig\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:46.064198 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064036    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/53ed5a58-5ef1-4847-9a34-a06435831d4a-host\") pod \"node-ca-jnddc\" (UID: \"53ed5a58-5ef1-4847-9a34-a06435831d4a\") " pod="openshift-image-registry/node-ca-jnddc"
Jul 24 21:14:46.064198 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064038    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-host-var-lib-cni-bin\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:46.064198 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064056    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-host-run-netns\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.064198 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064079    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-run-openvswitch\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.064198 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064105    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f85fa254-5b39-4c72-878d-8743bdaead48-var-lib-kubelet\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:46.064198 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064156    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-host-kubelet\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.064198 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:46.064171    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 21:14:46.064198 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064184    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-run-ovn\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.064793 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064208    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-multus-conf-dir\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:46.064793 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064232    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/78033d56-f0fa-4c50-be00-b86a2e8667e6-kubelet-config\") pod \"global-pull-secret-syncer-zb8df\" (UID: \"78033d56-f0fa-4c50-be00-b86a2e8667e6\") " pod="kube-system/global-pull-secret-syncer-zb8df"
Jul 24 21:14:46.064793 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:46.064289    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78033d56-f0fa-4c50-be00-b86a2e8667e6-original-pull-secret podName:78033d56-f0fa-4c50-be00-b86a2e8667e6 nodeName:}" failed. No retries permitted until 2026-07-24 21:14:46.564227912 +0000 UTC m=+3.008819643 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78033d56-f0fa-4c50-be00-b86a2e8667e6-original-pull-secret") pod "global-pull-secret-syncer-zb8df" (UID: "78033d56-f0fa-4c50-be00-b86a2e8667e6") : object "kube-system"/"original-pull-secret" not registered
Jul 24 21:14:46.064793 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064317    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/78033d56-f0fa-4c50-be00-b86a2e8667e6-kubelet-config\") pod \"global-pull-secret-syncer-zb8df\" (UID: \"78033d56-f0fa-4c50-be00-b86a2e8667e6\") " pod="kube-system/global-pull-secret-syncer-zb8df"
Jul 24 21:14:46.064793 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064339    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8htqg\" (UniqueName: \"kubernetes.io/projected/f85fa254-5b39-4c72-878d-8743bdaead48-kube-api-access-8htqg\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:46.064793 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064391    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f85fa254-5b39-4c72-878d-8743bdaead48-etc-sysconfig\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:46.064793 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064420    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-os-release\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:46.064793 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064447    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0f7f530a-6040-4754-b0c9-f08325ec5b2e-multus-daemon-config\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:46.064793 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064471    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f85fa254-5b39-4c72-878d-8743bdaead48-etc-tuned\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:46.064793 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064495    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f85fa254-5b39-4c72-878d-8743bdaead48-tmp\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:46.064793 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064506    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f85fa254-5b39-4c72-878d-8743bdaead48-var-lib-kubelet\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:46.064793 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064521    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/53ed5a58-5ef1-4847-9a34-a06435831d4a-serviceca\") pod \"node-ca-jnddc\" (UID: \"53ed5a58-5ef1-4847-9a34-a06435831d4a\") " pod="openshift-image-registry/node-ca-jnddc"
Jul 24 21:14:46.064793 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064556    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-run-systemd\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.064793 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064569    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-host-kubelet\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.064793 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064588    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.064793 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064613    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-run-ovn\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.064793 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064615    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-host-run-netns\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:46.065677 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064637    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-host-var-lib-cni-multus\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:46.065677 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064642    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-multus-conf-dir\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:46.065677 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064653    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-etc-kubernetes\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:46.065677 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064667    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-run-systemd\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.065677 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064670    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c360c906-f525-4df3-9776-9b9b6cea64c6-ovnkube-script-lib\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.065677 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064687    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-host-run-multus-certs\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:46.065677 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064695    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/53ed5a58-5ef1-4847-9a34-a06435831d4a-host\") pod \"node-ca-jnddc\" (UID: \"53ed5a58-5ef1-4847-9a34-a06435831d4a\") " pod="openshift-image-registry/node-ca-jnddc"
Jul 24 21:14:46.065677 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064704    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f85fa254-5b39-4c72-878d-8743bdaead48-etc-systemd\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:46.065677 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064714    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-host-run-netns\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.065677 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064733    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-systemd-units\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.065677 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064750    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6grh\" (UniqueName: \"kubernetes.io/projected/c360c906-f525-4df3-9776-9b9b6cea64c6-kube-api-access-j6grh\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.065677 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064768    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/687a4418-4e3f-473c-82e6-f7c6e963a3df-registration-dir\") pod \"aws-ebs-csi-driver-node-tmlgz\" (UID: \"687a4418-4e3f-473c-82e6-f7c6e963a3df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmlgz"
Jul 24 21:14:46.065677 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064783    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-host-run-k8s-cni-cncf-io\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:46.065677 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064807    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-hostroot\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:46.065677 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064823    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f85fa254-5b39-4c72-878d-8743bdaead48-etc-modprobe-d\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:46.065677 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064839    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f85fa254-5b39-4c72-878d-8743bdaead48-etc-sysctl-d\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:46.065677 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064854    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f85fa254-5b39-4c72-878d-8743bdaead48-lib-modules\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:46.065677 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064870    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f85fa254-5b39-4c72-878d-8743bdaead48-etc-kubernetes\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:46.066783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064886    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-host-cni-netd\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.066783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064908    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/687a4418-4e3f-473c-82e6-f7c6e963a3df-sys-fs\") pod \"aws-ebs-csi-driver-node-tmlgz\" (UID: \"687a4418-4e3f-473c-82e6-f7c6e963a3df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmlgz"
Jul 24 21:14:46.066783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064923    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f85fa254-5b39-4c72-878d-8743bdaead48-run\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:46.066783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064941    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmlq6\" (UniqueName: \"kubernetes.io/projected/53ed5a58-5ef1-4847-9a34-a06435831d4a-kube-api-access-xmlq6\") pod \"node-ca-jnddc\" (UID: \"53ed5a58-5ef1-4847-9a34-a06435831d4a\") " pod="openshift-image-registry/node-ca-jnddc"
Jul 24 21:14:46.066783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064957    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-multus-cni-dir\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:46.066783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.064996    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/53ed5a58-5ef1-4847-9a34-a06435831d4a-serviceca\") pod \"node-ca-jnddc\" (UID: \"53ed5a58-5ef1-4847-9a34-a06435831d4a\") " pod="openshift-image-registry/node-ca-jnddc"
Jul 24 21:14:46.066783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065076    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-multus-cni-dir\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:46.066783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065106    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-host-run-multus-certs\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:46.066783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065140    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f85fa254-5b39-4c72-878d-8743bdaead48-etc-kubernetes\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:46.066783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065156    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f85fa254-5b39-4c72-878d-8743bdaead48-lib-modules\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:46.066783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065166    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-systemd-units\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.066783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065204    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-run-openvswitch\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.066783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065232    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f85fa254-5b39-4c72-878d-8743bdaead48-run\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:46.066783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065189    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/78033d56-f0fa-4c50-be00-b86a2e8667e6-dbus\") pod \"global-pull-secret-syncer-zb8df\" (UID: \"78033d56-f0fa-4c50-be00-b86a2e8667e6\") " pod="kube-system/global-pull-secret-syncer-zb8df"
Jul 24 21:14:46.066783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065234    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-hostroot\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:46.066783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065267    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-os-release\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:46.066783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065278    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/78033d56-f0fa-4c50-be00-b86a2e8667e6-dbus\") pod \"global-pull-secret-syncer-zb8df\" (UID: \"78033d56-f0fa-4c50-be00-b86a2e8667e6\") " pod="kube-system/global-pull-secret-syncer-zb8df"
Jul 24 21:14:46.066783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065168    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f85fa254-5b39-4c72-878d-8743bdaead48-etc-systemd\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:46.067700 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065184    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-host-cni-netd\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.067700 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065329    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/687a4418-4e3f-473c-82e6-f7c6e963a3df-sys-fs\") pod \"aws-ebs-csi-driver-node-tmlgz\" (UID: \"687a4418-4e3f-473c-82e6-f7c6e963a3df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmlgz"
Jul 24 21:14:46.067700 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065351    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f85fa254-5b39-4c72-878d-8743bdaead48-etc-sysctl-d\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:46.067700 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065379    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-host-slash\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.067700 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065435    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/687a4418-4e3f-473c-82e6-f7c6e963a3df-registration-dir\") pod \"aws-ebs-csi-driver-node-tmlgz\" (UID: \"687a4418-4e3f-473c-82e6-f7c6e963a3df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmlgz"
Jul 24 21:14:46.067700 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065474    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-host-run-k8s-cni-cncf-io\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:46.067700 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065477    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-host-var-lib-cni-multus\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:46.067700 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065507    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-log-socket\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.067700 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065514    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-etc-kubernetes\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:46.067700 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065519    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-host-run-netns\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:46.067700 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065529    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f85fa254-5b39-4c72-878d-8743bdaead48-etc-modprobe-d\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:46.067700 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065554    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-host-slash\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.067700 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065553    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-host-run-ovn-kubernetes\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.067700 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065575    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.067700 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065596    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-log-socket\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.067700 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065592    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-host-run-ovn-kubernetes\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.067700 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065652    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c360c906-f525-4df3-9776-9b9b6cea64c6-ovn-node-metrics-cert\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.068434 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065707    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/687a4418-4e3f-473c-82e6-f7c6e963a3df-socket-dir\") pod \"aws-ebs-csi-driver-node-tmlgz\" (UID: \"687a4418-4e3f-473c-82e6-f7c6e963a3df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmlgz"
Jul 24 21:14:46.068434 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065756    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2db6\" (UniqueName: \"kubernetes.io/projected/0f7f530a-6040-4754-b0c9-f08325ec5b2e-kube-api-access-m2db6\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:46.068434 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065782    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f85fa254-5b39-4c72-878d-8743bdaead48-host\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:46.068434 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065826    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-var-lib-openvswitch\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.068434 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065853    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-node-log\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.068434 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065879    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-host-cni-bin\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.068434 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065906    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/687a4418-4e3f-473c-82e6-f7c6e963a3df-device-dir\") pod \"aws-ebs-csi-driver-node-tmlgz\" (UID: \"687a4418-4e3f-473c-82e6-f7c6e963a3df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmlgz"
Jul 24 21:14:46.068434 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065908    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c360c906-f525-4df3-9776-9b9b6cea64c6-ovnkube-script-lib\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.068434 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065974    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f85fa254-5b39-4c72-878d-8743bdaead48-sys\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:46.068434 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.065990    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-var-lib-openvswitch\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.068434 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.066037    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0f7f530a-6040-4754-b0c9-f08325ec5b2e-multus-daemon-config\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:46.068434 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.066040    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f85fa254-5b39-4c72-878d-8743bdaead48-sys\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:46.068434 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.066054    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-node-log\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.068434 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.066096    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0f7f530a-6040-4754-b0c9-f08325ec5b2e-cni-binary-copy\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:46.068434 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.066106    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/687a4418-4e3f-473c-82e6-f7c6e963a3df-device-dir\") pod \"aws-ebs-csi-driver-node-tmlgz\" (UID: \"687a4418-4e3f-473c-82e6-f7c6e963a3df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmlgz"
Jul 24 21:14:46.068434 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.066138    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-host-var-lib-kubelet\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:46.068434 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.066171    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-host-var-lib-kubelet\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:46.068434 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.066174    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ff19854-c536-4ba4-b2fc-29a8f87ff1a7-metrics-certs\") pod \"network-metrics-daemon-25fb5\" (UID: \"4ff19854-c536-4ba4-b2fc-29a8f87ff1a7\") " pod="openshift-multus/network-metrics-daemon-25fb5"
Jul 24 21:14:46.069194 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.066173    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-host-cni-bin\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.069194 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.066205    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f85fa254-5b39-4c72-878d-8743bdaead48-etc-sysctl-conf\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:46.069194 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.066261    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f85fa254-5b39-4c72-878d-8743bdaead48-host\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:46.069194 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:46.066301    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 21:14:46.069194 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.066302    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-etc-openvswitch\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.069194 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:46.066361    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ff19854-c536-4ba4-b2fc-29a8f87ff1a7-metrics-certs podName:4ff19854-c536-4ba4-b2fc-29a8f87ff1a7 nodeName:}" failed. No retries permitted until 2026-07-24 21:14:46.566343266 +0000 UTC m=+3.010934977 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ff19854-c536-4ba4-b2fc-29a8f87ff1a7-metrics-certs") pod "network-metrics-daemon-25fb5" (UID: "4ff19854-c536-4ba4-b2fc-29a8f87ff1a7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 21:14:46.069194 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.066361    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/687a4418-4e3f-473c-82e6-f7c6e963a3df-socket-dir\") pod \"aws-ebs-csi-driver-node-tmlgz\" (UID: \"687a4418-4e3f-473c-82e6-f7c6e963a3df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmlgz"
Jul 24 21:14:46.069194 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.066403    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c360c906-f525-4df3-9776-9b9b6cea64c6-ovnkube-config\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.069194 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.066406    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c360c906-f525-4df3-9776-9b9b6cea64c6-etc-openvswitch\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.069194 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.066447    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/687a4418-4e3f-473c-82e6-f7c6e963a3df-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tmlgz\" (UID: \"687a4418-4e3f-473c-82e6-f7c6e963a3df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmlgz"
Jul 24 21:14:46.069194 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.066502    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h78c2\" (UniqueName: \"kubernetes.io/projected/687a4418-4e3f-473c-82e6-f7c6e963a3df-kube-api-access-h78c2\") pod \"aws-ebs-csi-driver-node-tmlgz\" (UID: \"687a4418-4e3f-473c-82e6-f7c6e963a3df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmlgz"
Jul 24 21:14:46.069194 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.066539    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f85fa254-5b39-4c72-878d-8743bdaead48-etc-sysctl-conf\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:46.069194 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.066547    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-system-cni-dir\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:46.069194 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.066562    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/687a4418-4e3f-473c-82e6-f7c6e963a3df-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tmlgz\" (UID: \"687a4418-4e3f-473c-82e6-f7c6e963a3df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmlgz"
Jul 24 21:14:46.069194 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.066577    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-multus-socket-dir-parent\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:46.069194 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.066604    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c360c906-f525-4df3-9776-9b9b6cea64c6-env-overrides\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.069194 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.066618    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-system-cni-dir\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:46.069893 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.066629    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/687a4418-4e3f-473c-82e6-f7c6e963a3df-etc-selinux\") pod \"aws-ebs-csi-driver-node-tmlgz\" (UID: \"687a4418-4e3f-473c-82e6-f7c6e963a3df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmlgz"
Jul 24 21:14:46.069893 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.066656    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7ccx\" (UniqueName: \"kubernetes.io/projected/35503db5-115c-40a6-a785-ca16352ed1b2-kube-api-access-r7ccx\") pod \"network-check-target-l4zhw\" (UID: \"35503db5-115c-40a6-a785-ca16352ed1b2\") " pod="openshift-network-diagnostics/network-check-target-l4zhw"
Jul 24 21:14:46.069893 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.066672    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-multus-socket-dir-parent\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:46.069893 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.066679    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-cnibin\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:46.069893 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.066727    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0f7f530a-6040-4754-b0c9-f08325ec5b2e-cni-binary-copy\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:46.069893 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.066760    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0f7f530a-6040-4754-b0c9-f08325ec5b2e-cnibin\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:46.069893 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.066767    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/687a4418-4e3f-473c-82e6-f7c6e963a3df-etc-selinux\") pod \"aws-ebs-csi-driver-node-tmlgz\" (UID: \"687a4418-4e3f-473c-82e6-f7c6e963a3df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmlgz"
Jul 24 21:14:46.069893 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.067890    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c360c906-f525-4df3-9776-9b9b6cea64c6-env-overrides\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.069893 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.067934    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f85fa254-5b39-4c72-878d-8743bdaead48-etc-tuned\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:46.069893 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.067971    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c360c906-f525-4df3-9776-9b9b6cea64c6-ovnkube-config\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.069893 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.068016    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f85fa254-5b39-4c72-878d-8743bdaead48-tmp\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:46.069893 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.069140    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c360c906-f525-4df3-9776-9b9b6cea64c6-ovn-node-metrics-cert\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.072421 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:46.072193    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 21:14:46.072421 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:46.072216    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 21:14:46.072421 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:46.072230    2561 projected.go:196] Error preparing data for projected volume kube-api-access-r7ccx for pod openshift-network-diagnostics/network-check-target-l4zhw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 21:14:46.072421 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:46.072306    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35503db5-115c-40a6-a785-ca16352ed1b2-kube-api-access-r7ccx podName:35503db5-115c-40a6-a785-ca16352ed1b2 nodeName:}" failed. No retries permitted until 2026-07-24 21:14:46.572288966 +0000 UTC m=+3.016880697 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-r7ccx" (UniqueName: "kubernetes.io/projected/35503db5-115c-40a6-a785-ca16352ed1b2-kube-api-access-r7ccx") pod "network-check-target-l4zhw" (UID: "35503db5-115c-40a6-a785-ca16352ed1b2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 21:14:46.074462 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.074440    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmlq6\" (UniqueName: \"kubernetes.io/projected/53ed5a58-5ef1-4847-9a34-a06435831d4a-kube-api-access-xmlq6\") pod \"node-ca-jnddc\" (UID: \"53ed5a58-5ef1-4847-9a34-a06435831d4a\") " pod="openshift-image-registry/node-ca-jnddc"
Jul 24 21:14:46.074560 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.074533    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8htqg\" (UniqueName: \"kubernetes.io/projected/f85fa254-5b39-4c72-878d-8743bdaead48-kube-api-access-8htqg\") pod \"tuned-nwlgt\" (UID: \"f85fa254-5b39-4c72-878d-8743bdaead48\") " pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:46.074560 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.074552    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs9kl\" (UniqueName: \"kubernetes.io/projected/4ff19854-c536-4ba4-b2fc-29a8f87ff1a7-kube-api-access-fs9kl\") pod \"network-metrics-daemon-25fb5\" (UID: \"4ff19854-c536-4ba4-b2fc-29a8f87ff1a7\") " pod="openshift-multus/network-metrics-daemon-25fb5"
Jul 24 21:14:46.075680 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.075654    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h78c2\" (UniqueName: \"kubernetes.io/projected/687a4418-4e3f-473c-82e6-f7c6e963a3df-kube-api-access-h78c2\") pod \"aws-ebs-csi-driver-node-tmlgz\" (UID: \"687a4418-4e3f-473c-82e6-f7c6e963a3df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmlgz"
Jul 24 21:14:46.076158 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.076137    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6grh\" (UniqueName: \"kubernetes.io/projected/c360c906-f525-4df3-9776-9b9b6cea64c6-kube-api-access-j6grh\") pod \"ovnkube-node-z4l6m\" (UID: \"c360c906-f525-4df3-9776-9b9b6cea64c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.076310 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.076289    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2db6\" (UniqueName: \"kubernetes.io/projected/0f7f530a-6040-4754-b0c9-f08325ec5b2e-kube-api-access-m2db6\") pod \"multus-8rtjq\" (UID: \"0f7f530a-6040-4754-b0c9-f08325ec5b2e\") " pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:46.154183 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.154108    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m9952"
Jul 24 21:14:46.161665 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.161639    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5jw4h"
Jul 24 21:14:46.174082 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.174056    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jmzq6"
Jul 24 21:14:46.181428 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.181407    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jhsvn"
Jul 24 21:14:46.189739 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.189718    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmlgz"
Jul 24 21:14:46.196548 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.196527    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jnddc"
Jul 24 21:14:46.196641 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.196589    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 21:14:46.203473 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.203451    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8rtjq"
Jul 24 21:14:46.210601 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.210578    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:14:46.216734 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.216717    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nwlgt"
Jul 24 21:14:46.571331 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.571231    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ff19854-c536-4ba4-b2fc-29a8f87ff1a7-metrics-certs\") pod \"network-metrics-daemon-25fb5\" (UID: \"4ff19854-c536-4ba4-b2fc-29a8f87ff1a7\") " pod="openshift-multus/network-metrics-daemon-25fb5"
Jul 24 21:14:46.571331 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.571293    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78033d56-f0fa-4c50-be00-b86a2e8667e6-original-pull-secret\") pod \"global-pull-secret-syncer-zb8df\" (UID: \"78033d56-f0fa-4c50-be00-b86a2e8667e6\") " pod="kube-system/global-pull-secret-syncer-zb8df"
Jul 24 21:14:46.571524 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:46.571405    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 21:14:46.571524 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:46.571415    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 21:14:46.571524 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:46.571466    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78033d56-f0fa-4c50-be00-b86a2e8667e6-original-pull-secret podName:78033d56-f0fa-4c50-be00-b86a2e8667e6 nodeName:}" failed. No retries permitted until 2026-07-24 21:14:47.57145218 +0000 UTC m=+4.016043889 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78033d56-f0fa-4c50-be00-b86a2e8667e6-original-pull-secret") pod "global-pull-secret-syncer-zb8df" (UID: "78033d56-f0fa-4c50-be00-b86a2e8667e6") : object "kube-system"/"original-pull-secret" not registered
Jul 24 21:14:46.571524 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:46.571481    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ff19854-c536-4ba4-b2fc-29a8f87ff1a7-metrics-certs podName:4ff19854-c536-4ba4-b2fc-29a8f87ff1a7 nodeName:}" failed. No retries permitted until 2026-07-24 21:14:47.571475241 +0000 UTC m=+4.016066950 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ff19854-c536-4ba4-b2fc-29a8f87ff1a7-metrics-certs") pod "network-metrics-daemon-25fb5" (UID: "4ff19854-c536-4ba4-b2fc-29a8f87ff1a7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 21:14:46.672048 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.672017    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7ccx\" (UniqueName: \"kubernetes.io/projected/35503db5-115c-40a6-a785-ca16352ed1b2-kube-api-access-r7ccx\") pod \"network-check-target-l4zhw\" (UID: \"35503db5-115c-40a6-a785-ca16352ed1b2\") " pod="openshift-network-diagnostics/network-check-target-l4zhw"
Jul 24 21:14:46.672211 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:46.672144    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 21:14:46.672211 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:46.672165    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 21:14:46.672211 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:46.672179    2561 projected.go:196] Error preparing data for projected volume kube-api-access-r7ccx for pod openshift-network-diagnostics/network-check-target-l4zhw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 21:14:46.672390 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:46.672264    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35503db5-115c-40a6-a785-ca16352ed1b2-kube-api-access-r7ccx podName:35503db5-115c-40a6-a785-ca16352ed1b2 nodeName:}" failed. No retries permitted until 2026-07-24 21:14:47.672227711 +0000 UTC m=+4.116819421 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-r7ccx" (UniqueName: "kubernetes.io/projected/35503db5-115c-40a6-a785-ca16352ed1b2-kube-api-access-r7ccx") pod "network-check-target-l4zhw" (UID: "35503db5-115c-40a6-a785-ca16352ed1b2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 21:14:46.846836 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:46.846805    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc38305ec_8b35_4d35_861e_381f6d679ae9.slice/crio-6b4b18ee74f58774fe038945fbca7f19992f3eaa407fb8bfc8b4130aa345d4c9 WatchSource:0}: Error finding container 6b4b18ee74f58774fe038945fbca7f19992f3eaa407fb8bfc8b4130aa345d4c9: Status 404 returned error can't find the container with id 6b4b18ee74f58774fe038945fbca7f19992f3eaa407fb8bfc8b4130aa345d4c9
Jul 24 21:14:46.849085 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:46.849057    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod115c393f_0d8f_4d21_8247_546a7f0bef21.slice/crio-14336e9c8686cd652a855fe97a1a27c613b65ec268a2b2e191b9a9b3be154b70 WatchSource:0}: Error finding container 14336e9c8686cd652a855fe97a1a27c613b65ec268a2b2e191b9a9b3be154b70: Status 404 returned error can't find the container with id 14336e9c8686cd652a855fe97a1a27c613b65ec268a2b2e191b9a9b3be154b70
Jul 24 21:14:46.850776 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:46.850722    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf85fa254_5b39_4c72_878d_8743bdaead48.slice/crio-962025ceb3970dc412c618d2a6b0389ae14e9f41c8d5d47f3495a068392908eb WatchSource:0}: Error finding container 962025ceb3970dc412c618d2a6b0389ae14e9f41c8d5d47f3495a068392908eb: Status 404 returned error can't find the container with id 962025ceb3970dc412c618d2a6b0389ae14e9f41c8d5d47f3495a068392908eb
Jul 24 21:14:46.851137 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:14:46.851113    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod687a4418_4e3f_473c_82e6_f7c6e963a3df.slice/crio-9700806c9d6b1d2cbec2b89b9f73f4ab57ac738f5b8047a561d88374c9bc4528 WatchSource:0}: Error finding container 9700806c9d6b1d2cbec2b89b9f73f4ab57ac738f5b8047a561d88374c9bc4528: Status 404 returned error can't find the container with id 9700806c9d6b1d2cbec2b89b9f73f4ab57ac738f5b8047a561d88374c9bc4528
Jul 24 21:14:46.892956 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.892924    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 21:09:46 +0000 UTC" deadline="2028-04-09 21:45:25.331487874 +0000 UTC"
Jul 24 21:14:46.892956 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.892956    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15000h30m38.438535715s"
Jul 24 21:14:46.957901 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.957874    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jmzq6" event={"ID":"b1b822a6-97f4-48cb-8de9-20e36637d53b","Type":"ContainerStarted","Data":"e1d70e064c2a1c59cd28a186027573573c76b0be74fffa2e1c01bdd075cee9d0"}
Jul 24 21:14:46.959587 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.959564    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhsvn" event={"ID":"92b9098e-caea-4f9b-bfb6-d6757c2d19d6","Type":"ContainerStarted","Data":"bee88f1e3f7ce6f8dd61564beaa414b428218f115cdf4467def7d8f4b5bab78a"}
Jul 24 21:14:46.960781 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.960753    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m" event={"ID":"c360c906-f525-4df3-9776-9b9b6cea64c6","Type":"ContainerStarted","Data":"6a60c47db412cf0b52dab0606892682416d18f1c2dfced20b2520b4ab8710e9d"}
Jul 24 21:14:46.962137 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.962112    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8rtjq" event={"ID":"0f7f530a-6040-4754-b0c9-f08325ec5b2e","Type":"ContainerStarted","Data":"6496821031c32465eed8cc3f153adc929b730b56aa3bbfd3d98004640187da5a"}
Jul 24 21:14:46.965157 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.965135    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmlgz" event={"ID":"687a4418-4e3f-473c-82e6-f7c6e963a3df","Type":"ContainerStarted","Data":"9700806c9d6b1d2cbec2b89b9f73f4ab57ac738f5b8047a561d88374c9bc4528"}
Jul 24 21:14:46.969234 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.969199    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-226.ec2.internal" event={"ID":"e4f17126843a86705fdd26207b6a7db0","Type":"ContainerStarted","Data":"928eb6ca162278e4bca3ab22f1f09b36202609d487a83cf6bcef222b346231a6"}
Jul 24 21:14:46.971840 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.971821    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nwlgt" event={"ID":"f85fa254-5b39-4c72-878d-8743bdaead48","Type":"ContainerStarted","Data":"962025ceb3970dc412c618d2a6b0389ae14e9f41c8d5d47f3495a068392908eb"}
Jul 24 21:14:46.974614 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.974587    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jnddc" event={"ID":"53ed5a58-5ef1-4847-9a34-a06435831d4a","Type":"ContainerStarted","Data":"aa8d57f03a75a22bba5a4b4380714d2736ce434208e46e13e9389dfe31e71bdc"}
Jul 24 21:14:46.977645 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.977622    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5jw4h" event={"ID":"115c393f-0d8f-4d21-8247-546a7f0bef21","Type":"ContainerStarted","Data":"14336e9c8686cd652a855fe97a1a27c613b65ec268a2b2e191b9a9b3be154b70"}
Jul 24 21:14:46.979365 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.979344    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m9952" event={"ID":"c38305ec-8b35-4d35-861e-381f6d679ae9","Type":"ContainerStarted","Data":"6b4b18ee74f58774fe038945fbca7f19992f3eaa407fb8bfc8b4130aa345d4c9"}
Jul 24 21:14:46.985217 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:46.985168    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-226.ec2.internal" podStartSLOduration=1.985140044 podStartE2EDuration="1.985140044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 21:14:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:14:46.985013724 +0000 UTC m=+3.429605448" watchObservedRunningTime="2026-07-24 21:14:46.985140044 +0000 UTC m=+3.429731770"
Jul 24 21:14:47.580465 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:47.580422    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ff19854-c536-4ba4-b2fc-29a8f87ff1a7-metrics-certs\") pod \"network-metrics-daemon-25fb5\" (UID: \"4ff19854-c536-4ba4-b2fc-29a8f87ff1a7\") " pod="openshift-multus/network-metrics-daemon-25fb5"
Jul 24 21:14:47.580714 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:47.580492    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78033d56-f0fa-4c50-be00-b86a2e8667e6-original-pull-secret\") pod \"global-pull-secret-syncer-zb8df\" (UID: \"78033d56-f0fa-4c50-be00-b86a2e8667e6\") " pod="kube-system/global-pull-secret-syncer-zb8df"
Jul 24 21:14:47.580714 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:47.580690    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 21:14:47.580841 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:47.580759    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78033d56-f0fa-4c50-be00-b86a2e8667e6-original-pull-secret podName:78033d56-f0fa-4c50-be00-b86a2e8667e6 nodeName:}" failed. No retries permitted until 2026-07-24 21:14:49.580738521 +0000 UTC m=+6.025330248 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78033d56-f0fa-4c50-be00-b86a2e8667e6-original-pull-secret") pod "global-pull-secret-syncer-zb8df" (UID: "78033d56-f0fa-4c50-be00-b86a2e8667e6") : object "kube-system"/"original-pull-secret" not registered
Jul 24 21:14:47.581245 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:47.581187    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 21:14:47.581245 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:47.581244    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ff19854-c536-4ba4-b2fc-29a8f87ff1a7-metrics-certs podName:4ff19854-c536-4ba4-b2fc-29a8f87ff1a7 nodeName:}" failed. No retries permitted until 2026-07-24 21:14:49.581226383 +0000 UTC m=+6.025818097 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ff19854-c536-4ba4-b2fc-29a8f87ff1a7-metrics-certs") pod "network-metrics-daemon-25fb5" (UID: "4ff19854-c536-4ba4-b2fc-29a8f87ff1a7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 21:14:47.682072 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:47.681858    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7ccx\" (UniqueName: \"kubernetes.io/projected/35503db5-115c-40a6-a785-ca16352ed1b2-kube-api-access-r7ccx\") pod \"network-check-target-l4zhw\" (UID: \"35503db5-115c-40a6-a785-ca16352ed1b2\") " pod="openshift-network-diagnostics/network-check-target-l4zhw"
Jul 24 21:14:47.682072 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:47.682061    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 21:14:47.682381 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:47.682087    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 21:14:47.682381 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:47.682101    2561 projected.go:196] Error preparing data for projected volume kube-api-access-r7ccx for pod openshift-network-diagnostics/network-check-target-l4zhw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 21:14:47.682381 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:47.682167    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35503db5-115c-40a6-a785-ca16352ed1b2-kube-api-access-r7ccx podName:35503db5-115c-40a6-a785-ca16352ed1b2 nodeName:}" failed. No retries permitted until 2026-07-24 21:14:49.682147344 +0000 UTC m=+6.126739058 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-r7ccx" (UniqueName: "kubernetes.io/projected/35503db5-115c-40a6-a785-ca16352ed1b2-kube-api-access-r7ccx") pod "network-check-target-l4zhw" (UID: "35503db5-115c-40a6-a785-ca16352ed1b2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 21:14:47.893585 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:47.893504    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 21:09:46 +0000 UTC" deadline="2028-04-16 19:19:07.45328273 +0000 UTC"
Jul 24 21:14:47.893585 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:47.893584    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15166h4m19.559703915s"
Jul 24 21:14:47.953808 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:47.953731    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25fb5"
Jul 24 21:14:47.953808 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:47.953787    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4zhw"
Jul 24 21:14:47.954021 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:47.953906    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25fb5" podUID="4ff19854-c536-4ba4-b2fc-29a8f87ff1a7"
Jul 24 21:14:47.954576 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:47.954389    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4zhw" podUID="35503db5-115c-40a6-a785-ca16352ed1b2"
Jul 24 21:14:47.954576 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:47.954464    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zb8df"
Jul 24 21:14:47.954576 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:47.954544    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zb8df" podUID="78033d56-f0fa-4c50-be00-b86a2e8667e6"
Jul 24 21:14:48.005782 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:48.005745    2561 generic.go:356] "Generic (PLEG): container finished" podID="65ffcbac9baa2903604c87255a496c3c" containerID="ca398849d1d836c201de3e30d09db7a0c2f0d63b2694e64c634f5a2ba88aee41" exitCode=0
Jul 24 21:14:48.006781 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:48.006750    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal" event={"ID":"65ffcbac9baa2903604c87255a496c3c","Type":"ContainerDied","Data":"ca398849d1d836c201de3e30d09db7a0c2f0d63b2694e64c634f5a2ba88aee41"}
Jul 24 21:14:49.038543 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:49.037771    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal" event={"ID":"65ffcbac9baa2903604c87255a496c3c","Type":"ContainerStarted","Data":"7bee41dbd8f2375701e32f657fce5e4c9f8bfc1406a4f2e6916b27d01d52f0fb"}
Jul 24 21:14:49.597500 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:49.597457    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ff19854-c536-4ba4-b2fc-29a8f87ff1a7-metrics-certs\") pod \"network-metrics-daemon-25fb5\" (UID: \"4ff19854-c536-4ba4-b2fc-29a8f87ff1a7\") " pod="openshift-multus/network-metrics-daemon-25fb5"
Jul 24 21:14:49.597714 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:49.597537    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78033d56-f0fa-4c50-be00-b86a2e8667e6-original-pull-secret\") pod \"global-pull-secret-syncer-zb8df\" (UID: \"78033d56-f0fa-4c50-be00-b86a2e8667e6\") " pod="kube-system/global-pull-secret-syncer-zb8df"
Jul 24 21:14:49.597714 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:49.597654    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 21:14:49.597714 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:49.597711    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78033d56-f0fa-4c50-be00-b86a2e8667e6-original-pull-secret podName:78033d56-f0fa-4c50-be00-b86a2e8667e6 nodeName:}" failed. No retries permitted until 2026-07-24 21:14:53.597691365 +0000 UTC m=+10.042283088 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78033d56-f0fa-4c50-be00-b86a2e8667e6-original-pull-secret") pod "global-pull-secret-syncer-zb8df" (UID: "78033d56-f0fa-4c50-be00-b86a2e8667e6") : object "kube-system"/"original-pull-secret" not registered
Jul 24 21:14:49.598071 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:49.598036    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 21:14:49.598145 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:49.598078    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ff19854-c536-4ba4-b2fc-29a8f87ff1a7-metrics-certs podName:4ff19854-c536-4ba4-b2fc-29a8f87ff1a7 nodeName:}" failed. No retries permitted until 2026-07-24 21:14:53.598065798 +0000 UTC m=+10.042657508 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ff19854-c536-4ba4-b2fc-29a8f87ff1a7-metrics-certs") pod "network-metrics-daemon-25fb5" (UID: "4ff19854-c536-4ba4-b2fc-29a8f87ff1a7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 21:14:49.701175 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:49.700474    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7ccx\" (UniqueName: \"kubernetes.io/projected/35503db5-115c-40a6-a785-ca16352ed1b2-kube-api-access-r7ccx\") pod \"network-check-target-l4zhw\" (UID: \"35503db5-115c-40a6-a785-ca16352ed1b2\") " pod="openshift-network-diagnostics/network-check-target-l4zhw"
Jul 24 21:14:49.701175 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:49.700714    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 21:14:49.701175 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:49.700735    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 21:14:49.701175 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:49.700748    2561 projected.go:196] Error preparing data for projected volume kube-api-access-r7ccx for pod openshift-network-diagnostics/network-check-target-l4zhw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 21:14:49.701175 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:49.700808    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35503db5-115c-40a6-a785-ca16352ed1b2-kube-api-access-r7ccx podName:35503db5-115c-40a6-a785-ca16352ed1b2 nodeName:}" failed. No retries permitted until 2026-07-24 21:14:53.700789181 +0000 UTC m=+10.145380896 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-r7ccx" (UniqueName: "kubernetes.io/projected/35503db5-115c-40a6-a785-ca16352ed1b2-kube-api-access-r7ccx") pod "network-check-target-l4zhw" (UID: "35503db5-115c-40a6-a785-ca16352ed1b2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 21:14:49.951389 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:49.950756    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4zhw"
Jul 24 21:14:49.951389 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:49.950864    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4zhw" podUID="35503db5-115c-40a6-a785-ca16352ed1b2"
Jul 24 21:14:49.951389 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:49.951020    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25fb5"
Jul 24 21:14:49.951389 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:49.951125    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25fb5" podUID="4ff19854-c536-4ba4-b2fc-29a8f87ff1a7"
Jul 24 21:14:49.951389 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:49.951187    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zb8df"
Jul 24 21:14:49.951389 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:49.951270    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zb8df" podUID="78033d56-f0fa-4c50-be00-b86a2e8667e6"
Jul 24 21:14:51.951752 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:51.951714    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4zhw"
Jul 24 21:14:51.952158 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:51.951761    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zb8df"
Jul 24 21:14:51.952158 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:51.951761    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25fb5"
Jul 24 21:14:51.952158 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:51.951896    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4zhw" podUID="35503db5-115c-40a6-a785-ca16352ed1b2"
Jul 24 21:14:51.952158 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:51.952015    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zb8df" podUID="78033d56-f0fa-4c50-be00-b86a2e8667e6"
Jul 24 21:14:51.952158 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:51.952080    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25fb5" podUID="4ff19854-c536-4ba4-b2fc-29a8f87ff1a7"
Jul 24 21:14:53.635104 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:53.635073    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ff19854-c536-4ba4-b2fc-29a8f87ff1a7-metrics-certs\") pod \"network-metrics-daemon-25fb5\" (UID: \"4ff19854-c536-4ba4-b2fc-29a8f87ff1a7\") " pod="openshift-multus/network-metrics-daemon-25fb5"
Jul 24 21:14:53.635591 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:53.635153    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78033d56-f0fa-4c50-be00-b86a2e8667e6-original-pull-secret\") pod \"global-pull-secret-syncer-zb8df\" (UID: \"78033d56-f0fa-4c50-be00-b86a2e8667e6\") " pod="kube-system/global-pull-secret-syncer-zb8df"
Jul 24 21:14:53.635591 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:53.635219    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 21:14:53.635591 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:53.635287    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ff19854-c536-4ba4-b2fc-29a8f87ff1a7-metrics-certs podName:4ff19854-c536-4ba4-b2fc-29a8f87ff1a7 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:01.635273183 +0000 UTC m=+18.079864892 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ff19854-c536-4ba4-b2fc-29a8f87ff1a7-metrics-certs") pod "network-metrics-daemon-25fb5" (UID: "4ff19854-c536-4ba4-b2fc-29a8f87ff1a7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 21:14:53.635591 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:53.635306    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 21:14:53.635591 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:53.635353    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78033d56-f0fa-4c50-be00-b86a2e8667e6-original-pull-secret podName:78033d56-f0fa-4c50-be00-b86a2e8667e6 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:01.635340575 +0000 UTC m=+18.079932285 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78033d56-f0fa-4c50-be00-b86a2e8667e6-original-pull-secret") pod "global-pull-secret-syncer-zb8df" (UID: "78033d56-f0fa-4c50-be00-b86a2e8667e6") : object "kube-system"/"original-pull-secret" not registered
Jul 24 21:14:53.736218 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:53.736186    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7ccx\" (UniqueName: \"kubernetes.io/projected/35503db5-115c-40a6-a785-ca16352ed1b2-kube-api-access-r7ccx\") pod \"network-check-target-l4zhw\" (UID: \"35503db5-115c-40a6-a785-ca16352ed1b2\") " pod="openshift-network-diagnostics/network-check-target-l4zhw"
Jul 24 21:14:53.736405 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:53.736354    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 21:14:53.736405 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:53.736375    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 21:14:53.736405 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:53.736388    2561 projected.go:196] Error preparing data for projected volume kube-api-access-r7ccx for pod openshift-network-diagnostics/network-check-target-l4zhw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 21:14:53.736551 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:53.736463    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35503db5-115c-40a6-a785-ca16352ed1b2-kube-api-access-r7ccx podName:35503db5-115c-40a6-a785-ca16352ed1b2 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:01.736441147 +0000 UTC m=+18.181032863 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-r7ccx" (UniqueName: "kubernetes.io/projected/35503db5-115c-40a6-a785-ca16352ed1b2-kube-api-access-r7ccx") pod "network-check-target-l4zhw" (UID: "35503db5-115c-40a6-a785-ca16352ed1b2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 21:14:53.948024 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:53.947930    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zb8df"
Jul 24 21:14:53.948190 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:53.948075    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zb8df" podUID="78033d56-f0fa-4c50-be00-b86a2e8667e6"
Jul 24 21:14:53.949850 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:53.949565    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25fb5"
Jul 24 21:14:53.949850 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:53.949680    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4zhw"
Jul 24 21:14:53.949850 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:53.949761    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4zhw" podUID="35503db5-115c-40a6-a785-ca16352ed1b2"
Jul 24 21:14:53.949850 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:53.949809    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25fb5" podUID="4ff19854-c536-4ba4-b2fc-29a8f87ff1a7"
Jul 24 21:14:55.947878 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:55.947835    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25fb5"
Jul 24 21:14:55.948378 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:55.947896    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4zhw"
Jul 24 21:14:55.948378 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:55.947908    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zb8df"
Jul 24 21:14:55.948378 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:55.947991    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4zhw" podUID="35503db5-115c-40a6-a785-ca16352ed1b2"
Jul 24 21:14:55.948378 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:55.948056    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25fb5" podUID="4ff19854-c536-4ba4-b2fc-29a8f87ff1a7"
Jul 24 21:14:55.948378 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:55.948120    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zb8df" podUID="78033d56-f0fa-4c50-be00-b86a2e8667e6"
Jul 24 21:14:57.948271 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:57.948239    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25fb5"
Jul 24 21:14:57.948709 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:57.948274    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4zhw"
Jul 24 21:14:57.948709 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:57.948333    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zb8df"
Jul 24 21:14:57.948709 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:57.948460    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zb8df" podUID="78033d56-f0fa-4c50-be00-b86a2e8667e6"
Jul 24 21:14:57.948908 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:57.948884    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4zhw" podUID="35503db5-115c-40a6-a785-ca16352ed1b2"
Jul 24 21:14:57.949006 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:57.948989    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25fb5" podUID="4ff19854-c536-4ba4-b2fc-29a8f87ff1a7"
Jul 24 21:14:59.951219 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:59.951182    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4zhw"
Jul 24 21:14:59.951700 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:59.951312    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25fb5"
Jul 24 21:14:59.951700 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:59.951321    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4zhw" podUID="35503db5-115c-40a6-a785-ca16352ed1b2"
Jul 24 21:14:59.951700 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:14:59.951347    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zb8df"
Jul 24 21:14:59.951700 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:59.951440    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25fb5" podUID="4ff19854-c536-4ba4-b2fc-29a8f87ff1a7"
Jul 24 21:14:59.951700 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:14:59.951507    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zb8df" podUID="78033d56-f0fa-4c50-be00-b86a2e8667e6"
Jul 24 21:15:01.699738 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:01.699700    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ff19854-c536-4ba4-b2fc-29a8f87ff1a7-metrics-certs\") pod \"network-metrics-daemon-25fb5\" (UID: \"4ff19854-c536-4ba4-b2fc-29a8f87ff1a7\") " pod="openshift-multus/network-metrics-daemon-25fb5"
Jul 24 21:15:01.700325 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:01.699765    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78033d56-f0fa-4c50-be00-b86a2e8667e6-original-pull-secret\") pod \"global-pull-secret-syncer-zb8df\" (UID: \"78033d56-f0fa-4c50-be00-b86a2e8667e6\") " pod="kube-system/global-pull-secret-syncer-zb8df"
Jul 24 21:15:01.700325 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:01.699868    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 21:15:01.700325 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:01.699943    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ff19854-c536-4ba4-b2fc-29a8f87ff1a7-metrics-certs podName:4ff19854-c536-4ba4-b2fc-29a8f87ff1a7 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:17.699926381 +0000 UTC m=+34.144518089 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ff19854-c536-4ba4-b2fc-29a8f87ff1a7-metrics-certs") pod "network-metrics-daemon-25fb5" (UID: "4ff19854-c536-4ba4-b2fc-29a8f87ff1a7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 21:15:01.700325 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:01.699877    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 21:15:01.700325 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:01.700004    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78033d56-f0fa-4c50-be00-b86a2e8667e6-original-pull-secret podName:78033d56-f0fa-4c50-be00-b86a2e8667e6 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:17.699991059 +0000 UTC m=+34.144582768 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78033d56-f0fa-4c50-be00-b86a2e8667e6-original-pull-secret") pod "global-pull-secret-syncer-zb8df" (UID: "78033d56-f0fa-4c50-be00-b86a2e8667e6") : object "kube-system"/"original-pull-secret" not registered
Jul 24 21:15:01.800572 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:01.800540    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7ccx\" (UniqueName: \"kubernetes.io/projected/35503db5-115c-40a6-a785-ca16352ed1b2-kube-api-access-r7ccx\") pod \"network-check-target-l4zhw\" (UID: \"35503db5-115c-40a6-a785-ca16352ed1b2\") " pod="openshift-network-diagnostics/network-check-target-l4zhw"
Jul 24 21:15:01.800792 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:01.800714    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 21:15:01.800792 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:01.800732    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 21:15:01.800792 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:01.800743    2561 projected.go:196] Error preparing data for projected volume kube-api-access-r7ccx for pod openshift-network-diagnostics/network-check-target-l4zhw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 21:15:01.800924 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:01.800798    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35503db5-115c-40a6-a785-ca16352ed1b2-kube-api-access-r7ccx podName:35503db5-115c-40a6-a785-ca16352ed1b2 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:17.800785108 +0000 UTC m=+34.245376815 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-r7ccx" (UniqueName: "kubernetes.io/projected/35503db5-115c-40a6-a785-ca16352ed1b2-kube-api-access-r7ccx") pod "network-check-target-l4zhw" (UID: "35503db5-115c-40a6-a785-ca16352ed1b2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 21:15:01.948521 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:01.948484    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zb8df"
Jul 24 21:15:01.948521 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:01.948528    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4zhw"
Jul 24 21:15:01.948767 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:01.948489    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25fb5"
Jul 24 21:15:01.948767 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:01.948629    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zb8df" podUID="78033d56-f0fa-4c50-be00-b86a2e8667e6"
Jul 24 21:15:01.948767 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:01.948681    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25fb5" podUID="4ff19854-c536-4ba4-b2fc-29a8f87ff1a7"
Jul 24 21:15:01.948767 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:01.948745    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4zhw" podUID="35503db5-115c-40a6-a785-ca16352ed1b2"
Jul 24 21:15:03.949033 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:03.948996    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4zhw"
Jul 24 21:15:03.949501 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:03.949171    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25fb5"
Jul 24 21:15:03.949501 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:03.949190    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4zhw" podUID="35503db5-115c-40a6-a785-ca16352ed1b2"
Jul 24 21:15:03.949501 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:03.949279    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25fb5" podUID="4ff19854-c536-4ba4-b2fc-29a8f87ff1a7"
Jul 24 21:15:03.949501 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:03.949339    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zb8df"
Jul 24 21:15:03.949501 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:03.949424    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zb8df" podUID="78033d56-f0fa-4c50-be00-b86a2e8667e6"
Jul 24 21:15:05.947659 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:05.947630    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4zhw"
Jul 24 21:15:05.948099 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:05.947631    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zb8df"
Jul 24 21:15:05.948099 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:05.947758    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4zhw" podUID="35503db5-115c-40a6-a785-ca16352ed1b2"
Jul 24 21:15:05.948099 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:05.947852    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zb8df" podUID="78033d56-f0fa-4c50-be00-b86a2e8667e6"
Jul 24 21:15:05.948099 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:05.947640    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25fb5"
Jul 24 21:15:05.948099 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:05.947990    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25fb5" podUID="4ff19854-c536-4ba4-b2fc-29a8f87ff1a7"
Jul 24 21:15:07.086134 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:07.085509    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jmzq6" event={"ID":"b1b822a6-97f4-48cb-8de9-20e36637d53b","Type":"ContainerStarted","Data":"72aae08cb8c510e0d4b5277ea4c9f50bb2e5b953b6816125c7a3a035bf77a21f"}
Jul 24 21:15:07.087274 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:07.087245    2561 generic.go:356] "Generic (PLEG): container finished" podID="92b9098e-caea-4f9b-bfb6-d6757c2d19d6" containerID="b00d6980b1e751f33ec471ff15ca1c3b404960134ff480a553ef59f46bae31d2" exitCode=0
Jul 24 21:15:07.087274 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:07.087260    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhsvn" event={"ID":"92b9098e-caea-4f9b-bfb6-d6757c2d19d6","Type":"ContainerDied","Data":"b00d6980b1e751f33ec471ff15ca1c3b404960134ff480a553ef59f46bae31d2"}
Jul 24 21:15:07.091151 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:07.091124    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m" event={"ID":"c360c906-f525-4df3-9776-9b9b6cea64c6","Type":"ContainerStarted","Data":"267ec88df864db8f8aaf6789e2e354ea5ccdee30c8b6c7a5cc97e5f2b292b6c0"}
Jul 24 21:15:07.091262 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:07.091189    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m" event={"ID":"c360c906-f525-4df3-9776-9b9b6cea64c6","Type":"ContainerStarted","Data":"414ab3b600206f17e1d54159818f9105088f86d7ed8dcfecf2f2d856dfffd56e"}
Jul 24 21:15:07.091262 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:07.091219    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m" event={"ID":"c360c906-f525-4df3-9776-9b9b6cea64c6","Type":"ContainerStarted","Data":"48320ddbbd5d34d4a98165d1c666fb9353487167030865a2e293a020c2b4a100"}
Jul 24 21:15:07.091355 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:07.091276    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m" event={"ID":"c360c906-f525-4df3-9776-9b9b6cea64c6","Type":"ContainerStarted","Data":"17f20d542ba1776c2f6a6635da5d05fc17cd8e6a5ef410ce11e10dae6bed34e5"}
Jul 24 21:15:07.091355 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:07.091305    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m" event={"ID":"c360c906-f525-4df3-9776-9b9b6cea64c6","Type":"ContainerStarted","Data":"1de3b0407468da008a0b96c33fead4254e308c255078a3e3448614d76ffaeb96"}
Jul 24 21:15:07.091355 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:07.091351    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m" event={"ID":"c360c906-f525-4df3-9776-9b9b6cea64c6","Type":"ContainerStarted","Data":"cdf0cd939c5bf1a31304e8aba2344a98be94d92d63a4e74688ff946a5a7f7d7c"}
Jul 24 21:15:07.092858 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:07.092824    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8rtjq" event={"ID":"0f7f530a-6040-4754-b0c9-f08325ec5b2e","Type":"ContainerStarted","Data":"1325bf0ff902fc029f1e7d9b7880bcda4f62a7a33ad0c5401d216849e1019fea"}
Jul 24 21:15:07.094629 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:07.094608    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmlgz" event={"ID":"687a4418-4e3f-473c-82e6-f7c6e963a3df","Type":"ContainerStarted","Data":"d6d943ec0ae41e0125d599d807fb62a270c47124e6aa8ca2cf49247c22710a19"}
Jul 24 21:15:07.096332 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:07.096308    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nwlgt" event={"ID":"f85fa254-5b39-4c72-878d-8743bdaead48","Type":"ContainerStarted","Data":"1a37102f1f8a0239b95c75194424e758087c9fc116d0e606c03111a3f5b0e464"}
Jul 24 21:15:07.098445 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:07.098423    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jnddc" event={"ID":"53ed5a58-5ef1-4847-9a34-a06435831d4a","Type":"ContainerStarted","Data":"f342ca5f8a3455a014daca26fe15cd790d726f3d42727c3395a8f60764218c7c"}
Jul 24 21:15:07.099881 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:07.099836    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jmzq6" podStartSLOduration=3.6224250590000002 podStartE2EDuration="23.099800507s" totalImagesPullingTime="19.477375448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:14:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:15:07.099707757 +0000 UTC m=+23.544299488" watchObservedRunningTime="2026-07-24 21:15:07.099800507 +0000 UTC m=+23.544392238"
Jul 24 21:15:07.100513 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:07.099953    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5jw4h" event={"ID":"115c393f-0d8f-4d21-8247-546a7f0bef21","Type":"ContainerStarted","Data":"d96945ab69e80da84efdde40130de3aac84fc8af343c051227d086225fb562d4"}
Jul 24 21:15:07.100590 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:07.100563    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal" podStartSLOduration=22.100545198 podStartE2EDuration="22.100545198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 21:14:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:14:49.0549665 +0000 UTC m=+5.499558235" watchObservedRunningTime="2026-07-24 21:15:07.100545198 +0000 UTC m=+23.545136929"
Jul 24 21:15:07.139121 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:07.138991    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nwlgt" podStartSLOduration=3.652764937 podStartE2EDuration="23.13897035s" totalImagesPullingTime="19.486205413s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 21:14:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:15:07.117197996 +0000 UTC m=+23.561789726" watchObservedRunningTime="2026-07-24 21:15:07.13897035 +0000 UTC m=+23.583562081"
Jul 24 21:15:07.152188 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:07.152145    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jnddc" podStartSLOduration=3.671074768 podStartE2EDuration="23.152129884s" totalImagesPullingTime="19.481055116s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 21:14:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:15:07.151447872 +0000 UTC m=+23.596039606" watchObservedRunningTime="2026-07-24 21:15:07.152129884 +0000 UTC m=+23.596721615"
Jul 24 21:15:07.169321 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:07.169257    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8rtjq" podStartSLOduration=3.634505984 podStartE2EDuration="23.169215269s" totalImagesPullingTime="19.534709285s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 21:14:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:15:07.168823382 +0000 UTC m=+23.613415104" watchObservedRunningTime="2026-07-24 21:15:07.169215269 +0000 UTC m=+23.613807000"
Jul 24 21:15:07.184024 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:07.183981    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5jw4h" podStartSLOduration=3.687034021 podStartE2EDuration="23.183966281s" totalImagesPullingTime="19.49693226s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 21:14:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:15:07.183813436 +0000 UTC m=+23.628405171" watchObservedRunningTime="2026-07-24 21:15:07.183966281 +0000 UTC m=+23.628558010"
Jul 24 21:15:07.319802 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:07.319769    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jmzq6"
Jul 24 21:15:07.320439 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:07.320421    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jmzq6"
Jul 24 21:15:07.948264 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:07.948240    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4zhw"
Jul 24 21:15:07.948401 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:07.948275    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zb8df"
Jul 24 21:15:07.948401 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:07.948358    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4zhw" podUID="35503db5-115c-40a6-a785-ca16352ed1b2"
Jul 24 21:15:07.948401 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:07.948243    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25fb5"
Jul 24 21:15:07.948568 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:07.948433    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zb8df" podUID="78033d56-f0fa-4c50-be00-b86a2e8667e6"
Jul 24 21:15:07.948568 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:07.948489    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25fb5" podUID="4ff19854-c536-4ba4-b2fc-29a8f87ff1a7"
Jul 24 21:15:08.013476 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:08.013451    2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 24 21:15:08.104157 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:08.104114    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m9952" event={"ID":"c38305ec-8b35-4d35-861e-381f6d679ae9","Type":"ContainerStarted","Data":"6b08120a4d0b193af3d90bfae0504975af2ed69a1c6c23bf0bdbbcfb870ea633"}
Jul 24 21:15:08.107147 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:08.107111    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmlgz" event={"ID":"687a4418-4e3f-473c-82e6-f7c6e963a3df","Type":"ContainerStarted","Data":"e842c4dc2a1b619dfc2869126d50a934ed24eb018b67d8d83269937c4b8cd7a1"}
Jul 24 21:15:08.107448 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:08.107425    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jmzq6"
Jul 24 21:15:08.108010 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:08.107992    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jmzq6"
Jul 24 21:15:08.121016 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:08.120971    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-m9952" podStartSLOduration=4.630726297 podStartE2EDuration="24.120958594s" totalImagesPullingTime="19.490232297s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 21:14:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:15:08.120569574 +0000 UTC m=+24.565161305" watchObservedRunningTime="2026-07-24 21:15:08.120958594 +0000 UTC m=+24.565550352"
Jul 24 21:15:08.928856 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:08.928749    2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T21:15:08.013471011Z","UUID":"39b04e38-5064-4437-a396-2419c07b7533","Handler":null,"Name":"","Endpoint":""}
Jul 24 21:15:08.930349 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:08.930311    2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 24 21:15:08.930531 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:08.930358    2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 24 21:15:09.948244 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:09.948083    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4zhw"
Jul 24 21:15:09.948244 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:09.948164    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zb8df"
Jul 24 21:15:09.948244 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:09.948104    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25fb5"
Jul 24 21:15:09.948892 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:09.948278    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4zhw" podUID="35503db5-115c-40a6-a785-ca16352ed1b2"
Jul 24 21:15:09.948892 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:09.948395    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25fb5" podUID="4ff19854-c536-4ba4-b2fc-29a8f87ff1a7"
Jul 24 21:15:09.948892 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:09.948489    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zb8df" podUID="78033d56-f0fa-4c50-be00-b86a2e8667e6"
Jul 24 21:15:10.115049 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:10.115011    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m" event={"ID":"c360c906-f525-4df3-9776-9b9b6cea64c6","Type":"ContainerStarted","Data":"47e8b020a10f29f754a2c514f2f90e02b6a2a6bcd2bed596be771cf1b0b86b88"}
Jul 24 21:15:10.117149 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:10.117116    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmlgz" event={"ID":"687a4418-4e3f-473c-82e6-f7c6e963a3df","Type":"ContainerStarted","Data":"f9ff2908a81c57c3ce6f4b528a826b025de78fb4fbb89e1532aba9351e98e86a"}
Jul 24 21:15:10.135008 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:10.134957    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmlgz" podStartSLOduration=4.321832688 podStartE2EDuration="26.134938576s" totalImagesPullingTime="21.813105888s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 21:14:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:15:10.134525407 +0000 UTC m=+26.579117139" watchObservedRunningTime="2026-07-24 21:15:10.134938576 +0000 UTC m=+26.579530310"
Jul 24 21:15:11.948303 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:11.948126    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25fb5"
Jul 24 21:15:11.948912 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:11.948135    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zb8df"
Jul 24 21:15:11.948912 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:11.948397    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25fb5" podUID="4ff19854-c536-4ba4-b2fc-29a8f87ff1a7"
Jul 24 21:15:11.948912 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:11.948478    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zb8df" podUID="78033d56-f0fa-4c50-be00-b86a2e8667e6"
Jul 24 21:15:11.948912 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:11.948167    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4zhw"
Jul 24 21:15:11.948912 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:11.948578    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4zhw" podUID="35503db5-115c-40a6-a785-ca16352ed1b2"
Jul 24 21:15:12.123071 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:12.122909    2561 generic.go:356] "Generic (PLEG): container finished" podID="92b9098e-caea-4f9b-bfb6-d6757c2d19d6" containerID="ece2d40a43537b7bb736a59ad7a321b669491d5df6b96d3fd3a92abcbfd0fc78" exitCode=0
Jul 24 21:15:12.123185 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:12.122986    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhsvn" event={"ID":"92b9098e-caea-4f9b-bfb6-d6757c2d19d6","Type":"ContainerDied","Data":"ece2d40a43537b7bb736a59ad7a321b669491d5df6b96d3fd3a92abcbfd0fc78"}
Jul 24 21:15:12.126734 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:12.126715    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m" event={"ID":"c360c906-f525-4df3-9776-9b9b6cea64c6","Type":"ContainerStarted","Data":"2571273827c54d6fc802a1d8100837cc23cae04066c50862385d2993e2471f37"}
Jul 24 21:15:12.127026 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:12.127002    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:15:12.127125 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:12.127064    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:15:12.142268 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:12.142216    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:15:12.182355 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:12.182313    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m" podStartSLOduration=8.640374441 podStartE2EDuration="28.182301321s" totalImagesPullingTime="19.54192688s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 21:14:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:15:12.18078732 +0000 UTC m=+28.625379049" watchObservedRunningTime="2026-07-24 21:15:12.182301321 +0000 UTC m=+28.626893050"
Jul 24 21:15:13.129722 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:13.129686    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:15:13.146423 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:13.146395    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:15:13.513721 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:13.513633    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zb8df"]
Jul 24 21:15:13.513884 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:13.513791    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zb8df"
Jul 24 21:15:13.513958 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:13.513884    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zb8df" podUID="78033d56-f0fa-4c50-be00-b86a2e8667e6"
Jul 24 21:15:13.517451 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:13.517424    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l4zhw"]
Jul 24 21:15:13.517564 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:13.517517    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4zhw"
Jul 24 21:15:13.517638 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:13.517618    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4zhw" podUID="35503db5-115c-40a6-a785-ca16352ed1b2"
Jul 24 21:15:13.518017 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:13.517996    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-25fb5"]
Jul 24 21:15:13.518106 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:13.518096    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25fb5"
Jul 24 21:15:13.518210 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:13.518193    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25fb5" podUID="4ff19854-c536-4ba4-b2fc-29a8f87ff1a7"
Jul 24 21:15:14.133406 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:14.133373    2561 generic.go:356] "Generic (PLEG): container finished" podID="92b9098e-caea-4f9b-bfb6-d6757c2d19d6" containerID="9ad94cb01ad47a97c61db296f4fe0f212af6410596779675e810118d4f9ac6ee" exitCode=0
Jul 24 21:15:14.133780 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:14.133458    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhsvn" event={"ID":"92b9098e-caea-4f9b-bfb6-d6757c2d19d6","Type":"ContainerDied","Data":"9ad94cb01ad47a97c61db296f4fe0f212af6410596779675e810118d4f9ac6ee"}
Jul 24 21:15:14.947919 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:14.947887    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zb8df"
Jul 24 21:15:14.947919 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:14.947921    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25fb5"
Jul 24 21:15:14.948159 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:14.947921    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4zhw"
Jul 24 21:15:14.948159 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:14.947999    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zb8df" podUID="78033d56-f0fa-4c50-be00-b86a2e8667e6"
Jul 24 21:15:14.948159 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:14.948076    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25fb5" podUID="4ff19854-c536-4ba4-b2fc-29a8f87ff1a7"
Jul 24 21:15:14.948159 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:14.948125    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4zhw" podUID="35503db5-115c-40a6-a785-ca16352ed1b2"
Jul 24 21:15:16.140401 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:16.140196    2561 generic.go:356] "Generic (PLEG): container finished" podID="92b9098e-caea-4f9b-bfb6-d6757c2d19d6" containerID="902577c982be809393ddfa73dc641dfc8735ca03d46e1d15adf68bfe37d2bccd" exitCode=0
Jul 24 21:15:16.140793 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:16.140289    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhsvn" event={"ID":"92b9098e-caea-4f9b-bfb6-d6757c2d19d6","Type":"ContainerDied","Data":"902577c982be809393ddfa73dc641dfc8735ca03d46e1d15adf68bfe37d2bccd"}
Jul 24 21:15:16.947666 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:16.947632    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zb8df"
Jul 24 21:15:16.947666 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:16.947664    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4zhw"
Jul 24 21:15:16.947897 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:16.947753    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25fb5"
Jul 24 21:15:16.947897 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:16.947768    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zb8df" podUID="78033d56-f0fa-4c50-be00-b86a2e8667e6"
Jul 24 21:15:16.947897 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:16.947864    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25fb5" podUID="4ff19854-c536-4ba4-b2fc-29a8f87ff1a7"
Jul 24 21:15:16.948063 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:16.947952    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4zhw" podUID="35503db5-115c-40a6-a785-ca16352ed1b2"
Jul 24 21:15:17.721927 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:17.721899    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ff19854-c536-4ba4-b2fc-29a8f87ff1a7-metrics-certs\") pod \"network-metrics-daemon-25fb5\" (UID: \"4ff19854-c536-4ba4-b2fc-29a8f87ff1a7\") " pod="openshift-multus/network-metrics-daemon-25fb5"
Jul 24 21:15:17.722497 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:17.721944    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78033d56-f0fa-4c50-be00-b86a2e8667e6-original-pull-secret\") pod \"global-pull-secret-syncer-zb8df\" (UID: \"78033d56-f0fa-4c50-be00-b86a2e8667e6\") " pod="kube-system/global-pull-secret-syncer-zb8df"
Jul 24 21:15:17.722497 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:17.722053    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 21:15:17.722497 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:17.722062    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 21:15:17.722497 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:17.722108    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78033d56-f0fa-4c50-be00-b86a2e8667e6-original-pull-secret podName:78033d56-f0fa-4c50-be00-b86a2e8667e6 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:49.722088579 +0000 UTC m=+66.166680287 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78033d56-f0fa-4c50-be00-b86a2e8667e6-original-pull-secret") pod "global-pull-secret-syncer-zb8df" (UID: "78033d56-f0fa-4c50-be00-b86a2e8667e6") : object "kube-system"/"original-pull-secret" not registered
Jul 24 21:15:17.722497 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:17.722128    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ff19854-c536-4ba4-b2fc-29a8f87ff1a7-metrics-certs podName:4ff19854-c536-4ba4-b2fc-29a8f87ff1a7 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:49.722117158 +0000 UTC m=+66.166708867 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ff19854-c536-4ba4-b2fc-29a8f87ff1a7-metrics-certs") pod "network-metrics-daemon-25fb5" (UID: "4ff19854-c536-4ba4-b2fc-29a8f87ff1a7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 21:15:17.822296 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:17.822264    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7ccx\" (UniqueName: \"kubernetes.io/projected/35503db5-115c-40a6-a785-ca16352ed1b2-kube-api-access-r7ccx\") pod \"network-check-target-l4zhw\" (UID: \"35503db5-115c-40a6-a785-ca16352ed1b2\") " pod="openshift-network-diagnostics/network-check-target-l4zhw"
Jul 24 21:15:17.822460 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:17.822425    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 21:15:17.822460 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:17.822444    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 21:15:17.822460 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:17.822455    2561 projected.go:196] Error preparing data for projected volume kube-api-access-r7ccx for pod openshift-network-diagnostics/network-check-target-l4zhw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 21:15:17.822585 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:17.822510    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35503db5-115c-40a6-a785-ca16352ed1b2-kube-api-access-r7ccx podName:35503db5-115c-40a6-a785-ca16352ed1b2 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:49.822493533 +0000 UTC m=+66.267085255 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-r7ccx" (UniqueName: "kubernetes.io/projected/35503db5-115c-40a6-a785-ca16352ed1b2-kube-api-access-r7ccx") pod "network-check-target-l4zhw" (UID: "35503db5-115c-40a6-a785-ca16352ed1b2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 21:15:18.948412 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:18.948384    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4zhw"
Jul 24 21:15:18.948775 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:18.948500    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4zhw" podUID="35503db5-115c-40a6-a785-ca16352ed1b2"
Jul 24 21:15:18.948910 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:18.948893    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25fb5"
Jul 24 21:15:18.949018 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:18.948998    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25fb5" podUID="4ff19854-c536-4ba4-b2fc-29a8f87ff1a7"
Jul 24 21:15:18.949073 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:18.949047    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zb8df"
Jul 24 21:15:18.949131 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:18.949115    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zb8df" podUID="78033d56-f0fa-4c50-be00-b86a2e8667e6"
Jul 24 21:15:19.444817 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:19.444789    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeReady"
Jul 24 21:15:19.444961 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:19.444937    2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 24 21:15:19.490260 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:19.489797    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-k5vbz"]
Jul 24 21:15:19.523181 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:19.523151    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vc495"]
Jul 24 21:15:19.523341 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:19.523314    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k5vbz"
Jul 24 21:15:19.526029 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:19.526005    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 24 21:15:19.526029 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:19.526013    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 24 21:15:19.526216 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:19.526029    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wbvbs\""
Jul 24 21:15:19.543082 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:19.543060    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-k5vbz"]
Jul 24 21:15:19.543210 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:19.543107    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vc495"]
Jul 24 21:15:19.543210 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:19.543186    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vc495"
Jul 24 21:15:19.545811 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:19.545782    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 24 21:15:19.545811 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:19.545795    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ng82g\""
Jul 24 21:15:19.546149 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:19.546133    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 24 21:15:19.546289 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:19.546172    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 24 21:15:19.635058 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:19.635026    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gc58\" (UniqueName: \"kubernetes.io/projected/c86f2249-21df-498b-afa2-ff795d234e97-kube-api-access-7gc58\") pod \"dns-default-k5vbz\" (UID: \"c86f2249-21df-498b-afa2-ff795d234e97\") " pod="openshift-dns/dns-default-k5vbz"
Jul 24 21:15:19.635270 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:19.635068    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51dfbcfc-876c-4227-bb8c-15ec65b23e56-cert\") pod \"ingress-canary-vc495\" (UID: \"51dfbcfc-876c-4227-bb8c-15ec65b23e56\") " pod="openshift-ingress-canary/ingress-canary-vc495"
Jul 24 21:15:19.635270 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:19.635104    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c86f2249-21df-498b-afa2-ff795d234e97-metrics-tls\") pod \"dns-default-k5vbz\" (UID: \"c86f2249-21df-498b-afa2-ff795d234e97\") " pod="openshift-dns/dns-default-k5vbz"
Jul 24 21:15:19.635270 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:19.635194    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c86f2249-21df-498b-afa2-ff795d234e97-config-volume\") pod \"dns-default-k5vbz\" (UID: \"c86f2249-21df-498b-afa2-ff795d234e97\") " pod="openshift-dns/dns-default-k5vbz"
Jul 24 21:15:19.635424 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:19.635295    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c86f2249-21df-498b-afa2-ff795d234e97-tmp-dir\") pod \"dns-default-k5vbz\" (UID: \"c86f2249-21df-498b-afa2-ff795d234e97\") " pod="openshift-dns/dns-default-k5vbz"
Jul 24 21:15:19.635424 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:19.635321    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcpdp\" (UniqueName: \"kubernetes.io/projected/51dfbcfc-876c-4227-bb8c-15ec65b23e56-kube-api-access-vcpdp\") pod \"ingress-canary-vc495\" (UID: \"51dfbcfc-876c-4227-bb8c-15ec65b23e56\") " pod="openshift-ingress-canary/ingress-canary-vc495"
Jul 24 21:15:19.736454 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:19.736359    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c86f2249-21df-498b-afa2-ff795d234e97-tmp-dir\") pod \"dns-default-k5vbz\" (UID: \"c86f2249-21df-498b-afa2-ff795d234e97\") " pod="openshift-dns/dns-default-k5vbz"
Jul 24 21:15:19.736454 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:19.736415    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcpdp\" (UniqueName: \"kubernetes.io/projected/51dfbcfc-876c-4227-bb8c-15ec65b23e56-kube-api-access-vcpdp\") pod \"ingress-canary-vc495\" (UID: \"51dfbcfc-876c-4227-bb8c-15ec65b23e56\") " pod="openshift-ingress-canary/ingress-canary-vc495"
Jul 24 21:15:19.736454 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:19.736456    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gc58\" (UniqueName: \"kubernetes.io/projected/c86f2249-21df-498b-afa2-ff795d234e97-kube-api-access-7gc58\") pod \"dns-default-k5vbz\" (UID: \"c86f2249-21df-498b-afa2-ff795d234e97\") " pod="openshift-dns/dns-default-k5vbz"
Jul 24 21:15:19.736655 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:19.736487    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51dfbcfc-876c-4227-bb8c-15ec65b23e56-cert\") pod \"ingress-canary-vc495\" (UID: \"51dfbcfc-876c-4227-bb8c-15ec65b23e56\") " pod="openshift-ingress-canary/ingress-canary-vc495"
Jul 24 21:15:19.736655 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:19.736510    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c86f2249-21df-498b-afa2-ff795d234e97-metrics-tls\") pod \"dns-default-k5vbz\" (UID: \"c86f2249-21df-498b-afa2-ff795d234e97\") " pod="openshift-dns/dns-default-k5vbz"
Jul 24 21:15:19.736655 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:19.736539    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c86f2249-21df-498b-afa2-ff795d234e97-config-volume\") pod \"dns-default-k5vbz\" (UID: \"c86f2249-21df-498b-afa2-ff795d234e97\") " pod="openshift-dns/dns-default-k5vbz"
Jul 24 21:15:19.736747 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:19.736677    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c86f2249-21df-498b-afa2-ff795d234e97-tmp-dir\") pod \"dns-default-k5vbz\" (UID: \"c86f2249-21df-498b-afa2-ff795d234e97\") " pod="openshift-dns/dns-default-k5vbz"
Jul 24 21:15:19.736987 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:19.736972    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 21:15:19.737038 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:19.737024    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c86f2249-21df-498b-afa2-ff795d234e97-config-volume\") pod \"dns-default-k5vbz\" (UID: \"c86f2249-21df-498b-afa2-ff795d234e97\") " pod="openshift-dns/dns-default-k5vbz"
Jul 24 21:15:19.737072 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:19.737028    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c86f2249-21df-498b-afa2-ff795d234e97-metrics-tls podName:c86f2249-21df-498b-afa2-ff795d234e97 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:20.237009641 +0000 UTC m=+36.681601349 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c86f2249-21df-498b-afa2-ff795d234e97-metrics-tls") pod "dns-default-k5vbz" (UID: "c86f2249-21df-498b-afa2-ff795d234e97") : secret "dns-default-metrics-tls" not found
Jul 24 21:15:19.741514 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:19.741469    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51dfbcfc-876c-4227-bb8c-15ec65b23e56-cert\") pod \"ingress-canary-vc495\" (UID: \"51dfbcfc-876c-4227-bb8c-15ec65b23e56\") " pod="openshift-ingress-canary/ingress-canary-vc495"
Jul 24 21:15:19.745927 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:19.745907    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcpdp\" (UniqueName: \"kubernetes.io/projected/51dfbcfc-876c-4227-bb8c-15ec65b23e56-kube-api-access-vcpdp\") pod \"ingress-canary-vc495\" (UID: \"51dfbcfc-876c-4227-bb8c-15ec65b23e56\") " pod="openshift-ingress-canary/ingress-canary-vc495"
Jul 24 21:15:19.746615 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:19.746594    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gc58\" (UniqueName: \"kubernetes.io/projected/c86f2249-21df-498b-afa2-ff795d234e97-kube-api-access-7gc58\") pod \"dns-default-k5vbz\" (UID: \"c86f2249-21df-498b-afa2-ff795d234e97\") " pod="openshift-dns/dns-default-k5vbz"
Jul 24 21:15:19.852554 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:19.852517    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vc495"
Jul 24 21:15:20.234866 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:20.234713    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vc495"]
Jul 24 21:15:20.241471 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:20.241448    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c86f2249-21df-498b-afa2-ff795d234e97-metrics-tls\") pod \"dns-default-k5vbz\" (UID: \"c86f2249-21df-498b-afa2-ff795d234e97\") " pod="openshift-dns/dns-default-k5vbz"
Jul 24 21:15:20.241612 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:20.241597    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 21:15:20.241665 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:20.241656    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c86f2249-21df-498b-afa2-ff795d234e97-metrics-tls podName:c86f2249-21df-498b-afa2-ff795d234e97 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:21.24164083 +0000 UTC m=+37.686232541 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c86f2249-21df-498b-afa2-ff795d234e97-metrics-tls") pod "dns-default-k5vbz" (UID: "c86f2249-21df-498b-afa2-ff795d234e97") : secret "dns-default-metrics-tls" not found
Jul 24 21:15:20.299259 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:15:20.299211    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51dfbcfc_876c_4227_bb8c_15ec65b23e56.slice/crio-6e322b3dc0fc2664efe6fa874fcb955e566c14b791c190d7279b5d3244188ccd WatchSource:0}: Error finding container 6e322b3dc0fc2664efe6fa874fcb955e566c14b791c190d7279b5d3244188ccd: Status 404 returned error can't find the container with id 6e322b3dc0fc2664efe6fa874fcb955e566c14b791c190d7279b5d3244188ccd
Jul 24 21:15:20.948040 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:20.947990    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zb8df"
Jul 24 21:15:20.948040 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:20.948019    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4zhw"
Jul 24 21:15:20.948299 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:20.948005    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25fb5"
Jul 24 21:15:20.950962 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:20.950934    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 21:15:20.951856 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:20.951839    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qnp5w\""
Jul 24 21:15:20.952383 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:20.952097    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zlbx8\""
Jul 24 21:15:20.952383 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:20.952132    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 21:15:20.952383 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:20.952146    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 21:15:20.952383 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:20.952175    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 21:15:21.153164 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:21.153130    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vc495" event={"ID":"51dfbcfc-876c-4227-bb8c-15ec65b23e56","Type":"ContainerStarted","Data":"6e322b3dc0fc2664efe6fa874fcb955e566c14b791c190d7279b5d3244188ccd"}
Jul 24 21:15:21.156421 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:21.156395    2561 generic.go:356] "Generic (PLEG): container finished" podID="92b9098e-caea-4f9b-bfb6-d6757c2d19d6" containerID="0d59fc47fb2d692d91a9ccc732ee78f9e43dbfbe70599eb9860a76723b498550" exitCode=0
Jul 24 21:15:21.156532 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:21.156442    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhsvn" event={"ID":"92b9098e-caea-4f9b-bfb6-d6757c2d19d6","Type":"ContainerDied","Data":"0d59fc47fb2d692d91a9ccc732ee78f9e43dbfbe70599eb9860a76723b498550"}
Jul 24 21:15:21.249900 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:21.249876    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c86f2249-21df-498b-afa2-ff795d234e97-metrics-tls\") pod \"dns-default-k5vbz\" (UID: \"c86f2249-21df-498b-afa2-ff795d234e97\") " pod="openshift-dns/dns-default-k5vbz"
Jul 24 21:15:21.250256 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:21.250025    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 21:15:21.250256 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:21.250076    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c86f2249-21df-498b-afa2-ff795d234e97-metrics-tls podName:c86f2249-21df-498b-afa2-ff795d234e97 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:23.250059596 +0000 UTC m=+39.694651309 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c86f2249-21df-498b-afa2-ff795d234e97-metrics-tls") pod "dns-default-k5vbz" (UID: "c86f2249-21df-498b-afa2-ff795d234e97") : secret "dns-default-metrics-tls" not found
Jul 24 21:15:22.163646 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:22.163611    2561 generic.go:356] "Generic (PLEG): container finished" podID="92b9098e-caea-4f9b-bfb6-d6757c2d19d6" containerID="c03efbfea4fd53c5bf86ae12386e65f9cfc00a1f2b48eb125416fb1ddc7d8d6c" exitCode=0
Jul 24 21:15:22.163846 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:22.163674    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhsvn" event={"ID":"92b9098e-caea-4f9b-bfb6-d6757c2d19d6","Type":"ContainerDied","Data":"c03efbfea4fd53c5bf86ae12386e65f9cfc00a1f2b48eb125416fb1ddc7d8d6c"}
Jul 24 21:15:23.167363 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:23.167160    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vc495" event={"ID":"51dfbcfc-876c-4227-bb8c-15ec65b23e56","Type":"ContainerStarted","Data":"d41cb7857843b374d0276bcbd12c313201b94e6e0477ff9b5d55210c58bf9dab"}
Jul 24 21:15:23.170465 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:23.170429    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhsvn" event={"ID":"92b9098e-caea-4f9b-bfb6-d6757c2d19d6","Type":"ContainerStarted","Data":"2f85c4dc8c8e00763e9bce89d32f24d6cef9b105b99dabd92bb77f8b219afa8d"}
Jul 24 21:15:23.184855 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:23.184813    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vc495" podStartSLOduration=2.193589214 podStartE2EDuration="4.184800159s" totalImagesPullingTime="1.991210945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:15:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:15:23.183952891 +0000 UTC m=+39.628544621" watchObservedRunningTime="2026-07-24 21:15:23.184800159 +0000 UTC m=+39.629391890"
Jul 24 21:15:23.207910 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:23.207871    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jhsvn" podStartSLOduration=8.77673343 podStartE2EDuration="39.207856012s" totalImagesPullingTime="30.431122582s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 21:14:44 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:15:23.206295707 +0000 UTC m=+39.650887438" watchObservedRunningTime="2026-07-24 21:15:23.207856012 +0000 UTC m=+39.652447742"
Jul 24 21:15:23.266564 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:23.266537    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c86f2249-21df-498b-afa2-ff795d234e97-metrics-tls\") pod \"dns-default-k5vbz\" (UID: \"c86f2249-21df-498b-afa2-ff795d234e97\") " pod="openshift-dns/dns-default-k5vbz"
Jul 24 21:15:23.266765 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:23.266738    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 21:15:23.266886 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:23.266839    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c86f2249-21df-498b-afa2-ff795d234e97-metrics-tls podName:c86f2249-21df-498b-afa2-ff795d234e97 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:27.266804664 +0000 UTC m=+43.711396397 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c86f2249-21df-498b-afa2-ff795d234e97-metrics-tls") pod "dns-default-k5vbz" (UID: "c86f2249-21df-498b-afa2-ff795d234e97") : secret "dns-default-metrics-tls" not found
Jul 24 21:15:27.293540 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:27.293507    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c86f2249-21df-498b-afa2-ff795d234e97-metrics-tls\") pod \"dns-default-k5vbz\" (UID: \"c86f2249-21df-498b-afa2-ff795d234e97\") " pod="openshift-dns/dns-default-k5vbz"
Jul 24 21:15:27.293949 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:27.293664    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 21:15:27.293949 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:27.293729    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c86f2249-21df-498b-afa2-ff795d234e97-metrics-tls podName:c86f2249-21df-498b-afa2-ff795d234e97 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:35.29371401 +0000 UTC m=+51.738305720 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c86f2249-21df-498b-afa2-ff795d234e97-metrics-tls") pod "dns-default-k5vbz" (UID: "c86f2249-21df-498b-afa2-ff795d234e97") : secret "dns-default-metrics-tls" not found
Jul 24 21:15:35.346518 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:35.346482    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c86f2249-21df-498b-afa2-ff795d234e97-metrics-tls\") pod \"dns-default-k5vbz\" (UID: \"c86f2249-21df-498b-afa2-ff795d234e97\") " pod="openshift-dns/dns-default-k5vbz"
Jul 24 21:15:35.346969 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:35.346615    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 21:15:35.346969 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:35.346669    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c86f2249-21df-498b-afa2-ff795d234e97-metrics-tls podName:c86f2249-21df-498b-afa2-ff795d234e97 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:51.346654962 +0000 UTC m=+67.791246669 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c86f2249-21df-498b-afa2-ff795d234e97-metrics-tls") pod "dns-default-k5vbz" (UID: "c86f2249-21df-498b-afa2-ff795d234e97") : secret "dns-default-metrics-tls" not found
Jul 24 21:15:45.156549 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:45.156522    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z4l6m"
Jul 24 21:15:46.891823 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:46.891790    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-f4gmz"]
Jul 24 21:15:46.894858 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:46.894843    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-f4gmz"
Jul 24 21:15:46.897292 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:46.897273    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 24 21:15:46.897410 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:46.897296    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 24 21:15:46.897410 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:46.897308    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-lnsrb\""
Jul 24 21:15:46.905338 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:46.905319    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-f4gmz"]
Jul 24 21:15:46.927854 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:46.927832    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7dbf35e8-d81a-439f-99b3-6bca86301cd9-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-f4gmz\" (UID: \"7dbf35e8-d81a-439f-99b3-6bca86301cd9\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-f4gmz"
Jul 24 21:15:46.927940 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:46.927871    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7dbf35e8-d81a-439f-99b3-6bca86301cd9-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-f4gmz\" (UID: \"7dbf35e8-d81a-439f-99b3-6bca86301cd9\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-f4gmz"
Jul 24 21:15:47.003541 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.003519    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-9p7nm"]
Jul 24 21:15:47.005357 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.005343    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-9p7nm"
Jul 24 21:15:47.008670 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.008649    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 24 21:15:47.008996 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.008980    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-2v5mr\""
Jul 24 21:15:47.008996 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.008992    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 24 21:15:47.009259 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.009239    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 24 21:15:47.009390 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.009374    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 24 21:15:47.019067 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.019050    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qcxgx"]
Jul 24 21:15:47.020925 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.020907    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qcxgx"
Jul 24 21:15:47.022909 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.022890    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 24 21:15:47.026029 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.026008    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 24 21:15:47.026159 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.026057    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 24 21:15:47.026159 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.026069    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 24 21:15:47.027217 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.027201    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-9p7nm"]
Jul 24 21:15:47.028435 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.028415    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7dbf35e8-d81a-439f-99b3-6bca86301cd9-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-f4gmz\" (UID: \"7dbf35e8-d81a-439f-99b3-6bca86301cd9\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-f4gmz"
Jul 24 21:15:47.028507 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.028447    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2353455-ff61-45d7-8f21-e18e09680380-tmp\") pod \"insights-operator-5885fdb759-9p7nm\" (UID: \"c2353455-ff61-45d7-8f21-e18e09680380\") " pod="openshift-insights/insights-operator-5885fdb759-9p7nm"
Jul 24 21:15:47.028507 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.028490    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2353455-ff61-45d7-8f21-e18e09680380-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-9p7nm\" (UID: \"c2353455-ff61-45d7-8f21-e18e09680380\") " pod="openshift-insights/insights-operator-5885fdb759-9p7nm"
Jul 24 21:15:47.028601 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.028506    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c2353455-ff61-45d7-8f21-e18e09680380-serving-cert\") pod \"insights-operator-5885fdb759-9p7nm\" (UID: \"c2353455-ff61-45d7-8f21-e18e09680380\") " pod="openshift-insights/insights-operator-5885fdb759-9p7nm"
Jul 24 21:15:47.028601 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.028526    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7dbf35e8-d81a-439f-99b3-6bca86301cd9-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-f4gmz\" (UID: \"7dbf35e8-d81a-439f-99b3-6bca86301cd9\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-f4gmz"
Jul 24 21:15:47.028601 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.028541    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c2353455-ff61-45d7-8f21-e18e09680380-snapshots\") pod \"insights-operator-5885fdb759-9p7nm\" (UID: \"c2353455-ff61-45d7-8f21-e18e09680380\") " pod="openshift-insights/insights-operator-5885fdb759-9p7nm"
Jul 24 21:15:47.028601 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:47.028549    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 21:15:47.028601 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.028567    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2353455-ff61-45d7-8f21-e18e09680380-service-ca-bundle\") pod \"insights-operator-5885fdb759-9p7nm\" (UID: \"c2353455-ff61-45d7-8f21-e18e09680380\") " pod="openshift-insights/insights-operator-5885fdb759-9p7nm"
Jul 24 21:15:47.028829 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:47.028614    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dbf35e8-d81a-439f-99b3-6bca86301cd9-networking-console-plugin-cert podName:7dbf35e8-d81a-439f-99b3-6bca86301cd9 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:47.528595356 +0000 UTC m=+63.973187064 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7dbf35e8-d81a-439f-99b3-6bca86301cd9-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-f4gmz" (UID: "7dbf35e8-d81a-439f-99b3-6bca86301cd9") : secret "networking-console-plugin-cert" not found
Jul 24 21:15:47.028829 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.028687    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhqrx\" (UniqueName: \"kubernetes.io/projected/c2353455-ff61-45d7-8f21-e18e09680380-kube-api-access-lhqrx\") pod \"insights-operator-5885fdb759-9p7nm\" (UID: \"c2353455-ff61-45d7-8f21-e18e09680380\") " pod="openshift-insights/insights-operator-5885fdb759-9p7nm"
Jul 24 21:15:47.029126 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.029097    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-fznkf\""
Jul 24 21:15:47.029206 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.029124    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7dbf35e8-d81a-439f-99b3-6bca86301cd9-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-f4gmz\" (UID: \"7dbf35e8-d81a-439f-99b3-6bca86301cd9\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-f4gmz"
Jul 24 21:15:47.033122 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.033103    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 24 21:15:47.033993 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.033976    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qcxgx"]
Jul 24 21:15:47.104910 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.104878    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-pl9b8"]
Jul 24 21:15:47.107286 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.107253    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-pl9b8"
Jul 24 21:15:47.108270 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.108248    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-nsjrg"]
Jul 24 21:15:47.109774 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.109755    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 24 21:15:47.109774 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.109765    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-m78bb\""
Jul 24 21:15:47.109907 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.109889    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 24 21:15:47.110107 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.110090    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 24 21:15:47.110294 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.110277    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-nsjrg"
Jul 24 21:15:47.112926 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.112907    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 24 21:15:47.113017 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.112941    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 24 21:15:47.113017 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.112950    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 24 21:15:47.115699 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.115683    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 24 21:15:47.115788 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.115685    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-5r2jz\""
Jul 24 21:15:47.120506 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.120484    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 24 21:15:47.121010 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.120989    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-pl9b8"]
Jul 24 21:15:47.124098 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.124074    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-nsjrg"]
Jul 24 21:15:47.129552 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.129531    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2353455-ff61-45d7-8f21-e18e09680380-tmp\") pod \"insights-operator-5885fdb759-9p7nm\" (UID: \"c2353455-ff61-45d7-8f21-e18e09680380\") " pod="openshift-insights/insights-operator-5885fdb759-9p7nm"
Jul 24 21:15:47.129655 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.129567    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0a7bfbf1-0e0b-485b-a9bd-8434ae053d3f-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-qcxgx\" (UID: \"0a7bfbf1-0e0b-485b-a9bd-8434ae053d3f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qcxgx"
Jul 24 21:15:47.129655 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.129594    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/87f18cf4-62ce-48a0-99b0-fe22bc19f701-serving-cert\") pod \"console-operator-584dcb6b54-nsjrg\" (UID: \"87f18cf4-62ce-48a0-99b0-fe22bc19f701\") " pod="openshift-console-operator/console-operator-584dcb6b54-nsjrg"
Jul 24 21:15:47.129655 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.129608    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/87f18cf4-62ce-48a0-99b0-fe22bc19f701-trusted-ca\") pod \"console-operator-584dcb6b54-nsjrg\" (UID: \"87f18cf4-62ce-48a0-99b0-fe22bc19f701\") " pod="openshift-console-operator/console-operator-584dcb6b54-nsjrg"
Jul 24 21:15:47.129655 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.129623    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/294caa54-48f2-4b87-aef7-2eda691fd0e3-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-pl9b8\" (UID: \"294caa54-48f2-4b87-aef7-2eda691fd0e3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-pl9b8"
Jul 24 21:15:47.129655 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.129644    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2353455-ff61-45d7-8f21-e18e09680380-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-9p7nm\" (UID: \"c2353455-ff61-45d7-8f21-e18e09680380\") " pod="openshift-insights/insights-operator-5885fdb759-9p7nm"
Jul 24 21:15:47.129655 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.129659    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c2353455-ff61-45d7-8f21-e18e09680380-serving-cert\") pod \"insights-operator-5885fdb759-9p7nm\" (UID: \"c2353455-ff61-45d7-8f21-e18e09680380\") " pod="openshift-insights/insights-operator-5885fdb759-9p7nm"
Jul 24 21:15:47.129962 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.129673    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0a7bfbf1-0e0b-485b-a9bd-8434ae053d3f-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-qcxgx\" (UID: \"0a7bfbf1-0e0b-485b-a9bd-8434ae053d3f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qcxgx"
Jul 24 21:15:47.129962 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.129693    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c2353455-ff61-45d7-8f21-e18e09680380-snapshots\") pod \"insights-operator-5885fdb759-9p7nm\" (UID: \"c2353455-ff61-45d7-8f21-e18e09680380\") " pod="openshift-insights/insights-operator-5885fdb759-9p7nm"
Jul 24 21:15:47.129962 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.129716    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2353455-ff61-45d7-8f21-e18e09680380-service-ca-bundle\") pod \"insights-operator-5885fdb759-9p7nm\" (UID: \"c2353455-ff61-45d7-8f21-e18e09680380\") " pod="openshift-insights/insights-operator-5885fdb759-9p7nm"
Jul 24 21:15:47.129962 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.129738    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/87f18cf4-62ce-48a0-99b0-fe22bc19f701-config\") pod \"console-operator-584dcb6b54-nsjrg\" (UID: \"87f18cf4-62ce-48a0-99b0-fe22bc19f701\") " pod="openshift-console-operator/console-operator-584dcb6b54-nsjrg"
Jul 24 21:15:47.129962 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.129751    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5s5v\" (UniqueName: \"kubernetes.io/projected/294caa54-48f2-4b87-aef7-2eda691fd0e3-kube-api-access-q5s5v\") pod \"cluster-samples-operator-6748489656-pl9b8\" (UID: \"294caa54-48f2-4b87-aef7-2eda691fd0e3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-pl9b8"
Jul 24 21:15:47.129962 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.129784    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhqrx\" (UniqueName: \"kubernetes.io/projected/c2353455-ff61-45d7-8f21-e18e09680380-kube-api-access-lhqrx\") pod \"insights-operator-5885fdb759-9p7nm\" (UID: \"c2353455-ff61-45d7-8f21-e18e09680380\") " pod="openshift-insights/insights-operator-5885fdb759-9p7nm"
Jul 24 21:15:47.129962 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.129807    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85flr\" (UniqueName: \"kubernetes.io/projected/0a7bfbf1-0e0b-485b-a9bd-8434ae053d3f-kube-api-access-85flr\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-qcxgx\" (UID: \"0a7bfbf1-0e0b-485b-a9bd-8434ae053d3f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qcxgx"
Jul 24 21:15:47.129962 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.129921    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45w8w\" (UniqueName: \"kubernetes.io/projected/87f18cf4-62ce-48a0-99b0-fe22bc19f701-kube-api-access-45w8w\") pod \"console-operator-584dcb6b54-nsjrg\" (UID: \"87f18cf4-62ce-48a0-99b0-fe22bc19f701\") " pod="openshift-console-operator/console-operator-584dcb6b54-nsjrg"
Jul 24 21:15:47.129962 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.129949    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2353455-ff61-45d7-8f21-e18e09680380-tmp\") pod \"insights-operator-5885fdb759-9p7nm\" (UID: \"c2353455-ff61-45d7-8f21-e18e09680380\") " pod="openshift-insights/insights-operator-5885fdb759-9p7nm"
Jul 24 21:15:47.130279 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.130218    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2353455-ff61-45d7-8f21-e18e09680380-service-ca-bundle\") pod \"insights-operator-5885fdb759-9p7nm\" (UID: \"c2353455-ff61-45d7-8f21-e18e09680380\") " pod="openshift-insights/insights-operator-5885fdb759-9p7nm"
Jul 24 21:15:47.130279 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.130263    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c2353455-ff61-45d7-8f21-e18e09680380-snapshots\") pod \"insights-operator-5885fdb759-9p7nm\" (UID: \"c2353455-ff61-45d7-8f21-e18e09680380\") " pod="openshift-insights/insights-operator-5885fdb759-9p7nm"
Jul 24 21:15:47.130502 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.130486    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2353455-ff61-45d7-8f21-e18e09680380-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-9p7nm\" (UID: \"c2353455-ff61-45d7-8f21-e18e09680380\") " pod="openshift-insights/insights-operator-5885fdb759-9p7nm"
Jul 24 21:15:47.133855 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.133836    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c2353455-ff61-45d7-8f21-e18e09680380-serving-cert\") pod \"insights-operator-5885fdb759-9p7nm\" (UID: \"c2353455-ff61-45d7-8f21-e18e09680380\") " pod="openshift-insights/insights-operator-5885fdb759-9p7nm"
Jul 24 21:15:47.139889 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.139872    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhqrx\" (UniqueName: \"kubernetes.io/projected/c2353455-ff61-45d7-8f21-e18e09680380-kube-api-access-lhqrx\") pod \"insights-operator-5885fdb759-9p7nm\" (UID: \"c2353455-ff61-45d7-8f21-e18e09680380\") " pod="openshift-insights/insights-operator-5885fdb759-9p7nm"
Jul 24 21:15:47.211036 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.210979    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-x5hfl"]
Jul 24 21:15:47.214088 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.214069    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-66f5b57d85-n8d77"]
Jul 24 21:15:47.214250 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.214219    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-x5hfl"
Jul 24 21:15:47.216419 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.216402    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66f5b57d85-n8d77"
Jul 24 21:15:47.217037 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.217022    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-7t9hd\""
Jul 24 21:15:47.217198 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.217182    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 24 21:15:47.218567 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.218553    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 24 21:15:47.219514 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.219492    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 24 21:15:47.219613 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.219557    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rzr52\""
Jul 24 21:15:47.219613 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.219557    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 24 21:15:47.219613 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.219605    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 24 21:15:47.225617 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.225555    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-x5hfl"]
Jul 24 21:15:47.226580 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.226558    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 24 21:15:47.230444 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.230425    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45w8w\" (UniqueName: \"kubernetes.io/projected/87f18cf4-62ce-48a0-99b0-fe22bc19f701-kube-api-access-45w8w\") pod \"console-operator-584dcb6b54-nsjrg\" (UID: \"87f18cf4-62ce-48a0-99b0-fe22bc19f701\") " pod="openshift-console-operator/console-operator-584dcb6b54-nsjrg"
Jul 24 21:15:47.230543 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.230453    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85flr\" (UniqueName: \"kubernetes.io/projected/0a7bfbf1-0e0b-485b-a9bd-8434ae053d3f-kube-api-access-85flr\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-qcxgx\" (UID: \"0a7bfbf1-0e0b-485b-a9bd-8434ae053d3f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qcxgx"
Jul 24 21:15:47.230543 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.230475    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/18a9c709-feb0-4dac-800a-ddeed3529d68-trusted-ca\") pod \"image-registry-66f5b57d85-n8d77\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") " pod="openshift-image-registry/image-registry-66f5b57d85-n8d77"
Jul 24 21:15:47.230543 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.230491    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/87f18cf4-62ce-48a0-99b0-fe22bc19f701-serving-cert\") pod \"console-operator-584dcb6b54-nsjrg\" (UID: \"87f18cf4-62ce-48a0-99b0-fe22bc19f701\") " pod="openshift-console-operator/console-operator-584dcb6b54-nsjrg"
Jul 24 21:15:47.230703 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.230576    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/18a9c709-feb0-4dac-800a-ddeed3529d68-image-registry-private-configuration\") pod \"image-registry-66f5b57d85-n8d77\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") " pod="openshift-image-registry/image-registry-66f5b57d85-n8d77"
Jul 24 21:15:47.230703 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.230639    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/87f18cf4-62ce-48a0-99b0-fe22bc19f701-config\") pod \"console-operator-584dcb6b54-nsjrg\" (UID: \"87f18cf4-62ce-48a0-99b0-fe22bc19f701\") " pod="openshift-console-operator/console-operator-584dcb6b54-nsjrg"
Jul 24 21:15:47.230703 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.230668    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5s5v\" (UniqueName: \"kubernetes.io/projected/294caa54-48f2-4b87-aef7-2eda691fd0e3-kube-api-access-q5s5v\") pod \"cluster-samples-operator-6748489656-pl9b8\" (UID: \"294caa54-48f2-4b87-aef7-2eda691fd0e3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-pl9b8"
Jul 24 21:15:47.230703 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.230698    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/18a9c709-feb0-4dac-800a-ddeed3529d68-registry-tls\") pod \"image-registry-66f5b57d85-n8d77\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") " pod="openshift-image-registry/image-registry-66f5b57d85-n8d77"
Jul 24 21:15:47.230859 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.230721    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/18a9c709-feb0-4dac-800a-ddeed3529d68-registry-certificates\") pod \"image-registry-66f5b57d85-n8d77\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") " pod="openshift-image-registry/image-registry-66f5b57d85-n8d77"
Jul 24 21:15:47.230859 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.230752    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/18a9c709-feb0-4dac-800a-ddeed3529d68-bound-sa-token\") pod \"image-registry-66f5b57d85-n8d77\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") " pod="openshift-image-registry/image-registry-66f5b57d85-n8d77"
Jul 24 21:15:47.230859 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.230844    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbnzl\" (UniqueName: \"kubernetes.io/projected/18a9c709-feb0-4dac-800a-ddeed3529d68-kube-api-access-tbnzl\") pod \"image-registry-66f5b57d85-n8d77\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") " pod="openshift-image-registry/image-registry-66f5b57d85-n8d77"
Jul 24 21:15:47.230998 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.230926    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0a7bfbf1-0e0b-485b-a9bd-8434ae053d3f-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-qcxgx\" (UID: \"0a7bfbf1-0e0b-485b-a9bd-8434ae053d3f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qcxgx"
Jul 24 21:15:47.230998 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.230967    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/294caa54-48f2-4b87-aef7-2eda691fd0e3-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-pl9b8\" (UID: \"294caa54-48f2-4b87-aef7-2eda691fd0e3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-pl9b8"
Jul 24 21:15:47.231101 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.231000    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/18a9c709-feb0-4dac-800a-ddeed3529d68-installation-pull-secrets\") pod \"image-registry-66f5b57d85-n8d77\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") " pod="openshift-image-registry/image-registry-66f5b57d85-n8d77"
Jul 24 21:15:47.231101 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.231033    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/87f18cf4-62ce-48a0-99b0-fe22bc19f701-trusted-ca\") pod \"console-operator-584dcb6b54-nsjrg\" (UID: \"87f18cf4-62ce-48a0-99b0-fe22bc19f701\") " pod="openshift-console-operator/console-operator-584dcb6b54-nsjrg"
Jul 24 21:15:47.231101 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.231082    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0a7bfbf1-0e0b-485b-a9bd-8434ae053d3f-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-qcxgx\" (UID: \"0a7bfbf1-0e0b-485b-a9bd-8434ae053d3f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qcxgx"
Jul 24 21:15:47.231264 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.231115    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/18a9c709-feb0-4dac-800a-ddeed3529d68-ca-trust-extracted\") pod \"image-registry-66f5b57d85-n8d77\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") " pod="openshift-image-registry/image-registry-66f5b57d85-n8d77"
Jul 24 21:15:47.231264 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.231141    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr2h2\" (UniqueName: \"kubernetes.io/projected/e9728021-57be-4ee8-80a6-cfb8f2ec27aa-kube-api-access-nr2h2\") pod \"volume-data-source-validator-549c6d54cf-x5hfl\" (UID: \"e9728021-57be-4ee8-80a6-cfb8f2ec27aa\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-x5hfl"
Jul 24 21:15:47.231264 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:47.231083    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 21:15:47.231264 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:47.231247    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/294caa54-48f2-4b87-aef7-2eda691fd0e3-samples-operator-tls podName:294caa54-48f2-4b87-aef7-2eda691fd0e3 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:47.731204014 +0000 UTC m=+64.175795727 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/294caa54-48f2-4b87-aef7-2eda691fd0e3-samples-operator-tls") pod "cluster-samples-operator-6748489656-pl9b8" (UID: "294caa54-48f2-4b87-aef7-2eda691fd0e3") : secret "samples-operator-tls" not found
Jul 24 21:15:47.231464 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.231441    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/87f18cf4-62ce-48a0-99b0-fe22bc19f701-config\") pod \"console-operator-584dcb6b54-nsjrg\" (UID: \"87f18cf4-62ce-48a0-99b0-fe22bc19f701\") " pod="openshift-console-operator/console-operator-584dcb6b54-nsjrg"
Jul 24 21:15:47.231761 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.231738    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0a7bfbf1-0e0b-485b-a9bd-8434ae053d3f-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-qcxgx\" (UID: \"0a7bfbf1-0e0b-485b-a9bd-8434ae053d3f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qcxgx"
Jul 24 21:15:47.231978 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.231958    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/87f18cf4-62ce-48a0-99b0-fe22bc19f701-trusted-ca\") pod \"console-operator-584dcb6b54-nsjrg\" (UID: \"87f18cf4-62ce-48a0-99b0-fe22bc19f701\") " pod="openshift-console-operator/console-operator-584dcb6b54-nsjrg"
Jul 24 21:15:47.232988 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.232969    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/87f18cf4-62ce-48a0-99b0-fe22bc19f701-serving-cert\") pod \"console-operator-584dcb6b54-nsjrg\" (UID: \"87f18cf4-62ce-48a0-99b0-fe22bc19f701\") " pod="openshift-console-operator/console-operator-584dcb6b54-nsjrg"
Jul 24 21:15:47.233458 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.233439    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0a7bfbf1-0e0b-485b-a9bd-8434ae053d3f-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-qcxgx\" (UID: \"0a7bfbf1-0e0b-485b-a9bd-8434ae053d3f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qcxgx"
Jul 24 21:15:47.236988 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.236966    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66f5b57d85-n8d77"]
Jul 24 21:15:47.252433 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.252413    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5s5v\" (UniqueName: \"kubernetes.io/projected/294caa54-48f2-4b87-aef7-2eda691fd0e3-kube-api-access-q5s5v\") pod \"cluster-samples-operator-6748489656-pl9b8\" (UID: \"294caa54-48f2-4b87-aef7-2eda691fd0e3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-pl9b8"
Jul 24 21:15:47.252663 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.252645    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45w8w\" (UniqueName: \"kubernetes.io/projected/87f18cf4-62ce-48a0-99b0-fe22bc19f701-kube-api-access-45w8w\") pod \"console-operator-584dcb6b54-nsjrg\" (UID: \"87f18cf4-62ce-48a0-99b0-fe22bc19f701\") " pod="openshift-console-operator/console-operator-584dcb6b54-nsjrg"
Jul 24 21:15:47.252761 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.252744    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85flr\" (UniqueName: \"kubernetes.io/projected/0a7bfbf1-0e0b-485b-a9bd-8434ae053d3f-kube-api-access-85flr\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-qcxgx\" (UID: \"0a7bfbf1-0e0b-485b-a9bd-8434ae053d3f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qcxgx"
Jul 24 21:15:47.314462 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.314430    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-9p7nm"
Jul 24 21:15:47.329011 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.328992    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qcxgx"
Jul 24 21:15:47.331482 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.331465    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr2h2\" (UniqueName: \"kubernetes.io/projected/e9728021-57be-4ee8-80a6-cfb8f2ec27aa-kube-api-access-nr2h2\") pod \"volume-data-source-validator-549c6d54cf-x5hfl\" (UID: \"e9728021-57be-4ee8-80a6-cfb8f2ec27aa\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-x5hfl"
Jul 24 21:15:47.331569 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.331522    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/18a9c709-feb0-4dac-800a-ddeed3529d68-trusted-ca\") pod \"image-registry-66f5b57d85-n8d77\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") " pod="openshift-image-registry/image-registry-66f5b57d85-n8d77"
Jul 24 21:15:47.331625 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.331574    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/18a9c709-feb0-4dac-800a-ddeed3529d68-image-registry-private-configuration\") pod \"image-registry-66f5b57d85-n8d77\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") " pod="openshift-image-registry/image-registry-66f5b57d85-n8d77"
Jul 24 21:15:47.332047 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.332019    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/18a9c709-feb0-4dac-800a-ddeed3529d68-registry-tls\") pod \"image-registry-66f5b57d85-n8d77\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") " pod="openshift-image-registry/image-registry-66f5b57d85-n8d77"
Jul 24 21:15:47.332244 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.332208    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/18a9c709-feb0-4dac-800a-ddeed3529d68-registry-certificates\") pod \"image-registry-66f5b57d85-n8d77\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") " pod="openshift-image-registry/image-registry-66f5b57d85-n8d77"
Jul 24 21:15:47.332344 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:47.332273    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 21:15:47.332436 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:47.332425    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66f5b57d85-n8d77: secret "image-registry-tls" not found
Jul 24 21:15:47.332800 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.332775    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/18a9c709-feb0-4dac-800a-ddeed3529d68-registry-certificates\") pod \"image-registry-66f5b57d85-n8d77\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") " pod="openshift-image-registry/image-registry-66f5b57d85-n8d77"
Jul 24 21:15:47.332932 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:47.332919    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/18a9c709-feb0-4dac-800a-ddeed3529d68-registry-tls podName:18a9c709-feb0-4dac-800a-ddeed3529d68 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:47.832898251 +0000 UTC m=+64.277489959 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/18a9c709-feb0-4dac-800a-ddeed3529d68-registry-tls") pod "image-registry-66f5b57d85-n8d77" (UID: "18a9c709-feb0-4dac-800a-ddeed3529d68") : secret "image-registry-tls" not found
Jul 24 21:15:47.333002 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.332971    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/18a9c709-feb0-4dac-800a-ddeed3529d68-bound-sa-token\") pod \"image-registry-66f5b57d85-n8d77\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") " pod="openshift-image-registry/image-registry-66f5b57d85-n8d77"
Jul 24 21:15:47.333060 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.333023    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbnzl\" (UniqueName: \"kubernetes.io/projected/18a9c709-feb0-4dac-800a-ddeed3529d68-kube-api-access-tbnzl\") pod \"image-registry-66f5b57d85-n8d77\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") " pod="openshift-image-registry/image-registry-66f5b57d85-n8d77"
Jul 24 21:15:47.333115 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.333059    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/18a9c709-feb0-4dac-800a-ddeed3529d68-trusted-ca\") pod \"image-registry-66f5b57d85-n8d77\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") " pod="openshift-image-registry/image-registry-66f5b57d85-n8d77"
Jul 24 21:15:47.333193 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.333176    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/18a9c709-feb0-4dac-800a-ddeed3529d68-installation-pull-secrets\") pod \"image-registry-66f5b57d85-n8d77\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") " pod="openshift-image-registry/image-registry-66f5b57d85-n8d77"
Jul 24 21:15:47.333266 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.333247    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/18a9c709-feb0-4dac-800a-ddeed3529d68-ca-trust-extracted\") pod \"image-registry-66f5b57d85-n8d77\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") " pod="openshift-image-registry/image-registry-66f5b57d85-n8d77"
Jul 24 21:15:47.333725 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.333704    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/18a9c709-feb0-4dac-800a-ddeed3529d68-ca-trust-extracted\") pod \"image-registry-66f5b57d85-n8d77\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") " pod="openshift-image-registry/image-registry-66f5b57d85-n8d77"
Jul 24 21:15:47.338149 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.338123    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/18a9c709-feb0-4dac-800a-ddeed3529d68-image-registry-private-configuration\") pod \"image-registry-66f5b57d85-n8d77\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") " pod="openshift-image-registry/image-registry-66f5b57d85-n8d77"
Jul 24 21:15:47.338677 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.338658    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/18a9c709-feb0-4dac-800a-ddeed3529d68-installation-pull-secrets\") pod \"image-registry-66f5b57d85-n8d77\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") " pod="openshift-image-registry/image-registry-66f5b57d85-n8d77"
Jul 24 21:15:47.339977 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.339959    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr2h2\" (UniqueName: \"kubernetes.io/projected/e9728021-57be-4ee8-80a6-cfb8f2ec27aa-kube-api-access-nr2h2\") pod \"volume-data-source-validator-549c6d54cf-x5hfl\" (UID: \"e9728021-57be-4ee8-80a6-cfb8f2ec27aa\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-x5hfl"
Jul 24 21:15:47.345769 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.345746    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbnzl\" (UniqueName: \"kubernetes.io/projected/18a9c709-feb0-4dac-800a-ddeed3529d68-kube-api-access-tbnzl\") pod \"image-registry-66f5b57d85-n8d77\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") " pod="openshift-image-registry/image-registry-66f5b57d85-n8d77"
Jul 24 21:15:47.346243 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.346191    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/18a9c709-feb0-4dac-800a-ddeed3529d68-bound-sa-token\") pod \"image-registry-66f5b57d85-n8d77\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") " pod="openshift-image-registry/image-registry-66f5b57d85-n8d77"
Jul 24 21:15:47.423713 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.423686    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-nsjrg"
Jul 24 21:15:47.446506 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.446476    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-9p7nm"]
Jul 24 21:15:47.449237 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:15:47.449195    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2353455_ff61_45d7_8f21_e18e09680380.slice/crio-05c905017e386636f9569158c52f92e78334fc299f10e6548c4bdb1acf18916c WatchSource:0}: Error finding container 05c905017e386636f9569158c52f92e78334fc299f10e6548c4bdb1acf18916c: Status 404 returned error can't find the container with id 05c905017e386636f9569158c52f92e78334fc299f10e6548c4bdb1acf18916c
Jul 24 21:15:47.463533 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.462820    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qcxgx"]
Jul 24 21:15:47.467514 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:15:47.467484    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a7bfbf1_0e0b_485b_a9bd_8434ae053d3f.slice/crio-ae7d9c0a7dbac18f1115a85064877d79270ae8ec6ecd56b241da9b74f2d5b7c9 WatchSource:0}: Error finding container ae7d9c0a7dbac18f1115a85064877d79270ae8ec6ecd56b241da9b74f2d5b7c9: Status 404 returned error can't find the container with id ae7d9c0a7dbac18f1115a85064877d79270ae8ec6ecd56b241da9b74f2d5b7c9
Jul 24 21:15:47.524647 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.524614    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-x5hfl"
Jul 24 21:15:47.534828 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.534801    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7dbf35e8-d81a-439f-99b3-6bca86301cd9-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-f4gmz\" (UID: \"7dbf35e8-d81a-439f-99b3-6bca86301cd9\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-f4gmz"
Jul 24 21:15:47.534950 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:47.534933    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 21:15:47.535017 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:47.535008    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dbf35e8-d81a-439f-99b3-6bca86301cd9-networking-console-plugin-cert podName:7dbf35e8-d81a-439f-99b3-6bca86301cd9 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:48.534986964 +0000 UTC m=+64.979578687 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7dbf35e8-d81a-439f-99b3-6bca86301cd9-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-f4gmz" (UID: "7dbf35e8-d81a-439f-99b3-6bca86301cd9") : secret "networking-console-plugin-cert" not found
Jul 24 21:15:47.549687 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.549659    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-nsjrg"]
Jul 24 21:15:47.552304 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:15:47.552280    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87f18cf4_62ce_48a0_99b0_fe22bc19f701.slice/crio-ace622814cb15fbf7599a4ed940437bf9186bc848e6bd46e2b2ae12d5a0d4069 WatchSource:0}: Error finding container ace622814cb15fbf7599a4ed940437bf9186bc848e6bd46e2b2ae12d5a0d4069: Status 404 returned error can't find the container with id ace622814cb15fbf7599a4ed940437bf9186bc848e6bd46e2b2ae12d5a0d4069
Jul 24 21:15:47.647097 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.647069    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-x5hfl"]
Jul 24 21:15:47.650447 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:15:47.650420    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9728021_57be_4ee8_80a6_cfb8f2ec27aa.slice/crio-8e882eb93d35114452d5abe3a5a42e7e9cb3f9bc01bf4118629aca5d1f09ce87 WatchSource:0}: Error finding container 8e882eb93d35114452d5abe3a5a42e7e9cb3f9bc01bf4118629aca5d1f09ce87: Status 404 returned error can't find the container with id 8e882eb93d35114452d5abe3a5a42e7e9cb3f9bc01bf4118629aca5d1f09ce87
Jul 24 21:15:47.736550 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.736487    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/294caa54-48f2-4b87-aef7-2eda691fd0e3-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-pl9b8\" (UID: \"294caa54-48f2-4b87-aef7-2eda691fd0e3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-pl9b8"
Jul 24 21:15:47.736648 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:47.736633    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 21:15:47.736698 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:47.736688    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/294caa54-48f2-4b87-aef7-2eda691fd0e3-samples-operator-tls podName:294caa54-48f2-4b87-aef7-2eda691fd0e3 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:48.736672742 +0000 UTC m=+65.181264449 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/294caa54-48f2-4b87-aef7-2eda691fd0e3-samples-operator-tls") pod "cluster-samples-operator-6748489656-pl9b8" (UID: "294caa54-48f2-4b87-aef7-2eda691fd0e3") : secret "samples-operator-tls" not found
Jul 24 21:15:47.837275 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:47.837243    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/18a9c709-feb0-4dac-800a-ddeed3529d68-registry-tls\") pod \"image-registry-66f5b57d85-n8d77\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") " pod="openshift-image-registry/image-registry-66f5b57d85-n8d77"
Jul 24 21:15:47.837442 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:47.837423    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 21:15:47.837485 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:47.837447    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66f5b57d85-n8d77: secret "image-registry-tls" not found
Jul 24 21:15:47.837528 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:47.837513    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/18a9c709-feb0-4dac-800a-ddeed3529d68-registry-tls podName:18a9c709-feb0-4dac-800a-ddeed3529d68 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:48.837490861 +0000 UTC m=+65.282082584 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/18a9c709-feb0-4dac-800a-ddeed3529d68-registry-tls") pod "image-registry-66f5b57d85-n8d77" (UID: "18a9c709-feb0-4dac-800a-ddeed3529d68") : secret "image-registry-tls" not found
Jul 24 21:15:48.231334 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:48.231294    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-x5hfl" event={"ID":"e9728021-57be-4ee8-80a6-cfb8f2ec27aa","Type":"ContainerStarted","Data":"8e882eb93d35114452d5abe3a5a42e7e9cb3f9bc01bf4118629aca5d1f09ce87"}
Jul 24 21:15:48.234178 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:48.234097    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qcxgx" event={"ID":"0a7bfbf1-0e0b-485b-a9bd-8434ae053d3f","Type":"ContainerStarted","Data":"ae7d9c0a7dbac18f1115a85064877d79270ae8ec6ecd56b241da9b74f2d5b7c9"}
Jul 24 21:15:48.236416 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:48.236336    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-nsjrg" event={"ID":"87f18cf4-62ce-48a0-99b0-fe22bc19f701","Type":"ContainerStarted","Data":"ace622814cb15fbf7599a4ed940437bf9186bc848e6bd46e2b2ae12d5a0d4069"}
Jul 24 21:15:48.239606 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:48.239546    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-9p7nm" event={"ID":"c2353455-ff61-45d7-8f21-e18e09680380","Type":"ContainerStarted","Data":"05c905017e386636f9569158c52f92e78334fc299f10e6548c4bdb1acf18916c"}
Jul 24 21:15:48.544531 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:48.543817    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7dbf35e8-d81a-439f-99b3-6bca86301cd9-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-f4gmz\" (UID: \"7dbf35e8-d81a-439f-99b3-6bca86301cd9\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-f4gmz"
Jul 24 21:15:48.544531 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:48.544055    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 21:15:48.544531 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:48.544129    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dbf35e8-d81a-439f-99b3-6bca86301cd9-networking-console-plugin-cert podName:7dbf35e8-d81a-439f-99b3-6bca86301cd9 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:50.544109172 +0000 UTC m=+66.988700884 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7dbf35e8-d81a-439f-99b3-6bca86301cd9-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-f4gmz" (UID: "7dbf35e8-d81a-439f-99b3-6bca86301cd9") : secret "networking-console-plugin-cert" not found
Jul 24 21:15:48.746171 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:48.746133    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/294caa54-48f2-4b87-aef7-2eda691fd0e3-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-pl9b8\" (UID: \"294caa54-48f2-4b87-aef7-2eda691fd0e3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-pl9b8"
Jul 24 21:15:48.746362 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:48.746322    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 21:15:48.746426 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:48.746401    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/294caa54-48f2-4b87-aef7-2eda691fd0e3-samples-operator-tls podName:294caa54-48f2-4b87-aef7-2eda691fd0e3 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:50.746380909 +0000 UTC m=+67.190972637 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/294caa54-48f2-4b87-aef7-2eda691fd0e3-samples-operator-tls") pod "cluster-samples-operator-6748489656-pl9b8" (UID: "294caa54-48f2-4b87-aef7-2eda691fd0e3") : secret "samples-operator-tls" not found
Jul 24 21:15:48.847187 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:48.847091    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/18a9c709-feb0-4dac-800a-ddeed3529d68-registry-tls\") pod \"image-registry-66f5b57d85-n8d77\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") " pod="openshift-image-registry/image-registry-66f5b57d85-n8d77"
Jul 24 21:15:48.847341 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:48.847259    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 21:15:48.847341 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:48.847276    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66f5b57d85-n8d77: secret "image-registry-tls" not found
Jul 24 21:15:48.847341 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:48.847335    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/18a9c709-feb0-4dac-800a-ddeed3529d68-registry-tls podName:18a9c709-feb0-4dac-800a-ddeed3529d68 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:50.847315284 +0000 UTC m=+67.291907015 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/18a9c709-feb0-4dac-800a-ddeed3529d68-registry-tls") pod "image-registry-66f5b57d85-n8d77" (UID: "18a9c709-feb0-4dac-800a-ddeed3529d68") : secret "image-registry-tls" not found
Jul 24 21:15:49.244929 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:49.244841    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-x5hfl" event={"ID":"e9728021-57be-4ee8-80a6-cfb8f2ec27aa","Type":"ContainerStarted","Data":"ec644b4fcf459ee080b3a6477973eeaa47bdd616a872b7894dec2349030f2735"}
Jul 24 21:15:49.261605 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:49.261546    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-x5hfl" podStartSLOduration=0.94638553 podStartE2EDuration="2.261525399s" totalImagesPullingTime="1.315139869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:15:49.259835952 +0000 UTC m=+65.704427683" watchObservedRunningTime="2026-07-24 21:15:49.261525399 +0000 UTC m=+65.706117130"
Jul 24 21:15:49.756897 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:49.756859    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ff19854-c536-4ba4-b2fc-29a8f87ff1a7-metrics-certs\") pod \"network-metrics-daemon-25fb5\" (UID: \"4ff19854-c536-4ba4-b2fc-29a8f87ff1a7\") " pod="openshift-multus/network-metrics-daemon-25fb5"
Jul 24 21:15:49.757093 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:49.756914    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78033d56-f0fa-4c50-be00-b86a2e8667e6-original-pull-secret\") pod \"global-pull-secret-syncer-zb8df\" (UID: \"78033d56-f0fa-4c50-be00-b86a2e8667e6\") " pod="kube-system/global-pull-secret-syncer-zb8df"
Jul 24 21:15:49.759349 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:49.759321    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 21:15:49.759488 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:49.759416    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 21:15:49.767612 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:49.767581    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 24 21:15:49.767734 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:49.767658    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ff19854-c536-4ba4-b2fc-29a8f87ff1a7-metrics-certs podName:4ff19854-c536-4ba4-b2fc-29a8f87ff1a7 nodeName:}" failed. No retries permitted until 2026-07-24 21:16:53.767636276 +0000 UTC m=+130.212227992 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ff19854-c536-4ba4-b2fc-29a8f87ff1a7-metrics-certs") pod "network-metrics-daemon-25fb5" (UID: "4ff19854-c536-4ba4-b2fc-29a8f87ff1a7") : secret "metrics-daemon-secret" not found
Jul 24 21:15:49.769983 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:49.769962    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78033d56-f0fa-4c50-be00-b86a2e8667e6-original-pull-secret\") pod \"global-pull-secret-syncer-zb8df\" (UID: \"78033d56-f0fa-4c50-be00-b86a2e8667e6\") " pod="kube-system/global-pull-secret-syncer-zb8df"
Jul 24 21:15:49.858138 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:49.858105    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7ccx\" (UniqueName: \"kubernetes.io/projected/35503db5-115c-40a6-a785-ca16352ed1b2-kube-api-access-r7ccx\") pod \"network-check-target-l4zhw\" (UID: \"35503db5-115c-40a6-a785-ca16352ed1b2\") " pod="openshift-network-diagnostics/network-check-target-l4zhw"
Jul 24 21:15:49.860760 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:49.860739    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 21:15:49.871184 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:49.871163    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 21:15:49.882110 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:49.882089    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7ccx\" (UniqueName: \"kubernetes.io/projected/35503db5-115c-40a6-a785-ca16352ed1b2-kube-api-access-r7ccx\") pod \"network-check-target-l4zhw\" (UID: \"35503db5-115c-40a6-a785-ca16352ed1b2\") " pod="openshift-network-diagnostics/network-check-target-l4zhw"
Jul 24 21:15:50.059360 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:50.059273    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zb8df"
Jul 24 21:15:50.075059 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:50.075036    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qnp5w\""
Jul 24 21:15:50.083528 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:50.083496    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4zhw"
Jul 24 21:15:50.563203 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:50.563162    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7dbf35e8-d81a-439f-99b3-6bca86301cd9-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-f4gmz\" (UID: \"7dbf35e8-d81a-439f-99b3-6bca86301cd9\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-f4gmz"
Jul 24 21:15:50.563684 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:50.563363    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 21:15:50.563684 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:50.563447    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dbf35e8-d81a-439f-99b3-6bca86301cd9-networking-console-plugin-cert podName:7dbf35e8-d81a-439f-99b3-6bca86301cd9 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:54.563424638 +0000 UTC m=+71.008016384 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7dbf35e8-d81a-439f-99b3-6bca86301cd9-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-f4gmz" (UID: "7dbf35e8-d81a-439f-99b3-6bca86301cd9") : secret "networking-console-plugin-cert" not found
Jul 24 21:15:50.765302 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:50.765092    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/294caa54-48f2-4b87-aef7-2eda691fd0e3-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-pl9b8\" (UID: \"294caa54-48f2-4b87-aef7-2eda691fd0e3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-pl9b8"
Jul 24 21:15:50.765302 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:50.765219    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 21:15:50.765302 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:50.765282    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/294caa54-48f2-4b87-aef7-2eda691fd0e3-samples-operator-tls podName:294caa54-48f2-4b87-aef7-2eda691fd0e3 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:54.765264016 +0000 UTC m=+71.209855724 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/294caa54-48f2-4b87-aef7-2eda691fd0e3-samples-operator-tls") pod "cluster-samples-operator-6748489656-pl9b8" (UID: "294caa54-48f2-4b87-aef7-2eda691fd0e3") : secret "samples-operator-tls" not found
Jul 24 21:15:50.816038 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:50.815404    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l4zhw"]
Jul 24 21:15:50.821149 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:15:50.821085    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35503db5_115c_40a6_a785_ca16352ed1b2.slice/crio-ee9e563b20f1b24ffc9140f5ac91c50fb3649f6f22a8e0646e1be2201954902b WatchSource:0}: Error finding container ee9e563b20f1b24ffc9140f5ac91c50fb3649f6f22a8e0646e1be2201954902b: Status 404 returned error can't find the container with id ee9e563b20f1b24ffc9140f5ac91c50fb3649f6f22a8e0646e1be2201954902b
Jul 24 21:15:50.834111 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:50.834081    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zb8df"]
Jul 24 21:15:50.839767 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:15:50.839732    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78033d56_f0fa_4c50_be00_b86a2e8667e6.slice/crio-98e6980c777007f4d7854c3f61660f0e389ec408925e9867d601a6a85e609f5c WatchSource:0}: Error finding container 98e6980c777007f4d7854c3f61660f0e389ec408925e9867d601a6a85e609f5c: Status 404 returned error can't find the container with id 98e6980c777007f4d7854c3f61660f0e389ec408925e9867d601a6a85e609f5c
Jul 24 21:15:50.865904 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:50.865874    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/18a9c709-feb0-4dac-800a-ddeed3529d68-registry-tls\") pod \"image-registry-66f5b57d85-n8d77\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") " pod="openshift-image-registry/image-registry-66f5b57d85-n8d77"
Jul 24 21:15:50.866039 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:50.866023    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 21:15:50.866090 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:50.866041    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66f5b57d85-n8d77: secret "image-registry-tls" not found
Jul 24 21:15:50.866090 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:50.866088    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/18a9c709-feb0-4dac-800a-ddeed3529d68-registry-tls podName:18a9c709-feb0-4dac-800a-ddeed3529d68 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:54.866073923 +0000 UTC m=+71.310665631 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/18a9c709-feb0-4dac-800a-ddeed3529d68-registry-tls") pod "image-registry-66f5b57d85-n8d77" (UID: "18a9c709-feb0-4dac-800a-ddeed3529d68") : secret "image-registry-tls" not found
Jul 24 21:15:51.252606 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:51.252522    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l4zhw" event={"ID":"35503db5-115c-40a6-a785-ca16352ed1b2","Type":"ContainerStarted","Data":"ee9e563b20f1b24ffc9140f5ac91c50fb3649f6f22a8e0646e1be2201954902b"}
Jul 24 21:15:51.254812 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:51.254772    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qcxgx" event={"ID":"0a7bfbf1-0e0b-485b-a9bd-8434ae053d3f","Type":"ContainerStarted","Data":"8e1174c520b599753232d1b52aba8477a10cfff1a4d1914fca0bab1ab314e9f7"}
Jul 24 21:15:51.256300 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:51.256253    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zb8df" event={"ID":"78033d56-f0fa-4c50-be00-b86a2e8667e6","Type":"ContainerStarted","Data":"98e6980c777007f4d7854c3f61660f0e389ec408925e9867d601a6a85e609f5c"}
Jul 24 21:15:51.257946 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:51.257915    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nsjrg_87f18cf4-62ce-48a0-99b0-fe22bc19f701/console-operator/0.log"
Jul 24 21:15:51.258049 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:51.257952    2561 generic.go:356] "Generic (PLEG): container finished" podID="87f18cf4-62ce-48a0-99b0-fe22bc19f701" containerID="557d1359647c2f65065588cf42da8c6fac4c2c14296c7af7744482f8b91f41d2" exitCode=255
Jul 24 21:15:51.258049 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:51.258012    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-nsjrg" event={"ID":"87f18cf4-62ce-48a0-99b0-fe22bc19f701","Type":"ContainerDied","Data":"557d1359647c2f65065588cf42da8c6fac4c2c14296c7af7744482f8b91f41d2"}
Jul 24 21:15:51.258380 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:51.258362    2561 scope.go:117] "RemoveContainer" containerID="557d1359647c2f65065588cf42da8c6fac4c2c14296c7af7744482f8b91f41d2"
Jul 24 21:15:51.261024 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:51.260999    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-9p7nm" event={"ID":"c2353455-ff61-45d7-8f21-e18e09680380","Type":"ContainerStarted","Data":"100dc26154550b004bdbc4833a607680c5d74dbd9ae9560d48cad6984115d1f4"}
Jul 24 21:15:51.272325 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:51.272171    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qcxgx" podStartSLOduration=2.076884211 podStartE2EDuration="5.272153109s" totalImagesPullingTime="3.195268898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:15:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:15:51.271533525 +0000 UTC m=+67.716125261" watchObservedRunningTime="2026-07-24 21:15:51.272153109 +0000 UTC m=+67.716744840"
Jul 24 21:15:51.307727 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:51.307621    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-9p7nm" podStartSLOduration=2.08872157 podStartE2EDuration="5.307601003s" totalImagesPullingTime="3.218879433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:15:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:15:51.290959527 +0000 UTC m=+67.735551262" watchObservedRunningTime="2026-07-24 21:15:51.307601003 +0000 UTC m=+67.752192733"
Jul 24 21:15:51.371840 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:51.370738    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c86f2249-21df-498b-afa2-ff795d234e97-metrics-tls\") pod \"dns-default-k5vbz\" (UID: \"c86f2249-21df-498b-afa2-ff795d234e97\") " pod="openshift-dns/dns-default-k5vbz"
Jul 24 21:15:51.371840 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:51.371744    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 21:15:51.371840 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:51.371799    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c86f2249-21df-498b-afa2-ff795d234e97-metrics-tls podName:c86f2249-21df-498b-afa2-ff795d234e97 nodeName:}" failed. No retries permitted until 2026-07-24 21:16:23.371781062 +0000 UTC m=+99.816372774 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c86f2249-21df-498b-afa2-ff795d234e97-metrics-tls") pod "dns-default-k5vbz" (UID: "c86f2249-21df-498b-afa2-ff795d234e97") : secret "dns-default-metrics-tls" not found
Jul 24 21:15:51.985913 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:51.985878    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jrhqv"]
Jul 24 21:15:52.001077 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:52.001035    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jrhqv"
Jul 24 21:15:52.007540 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:52.007085    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-v7v2z\""
Jul 24 21:15:52.007540 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:52.007360    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 24 21:15:52.011513 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:52.010462    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 24 21:15:52.012781 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:52.012712    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jrhqv"]
Jul 24 21:15:52.077954 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:52.077867    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-data-volume\") pod \"insights-runtime-extractor-jrhqv\" (UID: \"f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96\") " pod="openshift-insights/insights-runtime-extractor-jrhqv"
Jul 24 21:15:52.078088 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:52.077961    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jrhqv\" (UID: \"f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96\") " pod="openshift-insights/insights-runtime-extractor-jrhqv"
Jul 24 21:15:52.078088 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:52.078029    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7442d\" (UniqueName: \"kubernetes.io/projected/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-kube-api-access-7442d\") pod \"insights-runtime-extractor-jrhqv\" (UID: \"f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96\") " pod="openshift-insights/insights-runtime-extractor-jrhqv"
Jul 24 21:15:52.078214 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:52.078106    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jrhqv\" (UID: \"f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96\") " pod="openshift-insights/insights-runtime-extractor-jrhqv"
Jul 24 21:15:52.078214 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:52.078138    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-crio-socket\") pod \"insights-runtime-extractor-jrhqv\" (UID: \"f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96\") " pod="openshift-insights/insights-runtime-extractor-jrhqv"
Jul 24 21:15:52.179618 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:52.179585    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-data-volume\") pod \"insights-runtime-extractor-jrhqv\" (UID: \"f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96\") " pod="openshift-insights/insights-runtime-extractor-jrhqv"
Jul 24 21:15:52.179782 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:52.179667    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jrhqv\" (UID: \"f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96\") " pod="openshift-insights/insights-runtime-extractor-jrhqv"
Jul 24 21:15:52.179782 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:52.179724    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7442d\" (UniqueName: \"kubernetes.io/projected/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-kube-api-access-7442d\") pod \"insights-runtime-extractor-jrhqv\" (UID: \"f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96\") " pod="openshift-insights/insights-runtime-extractor-jrhqv"
Jul 24 21:15:52.179782 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:52.179763    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jrhqv\" (UID: \"f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96\") " pod="openshift-insights/insights-runtime-extractor-jrhqv"
Jul 24 21:15:52.179782 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:52.179783    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-crio-socket\") pod \"insights-runtime-extractor-jrhqv\" (UID: \"f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96\") " pod="openshift-insights/insights-runtime-extractor-jrhqv"
Jul 24 21:15:52.180001 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:52.179867    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-crio-socket\") pod \"insights-runtime-extractor-jrhqv\" (UID: \"f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96\") " pod="openshift-insights/insights-runtime-extractor-jrhqv"
Jul 24 21:15:52.180113 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:52.180092    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 21:15:52.180168 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:52.180114    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 21:15:52.180219 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:52.180171    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-insights-runtime-extractor-tls podName:f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:52.680150224 +0000 UTC m=+69.124741947 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jrhqv" (UID: "f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96") : secret "insights-runtime-extractor-tls" not found
Jul 24 21:15:52.180219 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:52.180173    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-data-volume\") pod \"insights-runtime-extractor-jrhqv\" (UID: \"f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96\") " pod="openshift-insights/insights-runtime-extractor-jrhqv"
Jul 24 21:15:52.180219 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:52.180188    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-kube-rbac-proxy-cm podName:f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:52.680178384 +0000 UTC m=+69.124770092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jrhqv" (UID: "f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96") : configmap "kube-rbac-proxy" not found
Jul 24 21:15:52.188436 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:52.188391    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7442d\" (UniqueName: \"kubernetes.io/projected/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-kube-api-access-7442d\") pod \"insights-runtime-extractor-jrhqv\" (UID: \"f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96\") " pod="openshift-insights/insights-runtime-extractor-jrhqv"
Jul 24 21:15:52.267096 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:52.267066    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nsjrg_87f18cf4-62ce-48a0-99b0-fe22bc19f701/console-operator/1.log"
Jul 24 21:15:52.267723 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:52.267703    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nsjrg_87f18cf4-62ce-48a0-99b0-fe22bc19f701/console-operator/0.log"
Jul 24 21:15:52.267841 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:52.267749    2561 generic.go:356] "Generic (PLEG): container finished" podID="87f18cf4-62ce-48a0-99b0-fe22bc19f701" containerID="4261e77367b627cc706edbc14fb1f13aeb8677124f79e4db7e3be99f656cd8bb" exitCode=255
Jul 24 21:15:52.267905 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:52.267845    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-nsjrg" event={"ID":"87f18cf4-62ce-48a0-99b0-fe22bc19f701","Type":"ContainerDied","Data":"4261e77367b627cc706edbc14fb1f13aeb8677124f79e4db7e3be99f656cd8bb"}
Jul 24 21:15:52.267963 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:52.267910    2561 scope.go:117] "RemoveContainer" containerID="557d1359647c2f65065588cf42da8c6fac4c2c14296c7af7744482f8b91f41d2"
Jul 24 21:15:52.268154 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:52.268131    2561 scope.go:117] "RemoveContainer" containerID="4261e77367b627cc706edbc14fb1f13aeb8677124f79e4db7e3be99f656cd8bb"
Jul 24 21:15:52.268369 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:52.268347    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-nsjrg_openshift-console-operator(87f18cf4-62ce-48a0-99b0-fe22bc19f701)\"" pod="openshift-console-operator/console-operator-584dcb6b54-nsjrg" podUID="87f18cf4-62ce-48a0-99b0-fe22bc19f701"
Jul 24 21:15:52.684736 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:52.684702    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jrhqv\" (UID: \"f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96\") " pod="openshift-insights/insights-runtime-extractor-jrhqv"
Jul 24 21:15:52.684988 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:52.684791    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jrhqv\" (UID: \"f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96\") " pod="openshift-insights/insights-runtime-extractor-jrhqv"
Jul 24 21:15:52.684988 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:52.684878    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 21:15:52.684988 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:52.684900    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 21:15:52.684988 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:52.684933    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-kube-rbac-proxy-cm podName:f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:53.684915648 +0000 UTC m=+70.129507357 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jrhqv" (UID: "f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96") : configmap "kube-rbac-proxy" not found
Jul 24 21:15:52.684988 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:52.684966    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-insights-runtime-extractor-tls podName:f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:53.684947528 +0000 UTC m=+70.129539238 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jrhqv" (UID: "f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96") : secret "insights-runtime-extractor-tls" not found
Jul 24 21:15:53.272122 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:53.272085    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nsjrg_87f18cf4-62ce-48a0-99b0-fe22bc19f701/console-operator/1.log"
Jul 24 21:15:53.272639 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:53.272620    2561 scope.go:117] "RemoveContainer" containerID="4261e77367b627cc706edbc14fb1f13aeb8677124f79e4db7e3be99f656cd8bb"
Jul 24 21:15:53.272904 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:53.272855    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-nsjrg_openshift-console-operator(87f18cf4-62ce-48a0-99b0-fe22bc19f701)\"" pod="openshift-console-operator/console-operator-584dcb6b54-nsjrg" podUID="87f18cf4-62ce-48a0-99b0-fe22bc19f701"
Jul 24 21:15:53.693423 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:53.693333    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jrhqv\" (UID: \"f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96\") " pod="openshift-insights/insights-runtime-extractor-jrhqv"
Jul 24 21:15:53.693594 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:53.693426    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jrhqv\" (UID: \"f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96\") " pod="openshift-insights/insights-runtime-extractor-jrhqv"
Jul 24 21:15:53.693594 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:53.693503    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 21:15:53.693594 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:53.693545    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 21:15:53.693594 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:53.693591    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-insights-runtime-extractor-tls podName:f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:55.69356951 +0000 UTC m=+72.138161232 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jrhqv" (UID: "f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96") : secret "insights-runtime-extractor-tls" not found
Jul 24 21:15:53.693753 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:53.693612    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-kube-rbac-proxy-cm podName:f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:55.693602447 +0000 UTC m=+72.138194157 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jrhqv" (UID: "f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96") : configmap "kube-rbac-proxy" not found
Jul 24 21:15:53.775261 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:53.775215    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5jw4h_115c393f-0d8f-4d21-8247-546a7f0bef21/dns-node-resolver/0.log"
Jul 24 21:15:54.601051 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:54.601008    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7dbf35e8-d81a-439f-99b3-6bca86301cd9-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-f4gmz\" (UID: \"7dbf35e8-d81a-439f-99b3-6bca86301cd9\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-f4gmz"
Jul 24 21:15:54.601515 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:54.601187    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 21:15:54.601515 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:54.601261    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dbf35e8-d81a-439f-99b3-6bca86301cd9-networking-console-plugin-cert podName:7dbf35e8-d81a-439f-99b3-6bca86301cd9 nodeName:}" failed. No retries permitted until 2026-07-24 21:16:02.601244325 +0000 UTC m=+79.045836053 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7dbf35e8-d81a-439f-99b3-6bca86301cd9-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-f4gmz" (UID: "7dbf35e8-d81a-439f-99b3-6bca86301cd9") : secret "networking-console-plugin-cert" not found
Jul 24 21:15:54.802958 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:54.802906    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/294caa54-48f2-4b87-aef7-2eda691fd0e3-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-pl9b8\" (UID: \"294caa54-48f2-4b87-aef7-2eda691fd0e3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-pl9b8"
Jul 24 21:15:54.803113 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:54.803092    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 21:15:54.803188 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:54.803176    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/294caa54-48f2-4b87-aef7-2eda691fd0e3-samples-operator-tls podName:294caa54-48f2-4b87-aef7-2eda691fd0e3 nodeName:}" failed. No retries permitted until 2026-07-24 21:16:02.803153791 +0000 UTC m=+79.247745503 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/294caa54-48f2-4b87-aef7-2eda691fd0e3-samples-operator-tls") pod "cluster-samples-operator-6748489656-pl9b8" (UID: "294caa54-48f2-4b87-aef7-2eda691fd0e3") : secret "samples-operator-tls" not found
Jul 24 21:15:54.904363 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:54.904277    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/18a9c709-feb0-4dac-800a-ddeed3529d68-registry-tls\") pod \"image-registry-66f5b57d85-n8d77\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") " pod="openshift-image-registry/image-registry-66f5b57d85-n8d77"
Jul 24 21:15:54.904517 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:54.904448    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 21:15:54.904517 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:54.904467    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66f5b57d85-n8d77: secret "image-registry-tls" not found
Jul 24 21:15:54.904588 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:54.904522    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/18a9c709-feb0-4dac-800a-ddeed3529d68-registry-tls podName:18a9c709-feb0-4dac-800a-ddeed3529d68 nodeName:}" failed. No retries permitted until 2026-07-24 21:16:02.904505744 +0000 UTC m=+79.349097452 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/18a9c709-feb0-4dac-800a-ddeed3529d68-registry-tls") pod "image-registry-66f5b57d85-n8d77" (UID: "18a9c709-feb0-4dac-800a-ddeed3529d68") : secret "image-registry-tls" not found
Jul 24 21:15:54.971636 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:54.971609    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jnddc_53ed5a58-5ef1-4847-9a34-a06435831d4a/node-ca/0.log"
Jul 24 21:15:55.712824 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:55.712790    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jrhqv\" (UID: \"f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96\") " pod="openshift-insights/insights-runtime-extractor-jrhqv"
Jul 24 21:15:55.713191 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:55.712886    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jrhqv\" (UID: \"f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96\") " pod="openshift-insights/insights-runtime-extractor-jrhqv"
Jul 24 21:15:55.713191 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:55.712950    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 21:15:55.713191 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:55.712970    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 21:15:55.713191 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:55.713020    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-insights-runtime-extractor-tls podName:f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:59.713000115 +0000 UTC m=+76.157591837 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jrhqv" (UID: "f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96") : secret "insights-runtime-extractor-tls" not found
Jul 24 21:15:55.713191 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:55.713036    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-kube-rbac-proxy-cm podName:f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:59.713028096 +0000 UTC m=+76.157619804 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jrhqv" (UID: "f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96") : configmap "kube-rbac-proxy" not found
Jul 24 21:15:55.973636 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:55.973603    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vc495_51dfbcfc-876c-4227-bb8c-15ec65b23e56/serve-healthcheck-canary/0.log"
Jul 24 21:15:56.281742 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:56.281706    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zb8df" event={"ID":"78033d56-f0fa-4c50-be00-b86a2e8667e6","Type":"ContainerStarted","Data":"4cc03c7a4afeb4876706173f25fb9891c5bde0284f68f5c106ce61832085ebd5"}
Jul 24 21:15:56.283141 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:56.283118    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l4zhw" event={"ID":"35503db5-115c-40a6-a785-ca16352ed1b2","Type":"ContainerStarted","Data":"23629614baf0028c1ab99dc56ab3d608746252527464ae925659c832e814f7c1"}
Jul 24 21:15:56.283275 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:56.283183    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-l4zhw"
Jul 24 21:15:56.321657 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:56.321616    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-l4zhw" podStartSLOduration=67.678339209 podStartE2EDuration="1m12.321604155s" totalImagesPullingTime="4.643264946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:14:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:15:56.320767677 +0000 UTC m=+72.765359407" watchObservedRunningTime="2026-07-24 21:15:56.321604155 +0000 UTC m=+72.766195884"
Jul 24 21:15:56.321806 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:56.321789    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zb8df" podStartSLOduration=67.693395867 podStartE2EDuration="1m12.321783045s" totalImagesPullingTime="4.628387178s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 21:14:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:15:56.302204136 +0000 UTC m=+72.746795866" watchObservedRunningTime="2026-07-24 21:15:56.321783045 +0000 UTC m=+72.766374779"
Jul 24 21:15:57.424281 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:57.424236    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-nsjrg"
Jul 24 21:15:57.424681 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:57.424302    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-nsjrg"
Jul 24 21:15:57.424681 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:57.424588    2561 scope.go:117] "RemoveContainer" containerID="4261e77367b627cc706edbc14fb1f13aeb8677124f79e4db7e3be99f656cd8bb"
Jul 24 21:15:57.424778 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:57.424727    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-nsjrg_openshift-console-operator(87f18cf4-62ce-48a0-99b0-fe22bc19f701)\"" pod="openshift-console-operator/console-operator-584dcb6b54-nsjrg" podUID="87f18cf4-62ce-48a0-99b0-fe22bc19f701"
Jul 24 21:15:59.743365 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:59.743331    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jrhqv\" (UID: \"f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96\") " pod="openshift-insights/insights-runtime-extractor-jrhqv"
Jul 24 21:15:59.743769 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:15:59.743400    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jrhqv\" (UID: \"f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96\") " pod="openshift-insights/insights-runtime-extractor-jrhqv"
Jul 24 21:15:59.743769 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:59.743454    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 21:15:59.743769 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:59.743488    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 21:15:59.743769 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:59.743530    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-kube-rbac-proxy-cm podName:f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96 nodeName:}" failed. No retries permitted until 2026-07-24 21:16:07.743511396 +0000 UTC m=+84.188103104 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jrhqv" (UID: "f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96") : configmap "kube-rbac-proxy" not found
Jul 24 21:15:59.743769 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:15:59.743546    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-insights-runtime-extractor-tls podName:f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96 nodeName:}" failed. No retries permitted until 2026-07-24 21:16:07.743539573 +0000 UTC m=+84.188131280 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jrhqv" (UID: "f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96") : secret "insights-runtime-extractor-tls" not found
Jul 24 21:16:02.669188 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:02.669145    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7dbf35e8-d81a-439f-99b3-6bca86301cd9-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-f4gmz\" (UID: \"7dbf35e8-d81a-439f-99b3-6bca86301cd9\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-f4gmz"
Jul 24 21:16:02.669603 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:16:02.669274    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 21:16:02.669603 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:16:02.669328    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dbf35e8-d81a-439f-99b3-6bca86301cd9-networking-console-plugin-cert podName:7dbf35e8-d81a-439f-99b3-6bca86301cd9 nodeName:}" failed. No retries permitted until 2026-07-24 21:16:18.669315392 +0000 UTC m=+95.113907100 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7dbf35e8-d81a-439f-99b3-6bca86301cd9-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-f4gmz" (UID: "7dbf35e8-d81a-439f-99b3-6bca86301cd9") : secret "networking-console-plugin-cert" not found
Jul 24 21:16:02.871089 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:02.871054    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/294caa54-48f2-4b87-aef7-2eda691fd0e3-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-pl9b8\" (UID: \"294caa54-48f2-4b87-aef7-2eda691fd0e3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-pl9b8"
Jul 24 21:16:02.873620 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:02.873588    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/294caa54-48f2-4b87-aef7-2eda691fd0e3-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-pl9b8\" (UID: \"294caa54-48f2-4b87-aef7-2eda691fd0e3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-pl9b8"
Jul 24 21:16:02.971785 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:02.971705    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/18a9c709-feb0-4dac-800a-ddeed3529d68-registry-tls\") pod \"image-registry-66f5b57d85-n8d77\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") " pod="openshift-image-registry/image-registry-66f5b57d85-n8d77"
Jul 24 21:16:02.971922 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:16:02.971816    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 21:16:02.971922 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:16:02.971827    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66f5b57d85-n8d77: secret "image-registry-tls" not found
Jul 24 21:16:02.971922 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:16:02.971873    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/18a9c709-feb0-4dac-800a-ddeed3529d68-registry-tls podName:18a9c709-feb0-4dac-800a-ddeed3529d68 nodeName:}" failed. No retries permitted until 2026-07-24 21:16:18.971860946 +0000 UTC m=+95.416452667 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/18a9c709-feb0-4dac-800a-ddeed3529d68-registry-tls") pod "image-registry-66f5b57d85-n8d77" (UID: "18a9c709-feb0-4dac-800a-ddeed3529d68") : secret "image-registry-tls" not found
Jul 24 21:16:03.017811 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:03.017785    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-pl9b8"
Jul 24 21:16:03.140879 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:03.140852    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-pl9b8"]
Jul 24 21:16:03.303395 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:03.303364    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-pl9b8" event={"ID":"294caa54-48f2-4b87-aef7-2eda691fd0e3","Type":"ContainerStarted","Data":"d248435e662bbe498c1575eda41b7ecda7761e775bc0833b808be13c34d9274b"}
Jul 24 21:16:05.311445 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:05.311404    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-pl9b8" event={"ID":"294caa54-48f2-4b87-aef7-2eda691fd0e3","Type":"ContainerStarted","Data":"d25e6543eae02afc7aa5b31f1b73f5c765f96efa2ca8b5c4ef140cee3f373afa"}
Jul 24 21:16:05.311803 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:05.311469    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-pl9b8" event={"ID":"294caa54-48f2-4b87-aef7-2eda691fd0e3","Type":"ContainerStarted","Data":"31e8c67ed63f12022fafea159262d770d3cae3ae40f3412c6632204ae5a0296b"}
Jul 24 21:16:05.332970 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:05.332923    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-pl9b8" podStartSLOduration=16.57339237 podStartE2EDuration="18.332905657s" totalImagesPullingTime="1.759513287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:16:05.331647623 +0000 UTC m=+81.776239355" watchObservedRunningTime="2026-07-24 21:16:05.332905657 +0000 UTC m=+81.777497410"
Jul 24 21:16:07.813972 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:07.813930    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jrhqv\" (UID: \"f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96\") " pod="openshift-insights/insights-runtime-extractor-jrhqv"
Jul 24 21:16:07.814360 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:07.814031    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jrhqv\" (UID: \"f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96\") " pod="openshift-insights/insights-runtime-extractor-jrhqv"
Jul 24 21:16:07.814360 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:16:07.814079    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 21:16:07.814360 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:16:07.814146    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-insights-runtime-extractor-tls podName:f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96 nodeName:}" failed. No retries permitted until 2026-07-24 21:16:23.81412963 +0000 UTC m=+100.258721340 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jrhqv" (UID: "f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96") : secret "insights-runtime-extractor-tls" not found
Jul 24 21:16:07.814547 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:07.814523    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jrhqv\" (UID: \"f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96\") " pod="openshift-insights/insights-runtime-extractor-jrhqv"
Jul 24 21:16:07.948196 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:07.948170    2561 scope.go:117] "RemoveContainer" containerID="4261e77367b627cc706edbc14fb1f13aeb8677124f79e4db7e3be99f656cd8bb"
Jul 24 21:16:08.323474 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:08.323417    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nsjrg_87f18cf4-62ce-48a0-99b0-fe22bc19f701/console-operator/1.log"
Jul 24 21:16:08.323629 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:08.323503    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-nsjrg" event={"ID":"87f18cf4-62ce-48a0-99b0-fe22bc19f701","Type":"ContainerStarted","Data":"04fc13f6f0709340462a6304cd40a17c09e2ba5f08aa31724f4442cb0fdcf40f"}
Jul 24 21:16:08.323879 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:08.323859    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-nsjrg"
Jul 24 21:16:08.344771 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:08.344725    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-nsjrg" podStartSLOduration=18.234355504 podStartE2EDuration="21.34471189s" totalImagesPullingTime="3.110356386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:16:08.342718087 +0000 UTC m=+84.787309818" watchObservedRunningTime="2026-07-24 21:16:08.34471189 +0000 UTC m=+84.789303635"
Jul 24 21:16:08.757671 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:08.757648    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-nsjrg"
Jul 24 21:16:17.626589 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:17.626558    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8c86cd798-qgtv8"]
Jul 24 21:16:17.629878 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:17.629854    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8c86cd798-qgtv8"
Jul 24 21:16:17.633418 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:17.633391    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 24 21:16:17.633543 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:17.633418    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 24 21:16:17.633543 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:17.633396    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 24 21:16:17.633543 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:17.633391    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 24 21:16:17.646406 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:17.646377    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8c86cd798-qgtv8"]
Jul 24 21:16:17.670507 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:17.670482    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66f5b57d85-n8d77"]
Jul 24 21:16:17.670693 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:16:17.670672    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-66f5b57d85-n8d77" podUID="18a9c709-feb0-4dac-800a-ddeed3529d68"
Jul 24 21:16:17.752722 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:17.752693    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-v7wlt"]
Jul 24 21:16:17.757646 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:17.757623    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-v7wlt"
Jul 24 21:16:17.761540 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:17.761517    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 24 21:16:17.761803 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:17.761785    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 24 21:16:17.761884 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:17.761835    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-npcjb\""
Jul 24 21:16:17.771835 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:17.771812    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-v7wlt"]
Jul 24 21:16:17.792746 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:17.792718    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e5044211-5c76-4760-8374-6d0e3f787242-klusterlet-config\") pod \"klusterlet-addon-workmgr-8c86cd798-qgtv8\" (UID: \"e5044211-5c76-4760-8374-6d0e3f787242\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8c86cd798-qgtv8"
Jul 24 21:16:17.792862 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:17.792843    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5n6v\" (UniqueName: \"kubernetes.io/projected/e5044211-5c76-4760-8374-6d0e3f787242-kube-api-access-f5n6v\") pod \"klusterlet-addon-workmgr-8c86cd798-qgtv8\" (UID: \"e5044211-5c76-4760-8374-6d0e3f787242\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8c86cd798-qgtv8"
Jul 24 21:16:17.792935 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:17.792879    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5044211-5c76-4760-8374-6d0e3f787242-tmp\") pod \"klusterlet-addon-workmgr-8c86cd798-qgtv8\" (UID: \"e5044211-5c76-4760-8374-6d0e3f787242\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8c86cd798-qgtv8"
Jul 24 21:16:17.843560 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:17.843532    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5498cb8547-jn4vc"]
Jul 24 21:16:17.846531 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:17.846514    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5498cb8547-jn4vc"
Jul 24 21:16:17.866729 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:17.866710    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5498cb8547-jn4vc"]
Jul 24 21:16:17.893745 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:17.893681    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5n6v\" (UniqueName: \"kubernetes.io/projected/e5044211-5c76-4760-8374-6d0e3f787242-kube-api-access-f5n6v\") pod \"klusterlet-addon-workmgr-8c86cd798-qgtv8\" (UID: \"e5044211-5c76-4760-8374-6d0e3f787242\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8c86cd798-qgtv8"
Jul 24 21:16:17.893745 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:17.893709    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5044211-5c76-4760-8374-6d0e3f787242-tmp\") pod \"klusterlet-addon-workmgr-8c86cd798-qgtv8\" (UID: \"e5044211-5c76-4760-8374-6d0e3f787242\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8c86cd798-qgtv8"
Jul 24 21:16:17.893909 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:17.893777    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg698\" (UniqueName: \"kubernetes.io/projected/5df1f115-30a2-4f8a-934e-22d4596da803-kube-api-access-lg698\") pod \"downloads-7c97dc4555-v7wlt\" (UID: \"5df1f115-30a2-4f8a-934e-22d4596da803\") " pod="openshift-console/downloads-7c97dc4555-v7wlt"
Jul 24 21:16:17.893909 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:17.893824    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e5044211-5c76-4760-8374-6d0e3f787242-klusterlet-config\") pod \"klusterlet-addon-workmgr-8c86cd798-qgtv8\" (UID: \"e5044211-5c76-4760-8374-6d0e3f787242\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8c86cd798-qgtv8"
Jul 24 21:16:17.894107 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:17.894086    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5044211-5c76-4760-8374-6d0e3f787242-tmp\") pod \"klusterlet-addon-workmgr-8c86cd798-qgtv8\" (UID: \"e5044211-5c76-4760-8374-6d0e3f787242\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8c86cd798-qgtv8"
Jul 24 21:16:17.896320 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:17.896304    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e5044211-5c76-4760-8374-6d0e3f787242-klusterlet-config\") pod \"klusterlet-addon-workmgr-8c86cd798-qgtv8\" (UID: \"e5044211-5c76-4760-8374-6d0e3f787242\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8c86cd798-qgtv8"
Jul 24 21:16:17.910444 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:17.910422    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5n6v\" (UniqueName: \"kubernetes.io/projected/e5044211-5c76-4760-8374-6d0e3f787242-kube-api-access-f5n6v\") pod \"klusterlet-addon-workmgr-8c86cd798-qgtv8\" (UID: \"e5044211-5c76-4760-8374-6d0e3f787242\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8c86cd798-qgtv8"
Jul 24 21:16:17.940685 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:17.940664    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8c86cd798-qgtv8"
Jul 24 21:16:17.995041 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:17.995008    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg698\" (UniqueName: \"kubernetes.io/projected/5df1f115-30a2-4f8a-934e-22d4596da803-kube-api-access-lg698\") pod \"downloads-7c97dc4555-v7wlt\" (UID: \"5df1f115-30a2-4f8a-934e-22d4596da803\") " pod="openshift-console/downloads-7c97dc4555-v7wlt"
Jul 24 21:16:17.995292 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:17.995266    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a74ed62d-678c-4d60-a2c1-85293b8f31c1-registry-tls\") pod \"image-registry-5498cb8547-jn4vc\" (UID: \"a74ed62d-678c-4d60-a2c1-85293b8f31c1\") " pod="openshift-image-registry/image-registry-5498cb8547-jn4vc"
Jul 24 21:16:17.995413 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:17.995321    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a74ed62d-678c-4d60-a2c1-85293b8f31c1-installation-pull-secrets\") pod \"image-registry-5498cb8547-jn4vc\" (UID: \"a74ed62d-678c-4d60-a2c1-85293b8f31c1\") " pod="openshift-image-registry/image-registry-5498cb8547-jn4vc"
Jul 24 21:16:17.995469 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:17.995408    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a74ed62d-678c-4d60-a2c1-85293b8f31c1-registry-certificates\") pod \"image-registry-5498cb8547-jn4vc\" (UID: \"a74ed62d-678c-4d60-a2c1-85293b8f31c1\") " pod="openshift-image-registry/image-registry-5498cb8547-jn4vc"
Jul 24 21:16:17.995469 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:17.995459    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ljcc\" (UniqueName: \"kubernetes.io/projected/a74ed62d-678c-4d60-a2c1-85293b8f31c1-kube-api-access-6ljcc\") pod \"image-registry-5498cb8547-jn4vc\" (UID: \"a74ed62d-678c-4d60-a2c1-85293b8f31c1\") " pod="openshift-image-registry/image-registry-5498cb8547-jn4vc"
Jul 24 21:16:17.995569 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:17.995497    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a74ed62d-678c-4d60-a2c1-85293b8f31c1-image-registry-private-configuration\") pod \"image-registry-5498cb8547-jn4vc\" (UID: \"a74ed62d-678c-4d60-a2c1-85293b8f31c1\") " pod="openshift-image-registry/image-registry-5498cb8547-jn4vc"
Jul 24 21:16:17.995569 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:17.995561    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a74ed62d-678c-4d60-a2c1-85293b8f31c1-ca-trust-extracted\") pod \"image-registry-5498cb8547-jn4vc\" (UID: \"a74ed62d-678c-4d60-a2c1-85293b8f31c1\") " pod="openshift-image-registry/image-registry-5498cb8547-jn4vc"
Jul 24 21:16:17.995668 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:17.995591    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a74ed62d-678c-4d60-a2c1-85293b8f31c1-trusted-ca\") pod \"image-registry-5498cb8547-jn4vc\" (UID: \"a74ed62d-678c-4d60-a2c1-85293b8f31c1\") " pod="openshift-image-registry/image-registry-5498cb8547-jn4vc"
Jul 24 21:16:17.995668 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:17.995616    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a74ed62d-678c-4d60-a2c1-85293b8f31c1-bound-sa-token\") pod \"image-registry-5498cb8547-jn4vc\" (UID: \"a74ed62d-678c-4d60-a2c1-85293b8f31c1\") " pod="openshift-image-registry/image-registry-5498cb8547-jn4vc"
Jul 24 21:16:18.011420 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.011398    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg698\" (UniqueName: \"kubernetes.io/projected/5df1f115-30a2-4f8a-934e-22d4596da803-kube-api-access-lg698\") pod \"downloads-7c97dc4555-v7wlt\" (UID: \"5df1f115-30a2-4f8a-934e-22d4596da803\") " pod="openshift-console/downloads-7c97dc4555-v7wlt"
Jul 24 21:16:18.066450 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.066421    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-v7wlt"
Jul 24 21:16:18.078837 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.078811    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8c86cd798-qgtv8"]
Jul 24 21:16:18.081077 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:16:18.081049    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5044211_5c76_4760_8374_6d0e3f787242.slice/crio-59c33bd158e02fbf04ac75b06618c954c9ce0db1944a73ae906b568d0add7d9c WatchSource:0}: Error finding container 59c33bd158e02fbf04ac75b06618c954c9ce0db1944a73ae906b568d0add7d9c: Status 404 returned error can't find the container with id 59c33bd158e02fbf04ac75b06618c954c9ce0db1944a73ae906b568d0add7d9c
Jul 24 21:16:18.096866 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.096845    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a74ed62d-678c-4d60-a2c1-85293b8f31c1-registry-tls\") pod \"image-registry-5498cb8547-jn4vc\" (UID: \"a74ed62d-678c-4d60-a2c1-85293b8f31c1\") " pod="openshift-image-registry/image-registry-5498cb8547-jn4vc"
Jul 24 21:16:18.096960 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.096879    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a74ed62d-678c-4d60-a2c1-85293b8f31c1-installation-pull-secrets\") pod \"image-registry-5498cb8547-jn4vc\" (UID: \"a74ed62d-678c-4d60-a2c1-85293b8f31c1\") " pod="openshift-image-registry/image-registry-5498cb8547-jn4vc"
Jul 24 21:16:18.096960 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.096921    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a74ed62d-678c-4d60-a2c1-85293b8f31c1-registry-certificates\") pod \"image-registry-5498cb8547-jn4vc\" (UID: \"a74ed62d-678c-4d60-a2c1-85293b8f31c1\") " pod="openshift-image-registry/image-registry-5498cb8547-jn4vc"
Jul 24 21:16:18.096960 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.096938    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ljcc\" (UniqueName: \"kubernetes.io/projected/a74ed62d-678c-4d60-a2c1-85293b8f31c1-kube-api-access-6ljcc\") pod \"image-registry-5498cb8547-jn4vc\" (UID: \"a74ed62d-678c-4d60-a2c1-85293b8f31c1\") " pod="openshift-image-registry/image-registry-5498cb8547-jn4vc"
Jul 24 21:16:18.097110 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.096960    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a74ed62d-678c-4d60-a2c1-85293b8f31c1-image-registry-private-configuration\") pod \"image-registry-5498cb8547-jn4vc\" (UID: \"a74ed62d-678c-4d60-a2c1-85293b8f31c1\") " pod="openshift-image-registry/image-registry-5498cb8547-jn4vc"
Jul 24 21:16:18.097168 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.097144    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a74ed62d-678c-4d60-a2c1-85293b8f31c1-ca-trust-extracted\") pod \"image-registry-5498cb8547-jn4vc\" (UID: \"a74ed62d-678c-4d60-a2c1-85293b8f31c1\") " pod="openshift-image-registry/image-registry-5498cb8547-jn4vc"
Jul 24 21:16:18.097219 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.097187    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a74ed62d-678c-4d60-a2c1-85293b8f31c1-trusted-ca\") pod \"image-registry-5498cb8547-jn4vc\" (UID: \"a74ed62d-678c-4d60-a2c1-85293b8f31c1\") " pod="openshift-image-registry/image-registry-5498cb8547-jn4vc"
Jul 24 21:16:18.097308 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.097280    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a74ed62d-678c-4d60-a2c1-85293b8f31c1-bound-sa-token\") pod \"image-registry-5498cb8547-jn4vc\" (UID: \"a74ed62d-678c-4d60-a2c1-85293b8f31c1\") " pod="openshift-image-registry/image-registry-5498cb8547-jn4vc"
Jul 24 21:16:18.097816 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.097797    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a74ed62d-678c-4d60-a2c1-85293b8f31c1-registry-certificates\") pod \"image-registry-5498cb8547-jn4vc\" (UID: \"a74ed62d-678c-4d60-a2c1-85293b8f31c1\") " pod="openshift-image-registry/image-registry-5498cb8547-jn4vc"
Jul 24 21:16:18.098029 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.098009    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a74ed62d-678c-4d60-a2c1-85293b8f31c1-ca-trust-extracted\") pod \"image-registry-5498cb8547-jn4vc\" (UID: \"a74ed62d-678c-4d60-a2c1-85293b8f31c1\") " pod="openshift-image-registry/image-registry-5498cb8547-jn4vc"
Jul 24 21:16:18.098148 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.098129    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a74ed62d-678c-4d60-a2c1-85293b8f31c1-trusted-ca\") pod \"image-registry-5498cb8547-jn4vc\" (UID: \"a74ed62d-678c-4d60-a2c1-85293b8f31c1\") " pod="openshift-image-registry/image-registry-5498cb8547-jn4vc"
Jul 24 21:16:18.099700 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.099676    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a74ed62d-678c-4d60-a2c1-85293b8f31c1-registry-tls\") pod \"image-registry-5498cb8547-jn4vc\" (UID: \"a74ed62d-678c-4d60-a2c1-85293b8f31c1\") " pod="openshift-image-registry/image-registry-5498cb8547-jn4vc"
Jul 24 21:16:18.100114 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.100094    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a74ed62d-678c-4d60-a2c1-85293b8f31c1-installation-pull-secrets\") pod \"image-registry-5498cb8547-jn4vc\" (UID: \"a74ed62d-678c-4d60-a2c1-85293b8f31c1\") " pod="openshift-image-registry/image-registry-5498cb8547-jn4vc"
Jul 24 21:16:18.100489 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.100471    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a74ed62d-678c-4d60-a2c1-85293b8f31c1-image-registry-private-configuration\") pod \"image-registry-5498cb8547-jn4vc\" (UID: \"a74ed62d-678c-4d60-a2c1-85293b8f31c1\") " pod="openshift-image-registry/image-registry-5498cb8547-jn4vc"
Jul 24 21:16:18.108451 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.108431    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ljcc\" (UniqueName: \"kubernetes.io/projected/a74ed62d-678c-4d60-a2c1-85293b8f31c1-kube-api-access-6ljcc\") pod \"image-registry-5498cb8547-jn4vc\" (UID: \"a74ed62d-678c-4d60-a2c1-85293b8f31c1\") " pod="openshift-image-registry/image-registry-5498cb8547-jn4vc"
Jul 24 21:16:18.108663 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.108646    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a74ed62d-678c-4d60-a2c1-85293b8f31c1-bound-sa-token\") pod \"image-registry-5498cb8547-jn4vc\" (UID: \"a74ed62d-678c-4d60-a2c1-85293b8f31c1\") " pod="openshift-image-registry/image-registry-5498cb8547-jn4vc"
Jul 24 21:16:18.154243 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.154203    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5498cb8547-jn4vc"
Jul 24 21:16:18.200558 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.200538    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-v7wlt"]
Jul 24 21:16:18.202461 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:16:18.202434    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5df1f115_30a2_4f8a_934e_22d4596da803.slice/crio-4708044df25069403c87aae27f276852e1c2c61a7c75504b100f914fe941d246 WatchSource:0}: Error finding container 4708044df25069403c87aae27f276852e1c2c61a7c75504b100f914fe941d246: Status 404 returned error can't find the container with id 4708044df25069403c87aae27f276852e1c2c61a7c75504b100f914fe941d246
Jul 24 21:16:18.310187 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.310155    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5498cb8547-jn4vc"]
Jul 24 21:16:18.313802 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:16:18.313777    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda74ed62d_678c_4d60_a2c1_85293b8f31c1.slice/crio-0ebca3aad54ffb678fecda545b89a1a6e2a83052838b6dfe5ce01cfa905bdd43 WatchSource:0}: Error finding container 0ebca3aad54ffb678fecda545b89a1a6e2a83052838b6dfe5ce01cfa905bdd43: Status 404 returned error can't find the container with id 0ebca3aad54ffb678fecda545b89a1a6e2a83052838b6dfe5ce01cfa905bdd43
Jul 24 21:16:18.354589 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.354560    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5498cb8547-jn4vc" event={"ID":"a74ed62d-678c-4d60-a2c1-85293b8f31c1","Type":"ContainerStarted","Data":"0ebca3aad54ffb678fecda545b89a1a6e2a83052838b6dfe5ce01cfa905bdd43"}
Jul 24 21:16:18.355656 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.355628    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-v7wlt" event={"ID":"5df1f115-30a2-4f8a-934e-22d4596da803","Type":"ContainerStarted","Data":"4708044df25069403c87aae27f276852e1c2c61a7c75504b100f914fe941d246"}
Jul 24 21:16:18.356797 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.356774    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8c86cd798-qgtv8" event={"ID":"e5044211-5c76-4760-8374-6d0e3f787242","Type":"ContainerStarted","Data":"59c33bd158e02fbf04ac75b06618c954c9ce0db1944a73ae906b568d0add7d9c"}
Jul 24 21:16:18.356859 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.356789    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66f5b57d85-n8d77"
Jul 24 21:16:18.366901 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.366884    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66f5b57d85-n8d77"
Jul 24 21:16:18.501503 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.501428    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/18a9c709-feb0-4dac-800a-ddeed3529d68-installation-pull-secrets\") pod \"18a9c709-feb0-4dac-800a-ddeed3529d68\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") "
Jul 24 21:16:18.501503 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.501467    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/18a9c709-feb0-4dac-800a-ddeed3529d68-registry-certificates\") pod \"18a9c709-feb0-4dac-800a-ddeed3529d68\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") "
Jul 24 21:16:18.501503 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.501492    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/18a9c709-feb0-4dac-800a-ddeed3529d68-trusted-ca\") pod \"18a9c709-feb0-4dac-800a-ddeed3529d68\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") "
Jul 24 21:16:18.501748 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.501522    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/18a9c709-feb0-4dac-800a-ddeed3529d68-bound-sa-token\") pod \"18a9c709-feb0-4dac-800a-ddeed3529d68\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") "
Jul 24 21:16:18.501748 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.501551    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbnzl\" (UniqueName: \"kubernetes.io/projected/18a9c709-feb0-4dac-800a-ddeed3529d68-kube-api-access-tbnzl\") pod \"18a9c709-feb0-4dac-800a-ddeed3529d68\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") "
Jul 24 21:16:18.501748 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.501582    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/18a9c709-feb0-4dac-800a-ddeed3529d68-ca-trust-extracted\") pod \"18a9c709-feb0-4dac-800a-ddeed3529d68\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") "
Jul 24 21:16:18.501929 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.501902    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18a9c709-feb0-4dac-800a-ddeed3529d68-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "18a9c709-feb0-4dac-800a-ddeed3529d68" (UID: "18a9c709-feb0-4dac-800a-ddeed3529d68"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 21:16:18.501929 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.501914    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18a9c709-feb0-4dac-800a-ddeed3529d68-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "18a9c709-feb0-4dac-800a-ddeed3529d68" (UID: "18a9c709-feb0-4dac-800a-ddeed3529d68"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:16:18.502021 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.501939    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18a9c709-feb0-4dac-800a-ddeed3529d68-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "18a9c709-feb0-4dac-800a-ddeed3529d68" (UID: "18a9c709-feb0-4dac-800a-ddeed3529d68"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:16:18.502021 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.501999    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/18a9c709-feb0-4dac-800a-ddeed3529d68-image-registry-private-configuration\") pod \"18a9c709-feb0-4dac-800a-ddeed3529d68\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") "
Jul 24 21:16:18.502551 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.502530    2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/18a9c709-feb0-4dac-800a-ddeed3529d68-ca-trust-extracted\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:16:18.502612 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.502558    2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/18a9c709-feb0-4dac-800a-ddeed3529d68-registry-certificates\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:16:18.502612 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.502573    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/18a9c709-feb0-4dac-800a-ddeed3529d68-trusted-ca\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:16:18.503941 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.503916    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18a9c709-feb0-4dac-800a-ddeed3529d68-kube-api-access-tbnzl" (OuterVolumeSpecName: "kube-api-access-tbnzl") pod "18a9c709-feb0-4dac-800a-ddeed3529d68" (UID: "18a9c709-feb0-4dac-800a-ddeed3529d68"). InnerVolumeSpecName "kube-api-access-tbnzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 21:16:18.504043 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.503991    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18a9c709-feb0-4dac-800a-ddeed3529d68-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "18a9c709-feb0-4dac-800a-ddeed3529d68" (UID: "18a9c709-feb0-4dac-800a-ddeed3529d68"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 21:16:18.504111 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.504092    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18a9c709-feb0-4dac-800a-ddeed3529d68-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "18a9c709-feb0-4dac-800a-ddeed3529d68" (UID: "18a9c709-feb0-4dac-800a-ddeed3529d68"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 21:16:18.504345 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.504323    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18a9c709-feb0-4dac-800a-ddeed3529d68-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "18a9c709-feb0-4dac-800a-ddeed3529d68" (UID: "18a9c709-feb0-4dac-800a-ddeed3529d68"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 21:16:18.603946 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.603914    2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/18a9c709-feb0-4dac-800a-ddeed3529d68-image-registry-private-configuration\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:16:18.603946 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.603940    2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/18a9c709-feb0-4dac-800a-ddeed3529d68-installation-pull-secrets\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:16:18.603946 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.603950    2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/18a9c709-feb0-4dac-800a-ddeed3529d68-bound-sa-token\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:16:18.604160 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.603960    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbnzl\" (UniqueName: \"kubernetes.io/projected/18a9c709-feb0-4dac-800a-ddeed3529d68-kube-api-access-tbnzl\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:16:18.704688 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.704603    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7dbf35e8-d81a-439f-99b3-6bca86301cd9-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-f4gmz\" (UID: \"7dbf35e8-d81a-439f-99b3-6bca86301cd9\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-f4gmz"
Jul 24 21:16:18.707904 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:18.707875    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7dbf35e8-d81a-439f-99b3-6bca86301cd9-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-f4gmz\" (UID: \"7dbf35e8-d81a-439f-99b3-6bca86301cd9\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-f4gmz"
Jul 24 21:16:19.003266 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:19.003190    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-f4gmz"
Jul 24 21:16:19.006966 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:19.006898    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/18a9c709-feb0-4dac-800a-ddeed3529d68-registry-tls\") pod \"image-registry-66f5b57d85-n8d77\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") " pod="openshift-image-registry/image-registry-66f5b57d85-n8d77"
Jul 24 21:16:19.015818 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:19.015792    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/18a9c709-feb0-4dac-800a-ddeed3529d68-registry-tls\") pod \"image-registry-66f5b57d85-n8d77\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") " pod="openshift-image-registry/image-registry-66f5b57d85-n8d77"
Jul 24 21:16:19.108728 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:19.108169    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/18a9c709-feb0-4dac-800a-ddeed3529d68-registry-tls\") pod \"18a9c709-feb0-4dac-800a-ddeed3529d68\" (UID: \"18a9c709-feb0-4dac-800a-ddeed3529d68\") "
Jul 24 21:16:19.115744 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:19.115706    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18a9c709-feb0-4dac-800a-ddeed3529d68-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "18a9c709-feb0-4dac-800a-ddeed3529d68" (UID: "18a9c709-feb0-4dac-800a-ddeed3529d68"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 21:16:19.178769 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:19.178635    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-f4gmz"]
Jul 24 21:16:19.183529 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:16:19.183500    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dbf35e8_d81a_439f_99b3_6bca86301cd9.slice/crio-c122516a0399fd8524c533ab1c1d04b4d7b8380d219512701548076d83d439e7 WatchSource:0}: Error finding container c122516a0399fd8524c533ab1c1d04b4d7b8380d219512701548076d83d439e7: Status 404 returned error can't find the container with id c122516a0399fd8524c533ab1c1d04b4d7b8380d219512701548076d83d439e7
Jul 24 21:16:19.209274 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:19.209243    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/18a9c709-feb0-4dac-800a-ddeed3529d68-registry-tls\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:16:19.363269 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:19.363207    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-f4gmz" event={"ID":"7dbf35e8-d81a-439f-99b3-6bca86301cd9","Type":"ContainerStarted","Data":"c122516a0399fd8524c533ab1c1d04b4d7b8380d219512701548076d83d439e7"}
Jul 24 21:16:19.365419 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:19.365386    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66f5b57d85-n8d77"
Jul 24 21:16:19.366797 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:19.366767    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5498cb8547-jn4vc" event={"ID":"a74ed62d-678c-4d60-a2c1-85293b8f31c1","Type":"ContainerStarted","Data":"a29c91e783c1bd759ff5ff2c598624cf7169da95be5f8ad95b878ee17f5b0b44"}
Jul 24 21:16:19.366922 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:19.366820    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5498cb8547-jn4vc"
Jul 24 21:16:19.391736 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:19.391668    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5498cb8547-jn4vc" podStartSLOduration=2.391648679 podStartE2EDuration="2.391648679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:16:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:16:19.390211188 +0000 UTC m=+95.834802933" watchObservedRunningTime="2026-07-24 21:16:19.391648679 +0000 UTC m=+95.836240410"
Jul 24 21:16:19.440349 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:19.440257    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66f5b57d85-n8d77"]
Jul 24 21:16:19.441989 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:19.441831    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-66f5b57d85-n8d77"]
Jul 24 21:16:19.954175 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:19.954137    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18a9c709-feb0-4dac-800a-ddeed3529d68" path="/var/lib/kubelet/pods/18a9c709-feb0-4dac-800a-ddeed3529d68/volumes"
Jul 24 21:16:23.382365 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:23.382318    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8c86cd798-qgtv8" event={"ID":"e5044211-5c76-4760-8374-6d0e3f787242","Type":"ContainerStarted","Data":"4b44b568b03ee91572cc72a0239318589ce50b799df7eb2b7a7d46b1d1af5496"}
Jul 24 21:16:23.382826 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:23.382499    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8c86cd798-qgtv8"
Jul 24 21:16:23.384037 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:23.384003    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-f4gmz" event={"ID":"7dbf35e8-d81a-439f-99b3-6bca86301cd9","Type":"ContainerStarted","Data":"06ba673ff9db52eaaf74986cc64f3d8e7a36e3a2de1124ce41253e2f45c1211a"}
Jul 24 21:16:23.384481 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:23.384461    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8c86cd798-qgtv8"
Jul 24 21:16:23.404128 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:23.404061    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8c86cd798-qgtv8" podStartSLOduration=1.534095678 podStartE2EDuration="6.404046906s" totalImagesPullingTime="4.869951228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:16:23.403192236 +0000 UTC m=+99.847783966" watchObservedRunningTime="2026-07-24 21:16:23.404046906 +0000 UTC m=+99.848638638"
Jul 24 21:16:23.424346 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:23.424297    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-f4gmz" podStartSLOduration=33.680983408 podStartE2EDuration="37.424282083s" totalImagesPullingTime="3.743298675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:15:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:16:23.423992668 +0000 UTC m=+99.868584399" watchObservedRunningTime="2026-07-24 21:16:23.424282083 +0000 UTC m=+99.868873814"
Jul 24 21:16:23.447358 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:23.447332    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c86f2249-21df-498b-afa2-ff795d234e97-metrics-tls\") pod \"dns-default-k5vbz\" (UID: \"c86f2249-21df-498b-afa2-ff795d234e97\") " pod="openshift-dns/dns-default-k5vbz"
Jul 24 21:16:23.450145 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:23.450120    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c86f2249-21df-498b-afa2-ff795d234e97-metrics-tls\") pod \"dns-default-k5vbz\" (UID: \"c86f2249-21df-498b-afa2-ff795d234e97\") " pod="openshift-dns/dns-default-k5vbz"
Jul 24 21:16:23.738068 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:23.737992    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wbvbs\""
Jul 24 21:16:23.745121 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:23.745085    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k5vbz"
Jul 24 21:16:23.851825 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:23.851798    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jrhqv\" (UID: \"f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96\") " pod="openshift-insights/insights-runtime-extractor-jrhqv"
Jul 24 21:16:23.854748 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:23.854721    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jrhqv\" (UID: \"f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96\") " pod="openshift-insights/insights-runtime-extractor-jrhqv"
Jul 24 21:16:23.892048 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:23.891999    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-k5vbz"]
Jul 24 21:16:23.895601 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:16:23.895576    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc86f2249_21df_498b_afa2_ff795d234e97.slice/crio-91f534497c505f71a89d80877b1476d524162f559d0c74d1a565400471833c3f WatchSource:0}: Error finding container 91f534497c505f71a89d80877b1476d524162f559d0c74d1a565400471833c3f: Status 404 returned error can't find the container with id 91f534497c505f71a89d80877b1476d524162f559d0c74d1a565400471833c3f
Jul 24 21:16:24.115077 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:24.115044    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jrhqv"
Jul 24 21:16:24.276621 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:24.276537    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jrhqv"]
Jul 24 21:16:24.281017 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:16:24.280986    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7fcf7b7_9e8e_40a3_b5f7_29e8a7069b96.slice/crio-ff2ebf634db38d9f4ebfad0267307b07fa2081d373e8ce3181bf393eca699d8a WatchSource:0}: Error finding container ff2ebf634db38d9f4ebfad0267307b07fa2081d373e8ce3181bf393eca699d8a: Status 404 returned error can't find the container with id ff2ebf634db38d9f4ebfad0267307b07fa2081d373e8ce3181bf393eca699d8a
Jul 24 21:16:24.389617 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:24.389523    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jrhqv" event={"ID":"f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96","Type":"ContainerStarted","Data":"ff2ebf634db38d9f4ebfad0267307b07fa2081d373e8ce3181bf393eca699d8a"}
Jul 24 21:16:24.391353 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:24.391292    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k5vbz" event={"ID":"c86f2249-21df-498b-afa2-ff795d234e97","Type":"ContainerStarted","Data":"91f534497c505f71a89d80877b1476d524162f559d0c74d1a565400471833c3f"}
Jul 24 21:16:26.405043 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:26.405002    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k5vbz" event={"ID":"c86f2249-21df-498b-afa2-ff795d234e97","Type":"ContainerStarted","Data":"e626e74c167b0bd6cdc206fe6114b7dfe4dcfa2d08bcab5e64f9836ff3249884"}
Jul 24 21:16:26.405544 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:26.405063    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k5vbz" event={"ID":"c86f2249-21df-498b-afa2-ff795d234e97","Type":"ContainerStarted","Data":"e85783d53ed0f25d837fcc103f193f50fb5afe66aed9a3fc850197873a7a9c6e"}
Jul 24 21:16:26.405841 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:26.405810    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-k5vbz"
Jul 24 21:16:26.423134 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:26.423090    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-k5vbz" podStartSLOduration=65.470910467 podStartE2EDuration="1m7.42307462s" totalImagesPullingTime="1.952164153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:15:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:16:26.422463259 +0000 UTC m=+102.867055006" watchObservedRunningTime="2026-07-24 21:16:26.42307462 +0000 UTC m=+102.867666350"
Jul 24 21:16:27.288239 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:27.288192    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-l4zhw"
Jul 24 21:16:32.698886 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:32.698851    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rgr69"]
Jul 24 21:16:32.701427 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:32.701405    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rgr69"
Jul 24 21:16:32.705161 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:32.705140    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 24 21:16:32.705405 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:32.705182    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 24 21:16:32.705521 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:32.705182    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 24 21:16:32.705521 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:32.705482    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 24 21:16:32.705621 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:32.705525    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 24 21:16:32.706190 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:32.706168    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-p42fm\""
Jul 24 21:16:32.706323 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:32.706248    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 24 21:16:32.729894 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:32.729871    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4eed8790-d1de-470c-ab2d-f8a7618848c5-root\") pod \"node-exporter-rgr69\" (UID: \"4eed8790-d1de-470c-ab2d-f8a7618848c5\") " pod="openshift-monitoring/node-exporter-rgr69"
Jul 24 21:16:32.730020 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:32.729908    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4eed8790-d1de-470c-ab2d-f8a7618848c5-sys\") pod \"node-exporter-rgr69\" (UID: \"4eed8790-d1de-470c-ab2d-f8a7618848c5\") " pod="openshift-monitoring/node-exporter-rgr69"
Jul 24 21:16:32.730020 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:32.729934    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kchkh\" (UniqueName: \"kubernetes.io/projected/4eed8790-d1de-470c-ab2d-f8a7618848c5-kube-api-access-kchkh\") pod \"node-exporter-rgr69\" (UID: \"4eed8790-d1de-470c-ab2d-f8a7618848c5\") " pod="openshift-monitoring/node-exporter-rgr69"
Jul 24 21:16:32.730020 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:32.729956    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4eed8790-d1de-470c-ab2d-f8a7618848c5-node-exporter-textfile\") pod \"node-exporter-rgr69\" (UID: \"4eed8790-d1de-470c-ab2d-f8a7618848c5\") " pod="openshift-monitoring/node-exporter-rgr69"
Jul 24 21:16:32.730146 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:32.730091    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4eed8790-d1de-470c-ab2d-f8a7618848c5-metrics-client-ca\") pod \"node-exporter-rgr69\" (UID: \"4eed8790-d1de-470c-ab2d-f8a7618848c5\") " pod="openshift-monitoring/node-exporter-rgr69"
Jul 24 21:16:32.730146 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:32.730135    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4eed8790-d1de-470c-ab2d-f8a7618848c5-node-exporter-tls\") pod \"node-exporter-rgr69\" (UID: \"4eed8790-d1de-470c-ab2d-f8a7618848c5\") " pod="openshift-monitoring/node-exporter-rgr69"
Jul 24 21:16:32.730272 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:32.730160    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4eed8790-d1de-470c-ab2d-f8a7618848c5-node-exporter-accelerators-collector-config\") pod \"node-exporter-rgr69\" (UID: \"4eed8790-d1de-470c-ab2d-f8a7618848c5\") " pod="openshift-monitoring/node-exporter-rgr69"
Jul 24 21:16:32.730272 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:32.730178    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4eed8790-d1de-470c-ab2d-f8a7618848c5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rgr69\" (UID: \"4eed8790-d1de-470c-ab2d-f8a7618848c5\") " pod="openshift-monitoring/node-exporter-rgr69"
Jul 24 21:16:32.730272 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:32.730193    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4eed8790-d1de-470c-ab2d-f8a7618848c5-node-exporter-wtmp\") pod \"node-exporter-rgr69\" (UID: \"4eed8790-d1de-470c-ab2d-f8a7618848c5\") " pod="openshift-monitoring/node-exporter-rgr69"
Jul 24 21:16:32.831203 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:32.831173    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kchkh\" (UniqueName: \"kubernetes.io/projected/4eed8790-d1de-470c-ab2d-f8a7618848c5-kube-api-access-kchkh\") pod \"node-exporter-rgr69\" (UID: \"4eed8790-d1de-470c-ab2d-f8a7618848c5\") " pod="openshift-monitoring/node-exporter-rgr69"
Jul 24 21:16:32.831383 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:32.831214    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4eed8790-d1de-470c-ab2d-f8a7618848c5-node-exporter-textfile\") pod \"node-exporter-rgr69\" (UID: \"4eed8790-d1de-470c-ab2d-f8a7618848c5\") " pod="openshift-monitoring/node-exporter-rgr69"
Jul 24 21:16:32.831383 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:32.831306    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4eed8790-d1de-470c-ab2d-f8a7618848c5-metrics-client-ca\") pod \"node-exporter-rgr69\" (UID: \"4eed8790-d1de-470c-ab2d-f8a7618848c5\") " pod="openshift-monitoring/node-exporter-rgr69"
Jul 24 21:16:32.831383 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:32.831341    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4eed8790-d1de-470c-ab2d-f8a7618848c5-node-exporter-tls\") pod \"node-exporter-rgr69\" (UID: \"4eed8790-d1de-470c-ab2d-f8a7618848c5\") " pod="openshift-monitoring/node-exporter-rgr69"
Jul 24 21:16:32.831383 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:32.831370    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4eed8790-d1de-470c-ab2d-f8a7618848c5-node-exporter-accelerators-collector-config\") pod \"node-exporter-rgr69\" (UID: \"4eed8790-d1de-470c-ab2d-f8a7618848c5\") " pod="openshift-monitoring/node-exporter-rgr69"
Jul 24 21:16:32.831580 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:32.831394    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4eed8790-d1de-470c-ab2d-f8a7618848c5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rgr69\" (UID: \"4eed8790-d1de-470c-ab2d-f8a7618848c5\") " pod="openshift-monitoring/node-exporter-rgr69"
Jul 24 21:16:32.831580 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:32.831419    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4eed8790-d1de-470c-ab2d-f8a7618848c5-node-exporter-wtmp\") pod \"node-exporter-rgr69\" (UID: \"4eed8790-d1de-470c-ab2d-f8a7618848c5\") " pod="openshift-monitoring/node-exporter-rgr69"
Jul 24 21:16:32.831580 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:32.831464    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4eed8790-d1de-470c-ab2d-f8a7618848c5-root\") pod \"node-exporter-rgr69\" (UID: \"4eed8790-d1de-470c-ab2d-f8a7618848c5\") " pod="openshift-monitoring/node-exporter-rgr69"
Jul 24 21:16:32.831580 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:32.831494    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4eed8790-d1de-470c-ab2d-f8a7618848c5-sys\") pod \"node-exporter-rgr69\" (UID: \"4eed8790-d1de-470c-ab2d-f8a7618848c5\") " pod="openshift-monitoring/node-exporter-rgr69"
Jul 24 21:16:32.831580 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:16:32.831492    2561 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 24 21:16:32.831580 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:16:32.831583    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4eed8790-d1de-470c-ab2d-f8a7618848c5-node-exporter-tls podName:4eed8790-d1de-470c-ab2d-f8a7618848c5 nodeName:}" failed. No retries permitted until 2026-07-24 21:16:33.331562517 +0000 UTC m=+109.776154242 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4eed8790-d1de-470c-ab2d-f8a7618848c5-node-exporter-tls") pod "node-exporter-rgr69" (UID: "4eed8790-d1de-470c-ab2d-f8a7618848c5") : secret "node-exporter-tls" not found
Jul 24 21:16:32.831875 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:32.831590    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4eed8790-d1de-470c-ab2d-f8a7618848c5-root\") pod \"node-exporter-rgr69\" (UID: \"4eed8790-d1de-470c-ab2d-f8a7618848c5\") " pod="openshift-monitoring/node-exporter-rgr69"
Jul 24 21:16:32.831875 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:32.831617    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4eed8790-d1de-470c-ab2d-f8a7618848c5-node-exporter-wtmp\") pod \"node-exporter-rgr69\" (UID: \"4eed8790-d1de-470c-ab2d-f8a7618848c5\") " pod="openshift-monitoring/node-exporter-rgr69"
Jul 24 21:16:32.831875 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:32.831630    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4eed8790-d1de-470c-ab2d-f8a7618848c5-node-exporter-textfile\") pod \"node-exporter-rgr69\" (UID: \"4eed8790-d1de-470c-ab2d-f8a7618848c5\") " pod="openshift-monitoring/node-exporter-rgr69"
Jul 24 21:16:32.831875 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:32.831638    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4eed8790-d1de-470c-ab2d-f8a7618848c5-sys\") pod \"node-exporter-rgr69\" (UID: \"4eed8790-d1de-470c-ab2d-f8a7618848c5\") " pod="openshift-monitoring/node-exporter-rgr69"
Jul 24 21:16:32.832067 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:32.831884    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4eed8790-d1de-470c-ab2d-f8a7618848c5-node-exporter-accelerators-collector-config\") pod \"node-exporter-rgr69\" (UID: \"4eed8790-d1de-470c-ab2d-f8a7618848c5\") " pod="openshift-monitoring/node-exporter-rgr69"
Jul 24 21:16:32.832067 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:32.832007    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4eed8790-d1de-470c-ab2d-f8a7618848c5-metrics-client-ca\") pod \"node-exporter-rgr69\" (UID: \"4eed8790-d1de-470c-ab2d-f8a7618848c5\") " pod="openshift-monitoring/node-exporter-rgr69"
Jul 24 21:16:32.834247 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:32.834201    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4eed8790-d1de-470c-ab2d-f8a7618848c5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rgr69\" (UID: \"4eed8790-d1de-470c-ab2d-f8a7618848c5\") " pod="openshift-monitoring/node-exporter-rgr69"
Jul 24 21:16:32.844619 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:32.844599    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kchkh\" (UniqueName: \"kubernetes.io/projected/4eed8790-d1de-470c-ab2d-f8a7618848c5-kube-api-access-kchkh\") pod \"node-exporter-rgr69\" (UID: \"4eed8790-d1de-470c-ab2d-f8a7618848c5\") " pod="openshift-monitoring/node-exporter-rgr69"
Jul 24 21:16:33.336007 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:33.335966    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4eed8790-d1de-470c-ab2d-f8a7618848c5-node-exporter-tls\") pod \"node-exporter-rgr69\" (UID: \"4eed8790-d1de-470c-ab2d-f8a7618848c5\") " pod="openshift-monitoring/node-exporter-rgr69"
Jul 24 21:16:33.338736 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:33.338712    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4eed8790-d1de-470c-ab2d-f8a7618848c5-node-exporter-tls\") pod \"node-exporter-rgr69\" (UID: \"4eed8790-d1de-470c-ab2d-f8a7618848c5\") " pod="openshift-monitoring/node-exporter-rgr69"
Jul 24 21:16:33.613440 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:33.613361    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rgr69"
Jul 24 21:16:34.659093 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:34.659066    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7f796fdb98-9vpg7"]
Jul 24 21:16:34.662404 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:34.662374    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f796fdb98-9vpg7"
Jul 24 21:16:34.666322 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:34.666297    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 24 21:16:34.666918 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:34.666849    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 24 21:16:34.666918 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:34.666869    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-7p9c2\""
Jul 24 21:16:34.667297 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:34.667275    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3v9bo9bcugrm3\""
Jul 24 21:16:34.667428 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:34.667299    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 24 21:16:34.667844 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:34.667824    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 24 21:16:34.667923 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:34.667864    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 24 21:16:34.685638 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:34.685618    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f796fdb98-9vpg7"]
Jul 24 21:16:34.749396 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:34.749362    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b0ee441f-50e6-4c37-936e-637360dd3b85-secret-thanos-querier-tls\") pod \"thanos-querier-7f796fdb98-9vpg7\" (UID: \"b0ee441f-50e6-4c37-936e-637360dd3b85\") " pod="openshift-monitoring/thanos-querier-7f796fdb98-9vpg7"
Jul 24 21:16:34.749569 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:34.749425    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgw7x\" (UniqueName: \"kubernetes.io/projected/b0ee441f-50e6-4c37-936e-637360dd3b85-kube-api-access-bgw7x\") pod \"thanos-querier-7f796fdb98-9vpg7\" (UID: \"b0ee441f-50e6-4c37-936e-637360dd3b85\") " pod="openshift-monitoring/thanos-querier-7f796fdb98-9vpg7"
Jul 24 21:16:34.749569 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:34.749470    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b0ee441f-50e6-4c37-936e-637360dd3b85-secret-grpc-tls\") pod \"thanos-querier-7f796fdb98-9vpg7\" (UID: \"b0ee441f-50e6-4c37-936e-637360dd3b85\") " pod="openshift-monitoring/thanos-querier-7f796fdb98-9vpg7"
Jul 24 21:16:34.749569 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:34.749524    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b0ee441f-50e6-4c37-936e-637360dd3b85-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f796fdb98-9vpg7\" (UID: \"b0ee441f-50e6-4c37-936e-637360dd3b85\") " pod="openshift-monitoring/thanos-querier-7f796fdb98-9vpg7"
Jul 24 21:16:34.749689 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:34.749562    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0ee441f-50e6-4c37-936e-637360dd3b85-metrics-client-ca\") pod \"thanos-querier-7f796fdb98-9vpg7\" (UID: \"b0ee441f-50e6-4c37-936e-637360dd3b85\") " pod="openshift-monitoring/thanos-querier-7f796fdb98-9vpg7"
Jul 24 21:16:34.749689 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:34.749608    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b0ee441f-50e6-4c37-936e-637360dd3b85-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f796fdb98-9vpg7\" (UID: \"b0ee441f-50e6-4c37-936e-637360dd3b85\") " pod="openshift-monitoring/thanos-querier-7f796fdb98-9vpg7"
Jul 24 21:16:34.749689 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:34.749640    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b0ee441f-50e6-4c37-936e-637360dd3b85-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f796fdb98-9vpg7\" (UID: \"b0ee441f-50e6-4c37-936e-637360dd3b85\") " pod="openshift-monitoring/thanos-querier-7f796fdb98-9vpg7"
Jul 24 21:16:34.749689 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:34.749681    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b0ee441f-50e6-4c37-936e-637360dd3b85-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f796fdb98-9vpg7\" (UID: \"b0ee441f-50e6-4c37-936e-637360dd3b85\") " pod="openshift-monitoring/thanos-querier-7f796fdb98-9vpg7"
Jul 24 21:16:34.850751 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:34.850714    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgw7x\" (UniqueName: \"kubernetes.io/projected/b0ee441f-50e6-4c37-936e-637360dd3b85-kube-api-access-bgw7x\") pod \"thanos-querier-7f796fdb98-9vpg7\" (UID: \"b0ee441f-50e6-4c37-936e-637360dd3b85\") " pod="openshift-monitoring/thanos-querier-7f796fdb98-9vpg7"
Jul 24 21:16:34.850930 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:34.850775    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b0ee441f-50e6-4c37-936e-637360dd3b85-secret-grpc-tls\") pod \"thanos-querier-7f796fdb98-9vpg7\" (UID: \"b0ee441f-50e6-4c37-936e-637360dd3b85\") " pod="openshift-monitoring/thanos-querier-7f796fdb98-9vpg7"
Jul 24 21:16:34.850930 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:34.850805    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b0ee441f-50e6-4c37-936e-637360dd3b85-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f796fdb98-9vpg7\" (UID: \"b0ee441f-50e6-4c37-936e-637360dd3b85\") " pod="openshift-monitoring/thanos-querier-7f796fdb98-9vpg7"
Jul 24 21:16:34.850930 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:34.850832    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0ee441f-50e6-4c37-936e-637360dd3b85-metrics-client-ca\") pod \"thanos-querier-7f796fdb98-9vpg7\" (UID: \"b0ee441f-50e6-4c37-936e-637360dd3b85\") " pod="openshift-monitoring/thanos-querier-7f796fdb98-9vpg7"
Jul 24 21:16:34.850930 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:34.850863    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b0ee441f-50e6-4c37-936e-637360dd3b85-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f796fdb98-9vpg7\" (UID: \"b0ee441f-50e6-4c37-936e-637360dd3b85\") " pod="openshift-monitoring/thanos-querier-7f796fdb98-9vpg7"
Jul 24 21:16:34.850930 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:34.850889    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b0ee441f-50e6-4c37-936e-637360dd3b85-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f796fdb98-9vpg7\" (UID: \"b0ee441f-50e6-4c37-936e-637360dd3b85\") " pod="openshift-monitoring/thanos-querier-7f796fdb98-9vpg7"
Jul 24 21:16:34.851177 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:34.850931    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b0ee441f-50e6-4c37-936e-637360dd3b85-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f796fdb98-9vpg7\" (UID: \"b0ee441f-50e6-4c37-936e-637360dd3b85\") " pod="openshift-monitoring/thanos-querier-7f796fdb98-9vpg7"
Jul 24 21:16:34.851177 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:34.850992    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b0ee441f-50e6-4c37-936e-637360dd3b85-secret-thanos-querier-tls\") pod \"thanos-querier-7f796fdb98-9vpg7\" (UID: \"b0ee441f-50e6-4c37-936e-637360dd3b85\") " pod="openshift-monitoring/thanos-querier-7f796fdb98-9vpg7"
Jul 24 21:16:34.852021 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:34.851993    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0ee441f-50e6-4c37-936e-637360dd3b85-metrics-client-ca\") pod \"thanos-querier-7f796fdb98-9vpg7\" (UID: \"b0ee441f-50e6-4c37-936e-637360dd3b85\") " pod="openshift-monitoring/thanos-querier-7f796fdb98-9vpg7"
Jul 24 21:16:34.853962 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:34.853935    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b0ee441f-50e6-4c37-936e-637360dd3b85-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f796fdb98-9vpg7\" (UID: \"b0ee441f-50e6-4c37-936e-637360dd3b85\") " pod="openshift-monitoring/thanos-querier-7f796fdb98-9vpg7"
Jul 24 21:16:34.854461 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:34.854437    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b0ee441f-50e6-4c37-936e-637360dd3b85-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f796fdb98-9vpg7\" (UID: \"b0ee441f-50e6-4c37-936e-637360dd3b85\") " pod="openshift-monitoring/thanos-querier-7f796fdb98-9vpg7"
Jul 24 21:16:34.854461 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:34.854455    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b0ee441f-50e6-4c37-936e-637360dd3b85-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f796fdb98-9vpg7\" (UID: \"b0ee441f-50e6-4c37-936e-637360dd3b85\") " pod="openshift-monitoring/thanos-querier-7f796fdb98-9vpg7"
Jul 24 21:16:34.854623 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:34.854484    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b0ee441f-50e6-4c37-936e-637360dd3b85-secret-grpc-tls\") pod \"thanos-querier-7f796fdb98-9vpg7\" (UID: \"b0ee441f-50e6-4c37-936e-637360dd3b85\") " pod="openshift-monitoring/thanos-querier-7f796fdb98-9vpg7"
Jul 24 21:16:34.854897 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:34.854856    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b0ee441f-50e6-4c37-936e-637360dd3b85-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f796fdb98-9vpg7\" (UID: \"b0ee441f-50e6-4c37-936e-637360dd3b85\") " pod="openshift-monitoring/thanos-querier-7f796fdb98-9vpg7"
Jul 24 21:16:34.855625 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:34.855607    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b0ee441f-50e6-4c37-936e-637360dd3b85-secret-thanos-querier-tls\") pod \"thanos-querier-7f796fdb98-9vpg7\" (UID: \"b0ee441f-50e6-4c37-936e-637360dd3b85\") " pod="openshift-monitoring/thanos-querier-7f796fdb98-9vpg7"
Jul 24 21:16:34.861643 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:34.861621    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgw7x\" (UniqueName: \"kubernetes.io/projected/b0ee441f-50e6-4c37-936e-637360dd3b85-kube-api-access-bgw7x\") pod \"thanos-querier-7f796fdb98-9vpg7\" (UID: \"b0ee441f-50e6-4c37-936e-637360dd3b85\") " pod="openshift-monitoring/thanos-querier-7f796fdb98-9vpg7"
Jul 24 21:16:34.973983 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:34.973896    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f796fdb98-9vpg7"
Jul 24 21:16:37.047512 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.047475    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-9bd6ff4d6-clbgq"]
Jul 24 21:16:37.053143 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.053120    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-9bd6ff4d6-clbgq"
Jul 24 21:16:37.056425 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.056025    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 24 21:16:37.056425 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.056148    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 24 21:16:37.056425 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.056295    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 24 21:16:37.057111 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.057091    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-a9c2773klsfvl\""
Jul 24 21:16:37.057248 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.057159    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 24 21:16:37.057322 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.057264    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-lq8np\""
Jul 24 21:16:37.065134 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.064243    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-9bd6ff4d6-clbgq"]
Jul 24 21:16:37.173668 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.173631    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9d70963b-1629-4622-918f-8603f9533d22-secret-metrics-server-tls\") pod \"metrics-server-9bd6ff4d6-clbgq\" (UID: \"9d70963b-1629-4622-918f-8603f9533d22\") " pod="openshift-monitoring/metrics-server-9bd6ff4d6-clbgq"
Jul 24 21:16:37.173838 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.173676    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9d70963b-1629-4622-918f-8603f9533d22-secret-metrics-server-client-certs\") pod \"metrics-server-9bd6ff4d6-clbgq\" (UID: \"9d70963b-1629-4622-918f-8603f9533d22\") " pod="openshift-monitoring/metrics-server-9bd6ff4d6-clbgq"
Jul 24 21:16:37.173838 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.173720    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d70963b-1629-4622-918f-8603f9533d22-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9bd6ff4d6-clbgq\" (UID: \"9d70963b-1629-4622-918f-8603f9533d22\") " pod="openshift-monitoring/metrics-server-9bd6ff4d6-clbgq"
Jul 24 21:16:37.173838 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.173745    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9d70963b-1629-4622-918f-8603f9533d22-metrics-server-audit-profiles\") pod \"metrics-server-9bd6ff4d6-clbgq\" (UID: \"9d70963b-1629-4622-918f-8603f9533d22\") " pod="openshift-monitoring/metrics-server-9bd6ff4d6-clbgq"
Jul 24 21:16:37.173838 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.173796    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rdw8\" (UniqueName: \"kubernetes.io/projected/9d70963b-1629-4622-918f-8603f9533d22-kube-api-access-9rdw8\") pod \"metrics-server-9bd6ff4d6-clbgq\" (UID: \"9d70963b-1629-4622-918f-8603f9533d22\") " pod="openshift-monitoring/metrics-server-9bd6ff4d6-clbgq"
Jul 24 21:16:37.173838 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.173822    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9d70963b-1629-4622-918f-8603f9533d22-audit-log\") pod \"metrics-server-9bd6ff4d6-clbgq\" (UID: \"9d70963b-1629-4622-918f-8603f9533d22\") " pod="openshift-monitoring/metrics-server-9bd6ff4d6-clbgq"
Jul 24 21:16:37.174068 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.173860    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d70963b-1629-4622-918f-8603f9533d22-client-ca-bundle\") pod \"metrics-server-9bd6ff4d6-clbgq\" (UID: \"9d70963b-1629-4622-918f-8603f9533d22\") " pod="openshift-monitoring/metrics-server-9bd6ff4d6-clbgq"
Jul 24 21:16:37.274479 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.274446    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9d70963b-1629-4622-918f-8603f9533d22-secret-metrics-server-tls\") pod \"metrics-server-9bd6ff4d6-clbgq\" (UID: \"9d70963b-1629-4622-918f-8603f9533d22\") " pod="openshift-monitoring/metrics-server-9bd6ff4d6-clbgq"
Jul 24 21:16:37.274479 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.274484    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9d70963b-1629-4622-918f-8603f9533d22-secret-metrics-server-client-certs\") pod \"metrics-server-9bd6ff4d6-clbgq\" (UID: \"9d70963b-1629-4622-918f-8603f9533d22\") " pod="openshift-monitoring/metrics-server-9bd6ff4d6-clbgq"
Jul 24 21:16:37.274704 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.274518    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d70963b-1629-4622-918f-8603f9533d22-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9bd6ff4d6-clbgq\" (UID: \"9d70963b-1629-4622-918f-8603f9533d22\") " pod="openshift-monitoring/metrics-server-9bd6ff4d6-clbgq"
Jul 24 21:16:37.274704 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.274546    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9d70963b-1629-4622-918f-8603f9533d22-metrics-server-audit-profiles\") pod \"metrics-server-9bd6ff4d6-clbgq\" (UID: \"9d70963b-1629-4622-918f-8603f9533d22\") " pod="openshift-monitoring/metrics-server-9bd6ff4d6-clbgq"
Jul 24 21:16:37.274704 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.274597    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rdw8\" (UniqueName: \"kubernetes.io/projected/9d70963b-1629-4622-918f-8603f9533d22-kube-api-access-9rdw8\") pod \"metrics-server-9bd6ff4d6-clbgq\" (UID: \"9d70963b-1629-4622-918f-8603f9533d22\") " pod="openshift-monitoring/metrics-server-9bd6ff4d6-clbgq"
Jul 24 21:16:37.274704 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.274619    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9d70963b-1629-4622-918f-8603f9533d22-audit-log\") pod \"metrics-server-9bd6ff4d6-clbgq\" (UID: \"9d70963b-1629-4622-918f-8603f9533d22\") " pod="openshift-monitoring/metrics-server-9bd6ff4d6-clbgq"
Jul 24 21:16:37.274704 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.274655    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d70963b-1629-4622-918f-8603f9533d22-client-ca-bundle\") pod \"metrics-server-9bd6ff4d6-clbgq\" (UID: \"9d70963b-1629-4622-918f-8603f9533d22\") " pod="openshift-monitoring/metrics-server-9bd6ff4d6-clbgq"
Jul 24 21:16:37.275671 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.275642    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9d70963b-1629-4622-918f-8603f9533d22-audit-log\") pod \"metrics-server-9bd6ff4d6-clbgq\" (UID: \"9d70963b-1629-4622-918f-8603f9533d22\") " pod="openshift-monitoring/metrics-server-9bd6ff4d6-clbgq"
Jul 24 21:16:37.275836 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.275813    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d70963b-1629-4622-918f-8603f9533d22-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9bd6ff4d6-clbgq\" (UID: \"9d70963b-1629-4622-918f-8603f9533d22\") " pod="openshift-monitoring/metrics-server-9bd6ff4d6-clbgq"
Jul 24 21:16:37.275977 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.275947    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9d70963b-1629-4622-918f-8603f9533d22-metrics-server-audit-profiles\") pod \"metrics-server-9bd6ff4d6-clbgq\" (UID: \"9d70963b-1629-4622-918f-8603f9533d22\") " pod="openshift-monitoring/metrics-server-9bd6ff4d6-clbgq"
Jul 24 21:16:37.277520 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.277485    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d70963b-1629-4622-918f-8603f9533d22-client-ca-bundle\") pod \"metrics-server-9bd6ff4d6-clbgq\" (UID: \"9d70963b-1629-4622-918f-8603f9533d22\") " pod="openshift-monitoring/metrics-server-9bd6ff4d6-clbgq"
Jul 24 21:16:37.277674 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.277649    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9d70963b-1629-4622-918f-8603f9533d22-secret-metrics-server-tls\") pod \"metrics-server-9bd6ff4d6-clbgq\" (UID: \"9d70963b-1629-4622-918f-8603f9533d22\") " pod="openshift-monitoring/metrics-server-9bd6ff4d6-clbgq"
Jul 24 21:16:37.278291 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.278271    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9d70963b-1629-4622-918f-8603f9533d22-secret-metrics-server-client-certs\") pod \"metrics-server-9bd6ff4d6-clbgq\" (UID: \"9d70963b-1629-4622-918f-8603f9533d22\") " pod="openshift-monitoring/metrics-server-9bd6ff4d6-clbgq"
Jul 24 21:16:37.286636 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.286612    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-s2lmc"]
Jul 24 21:16:37.294798 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.294776    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rdw8\" (UniqueName: \"kubernetes.io/projected/9d70963b-1629-4622-918f-8603f9533d22-kube-api-access-9rdw8\") pod \"metrics-server-9bd6ff4d6-clbgq\" (UID: \"9d70963b-1629-4622-918f-8603f9533d22\") " pod="openshift-monitoring/metrics-server-9bd6ff4d6-clbgq"
Jul 24 21:16:37.321178 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.321107    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-s2lmc"]
Jul 24 21:16:37.321354 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.321198    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-s2lmc"
Jul 24 21:16:37.324599 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.324527    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-f5q84\""
Jul 24 21:16:37.325021 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.324959    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 24 21:16:37.368490 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.368465    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-9bd6ff4d6-clbgq"
Jul 24 21:16:37.375840 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.375806    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxbg7\" (UniqueName: \"kubernetes.io/projected/1318bbfb-d91f-4b45-b9c3-6c02f7ac7c0f-kube-api-access-mxbg7\") pod \"monitoring-plugin-68b7fc9574-s2lmc\" (UID: \"1318bbfb-d91f-4b45-b9c3-6c02f7ac7c0f\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-s2lmc"
Jul 24 21:16:37.375993 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.375970    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1318bbfb-d91f-4b45-b9c3-6c02f7ac7c0f-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-s2lmc\" (UID: \"1318bbfb-d91f-4b45-b9c3-6c02f7ac7c0f\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-s2lmc"
Jul 24 21:16:37.415005 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.414976    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-k5vbz"
Jul 24 21:16:37.476767 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.476737    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1318bbfb-d91f-4b45-b9c3-6c02f7ac7c0f-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-s2lmc\" (UID: \"1318bbfb-d91f-4b45-b9c3-6c02f7ac7c0f\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-s2lmc"
Jul 24 21:16:37.476941 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.476803    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxbg7\" (UniqueName: \"kubernetes.io/projected/1318bbfb-d91f-4b45-b9c3-6c02f7ac7c0f-kube-api-access-mxbg7\") pod \"monitoring-plugin-68b7fc9574-s2lmc\" (UID: \"1318bbfb-d91f-4b45-b9c3-6c02f7ac7c0f\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-s2lmc"
Jul 24 21:16:37.479883 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.479843    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1318bbfb-d91f-4b45-b9c3-6c02f7ac7c0f-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-s2lmc\" (UID: \"1318bbfb-d91f-4b45-b9c3-6c02f7ac7c0f\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-s2lmc"
Jul 24 21:16:37.485631 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.485605    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxbg7\" (UniqueName: \"kubernetes.io/projected/1318bbfb-d91f-4b45-b9c3-6c02f7ac7c0f-kube-api-access-mxbg7\") pod \"monitoring-plugin-68b7fc9574-s2lmc\" (UID: \"1318bbfb-d91f-4b45-b9c3-6c02f7ac7c0f\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-s2lmc"
Jul 24 21:16:37.632733 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.632654    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-s2lmc"
Jul 24 21:16:37.716371 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.716344    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-fbfcd779c-shsmf"]
Jul 24 21:16:37.728681 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.728660    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-fbfcd779c-shsmf"
Jul 24 21:16:37.732196 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.732160    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 24 21:16:37.732450 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.732435    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 24 21:16:37.732529 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.732509    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-fbfcd779c-shsmf"]
Jul 24 21:16:37.732588 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.732578    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 24 21:16:37.732801 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.732759    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 24 21:16:37.732986 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.732836    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-n7p28\""
Jul 24 21:16:37.733115 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.733021    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 24 21:16:37.738260 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.738216    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 24 21:16:37.779182 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.779158    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f-serving-certs-ca-bundle\") pod \"telemeter-client-fbfcd779c-shsmf\" (UID: \"5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f\") " pod="openshift-monitoring/telemeter-client-fbfcd779c-shsmf"
Jul 24 21:16:37.779333 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.779210    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f-metrics-client-ca\") pod \"telemeter-client-fbfcd779c-shsmf\" (UID: \"5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f\") " pod="openshift-monitoring/telemeter-client-fbfcd779c-shsmf"
Jul 24 21:16:37.779333 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.779259    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f-telemeter-client-tls\") pod \"telemeter-client-fbfcd779c-shsmf\" (UID: \"5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f\") " pod="openshift-monitoring/telemeter-client-fbfcd779c-shsmf"
Jul 24 21:16:37.779437 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.779340    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-fbfcd779c-shsmf\" (UID: \"5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f\") " pod="openshift-monitoring/telemeter-client-fbfcd779c-shsmf"
Jul 24 21:16:37.779437 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.779377    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f-secret-telemeter-client\") pod \"telemeter-client-fbfcd779c-shsmf\" (UID: \"5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f\") " pod="openshift-monitoring/telemeter-client-fbfcd779c-shsmf"
Jul 24 21:16:37.779437 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.779405    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r47p9\" (UniqueName: \"kubernetes.io/projected/5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f-kube-api-access-r47p9\") pod \"telemeter-client-fbfcd779c-shsmf\" (UID: \"5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f\") " pod="openshift-monitoring/telemeter-client-fbfcd779c-shsmf"
Jul 24 21:16:37.779586 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.779443    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f-federate-client-tls\") pod \"telemeter-client-fbfcd779c-shsmf\" (UID: \"5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f\") " pod="openshift-monitoring/telemeter-client-fbfcd779c-shsmf"
Jul 24 21:16:37.779586 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.779533    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-fbfcd779c-shsmf\" (UID: \"5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f\") " pod="openshift-monitoring/telemeter-client-fbfcd779c-shsmf"
Jul 24 21:16:37.880772 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.880739    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-fbfcd779c-shsmf\" (UID: \"5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f\") " pod="openshift-monitoring/telemeter-client-fbfcd779c-shsmf"
Jul 24 21:16:37.880772 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.880778    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f-secret-telemeter-client\") pod \"telemeter-client-fbfcd779c-shsmf\" (UID: \"5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f\") " pod="openshift-monitoring/telemeter-client-fbfcd779c-shsmf"
Jul 24 21:16:37.880968 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.880797    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r47p9\" (UniqueName: \"kubernetes.io/projected/5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f-kube-api-access-r47p9\") pod \"telemeter-client-fbfcd779c-shsmf\" (UID: \"5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f\") " pod="openshift-monitoring/telemeter-client-fbfcd779c-shsmf"
Jul 24 21:16:37.880968 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.880943    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f-federate-client-tls\") pod \"telemeter-client-fbfcd779c-shsmf\" (UID: \"5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f\") " pod="openshift-monitoring/telemeter-client-fbfcd779c-shsmf"
Jul 24 21:16:37.881076 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.881004    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-fbfcd779c-shsmf\" (UID: \"5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f\") " pod="openshift-monitoring/telemeter-client-fbfcd779c-shsmf"
Jul 24 21:16:37.881132 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.881091    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f-serving-certs-ca-bundle\") pod \"telemeter-client-fbfcd779c-shsmf\" (UID: \"5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f\") " pod="openshift-monitoring/telemeter-client-fbfcd779c-shsmf"
Jul 24 21:16:37.881184 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.881152    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f-metrics-client-ca\") pod \"telemeter-client-fbfcd779c-shsmf\" (UID: \"5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f\") " pod="openshift-monitoring/telemeter-client-fbfcd779c-shsmf"
Jul 24 21:16:37.881256 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.881192    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f-telemeter-client-tls\") pod \"telemeter-client-fbfcd779c-shsmf\" (UID: \"5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f\") " pod="openshift-monitoring/telemeter-client-fbfcd779c-shsmf"
Jul 24 21:16:37.881936 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.881886    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f-serving-certs-ca-bundle\") pod \"telemeter-client-fbfcd779c-shsmf\" (UID: \"5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f\") " pod="openshift-monitoring/telemeter-client-fbfcd779c-shsmf"
Jul 24 21:16:37.881936 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.881863    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-fbfcd779c-shsmf\" (UID: \"5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f\") " pod="openshift-monitoring/telemeter-client-fbfcd779c-shsmf"
Jul 24 21:16:37.882312 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.882293    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f-metrics-client-ca\") pod \"telemeter-client-fbfcd779c-shsmf\" (UID: \"5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f\") " pod="openshift-monitoring/telemeter-client-fbfcd779c-shsmf"
Jul 24 21:16:37.883748 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.883694    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f-telemeter-client-tls\") pod \"telemeter-client-fbfcd779c-shsmf\" (UID: \"5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f\") " pod="openshift-monitoring/telemeter-client-fbfcd779c-shsmf"
Jul 24 21:16:37.883820 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.883787    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-fbfcd779c-shsmf\" (UID: \"5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f\") " pod="openshift-monitoring/telemeter-client-fbfcd779c-shsmf"
Jul 24 21:16:37.884021 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.884005    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f-secret-telemeter-client\") pod \"telemeter-client-fbfcd779c-shsmf\" (UID: \"5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f\") " pod="openshift-monitoring/telemeter-client-fbfcd779c-shsmf"
Jul 24 21:16:37.884056 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.884023    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f-federate-client-tls\") pod \"telemeter-client-fbfcd779c-shsmf\" (UID: \"5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f\") " pod="openshift-monitoring/telemeter-client-fbfcd779c-shsmf"
Jul 24 21:16:37.890023 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:37.890005    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r47p9\" (UniqueName: \"kubernetes.io/projected/5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f-kube-api-access-r47p9\") pod \"telemeter-client-fbfcd779c-shsmf\" (UID: \"5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f\") " pod="openshift-monitoring/telemeter-client-fbfcd779c-shsmf"
Jul 24 21:16:38.040359 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:38.040332    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-fbfcd779c-shsmf"
Jul 24 21:16:38.310292 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:16:38.308028    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eed8790_d1de_470c_ab2d_f8a7618848c5.slice/crio-9db059aa126c85d839d1b89b7819ed1a6f574060e02f084fbbc09e547747b0a6 WatchSource:0}: Error finding container 9db059aa126c85d839d1b89b7819ed1a6f574060e02f084fbbc09e547747b0a6: Status 404 returned error can't find the container with id 9db059aa126c85d839d1b89b7819ed1a6f574060e02f084fbbc09e547747b0a6
Jul 24 21:16:38.455008 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:38.454923    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jrhqv" event={"ID":"f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96","Type":"ContainerStarted","Data":"dee60646ba3ff847b7efa8c0677cec990511538a34ec80133801252e1c4f5071"}
Jul 24 21:16:38.456909 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:38.456855    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rgr69" event={"ID":"4eed8790-d1de-470c-ab2d-f8a7618848c5","Type":"ContainerStarted","Data":"9db059aa126c85d839d1b89b7819ed1a6f574060e02f084fbbc09e547747b0a6"}
Jul 24 21:16:38.494783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:38.494458    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-9bd6ff4d6-clbgq"]
Jul 24 21:16:38.497404 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:16:38.497364    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d70963b_1629_4622_918f_8603f9533d22.slice/crio-370d1295b1f3a450d5008860197dcc6a4222d17d8ea6c9395e70210937ee3e55 WatchSource:0}: Error finding container 370d1295b1f3a450d5008860197dcc6a4222d17d8ea6c9395e70210937ee3e55: Status 404 returned error can't find the container with id 370d1295b1f3a450d5008860197dcc6a4222d17d8ea6c9395e70210937ee3e55
Jul 24 21:16:38.547206 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:38.547124    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-s2lmc"]
Jul 24 21:16:38.549111 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:16:38.549086    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1318bbfb_d91f_4b45_b9c3_6c02f7ac7c0f.slice/crio-3722051b6f6da3f6ca06109c0903f547125cf644012390acd260e92c83ddb81f WatchSource:0}: Error finding container 3722051b6f6da3f6ca06109c0903f547125cf644012390acd260e92c83ddb81f: Status 404 returned error can't find the container with id 3722051b6f6da3f6ca06109c0903f547125cf644012390acd260e92c83ddb81f
Jul 24 21:16:38.750842 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:38.750809    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-fbfcd779c-shsmf"]
Jul 24 21:16:38.752452 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:38.752361    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f796fdb98-9vpg7"]
Jul 24 21:16:38.754442 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:16:38.754408    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b5f4e0e_5d3e_417b_9f6f_1a1fe597f20f.slice/crio-5e3752acfcc3602ea963d4056dc77b9695141268b34752ca44cc28f2144217c8 WatchSource:0}: Error finding container 5e3752acfcc3602ea963d4056dc77b9695141268b34752ca44cc28f2144217c8: Status 404 returned error can't find the container with id 5e3752acfcc3602ea963d4056dc77b9695141268b34752ca44cc28f2144217c8
Jul 24 21:16:38.755431 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:16:38.755259    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0ee441f_50e6_4c37_936e_637360dd3b85.slice/crio-3dfb67a7227bf29b7a54614dc9b8f4b803613262291d6ba80866dd2f9790cc90 WatchSource:0}: Error finding container 3dfb67a7227bf29b7a54614dc9b8f4b803613262291d6ba80866dd2f9790cc90: Status 404 returned error can't find the container with id 3dfb67a7227bf29b7a54614dc9b8f4b803613262291d6ba80866dd2f9790cc90
Jul 24 21:16:39.477115 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:39.477034    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fbfcd779c-shsmf" event={"ID":"5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f","Type":"ContainerStarted","Data":"5e3752acfcc3602ea963d4056dc77b9695141268b34752ca44cc28f2144217c8"}
Jul 24 21:16:39.481346 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:39.481314    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-s2lmc" event={"ID":"1318bbfb-d91f-4b45-b9c3-6c02f7ac7c0f","Type":"ContainerStarted","Data":"3722051b6f6da3f6ca06109c0903f547125cf644012390acd260e92c83ddb81f"}
Jul 24 21:16:39.485815 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:39.485784    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-v7wlt" event={"ID":"5df1f115-30a2-4f8a-934e-22d4596da803","Type":"ContainerStarted","Data":"31ac9cbb35f87c1eb90fb8cbfd3b54a8763305ca190bee7b42a3414f34e346c2"}
Jul 24 21:16:39.489526 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:39.489508    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-v7wlt"
Jul 24 21:16:39.491727 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:39.491686    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-9bd6ff4d6-clbgq" event={"ID":"9d70963b-1629-4622-918f-8603f9533d22","Type":"ContainerStarted","Data":"370d1295b1f3a450d5008860197dcc6a4222d17d8ea6c9395e70210937ee3e55"}
Jul 24 21:16:39.493386 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:39.493358    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f796fdb98-9vpg7" event={"ID":"b0ee441f-50e6-4c37-936e-637360dd3b85","Type":"ContainerStarted","Data":"3dfb67a7227bf29b7a54614dc9b8f4b803613262291d6ba80866dd2f9790cc90"}
Jul 24 21:16:39.505668 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:39.505596    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-v7wlt" podStartSLOduration=2.321962298 podStartE2EDuration="22.505576411s" totalImagesPullingTime="20.183614113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:16:39.503876629 +0000 UTC m=+115.948468360" watchObservedRunningTime="2026-07-24 21:16:39.505576411 +0000 UTC m=+115.950168144"
Jul 24 21:16:39.508854 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:39.508716    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-v7wlt"
Jul 24 21:16:40.378134 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:40.377413    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5498cb8547-jn4vc"
Jul 24 21:16:40.509055 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:40.507583    2561 generic.go:356] "Generic (PLEG): container finished" podID="4eed8790-d1de-470c-ab2d-f8a7618848c5" containerID="4a778717cf3498d36e81de4fa71aa3511751ebe3cbce663be8a1992b4ff33c60" exitCode=0
Jul 24 21:16:40.509055 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:40.508804    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rgr69" event={"ID":"4eed8790-d1de-470c-ab2d-f8a7618848c5","Type":"ContainerDied","Data":"4a778717cf3498d36e81de4fa71aa3511751ebe3cbce663be8a1992b4ff33c60"}
Jul 24 21:16:40.550725 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:40.549720    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cc9bcc567-jjr76"]
Jul 24 21:16:40.564911 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:40.564858    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc9bcc567-jjr76"
Jul 24 21:16:40.581253 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:40.580691    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-c84kp\""
Jul 24 21:16:40.581542 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:40.581515    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 24 21:16:40.581762 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:40.581744    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 24 21:16:40.581830 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:40.581801    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 24 21:16:40.582005 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:40.581987    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 24 21:16:40.582649 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:40.582330    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 24 21:16:40.584120 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:40.584098    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cc9bcc567-jjr76"]
Jul 24 21:16:40.586605 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:40.586549    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 24 21:16:40.617091 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:40.614304    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37265554-5e75-4b8c-9e96-1852b412e3ce-console-serving-cert\") pod \"console-6cc9bcc567-jjr76\" (UID: \"37265554-5e75-4b8c-9e96-1852b412e3ce\") " pod="openshift-console/console-6cc9bcc567-jjr76"
Jul 24 21:16:40.617091 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:40.614371    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z59bc\" (UniqueName: \"kubernetes.io/projected/37265554-5e75-4b8c-9e96-1852b412e3ce-kube-api-access-z59bc\") pod \"console-6cc9bcc567-jjr76\" (UID: \"37265554-5e75-4b8c-9e96-1852b412e3ce\") " pod="openshift-console/console-6cc9bcc567-jjr76"
Jul 24 21:16:40.617091 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:40.614471    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37265554-5e75-4b8c-9e96-1852b412e3ce-trusted-ca-bundle\") pod \"console-6cc9bcc567-jjr76\" (UID: \"37265554-5e75-4b8c-9e96-1852b412e3ce\") " pod="openshift-console/console-6cc9bcc567-jjr76"
Jul 24 21:16:40.617091 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:40.614516    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37265554-5e75-4b8c-9e96-1852b412e3ce-console-config\") pod \"console-6cc9bcc567-jjr76\" (UID: \"37265554-5e75-4b8c-9e96-1852b412e3ce\") " pod="openshift-console/console-6cc9bcc567-jjr76"
Jul 24 21:16:40.617091 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:40.614554    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37265554-5e75-4b8c-9e96-1852b412e3ce-console-oauth-config\") pod \"console-6cc9bcc567-jjr76\" (UID: \"37265554-5e75-4b8c-9e96-1852b412e3ce\") " pod="openshift-console/console-6cc9bcc567-jjr76"
Jul 24 21:16:40.617091 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:40.614591    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37265554-5e75-4b8c-9e96-1852b412e3ce-oauth-serving-cert\") pod \"console-6cc9bcc567-jjr76\" (UID: \"37265554-5e75-4b8c-9e96-1852b412e3ce\") " pod="openshift-console/console-6cc9bcc567-jjr76"
Jul 24 21:16:40.617091 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:40.614615    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37265554-5e75-4b8c-9e96-1852b412e3ce-service-ca\") pod \"console-6cc9bcc567-jjr76\" (UID: \"37265554-5e75-4b8c-9e96-1852b412e3ce\") " pod="openshift-console/console-6cc9bcc567-jjr76"
Jul 24 21:16:40.718128 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:40.715413    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37265554-5e75-4b8c-9e96-1852b412e3ce-trusted-ca-bundle\") pod \"console-6cc9bcc567-jjr76\" (UID: \"37265554-5e75-4b8c-9e96-1852b412e3ce\") " pod="openshift-console/console-6cc9bcc567-jjr76"
Jul 24 21:16:40.718128 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:40.715467    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37265554-5e75-4b8c-9e96-1852b412e3ce-console-config\") pod \"console-6cc9bcc567-jjr76\" (UID: \"37265554-5e75-4b8c-9e96-1852b412e3ce\") " pod="openshift-console/console-6cc9bcc567-jjr76"
Jul 24 21:16:40.718128 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:40.715500    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37265554-5e75-4b8c-9e96-1852b412e3ce-console-oauth-config\") pod \"console-6cc9bcc567-jjr76\" (UID: \"37265554-5e75-4b8c-9e96-1852b412e3ce\") " pod="openshift-console/console-6cc9bcc567-jjr76"
Jul 24 21:16:40.718128 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:40.715540    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37265554-5e75-4b8c-9e96-1852b412e3ce-oauth-serving-cert\") pod \"console-6cc9bcc567-jjr76\" (UID: \"37265554-5e75-4b8c-9e96-1852b412e3ce\") " pod="openshift-console/console-6cc9bcc567-jjr76"
Jul 24 21:16:40.718128 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:40.715565    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37265554-5e75-4b8c-9e96-1852b412e3ce-service-ca\") pod \"console-6cc9bcc567-jjr76\" (UID: \"37265554-5e75-4b8c-9e96-1852b412e3ce\") " pod="openshift-console/console-6cc9bcc567-jjr76"
Jul 24 21:16:40.718128 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:40.715644    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37265554-5e75-4b8c-9e96-1852b412e3ce-console-serving-cert\") pod \"console-6cc9bcc567-jjr76\" (UID: \"37265554-5e75-4b8c-9e96-1852b412e3ce\") " pod="openshift-console/console-6cc9bcc567-jjr76"
Jul 24 21:16:40.718128 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:40.715674    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z59bc\" (UniqueName: \"kubernetes.io/projected/37265554-5e75-4b8c-9e96-1852b412e3ce-kube-api-access-z59bc\") pod \"console-6cc9bcc567-jjr76\" (UID: \"37265554-5e75-4b8c-9e96-1852b412e3ce\") " pod="openshift-console/console-6cc9bcc567-jjr76"
Jul 24 21:16:40.718128 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:40.716843    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37265554-5e75-4b8c-9e96-1852b412e3ce-trusted-ca-bundle\") pod \"console-6cc9bcc567-jjr76\" (UID: \"37265554-5e75-4b8c-9e96-1852b412e3ce\") " pod="openshift-console/console-6cc9bcc567-jjr76"
Jul 24 21:16:40.718128 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:40.717770    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37265554-5e75-4b8c-9e96-1852b412e3ce-oauth-serving-cert\") pod \"console-6cc9bcc567-jjr76\" (UID: \"37265554-5e75-4b8c-9e96-1852b412e3ce\") " pod="openshift-console/console-6cc9bcc567-jjr76"
Jul 24 21:16:40.719298 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:40.719274    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37265554-5e75-4b8c-9e96-1852b412e3ce-service-ca\") pod \"console-6cc9bcc567-jjr76\" (UID: \"37265554-5e75-4b8c-9e96-1852b412e3ce\") " pod="openshift-console/console-6cc9bcc567-jjr76"
Jul 24 21:16:40.719940 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:40.719891    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37265554-5e75-4b8c-9e96-1852b412e3ce-console-config\") pod \"console-6cc9bcc567-jjr76\" (UID: \"37265554-5e75-4b8c-9e96-1852b412e3ce\") " pod="openshift-console/console-6cc9bcc567-jjr76"
Jul 24 21:16:40.721119 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:40.721072    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37265554-5e75-4b8c-9e96-1852b412e3ce-console-oauth-config\") pod \"console-6cc9bcc567-jjr76\" (UID: \"37265554-5e75-4b8c-9e96-1852b412e3ce\") " pod="openshift-console/console-6cc9bcc567-jjr76"
Jul 24 21:16:40.723011 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:40.722969    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37265554-5e75-4b8c-9e96-1852b412e3ce-console-serving-cert\") pod \"console-6cc9bcc567-jjr76\" (UID: \"37265554-5e75-4b8c-9e96-1852b412e3ce\") " pod="openshift-console/console-6cc9bcc567-jjr76"
Jul 24 21:16:40.744494 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:40.743531    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z59bc\" (UniqueName: \"kubernetes.io/projected/37265554-5e75-4b8c-9e96-1852b412e3ce-kube-api-access-z59bc\") pod \"console-6cc9bcc567-jjr76\" (UID: \"37265554-5e75-4b8c-9e96-1852b412e3ce\") " pod="openshift-console/console-6cc9bcc567-jjr76"
Jul 24 21:16:40.909257 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:40.907638    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc9bcc567-jjr76"
Jul 24 21:16:41.518330 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:41.517986    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rgr69" event={"ID":"4eed8790-d1de-470c-ab2d-f8a7618848c5","Type":"ContainerStarted","Data":"dd9418f39d832c0ab9d47a3047c16221e452f3d92c70105f163e9bcb694de3c0"}
Jul 24 21:16:41.518330 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:41.518040    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rgr69" event={"ID":"4eed8790-d1de-470c-ab2d-f8a7618848c5","Type":"ContainerStarted","Data":"902abe43665f6dcb76bde03f6e5565cc977714bd71d47baf914fccb0394a20e1"}
Jul 24 21:16:41.543552 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:41.542514    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rgr69" podStartSLOduration=7.577786875 podStartE2EDuration="9.54249268s" totalImagesPullingTime="1.840586334s" totalInitContainerRuntime="124.119471ms" isStatefulPod=true podCreationTimestamp="2026-07-24 21:16:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:16:41.540754861 +0000 UTC m=+117.985346590" watchObservedRunningTime="2026-07-24 21:16:41.54249268 +0000 UTC m=+117.987084398"
Jul 24 21:16:47.648833 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:47.648806    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cc9bcc567-jjr76"]
Jul 24 21:16:47.650384 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:16:47.650350    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37265554_5e75_4b8c_9e96_1852b412e3ce.slice/crio-e6c1d0acf1466df2b08db63a3255975f3f3ed42ffde483c4833169afa9555e91 WatchSource:0}: Error finding container e6c1d0acf1466df2b08db63a3255975f3f3ed42ffde483c4833169afa9555e91: Status 404 returned error can't find the container with id e6c1d0acf1466df2b08db63a3255975f3f3ed42ffde483c4833169afa9555e91
Jul 24 21:16:48.559859 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:48.559769    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jrhqv" event={"ID":"f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96","Type":"ContainerStarted","Data":"9983b2770f5cc5f3bd2f51f6211d70c314a8efa4b7fed26d9c3a0f3cc2481227"}
Jul 24 21:16:48.563105 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:48.562918    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f796fdb98-9vpg7" event={"ID":"b0ee441f-50e6-4c37-936e-637360dd3b85","Type":"ContainerStarted","Data":"7b31a92fb1bbac9f7c719e0be13d1e4d4072030165d1ad4858cbb5fb048d8cc6"}
Jul 24 21:16:48.563105 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:48.562992    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f796fdb98-9vpg7" event={"ID":"b0ee441f-50e6-4c37-936e-637360dd3b85","Type":"ContainerStarted","Data":"9093350bb3673a3072bb9b383e34b93f452dfe49aa9fda6858d16c4936e1d39b"}
Jul 24 21:16:48.563105 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:48.563030    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f796fdb98-9vpg7" event={"ID":"b0ee441f-50e6-4c37-936e-637360dd3b85","Type":"ContainerStarted","Data":"eec26d799d82fc406624c7eb9d9dd9b7ce5aa51e7888915e1a06f64bf4a1fa6f"}
Jul 24 21:16:48.565266 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:48.565237    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fbfcd779c-shsmf" event={"ID":"5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f","Type":"ContainerStarted","Data":"42627bfc6636588b41380f6c3056cedd87f71935458cf4c96ba21aee99913a99"}
Jul 24 21:16:48.567143 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:48.567009    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-s2lmc" event={"ID":"1318bbfb-d91f-4b45-b9c3-6c02f7ac7c0f","Type":"ContainerStarted","Data":"5118eacf5866c235f8737d67414c5429bdded2ac50bf3e692756b953d37cd744"}
Jul 24 21:16:48.567928 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:48.567878    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-s2lmc"
Jul 24 21:16:48.569340 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:48.569271    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc9bcc567-jjr76" event={"ID":"37265554-5e75-4b8c-9e96-1852b412e3ce","Type":"ContainerStarted","Data":"e6c1d0acf1466df2b08db63a3255975f3f3ed42ffde483c4833169afa9555e91"}
Jul 24 21:16:48.571950 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:48.571386    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-9bd6ff4d6-clbgq" event={"ID":"9d70963b-1629-4622-918f-8603f9533d22","Type":"ContainerStarted","Data":"e2e4662e84ffe8105842043f5755bc0d28b3827c3a1013da73e5a3af7f828c1b"}
Jul 24 21:16:48.573867 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:48.573828    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-s2lmc"
Jul 24 21:16:48.607678 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:48.606935    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-9bd6ff4d6-clbgq" podStartSLOduration=2.614972315 podStartE2EDuration="11.606915852s" totalImagesPullingTime="8.991943537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:16:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:16:48.60556031 +0000 UTC m=+125.050152041" watchObservedRunningTime="2026-07-24 21:16:48.606915852 +0000 UTC m=+125.051507565"
Jul 24 21:16:48.608891 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:48.607943    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-s2lmc" podStartSLOduration=2.667691327 podStartE2EDuration="11.607930539s" totalImagesPullingTime="8.940239212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:16:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:16:48.586013582 +0000 UTC m=+125.030605311" watchObservedRunningTime="2026-07-24 21:16:48.607930539 +0000 UTC m=+125.052522271"
Jul 24 21:16:53.596274 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:53.596244    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jrhqv" event={"ID":"f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96","Type":"ContainerStarted","Data":"60a1f6018198daced9b4c2fbb15671baa8410d1390a9f3c13f302a368b5961f2"}
Jul 24 21:16:53.598824 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:53.598799    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f796fdb98-9vpg7" event={"ID":"b0ee441f-50e6-4c37-936e-637360dd3b85","Type":"ContainerStarted","Data":"af945b917fc784d37b8d38c515fdca246ed6622611cd659a95d91b0130c5c2fe"}
Jul 24 21:16:53.598932 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:53.598871    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f796fdb98-9vpg7" event={"ID":"b0ee441f-50e6-4c37-936e-637360dd3b85","Type":"ContainerStarted","Data":"f8706f47ae7fec4b506b6ad074d3ba869d08752a17c7164c5c408c8fded350f7"}
Jul 24 21:16:53.600645 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:53.600622    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fbfcd779c-shsmf" event={"ID":"5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f","Type":"ContainerStarted","Data":"178ffcf8466169e117bd7373134de26e260f7e2a880cea994cd171704225daa2"}
Jul 24 21:16:53.600743 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:53.600673    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fbfcd779c-shsmf" event={"ID":"5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f","Type":"ContainerStarted","Data":"9969e887e8a569a286eabb8797e5223248250b293961c76dcaef427d8df2dce4"}
Jul 24 21:16:53.602017 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:53.601998    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc9bcc567-jjr76" event={"ID":"37265554-5e75-4b8c-9e96-1852b412e3ce","Type":"ContainerStarted","Data":"b0277b3c0edf8449e178a69e785e8f724c4e868040233f24458144cb93604de8"}
Jul 24 21:16:53.663366 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:53.663302    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jrhqv" podStartSLOduration=33.910969225 podStartE2EDuration="1m2.663278399s" totalImagesPullingTime="28.752309174s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 21:15:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:16:53.62137342 +0000 UTC m=+130.065965149" watchObservedRunningTime="2026-07-24 21:16:53.663278399 +0000 UTC m=+130.107870130"
Jul 24 21:16:53.663793 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:53.663760    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-fbfcd779c-shsmf" podStartSLOduration=2.545924193 podStartE2EDuration="16.663751131s" totalImagesPullingTime="14.117826938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:16:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:16:53.660575941 +0000 UTC m=+130.105167671" watchObservedRunningTime="2026-07-24 21:16:53.663751131 +0000 UTC m=+130.108342861"
Jul 24 21:16:53.688190 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:53.688148    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6cc9bcc567-jjr76" podStartSLOduration=8.058852658 podStartE2EDuration="13.688134313s" totalImagesPullingTime="5.629281655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:16:53.686470337 +0000 UTC m=+130.131062067" watchObservedRunningTime="2026-07-24 21:16:53.688134313 +0000 UTC m=+130.132726044"
Jul 24 21:16:53.853509 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:53.853427    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ff19854-c536-4ba4-b2fc-29a8f87ff1a7-metrics-certs\") pod \"network-metrics-daemon-25fb5\" (UID: \"4ff19854-c536-4ba4-b2fc-29a8f87ff1a7\") " pod="openshift-multus/network-metrics-daemon-25fb5"
Jul 24 21:16:53.855760 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:53.855742    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ff19854-c536-4ba4-b2fc-29a8f87ff1a7-metrics-certs\") pod \"network-metrics-daemon-25fb5\" (UID: \"4ff19854-c536-4ba4-b2fc-29a8f87ff1a7\") " pod="openshift-multus/network-metrics-daemon-25fb5"
Jul 24 21:16:53.971337 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:53.971302    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zlbx8\""
Jul 24 21:16:53.976533 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:53.976517    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25fb5"
Jul 24 21:16:54.132205 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:54.132170    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-25fb5"]
Jul 24 21:16:54.134328 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:16:54.134301    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ff19854_c536_4ba4_b2fc_29a8f87ff1a7.slice/crio-26207b505fa91cb69304b4b8c54a97b18539de1197892b89bcb5f15aa2f249df WatchSource:0}: Error finding container 26207b505fa91cb69304b4b8c54a97b18539de1197892b89bcb5f15aa2f249df: Status 404 returned error can't find the container with id 26207b505fa91cb69304b4b8c54a97b18539de1197892b89bcb5f15aa2f249df
Jul 24 21:16:54.596052 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:54.596014    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cc9bcc567-jjr76"]
Jul 24 21:16:54.610801 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:54.610767    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f796fdb98-9vpg7" event={"ID":"b0ee441f-50e6-4c37-936e-637360dd3b85","Type":"ContainerStarted","Data":"456dd62d8332d63e2a42ff05e8f5e60a4044ee9c37d7392538f95563a14b955b"}
Jul 24 21:16:54.611411 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:54.611388    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7f796fdb98-9vpg7"
Jul 24 21:16:54.612501 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:54.612473    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-25fb5" event={"ID":"4ff19854-c536-4ba4-b2fc-29a8f87ff1a7","Type":"ContainerStarted","Data":"26207b505fa91cb69304b4b8c54a97b18539de1197892b89bcb5f15aa2f249df"}
Jul 24 21:16:54.618681 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:54.618661    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7f796fdb98-9vpg7"
Jul 24 21:16:54.646147 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:54.646068    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7f796fdb98-9vpg7" podStartSLOduration=6.863167923 podStartE2EDuration="20.646048759s" totalImagesPullingTime="13.782880836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:16:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:16:54.645109799 +0000 UTC m=+131.089701529" watchObservedRunningTime="2026-07-24 21:16:54.646048759 +0000 UTC m=+131.090640491"
Jul 24 21:16:56.622454 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:56.622420    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-25fb5" event={"ID":"4ff19854-c536-4ba4-b2fc-29a8f87ff1a7","Type":"ContainerStarted","Data":"1e1a616dbd2e0e4da74cc22b9ccb5441b3ef519020f905ed1e3d28dfd1558271"}
Jul 24 21:16:56.622900 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:56.622479    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-25fb5" event={"ID":"4ff19854-c536-4ba4-b2fc-29a8f87ff1a7","Type":"ContainerStarted","Data":"2fbb6acc942b253c5ccd9b6ed0b438da0ddcb77aadaf8bd6df8cac15a9c6fca2"}
Jul 24 21:16:56.641120 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:56.641067    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-25fb5" podStartSLOduration=131.262242475 podStartE2EDuration="2m12.641052369s" totalImagesPullingTime="1.378809894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:14:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:16:56.640320946 +0000 UTC m=+133.084912676" watchObservedRunningTime="2026-07-24 21:16:56.641052369 +0000 UTC m=+133.085644098"
Jul 24 21:16:57.369378 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:57.369334    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-9bd6ff4d6-clbgq"
Jul 24 21:16:57.369587 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:16:57.369414    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-9bd6ff4d6-clbgq"
Jul 24 21:17:00.908411 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:00.908370    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cc9bcc567-jjr76"
Jul 24 21:17:01.643916 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:01.643840    2561 generic.go:356] "Generic (PLEG): container finished" podID="c2353455-ff61-45d7-8f21-e18e09680380" containerID="100dc26154550b004bdbc4833a607680c5d74dbd9ae9560d48cad6984115d1f4" exitCode=0
Jul 24 21:17:01.643916 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:01.643887    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-9p7nm" event={"ID":"c2353455-ff61-45d7-8f21-e18e09680380","Type":"ContainerDied","Data":"100dc26154550b004bdbc4833a607680c5d74dbd9ae9560d48cad6984115d1f4"}
Jul 24 21:17:01.644238 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:01.644201    2561 scope.go:117] "RemoveContainer" containerID="100dc26154550b004bdbc4833a607680c5d74dbd9ae9560d48cad6984115d1f4"
Jul 24 21:17:02.649923 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:02.649892    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-9p7nm" event={"ID":"c2353455-ff61-45d7-8f21-e18e09680380","Type":"ContainerStarted","Data":"6c10fff1518ecfddbe09e8083d9e77ac9d3fc79c5f995f8d5ad5cb6f24406942"}
Jul 24 21:17:17.373745 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:17.373715    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-9bd6ff4d6-clbgq"
Jul 24 21:17:17.382648 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:17.382617    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-9bd6ff4d6-clbgq"
Jul 24 21:17:20.635567 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:20.635522    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6cc9bcc567-jjr76" podUID="37265554-5e75-4b8c-9e96-1852b412e3ce" containerName="console" containerID="cri-o://b0277b3c0edf8449e178a69e785e8f724c4e868040233f24458144cb93604de8" gracePeriod=15
Jul 24 21:17:21.431445 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:21.431414    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc9bcc567-jjr76"
Jul 24 21:17:21.502534 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:21.502508    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37265554-5e75-4b8c-9e96-1852b412e3ce-service-ca\") pod \"37265554-5e75-4b8c-9e96-1852b412e3ce\" (UID: \"37265554-5e75-4b8c-9e96-1852b412e3ce\") "
Jul 24 21:17:21.502691 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:21.502551    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z59bc\" (UniqueName: \"kubernetes.io/projected/37265554-5e75-4b8c-9e96-1852b412e3ce-kube-api-access-z59bc\") pod \"37265554-5e75-4b8c-9e96-1852b412e3ce\" (UID: \"37265554-5e75-4b8c-9e96-1852b412e3ce\") "
Jul 24 21:17:21.502691 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:21.502571    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37265554-5e75-4b8c-9e96-1852b412e3ce-trusted-ca-bundle\") pod \"37265554-5e75-4b8c-9e96-1852b412e3ce\" (UID: \"37265554-5e75-4b8c-9e96-1852b412e3ce\") "
Jul 24 21:17:21.502691 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:21.502586    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37265554-5e75-4b8c-9e96-1852b412e3ce-console-oauth-config\") pod \"37265554-5e75-4b8c-9e96-1852b412e3ce\" (UID: \"37265554-5e75-4b8c-9e96-1852b412e3ce\") "
Jul 24 21:17:21.502884 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:21.502607    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37265554-5e75-4b8c-9e96-1852b412e3ce-console-config\") pod \"37265554-5e75-4b8c-9e96-1852b412e3ce\" (UID: \"37265554-5e75-4b8c-9e96-1852b412e3ce\") "
Jul 24 21:17:21.502962 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:21.502928    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37265554-5e75-4b8c-9e96-1852b412e3ce-console-serving-cert\") pod \"37265554-5e75-4b8c-9e96-1852b412e3ce\" (UID: \"37265554-5e75-4b8c-9e96-1852b412e3ce\") "
Jul 24 21:17:21.502962 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:21.502935    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37265554-5e75-4b8c-9e96-1852b412e3ce-service-ca" (OuterVolumeSpecName: "service-ca") pod "37265554-5e75-4b8c-9e96-1852b412e3ce" (UID: "37265554-5e75-4b8c-9e96-1852b412e3ce"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:17:21.503063 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:21.503047    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37265554-5e75-4b8c-9e96-1852b412e3ce-oauth-serving-cert\") pod \"37265554-5e75-4b8c-9e96-1852b412e3ce\" (UID: \"37265554-5e75-4b8c-9e96-1852b412e3ce\") "
Jul 24 21:17:21.503117 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:21.503063    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37265554-5e75-4b8c-9e96-1852b412e3ce-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "37265554-5e75-4b8c-9e96-1852b412e3ce" (UID: "37265554-5e75-4b8c-9e96-1852b412e3ce"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:17:21.503163 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:21.503115    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37265554-5e75-4b8c-9e96-1852b412e3ce-console-config" (OuterVolumeSpecName: "console-config") pod "37265554-5e75-4b8c-9e96-1852b412e3ce" (UID: "37265554-5e75-4b8c-9e96-1852b412e3ce"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:17:21.503488 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:21.503466    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37265554-5e75-4b8c-9e96-1852b412e3ce-service-ca\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:17:21.503566 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:21.503495    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37265554-5e75-4b8c-9e96-1852b412e3ce-trusted-ca-bundle\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:17:21.503566 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:21.503513    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37265554-5e75-4b8c-9e96-1852b412e3ce-console-config\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:17:21.503653 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:21.503632    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37265554-5e75-4b8c-9e96-1852b412e3ce-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "37265554-5e75-4b8c-9e96-1852b412e3ce" (UID: "37265554-5e75-4b8c-9e96-1852b412e3ce"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:17:21.504983 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:21.504939    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37265554-5e75-4b8c-9e96-1852b412e3ce-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "37265554-5e75-4b8c-9e96-1852b412e3ce" (UID: "37265554-5e75-4b8c-9e96-1852b412e3ce"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 21:17:21.505074 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:21.505008    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37265554-5e75-4b8c-9e96-1852b412e3ce-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "37265554-5e75-4b8c-9e96-1852b412e3ce" (UID: "37265554-5e75-4b8c-9e96-1852b412e3ce"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 21:17:21.505074 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:21.505021    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37265554-5e75-4b8c-9e96-1852b412e3ce-kube-api-access-z59bc" (OuterVolumeSpecName: "kube-api-access-z59bc") pod "37265554-5e75-4b8c-9e96-1852b412e3ce" (UID: "37265554-5e75-4b8c-9e96-1852b412e3ce"). InnerVolumeSpecName "kube-api-access-z59bc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 21:17:21.604299 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:21.604270    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z59bc\" (UniqueName: \"kubernetes.io/projected/37265554-5e75-4b8c-9e96-1852b412e3ce-kube-api-access-z59bc\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:17:21.604299 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:21.604296    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37265554-5e75-4b8c-9e96-1852b412e3ce-console-oauth-config\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:17:21.604439 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:21.604309    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37265554-5e75-4b8c-9e96-1852b412e3ce-console-serving-cert\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:17:21.604439 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:21.604321    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37265554-5e75-4b8c-9e96-1852b412e3ce-oauth-serving-cert\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:17:21.730998 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:21.730928    2561 generic.go:356] "Generic (PLEG): container finished" podID="37265554-5e75-4b8c-9e96-1852b412e3ce" containerID="b0277b3c0edf8449e178a69e785e8f724c4e868040233f24458144cb93604de8" exitCode=0
Jul 24 21:17:21.730998 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:21.730978    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc9bcc567-jjr76"
Jul 24 21:17:21.731455 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:21.731014    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc9bcc567-jjr76" event={"ID":"37265554-5e75-4b8c-9e96-1852b412e3ce","Type":"ContainerDied","Data":"b0277b3c0edf8449e178a69e785e8f724c4e868040233f24458144cb93604de8"}
Jul 24 21:17:21.731455 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:21.731096    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc9bcc567-jjr76" event={"ID":"37265554-5e75-4b8c-9e96-1852b412e3ce","Type":"ContainerDied","Data":"e6c1d0acf1466df2b08db63a3255975f3f3ed42ffde483c4833169afa9555e91"}
Jul 24 21:17:21.731455 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:21.731127    2561 scope.go:117] "RemoveContainer" containerID="b0277b3c0edf8449e178a69e785e8f724c4e868040233f24458144cb93604de8"
Jul 24 21:17:21.732924 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:21.732901    2561 generic.go:356] "Generic (PLEG): container finished" podID="0a7bfbf1-0e0b-485b-a9bd-8434ae053d3f" containerID="8e1174c520b599753232d1b52aba8477a10cfff1a4d1914fca0bab1ab314e9f7" exitCode=0
Jul 24 21:17:21.732996 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:21.732927    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qcxgx" event={"ID":"0a7bfbf1-0e0b-485b-a9bd-8434ae053d3f","Type":"ContainerDied","Data":"8e1174c520b599753232d1b52aba8477a10cfff1a4d1914fca0bab1ab314e9f7"}
Jul 24 21:17:21.733323 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:21.733307    2561 scope.go:117] "RemoveContainer" containerID="8e1174c520b599753232d1b52aba8477a10cfff1a4d1914fca0bab1ab314e9f7"
Jul 24 21:17:21.740276 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:21.740252    2561 scope.go:117] "RemoveContainer" containerID="b0277b3c0edf8449e178a69e785e8f724c4e868040233f24458144cb93604de8"
Jul 24 21:17:21.740669 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:17:21.740581    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0277b3c0edf8449e178a69e785e8f724c4e868040233f24458144cb93604de8\": container with ID starting with b0277b3c0edf8449e178a69e785e8f724c4e868040233f24458144cb93604de8 not found: ID does not exist" containerID="b0277b3c0edf8449e178a69e785e8f724c4e868040233f24458144cb93604de8"
Jul 24 21:17:21.740669 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:21.740615    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0277b3c0edf8449e178a69e785e8f724c4e868040233f24458144cb93604de8"} err="failed to get container status \"b0277b3c0edf8449e178a69e785e8f724c4e868040233f24458144cb93604de8\": rpc error: code = NotFound desc = could not find container \"b0277b3c0edf8449e178a69e785e8f724c4e868040233f24458144cb93604de8\": container with ID starting with b0277b3c0edf8449e178a69e785e8f724c4e868040233f24458144cb93604de8 not found: ID does not exist"
Jul 24 21:17:21.764719 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:21.764694    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cc9bcc567-jjr76"]
Jul 24 21:17:21.765956 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:21.765936    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6cc9bcc567-jjr76"]
Jul 24 21:17:21.954765 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:21.954735    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37265554-5e75-4b8c-9e96-1852b412e3ce" path="/var/lib/kubelet/pods/37265554-5e75-4b8c-9e96-1852b412e3ce/volumes"
Jul 24 21:17:22.739064 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:17:22.739025    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qcxgx" event={"ID":"0a7bfbf1-0e0b-485b-a9bd-8434ae053d3f","Type":"ContainerStarted","Data":"632b23a4c76ca35b420730dc06f6a99734e864851a41c83bc41f020252423f26"}
Jul 24 21:19:43.858722 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:19:43.858691    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nsjrg_87f18cf4-62ce-48a0-99b0-fe22bc19f701/console-operator/1.log"
Jul 24 21:19:43.863114 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:19:43.863083    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nsjrg_87f18cf4-62ce-48a0-99b0-fe22bc19f701/console-operator/1.log"
Jul 24 21:19:43.869705 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:19:43.869685    2561 kubelet.go:1648] "Image garbage collection succeeded"
Jul 24 21:20:17.748646 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:20:17.748610    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-77f648d694-8n9wr"]
Jul 24 21:20:17.751051 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:20:17.748936    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37265554-5e75-4b8c-9e96-1852b412e3ce" containerName="console"
Jul 24 21:20:17.751051 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:20:17.748947    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="37265554-5e75-4b8c-9e96-1852b412e3ce" containerName="console"
Jul 24 21:20:17.751051 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:20:17.749004    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="37265554-5e75-4b8c-9e96-1852b412e3ce" containerName="console"
Jul 24 21:20:17.751902 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:20:17.751884    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-8n9wr"
Jul 24 21:20:17.757451 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:20:17.757426    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-zs8xx\""
Jul 24 21:20:17.757580 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:20:17.757432    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Jul 24 21:20:17.757580 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:20:17.757496    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Jul 24 21:20:17.757580 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:20:17.757556    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Jul 24 21:20:17.757580 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:20:17.757562    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Jul 24 21:20:17.757764 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:20:17.757598    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\""
Jul 24 21:20:17.765998 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:20:17.765975    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/44dc8780-0f80-4431-9407-79b2bae45b05-cabundle0\") pod \"keda-operator-77f648d694-8n9wr\" (UID: \"44dc8780-0f80-4431-9407-79b2bae45b05\") " pod="openshift-keda/keda-operator-77f648d694-8n9wr"
Jul 24 21:20:17.766083 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:20:17.766006    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/44dc8780-0f80-4431-9407-79b2bae45b05-certificates\") pod \"keda-operator-77f648d694-8n9wr\" (UID: \"44dc8780-0f80-4431-9407-79b2bae45b05\") " pod="openshift-keda/keda-operator-77f648d694-8n9wr"
Jul 24 21:20:17.766083 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:20:17.766051    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq9wr\" (UniqueName: \"kubernetes.io/projected/44dc8780-0f80-4431-9407-79b2bae45b05-kube-api-access-gq9wr\") pod \"keda-operator-77f648d694-8n9wr\" (UID: \"44dc8780-0f80-4431-9407-79b2bae45b05\") " pod="openshift-keda/keda-operator-77f648d694-8n9wr"
Jul 24 21:20:17.771916 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:20:17.771896    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-8n9wr"]
Jul 24 21:20:17.866960 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:20:17.866926    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq9wr\" (UniqueName: \"kubernetes.io/projected/44dc8780-0f80-4431-9407-79b2bae45b05-kube-api-access-gq9wr\") pod \"keda-operator-77f648d694-8n9wr\" (UID: \"44dc8780-0f80-4431-9407-79b2bae45b05\") " pod="openshift-keda/keda-operator-77f648d694-8n9wr"
Jul 24 21:20:17.867119 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:20:17.866987    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/44dc8780-0f80-4431-9407-79b2bae45b05-cabundle0\") pod \"keda-operator-77f648d694-8n9wr\" (UID: \"44dc8780-0f80-4431-9407-79b2bae45b05\") " pod="openshift-keda/keda-operator-77f648d694-8n9wr"
Jul 24 21:20:17.867119 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:20:17.867023    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/44dc8780-0f80-4431-9407-79b2bae45b05-certificates\") pod \"keda-operator-77f648d694-8n9wr\" (UID: \"44dc8780-0f80-4431-9407-79b2bae45b05\") " pod="openshift-keda/keda-operator-77f648d694-8n9wr"
Jul 24 21:20:17.867268 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:20:17.867118    2561 configmap.go:193] Couldn't get configMap openshift-keda/keda-ocp-cabundle: configmap "keda-ocp-cabundle" not found
Jul 24 21:20:17.867268 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:20:17.867154    2561 secret.go:281] references non-existent secret key: ca.crt
Jul 24 21:20:17.867268 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:20:17.867171    2561 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Jul 24 21:20:17.867268 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:20:17.867182    2561 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-8n9wr: references non-existent secret key: ca.crt
Jul 24 21:20:17.867268 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:20:17.867192    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/44dc8780-0f80-4431-9407-79b2bae45b05-cabundle0 podName:44dc8780-0f80-4431-9407-79b2bae45b05 nodeName:}" failed. No retries permitted until 2026-07-24 21:20:18.367174152 +0000 UTC m=+334.811765881 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cabundle0" (UniqueName: "kubernetes.io/configmap/44dc8780-0f80-4431-9407-79b2bae45b05-cabundle0") pod "keda-operator-77f648d694-8n9wr" (UID: "44dc8780-0f80-4431-9407-79b2bae45b05") : configmap "keda-ocp-cabundle" not found
Jul 24 21:20:17.867268 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:20:17.867268    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44dc8780-0f80-4431-9407-79b2bae45b05-certificates podName:44dc8780-0f80-4431-9407-79b2bae45b05 nodeName:}" failed. No retries permitted until 2026-07-24 21:20:18.367220415 +0000 UTC m=+334.811812140 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/44dc8780-0f80-4431-9407-79b2bae45b05-certificates") pod "keda-operator-77f648d694-8n9wr" (UID: "44dc8780-0f80-4431-9407-79b2bae45b05") : references non-existent secret key: ca.crt
Jul 24 21:20:17.875968 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:20:17.875946    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq9wr\" (UniqueName: \"kubernetes.io/projected/44dc8780-0f80-4431-9407-79b2bae45b05-kube-api-access-gq9wr\") pod \"keda-operator-77f648d694-8n9wr\" (UID: \"44dc8780-0f80-4431-9407-79b2bae45b05\") " pod="openshift-keda/keda-operator-77f648d694-8n9wr"
Jul 24 21:20:18.371315 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:20:18.371278    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/44dc8780-0f80-4431-9407-79b2bae45b05-cabundle0\") pod \"keda-operator-77f648d694-8n9wr\" (UID: \"44dc8780-0f80-4431-9407-79b2bae45b05\") " pod="openshift-keda/keda-operator-77f648d694-8n9wr"
Jul 24 21:20:18.371315 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:20:18.371323    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/44dc8780-0f80-4431-9407-79b2bae45b05-certificates\") pod \"keda-operator-77f648d694-8n9wr\" (UID: \"44dc8780-0f80-4431-9407-79b2bae45b05\") " pod="openshift-keda/keda-operator-77f648d694-8n9wr"
Jul 24 21:20:18.371915 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:20:18.371890    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/44dc8780-0f80-4431-9407-79b2bae45b05-cabundle0\") pod \"keda-operator-77f648d694-8n9wr\" (UID: \"44dc8780-0f80-4431-9407-79b2bae45b05\") " pod="openshift-keda/keda-operator-77f648d694-8n9wr"
Jul 24 21:20:18.373750 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:20:18.373733    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/44dc8780-0f80-4431-9407-79b2bae45b05-certificates\") pod \"keda-operator-77f648d694-8n9wr\" (UID: \"44dc8780-0f80-4431-9407-79b2bae45b05\") " pod="openshift-keda/keda-operator-77f648d694-8n9wr"
Jul 24 21:20:18.661977 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:20:18.661894    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-8n9wr"
Jul 24 21:20:18.796290 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:20:18.796254    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-8n9wr"]
Jul 24 21:20:18.799033 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:20:18.799005    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44dc8780_0f80_4431_9407_79b2bae45b05.slice/crio-a8be71e871c18b48e268dc8de3cfbb7d52ddac4b52198a0b79db89c0e69ca1d4 WatchSource:0}: Error finding container a8be71e871c18b48e268dc8de3cfbb7d52ddac4b52198a0b79db89c0e69ca1d4: Status 404 returned error can't find the container with id a8be71e871c18b48e268dc8de3cfbb7d52ddac4b52198a0b79db89c0e69ca1d4
Jul 24 21:20:18.800421 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:20:18.800401    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 21:20:19.426782 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:20:19.426747    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-8n9wr" event={"ID":"44dc8780-0f80-4431-9407-79b2bae45b05","Type":"ContainerStarted","Data":"a8be71e871c18b48e268dc8de3cfbb7d52ddac4b52198a0b79db89c0e69ca1d4"}
Jul 24 21:20:22.441567 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:20:22.441536    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-8n9wr" event={"ID":"44dc8780-0f80-4431-9407-79b2bae45b05","Type":"ContainerStarted","Data":"8d779cad4e341605cf564547aab4232faff6bbd798a03f4aa6bf133ea9da2bc2"}
Jul 24 21:20:22.441954 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:20:22.441660    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-77f648d694-8n9wr"
Jul 24 21:20:22.458461 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:20:22.458411    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-77f648d694-8n9wr" podStartSLOduration=2.0448595960000002 podStartE2EDuration="5.458395066s" totalImagesPullingTime="3.41353547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:20:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:20:22.457028276 +0000 UTC m=+338.901620009" watchObservedRunningTime="2026-07-24 21:20:22.458395066 +0000 UTC m=+338.902986799"
Jul 24 21:20:43.448814 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:20:43.448735    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-77f648d694-8n9wr"
Jul 24 21:21:43.192322 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:21:43.192285    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-csqxg"]
Jul 24 21:21:43.195527 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:21:43.195511    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-csqxg"
Jul 24 21:21:43.198349 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:21:43.198325    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Jul 24 21:21:43.198349 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:21:43.198345    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 24 21:21:43.198538 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:21:43.198397    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 24 21:21:43.199197 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:21:43.199182    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-rkwtl\""
Jul 24 21:21:43.213576 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:21:43.213543    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-csqxg"]
Jul 24 21:21:43.249116 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:21:43.249090    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/97c449e6-1f88-43e6-8272-aed54ab683d7-data\") pod \"seaweedfs-64568bcd49-csqxg\" (UID: \"97c449e6-1f88-43e6-8272-aed54ab683d7\") " pod="kserve/seaweedfs-64568bcd49-csqxg"
Jul 24 21:21:43.249215 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:21:43.249124    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtlck\" (UniqueName: \"kubernetes.io/projected/97c449e6-1f88-43e6-8272-aed54ab683d7-kube-api-access-gtlck\") pod \"seaweedfs-64568bcd49-csqxg\" (UID: \"97c449e6-1f88-43e6-8272-aed54ab683d7\") " pod="kserve/seaweedfs-64568bcd49-csqxg"
Jul 24 21:21:43.349853 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:21:43.349818    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/97c449e6-1f88-43e6-8272-aed54ab683d7-data\") pod \"seaweedfs-64568bcd49-csqxg\" (UID: \"97c449e6-1f88-43e6-8272-aed54ab683d7\") " pod="kserve/seaweedfs-64568bcd49-csqxg"
Jul 24 21:21:43.349989 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:21:43.349868    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtlck\" (UniqueName: \"kubernetes.io/projected/97c449e6-1f88-43e6-8272-aed54ab683d7-kube-api-access-gtlck\") pod \"seaweedfs-64568bcd49-csqxg\" (UID: \"97c449e6-1f88-43e6-8272-aed54ab683d7\") " pod="kserve/seaweedfs-64568bcd49-csqxg"
Jul 24 21:21:43.350266 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:21:43.350218    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/97c449e6-1f88-43e6-8272-aed54ab683d7-data\") pod \"seaweedfs-64568bcd49-csqxg\" (UID: \"97c449e6-1f88-43e6-8272-aed54ab683d7\") " pod="kserve/seaweedfs-64568bcd49-csqxg"
Jul 24 21:21:43.376466 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:21:43.376440    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtlck\" (UniqueName: \"kubernetes.io/projected/97c449e6-1f88-43e6-8272-aed54ab683d7-kube-api-access-gtlck\") pod \"seaweedfs-64568bcd49-csqxg\" (UID: \"97c449e6-1f88-43e6-8272-aed54ab683d7\") " pod="kserve/seaweedfs-64568bcd49-csqxg"
Jul 24 21:21:43.504541 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:21:43.504464    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-csqxg"
Jul 24 21:21:43.661785 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:21:43.661755    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-csqxg"]
Jul 24 21:21:43.665023 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:21:43.665000    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97c449e6_1f88_43e6_8272_aed54ab683d7.slice/crio-d6e7d609a9bba2f505647b0f00dee6405088dace211256d8cd4669c3385f0064 WatchSource:0}: Error finding container d6e7d609a9bba2f505647b0f00dee6405088dace211256d8cd4669c3385f0064: Status 404 returned error can't find the container with id d6e7d609a9bba2f505647b0f00dee6405088dace211256d8cd4669c3385f0064
Jul 24 21:21:43.750700 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:21:43.750668    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-csqxg" event={"ID":"97c449e6-1f88-43e6-8272-aed54ab683d7","Type":"ContainerStarted","Data":"d6e7d609a9bba2f505647b0f00dee6405088dace211256d8cd4669c3385f0064"}
Jul 24 21:21:46.871910 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:21:46.871887    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Jul 24 21:21:47.769304 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:21:47.769263    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-csqxg" event={"ID":"97c449e6-1f88-43e6-8272-aed54ab683d7","Type":"ContainerStarted","Data":"86fa0b1479457d952885586c10d4ad1ed56e9d45b7ff5f1f1485232e4491e1e0"}
Jul 24 21:21:47.769474 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:21:47.769401    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-csqxg"
Jul 24 21:21:47.790377 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:21:47.790338    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-csqxg" podStartSLOduration=1.587360584 podStartE2EDuration="4.790324536s" totalImagesPullingTime="3.202963952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:21:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:21:47.788113291 +0000 UTC m=+424.232705022" watchObservedRunningTime="2026-07-24 21:21:47.790324536 +0000 UTC m=+424.234916266"
Jul 24 21:21:53.775385 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:21:53.775358    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-csqxg"
Jul 24 21:22:03.669825 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:03.669792    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6845b948c7-zw4nl"]
Jul 24 21:22:03.674366 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:03.674349    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6845b948c7-zw4nl"
Jul 24 21:22:03.680086 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:03.680059    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 24 21:22:03.688002 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:03.687979    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 24 21:22:03.689057 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:03.689040    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 24 21:22:03.689115 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:03.689048    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 24 21:22:03.689115 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:03.689089    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-c84kp\""
Jul 24 21:22:03.690462 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:03.690443    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 24 21:22:03.690693 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:03.690679    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 24 21:22:03.704562 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:03.704530    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6845b948c7-zw4nl"]
Jul 24 21:22:03.824906 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:03.824869    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7b0e951-2cff-4974-a9cc-ec547470b1c9-trusted-ca-bundle\") pod \"console-6845b948c7-zw4nl\" (UID: \"b7b0e951-2cff-4974-a9cc-ec547470b1c9\") " pod="openshift-console/console-6845b948c7-zw4nl"
Jul 24 21:22:03.824906 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:03.824909    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9c8m\" (UniqueName: \"kubernetes.io/projected/b7b0e951-2cff-4974-a9cc-ec547470b1c9-kube-api-access-p9c8m\") pod \"console-6845b948c7-zw4nl\" (UID: \"b7b0e951-2cff-4974-a9cc-ec547470b1c9\") " pod="openshift-console/console-6845b948c7-zw4nl"
Jul 24 21:22:03.825128 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:03.824941    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7b0e951-2cff-4974-a9cc-ec547470b1c9-service-ca\") pod \"console-6845b948c7-zw4nl\" (UID: \"b7b0e951-2cff-4974-a9cc-ec547470b1c9\") " pod="openshift-console/console-6845b948c7-zw4nl"
Jul 24 21:22:03.825128 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:03.825011    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7b0e951-2cff-4974-a9cc-ec547470b1c9-console-oauth-config\") pod \"console-6845b948c7-zw4nl\" (UID: \"b7b0e951-2cff-4974-a9cc-ec547470b1c9\") " pod="openshift-console/console-6845b948c7-zw4nl"
Jul 24 21:22:03.825128 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:03.825043    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7b0e951-2cff-4974-a9cc-ec547470b1c9-console-config\") pod \"console-6845b948c7-zw4nl\" (UID: \"b7b0e951-2cff-4974-a9cc-ec547470b1c9\") " pod="openshift-console/console-6845b948c7-zw4nl"
Jul 24 21:22:03.825128 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:03.825085    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7b0e951-2cff-4974-a9cc-ec547470b1c9-oauth-serving-cert\") pod \"console-6845b948c7-zw4nl\" (UID: \"b7b0e951-2cff-4974-a9cc-ec547470b1c9\") " pod="openshift-console/console-6845b948c7-zw4nl"
Jul 24 21:22:03.825290 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:03.825131    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7b0e951-2cff-4974-a9cc-ec547470b1c9-console-serving-cert\") pod \"console-6845b948c7-zw4nl\" (UID: \"b7b0e951-2cff-4974-a9cc-ec547470b1c9\") " pod="openshift-console/console-6845b948c7-zw4nl"
Jul 24 21:22:03.925858 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:03.925744    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7b0e951-2cff-4974-a9cc-ec547470b1c9-console-serving-cert\") pod \"console-6845b948c7-zw4nl\" (UID: \"b7b0e951-2cff-4974-a9cc-ec547470b1c9\") " pod="openshift-console/console-6845b948c7-zw4nl"
Jul 24 21:22:03.925858 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:03.925814    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7b0e951-2cff-4974-a9cc-ec547470b1c9-trusted-ca-bundle\") pod \"console-6845b948c7-zw4nl\" (UID: \"b7b0e951-2cff-4974-a9cc-ec547470b1c9\") " pod="openshift-console/console-6845b948c7-zw4nl"
Jul 24 21:22:03.925858 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:03.925843    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9c8m\" (UniqueName: \"kubernetes.io/projected/b7b0e951-2cff-4974-a9cc-ec547470b1c9-kube-api-access-p9c8m\") pod \"console-6845b948c7-zw4nl\" (UID: \"b7b0e951-2cff-4974-a9cc-ec547470b1c9\") " pod="openshift-console/console-6845b948c7-zw4nl"
Jul 24 21:22:03.926142 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:03.925885    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7b0e951-2cff-4974-a9cc-ec547470b1c9-service-ca\") pod \"console-6845b948c7-zw4nl\" (UID: \"b7b0e951-2cff-4974-a9cc-ec547470b1c9\") " pod="openshift-console/console-6845b948c7-zw4nl"
Jul 24 21:22:03.926142 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:03.925913    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7b0e951-2cff-4974-a9cc-ec547470b1c9-console-oauth-config\") pod \"console-6845b948c7-zw4nl\" (UID: \"b7b0e951-2cff-4974-a9cc-ec547470b1c9\") " pod="openshift-console/console-6845b948c7-zw4nl"
Jul 24 21:22:03.926142 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:03.925942    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7b0e951-2cff-4974-a9cc-ec547470b1c9-console-config\") pod \"console-6845b948c7-zw4nl\" (UID: \"b7b0e951-2cff-4974-a9cc-ec547470b1c9\") " pod="openshift-console/console-6845b948c7-zw4nl"
Jul 24 21:22:03.926142 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:03.925978    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7b0e951-2cff-4974-a9cc-ec547470b1c9-oauth-serving-cert\") pod \"console-6845b948c7-zw4nl\" (UID: \"b7b0e951-2cff-4974-a9cc-ec547470b1c9\") " pod="openshift-console/console-6845b948c7-zw4nl"
Jul 24 21:22:03.926736 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:03.926714    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7b0e951-2cff-4974-a9cc-ec547470b1c9-oauth-serving-cert\") pod \"console-6845b948c7-zw4nl\" (UID: \"b7b0e951-2cff-4974-a9cc-ec547470b1c9\") " pod="openshift-console/console-6845b948c7-zw4nl"
Jul 24 21:22:03.926810 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:03.926774    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7b0e951-2cff-4974-a9cc-ec547470b1c9-trusted-ca-bundle\") pod \"console-6845b948c7-zw4nl\" (UID: \"b7b0e951-2cff-4974-a9cc-ec547470b1c9\") " pod="openshift-console/console-6845b948c7-zw4nl"
Jul 24 21:22:03.926902 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:03.926881    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7b0e951-2cff-4974-a9cc-ec547470b1c9-service-ca\") pod \"console-6845b948c7-zw4nl\" (UID: \"b7b0e951-2cff-4974-a9cc-ec547470b1c9\") " pod="openshift-console/console-6845b948c7-zw4nl"
Jul 24 21:22:03.926998 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:03.926974    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7b0e951-2cff-4974-a9cc-ec547470b1c9-console-config\") pod \"console-6845b948c7-zw4nl\" (UID: \"b7b0e951-2cff-4974-a9cc-ec547470b1c9\") " pod="openshift-console/console-6845b948c7-zw4nl"
Jul 24 21:22:03.928456 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:03.928438    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7b0e951-2cff-4974-a9cc-ec547470b1c9-console-oauth-config\") pod \"console-6845b948c7-zw4nl\" (UID: \"b7b0e951-2cff-4974-a9cc-ec547470b1c9\") " pod="openshift-console/console-6845b948c7-zw4nl"
Jul 24 21:22:03.928543 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:03.928528    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7b0e951-2cff-4974-a9cc-ec547470b1c9-console-serving-cert\") pod \"console-6845b948c7-zw4nl\" (UID: \"b7b0e951-2cff-4974-a9cc-ec547470b1c9\") " pod="openshift-console/console-6845b948c7-zw4nl"
Jul 24 21:22:03.937880 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:03.937855    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9c8m\" (UniqueName: \"kubernetes.io/projected/b7b0e951-2cff-4974-a9cc-ec547470b1c9-kube-api-access-p9c8m\") pod \"console-6845b948c7-zw4nl\" (UID: \"b7b0e951-2cff-4974-a9cc-ec547470b1c9\") " pod="openshift-console/console-6845b948c7-zw4nl"
Jul 24 21:22:03.984289 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:03.984251    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6845b948c7-zw4nl"
Jul 24 21:22:04.138255 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:04.138212    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6845b948c7-zw4nl"]
Jul 24 21:22:04.141252 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:22:04.141202    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7b0e951_2cff_4974_a9cc_ec547470b1c9.slice/crio-30fc0598ac219f4b060f3fb3533e5692cb86a07b3d1675141f599f0a3f1f1eed WatchSource:0}: Error finding container 30fc0598ac219f4b060f3fb3533e5692cb86a07b3d1675141f599f0a3f1f1eed: Status 404 returned error can't find the container with id 30fc0598ac219f4b060f3fb3533e5692cb86a07b3d1675141f599f0a3f1f1eed
Jul 24 21:22:04.835353 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:04.835269    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6845b948c7-zw4nl" event={"ID":"b7b0e951-2cff-4974-a9cc-ec547470b1c9","Type":"ContainerStarted","Data":"c8091c4b041132c27244eb01edca81bc6ab258df4914b049f445fc15e5f622a9"}
Jul 24 21:22:04.835353 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:04.835326    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6845b948c7-zw4nl" event={"ID":"b7b0e951-2cff-4974-a9cc-ec547470b1c9","Type":"ContainerStarted","Data":"30fc0598ac219f4b060f3fb3533e5692cb86a07b3d1675141f599f0a3f1f1eed"}
Jul 24 21:22:04.875151 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:04.875097    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6845b948c7-zw4nl" podStartSLOduration=1.8750817400000002 podStartE2EDuration="1.87508174s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:22:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:22:04.874708368 +0000 UTC m=+441.319300098" watchObservedRunningTime="2026-07-24 21:22:04.87508174 +0000 UTC m=+441.319673499"
Jul 24 21:22:13.985261 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:13.985202    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6845b948c7-zw4nl"
Jul 24 21:22:13.985656 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:13.985294    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6845b948c7-zw4nl"
Jul 24 21:22:13.989716 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:13.989695    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6845b948c7-zw4nl"
Jul 24 21:22:14.877730 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:22:14.877704    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6845b948c7-zw4nl"
Jul 24 21:23:03.849174 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:03.849141    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-7b954ffc95-sh59l"]
Jul 24 21:23:03.852477 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:03.852461    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-sh59l"
Jul 24 21:23:03.855660 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:03.855631    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-rz52s\""
Jul 24 21:23:03.856570 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:03.856555    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\""
Jul 24 21:23:03.863317 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:03.863297    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-75d9cdbddf-v9s7f"]
Jul 24 21:23:03.866429 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:03.866408    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-75d9cdbddf-v9s7f"
Jul 24 21:23:03.871257 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:03.871211    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-7cn8f\""
Jul 24 21:23:03.872245 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:03.872172    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-sh59l"]
Jul 24 21:23:03.873606 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:03.873589    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\""
Jul 24 21:23:03.895339 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:03.895318    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-75d9cdbddf-v9s7f"]
Jul 24 21:23:04.026567 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:04.026535    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhpjw\" (UniqueName: \"kubernetes.io/projected/4e279b73-d916-4eb2-b601-14a8d9dc09cd-kube-api-access-zhpjw\") pod \"odh-model-controller-75d9cdbddf-v9s7f\" (UID: \"4e279b73-d916-4eb2-b601-14a8d9dc09cd\") " pod="kserve/odh-model-controller-75d9cdbddf-v9s7f"
Jul 24 21:23:04.026567 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:04.026567    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gsrv\" (UniqueName: \"kubernetes.io/projected/6aee5646-91c8-4354-985f-9da42d7110eb-kube-api-access-8gsrv\") pod \"model-serving-api-7b954ffc95-sh59l\" (UID: \"6aee5646-91c8-4354-985f-9da42d7110eb\") " pod="kserve/model-serving-api-7b954ffc95-sh59l"
Jul 24 21:23:04.026759 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:04.026632    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6aee5646-91c8-4354-985f-9da42d7110eb-tls-certs\") pod \"model-serving-api-7b954ffc95-sh59l\" (UID: \"6aee5646-91c8-4354-985f-9da42d7110eb\") " pod="kserve/model-serving-api-7b954ffc95-sh59l"
Jul 24 21:23:04.026759 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:04.026704    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e279b73-d916-4eb2-b601-14a8d9dc09cd-cert\") pod \"odh-model-controller-75d9cdbddf-v9s7f\" (UID: \"4e279b73-d916-4eb2-b601-14a8d9dc09cd\") " pod="kserve/odh-model-controller-75d9cdbddf-v9s7f"
Jul 24 21:23:04.127957 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:04.127859    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6aee5646-91c8-4354-985f-9da42d7110eb-tls-certs\") pod \"model-serving-api-7b954ffc95-sh59l\" (UID: \"6aee5646-91c8-4354-985f-9da42d7110eb\") " pod="kserve/model-serving-api-7b954ffc95-sh59l"
Jul 24 21:23:04.127957 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:04.127923    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e279b73-d916-4eb2-b601-14a8d9dc09cd-cert\") pod \"odh-model-controller-75d9cdbddf-v9s7f\" (UID: \"4e279b73-d916-4eb2-b601-14a8d9dc09cd\") " pod="kserve/odh-model-controller-75d9cdbddf-v9s7f"
Jul 24 21:23:04.128377 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:04.127977    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhpjw\" (UniqueName: \"kubernetes.io/projected/4e279b73-d916-4eb2-b601-14a8d9dc09cd-kube-api-access-zhpjw\") pod \"odh-model-controller-75d9cdbddf-v9s7f\" (UID: \"4e279b73-d916-4eb2-b601-14a8d9dc09cd\") " pod="kserve/odh-model-controller-75d9cdbddf-v9s7f"
Jul 24 21:23:04.128377 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:04.128010    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gsrv\" (UniqueName: \"kubernetes.io/projected/6aee5646-91c8-4354-985f-9da42d7110eb-kube-api-access-8gsrv\") pod \"model-serving-api-7b954ffc95-sh59l\" (UID: \"6aee5646-91c8-4354-985f-9da42d7110eb\") " pod="kserve/model-serving-api-7b954ffc95-sh59l"
Jul 24 21:23:04.130628 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:04.130595    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6aee5646-91c8-4354-985f-9da42d7110eb-tls-certs\") pod \"model-serving-api-7b954ffc95-sh59l\" (UID: \"6aee5646-91c8-4354-985f-9da42d7110eb\") " pod="kserve/model-serving-api-7b954ffc95-sh59l"
Jul 24 21:23:04.130925 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:04.130903    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e279b73-d916-4eb2-b601-14a8d9dc09cd-cert\") pod \"odh-model-controller-75d9cdbddf-v9s7f\" (UID: \"4e279b73-d916-4eb2-b601-14a8d9dc09cd\") " pod="kserve/odh-model-controller-75d9cdbddf-v9s7f"
Jul 24 21:23:04.141123 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:04.141096    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gsrv\" (UniqueName: \"kubernetes.io/projected/6aee5646-91c8-4354-985f-9da42d7110eb-kube-api-access-8gsrv\") pod \"model-serving-api-7b954ffc95-sh59l\" (UID: \"6aee5646-91c8-4354-985f-9da42d7110eb\") " pod="kserve/model-serving-api-7b954ffc95-sh59l"
Jul 24 21:23:04.141757 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:04.141737    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhpjw\" (UniqueName: \"kubernetes.io/projected/4e279b73-d916-4eb2-b601-14a8d9dc09cd-kube-api-access-zhpjw\") pod \"odh-model-controller-75d9cdbddf-v9s7f\" (UID: \"4e279b73-d916-4eb2-b601-14a8d9dc09cd\") " pod="kserve/odh-model-controller-75d9cdbddf-v9s7f"
Jul 24 21:23:04.162665 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:04.162639    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-sh59l"
Jul 24 21:23:04.176572 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:04.176544    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-75d9cdbddf-v9s7f"
Jul 24 21:23:04.313888 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:04.313863    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-sh59l"]
Jul 24 21:23:04.316661 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:23:04.316630    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aee5646_91c8_4354_985f_9da42d7110eb.slice/crio-cab43df8bf575cbc710ca7ebf48cb47defb988ff425de8592c88e58c35a63ab7 WatchSource:0}: Error finding container cab43df8bf575cbc710ca7ebf48cb47defb988ff425de8592c88e58c35a63ab7: Status 404 returned error can't find the container with id cab43df8bf575cbc710ca7ebf48cb47defb988ff425de8592c88e58c35a63ab7
Jul 24 21:23:04.334319 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:04.334297    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-75d9cdbddf-v9s7f"]
Jul 24 21:23:04.338246 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:23:04.338205    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e279b73_d916_4eb2_b601_14a8d9dc09cd.slice/crio-264f9422f3e6581fea3b3b6b98f8b37baf6c0d3e7938bf8c6cb434b59a33c562 WatchSource:0}: Error finding container 264f9422f3e6581fea3b3b6b98f8b37baf6c0d3e7938bf8c6cb434b59a33c562: Status 404 returned error can't find the container with id 264f9422f3e6581fea3b3b6b98f8b37baf6c0d3e7938bf8c6cb434b59a33c562
Jul 24 21:23:05.087568 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:05.087476    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-75d9cdbddf-v9s7f" event={"ID":"4e279b73-d916-4eb2-b601-14a8d9dc09cd","Type":"ContainerStarted","Data":"264f9422f3e6581fea3b3b6b98f8b37baf6c0d3e7938bf8c6cb434b59a33c562"}
Jul 24 21:23:05.089542 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:05.089511    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-sh59l" event={"ID":"6aee5646-91c8-4354-985f-9da42d7110eb","Type":"ContainerStarted","Data":"cab43df8bf575cbc710ca7ebf48cb47defb988ff425de8592c88e58c35a63ab7"}
Jul 24 21:23:08.104727 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:08.104659    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-75d9cdbddf-v9s7f" event={"ID":"4e279b73-d916-4eb2-b601-14a8d9dc09cd","Type":"ContainerStarted","Data":"e5cd8765cd2c258ad0fbecbef12133057f59979e574543f114ff3f7948f055cd"}
Jul 24 21:23:08.105210 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:08.104889    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-75d9cdbddf-v9s7f"
Jul 24 21:23:08.106269 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:08.106248    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-sh59l" event={"ID":"6aee5646-91c8-4354-985f-9da42d7110eb","Type":"ContainerStarted","Data":"be110c7368ee58ec6c602eb0a66e4f5aafe5645cc9efa10602a4d73ed6ae35d3"}
Jul 24 21:23:08.106375 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:08.106360    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-7b954ffc95-sh59l"
Jul 24 21:23:08.128482 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:08.128439    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-75d9cdbddf-v9s7f" podStartSLOduration=1.494421068 podStartE2EDuration="5.128425339s" totalImagesPullingTime="3.634004271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:23:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:23:08.127184685 +0000 UTC m=+504.571776416" watchObservedRunningTime="2026-07-24 21:23:08.128425339 +0000 UTC m=+504.573017070"
Jul 24 21:23:08.149979 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:08.149937    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-7b954ffc95-sh59l" podStartSLOduration=1.536454612 podStartE2EDuration="5.149923447s" totalImagesPullingTime="3.613468835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:23:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:23:08.148266999 +0000 UTC m=+504.592858730" watchObservedRunningTime="2026-07-24 21:23:08.149923447 +0000 UTC m=+504.594515177"
Jul 24 21:23:19.112935 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:19.112906    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-75d9cdbddf-v9s7f"
Jul 24 21:23:19.114698 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:19.114677    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-7b954ffc95-sh59l"
Jul 24 21:23:19.981257 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:19.981211    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-82bfz"]
Jul 24 21:23:19.984921 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:19.984903    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-82bfz"
Jul 24 21:23:19.992437 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:19.992416    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-82bfz"]
Jul 24 21:23:20.058862 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:20.058827    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blmls\" (UniqueName: \"kubernetes.io/projected/5abca1fc-c22d-4f08-b04d-d2bd15e78660-kube-api-access-blmls\") pod \"s3-init-82bfz\" (UID: \"5abca1fc-c22d-4f08-b04d-d2bd15e78660\") " pod="kserve/s3-init-82bfz"
Jul 24 21:23:20.059041 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:20.058952    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5abca1fc-c22d-4f08-b04d-d2bd15e78660-model-cache\") pod \"s3-init-82bfz\" (UID: \"5abca1fc-c22d-4f08-b04d-d2bd15e78660\") " pod="kserve/s3-init-82bfz"
Jul 24 21:23:20.160407 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:20.160374    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blmls\" (UniqueName: \"kubernetes.io/projected/5abca1fc-c22d-4f08-b04d-d2bd15e78660-kube-api-access-blmls\") pod \"s3-init-82bfz\" (UID: \"5abca1fc-c22d-4f08-b04d-d2bd15e78660\") " pod="kserve/s3-init-82bfz"
Jul 24 21:23:20.160760 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:20.160454    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5abca1fc-c22d-4f08-b04d-d2bd15e78660-model-cache\") pod \"s3-init-82bfz\" (UID: \"5abca1fc-c22d-4f08-b04d-d2bd15e78660\") " pod="kserve/s3-init-82bfz"
Jul 24 21:23:20.160798 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:20.160760    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5abca1fc-c22d-4f08-b04d-d2bd15e78660-model-cache\") pod \"s3-init-82bfz\" (UID: \"5abca1fc-c22d-4f08-b04d-d2bd15e78660\") " pod="kserve/s3-init-82bfz"
Jul 24 21:23:20.168754 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:20.168726    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blmls\" (UniqueName: \"kubernetes.io/projected/5abca1fc-c22d-4f08-b04d-d2bd15e78660-kube-api-access-blmls\") pod \"s3-init-82bfz\" (UID: \"5abca1fc-c22d-4f08-b04d-d2bd15e78660\") " pod="kserve/s3-init-82bfz"
Jul 24 21:23:20.301639 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:20.301613    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-82bfz"
Jul 24 21:23:20.434202 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:20.434040    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-82bfz"]
Jul 24 21:23:20.437030 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:23:20.437006    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5abca1fc_c22d_4f08_b04d_d2bd15e78660.slice/crio-a0562f7febdc016fe13a4f52a17f4e88ca9f07c935ebd6906cd1e16e14633f5f WatchSource:0}: Error finding container a0562f7febdc016fe13a4f52a17f4e88ca9f07c935ebd6906cd1e16e14633f5f: Status 404 returned error can't find the container with id a0562f7febdc016fe13a4f52a17f4e88ca9f07c935ebd6906cd1e16e14633f5f
Jul 24 21:23:21.159029 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:21.158996    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-82bfz" event={"ID":"5abca1fc-c22d-4f08-b04d-d2bd15e78660","Type":"ContainerStarted","Data":"a0562f7febdc016fe13a4f52a17f4e88ca9f07c935ebd6906cd1e16e14633f5f"}
Jul 24 21:23:25.178118 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:25.178085    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-82bfz" event={"ID":"5abca1fc-c22d-4f08-b04d-d2bd15e78660","Type":"ContainerStarted","Data":"c83ae2c657f646713d6523e14e7cb51479293d0e826d26e7667a6fc20a17e48b"}
Jul 24 21:23:27.190052 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:27.190019    2561 generic.go:356] "Generic (PLEG): container finished" podID="5abca1fc-c22d-4f08-b04d-d2bd15e78660" containerID="c83ae2c657f646713d6523e14e7cb51479293d0e826d26e7667a6fc20a17e48b" exitCode=0
Jul 24 21:23:27.190052 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:27.190061    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-82bfz" event={"ID":"5abca1fc-c22d-4f08-b04d-d2bd15e78660","Type":"ContainerDied","Data":"c83ae2c657f646713d6523e14e7cb51479293d0e826d26e7667a6fc20a17e48b"}
Jul 24 21:23:32.218825 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:32.218784    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-82bfz" event={"ID":"5abca1fc-c22d-4f08-b04d-d2bd15e78660","Type":"ContainerStarted","Data":"7e9e05f89f47f7b4d51d853c0b8b0fd4d3f4d5a7a9d1b6354723facfc3be6272"}
Jul 24 21:23:32.248600 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:23:32.248546    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-82bfz" podStartSLOduration=2.919079442 podStartE2EDuration="13.248531495s" totalImagesPullingTime="8.547310895s" totalInitContainerRuntime="1.782141158s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:23:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:23:32.246928811 +0000 UTC m=+528.691520538" watchObservedRunningTime="2026-07-24 21:23:32.248531495 +0000 UTC m=+528.693123225"
Jul 24 21:24:37.492107 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:37.492074    2561 generic.go:356] "Generic (PLEG): container finished" podID="5abca1fc-c22d-4f08-b04d-d2bd15e78660" containerID="7e9e05f89f47f7b4d51d853c0b8b0fd4d3f4d5a7a9d1b6354723facfc3be6272" exitCode=0
Jul 24 21:24:37.492544 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:37.492152    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-82bfz" event={"ID":"5abca1fc-c22d-4f08-b04d-d2bd15e78660","Type":"ContainerDied","Data":"7e9e05f89f47f7b4d51d853c0b8b0fd4d3f4d5a7a9d1b6354723facfc3be6272"}
Jul 24 21:24:38.623259 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:38.623216    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-82bfz"
Jul 24 21:24:38.734390 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:38.734359    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-blmls\" (UniqueName: \"kubernetes.io/projected/5abca1fc-c22d-4f08-b04d-d2bd15e78660-kube-api-access-blmls\") pod \"5abca1fc-c22d-4f08-b04d-d2bd15e78660\" (UID: \"5abca1fc-c22d-4f08-b04d-d2bd15e78660\") "
Jul 24 21:24:38.734559 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:38.734461    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5abca1fc-c22d-4f08-b04d-d2bd15e78660-model-cache\") pod \"5abca1fc-c22d-4f08-b04d-d2bd15e78660\" (UID: \"5abca1fc-c22d-4f08-b04d-d2bd15e78660\") "
Jul 24 21:24:38.736757 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:38.736719    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5abca1fc-c22d-4f08-b04d-d2bd15e78660-kube-api-access-blmls" (OuterVolumeSpecName: "kube-api-access-blmls") pod "5abca1fc-c22d-4f08-b04d-d2bd15e78660" (UID: "5abca1fc-c22d-4f08-b04d-d2bd15e78660"). InnerVolumeSpecName "kube-api-access-blmls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 21:24:38.753455 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:38.753382    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5abca1fc-c22d-4f08-b04d-d2bd15e78660-model-cache" (OuterVolumeSpecName: "model-cache") pod "5abca1fc-c22d-4f08-b04d-d2bd15e78660" (UID: "5abca1fc-c22d-4f08-b04d-d2bd15e78660"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 21:24:38.836003 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:38.835972    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5abca1fc-c22d-4f08-b04d-d2bd15e78660-model-cache\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:24:38.836003 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:38.835997    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-blmls\" (UniqueName: \"kubernetes.io/projected/5abca1fc-c22d-4f08-b04d-d2bd15e78660-kube-api-access-blmls\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:24:39.501293 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:39.501264    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-82bfz"
Jul 24 21:24:39.501293 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:39.501284    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-82bfz" event={"ID":"5abca1fc-c22d-4f08-b04d-d2bd15e78660","Type":"ContainerDied","Data":"a0562f7febdc016fe13a4f52a17f4e88ca9f07c935ebd6906cd1e16e14633f5f"}
Jul 24 21:24:39.501485 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:39.501325    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a0562f7febdc016fe13a4f52a17f4e88ca9f07c935ebd6906cd1e16e14633f5f"
Jul 24 21:24:43.887691 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:43.887662    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nsjrg_87f18cf4-62ce-48a0-99b0-fe22bc19f701/console-operator/1.log"
Jul 24 21:24:43.889778 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:43.889754    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nsjrg_87f18cf4-62ce-48a0-99b0-fe22bc19f701/console-operator/1.log"
Jul 24 21:24:51.500160 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.500096    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb"]
Jul 24 21:24:51.500548 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.500466    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5abca1fc-c22d-4f08-b04d-d2bd15e78660" containerName="download-hf-model"
Jul 24 21:24:51.500548 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.500478    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5abca1fc-c22d-4f08-b04d-d2bd15e78660" containerName="download-hf-model"
Jul 24 21:24:51.500548 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.500489    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5abca1fc-c22d-4f08-b04d-d2bd15e78660" containerName="s3-init"
Jul 24 21:24:51.500548 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.500495    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5abca1fc-c22d-4f08-b04d-d2bd15e78660" containerName="s3-init"
Jul 24 21:24:51.500548 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.500562    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5abca1fc-c22d-4f08-b04d-d2bd15e78660" containerName="s3-init"
Jul 24 21:24:51.504768 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.504752    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb"
Jul 24 21:24:51.507264 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.507242    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 24 21:24:51.507379 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.507325    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 24 21:24:51.508336 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.508316    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-77ecc-predictor-serving-cert\""
Jul 24 21:24:51.508416 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.508347    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-78szr\""
Jul 24 21:24:51.508477 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.508428    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-77ecc-kube-rbac-proxy-sar-config\""
Jul 24 21:24:51.514203 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.514183    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb"]
Jul 24 21:24:51.548401 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.548373    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzstx\" (UniqueName: \"kubernetes.io/projected/bb1a3190-0dee-4710-880c-f3e577d60a83-kube-api-access-zzstx\") pod \"success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb\" (UID: \"bb1a3190-0dee-4710-880c-f3e577d60a83\") " pod="kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb"
Jul 24 21:24:51.548519 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.548426    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bb1a3190-0dee-4710-880c-f3e577d60a83-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb\" (UID: \"bb1a3190-0dee-4710-880c-f3e577d60a83\") " pod="kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb"
Jul 24 21:24:51.548519 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.548478    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bb1a3190-0dee-4710-880c-f3e577d60a83-proxy-tls\") pod \"success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb\" (UID: \"bb1a3190-0dee-4710-880c-f3e577d60a83\") " pod="kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb"
Jul 24 21:24:51.648794 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.648765    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bb1a3190-0dee-4710-880c-f3e577d60a83-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb\" (UID: \"bb1a3190-0dee-4710-880c-f3e577d60a83\") " pod="kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb"
Jul 24 21:24:51.648970 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.648822    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bb1a3190-0dee-4710-880c-f3e577d60a83-proxy-tls\") pod \"success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb\" (UID: \"bb1a3190-0dee-4710-880c-f3e577d60a83\") " pod="kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb"
Jul 24 21:24:51.648970 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.648848    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzstx\" (UniqueName: \"kubernetes.io/projected/bb1a3190-0dee-4710-880c-f3e577d60a83-kube-api-access-zzstx\") pod \"success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb\" (UID: \"bb1a3190-0dee-4710-880c-f3e577d60a83\") " pod="kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb"
Jul 24 21:24:51.649418 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.649399    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bb1a3190-0dee-4710-880c-f3e577d60a83-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb\" (UID: \"bb1a3190-0dee-4710-880c-f3e577d60a83\") " pod="kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb"
Jul 24 21:24:51.651521 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.651500    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bb1a3190-0dee-4710-880c-f3e577d60a83-proxy-tls\") pod \"success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb\" (UID: \"bb1a3190-0dee-4710-880c-f3e577d60a83\") " pod="kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb"
Jul 24 21:24:51.657244 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.657202    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzstx\" (UniqueName: \"kubernetes.io/projected/bb1a3190-0dee-4710-880c-f3e577d60a83-kube-api-access-zzstx\") pod \"success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb\" (UID: \"bb1a3190-0dee-4710-880c-f3e577d60a83\") " pod="kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb"
Jul 24 21:24:51.815875 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.815844    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb"
Jul 24 21:24:51.818263 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.818232    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72"]
Jul 24 21:24:51.821745 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.821726    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72"
Jul 24 21:24:51.824202 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.824183    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 24 21:24:51.824568 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.824549    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-predictor-serving-cert\""
Jul 24 21:24:51.824765 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.824740    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\""
Jul 24 21:24:51.824880 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.824862    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 24 21:24:51.834080 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.834061    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72"]
Jul 24 21:24:51.851345 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.851302    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-7656b4965b-sbh72\" (UID: \"d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72"
Jul 24 21:24:51.851470 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.851366    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2mc8\" (UniqueName: \"kubernetes.io/projected/d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb-kube-api-access-c2mc8\") pod \"isvc-sklearn-graph-1-predictor-7656b4965b-sbh72\" (UID: \"d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72"
Jul 24 21:24:51.851470 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.851417    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-7656b4965b-sbh72\" (UID: \"d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72"
Jul 24 21:24:51.851555 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.851479    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-7656b4965b-sbh72\" (UID: \"d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72"
Jul 24 21:24:51.851555 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.851533    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-7656b4965b-sbh72\" (UID: \"d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72"
Jul 24 21:24:51.952138 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.952103    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-7656b4965b-sbh72\" (UID: \"d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72"
Jul 24 21:24:51.952138 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.952152    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2mc8\" (UniqueName: \"kubernetes.io/projected/d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb-kube-api-access-c2mc8\") pod \"isvc-sklearn-graph-1-predictor-7656b4965b-sbh72\" (UID: \"d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72"
Jul 24 21:24:51.952398 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.952197    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-7656b4965b-sbh72\" (UID: \"d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72"
Jul 24 21:24:51.952398 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.952251    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-7656b4965b-sbh72\" (UID: \"d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72"
Jul 24 21:24:51.952398 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:24:51.952283    2561 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-serving-cert: secret "isvc-sklearn-graph-1-predictor-serving-cert" not found
Jul 24 21:24:51.952398 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.952311    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-7656b4965b-sbh72\" (UID: \"d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72"
Jul 24 21:24:51.952398 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:24:51.952373    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb-proxy-tls podName:d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb nodeName:}" failed. No retries permitted until 2026-07-24 21:24:52.452353003 +0000 UTC m=+608.896944714 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb-proxy-tls") pod "isvc-sklearn-graph-1-predictor-7656b4965b-sbh72" (UID: "d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb") : secret "isvc-sklearn-graph-1-predictor-serving-cert" not found
Jul 24 21:24:51.952738 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.952708    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-7656b4965b-sbh72\" (UID: \"d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72"
Jul 24 21:24:51.953030 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.953007    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-7656b4965b-sbh72\" (UID: \"d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72"
Jul 24 21:24:51.953109 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.953025    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-7656b4965b-sbh72\" (UID: \"d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72"
Jul 24 21:24:51.963854 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.963832    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2mc8\" (UniqueName: \"kubernetes.io/projected/d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb-kube-api-access-c2mc8\") pod \"isvc-sklearn-graph-1-predictor-7656b4965b-sbh72\" (UID: \"d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72"
Jul 24 21:24:51.966186 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:51.966165    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb"]
Jul 24 21:24:51.967689 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:24:51.967669    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb1a3190_0dee_4710_880c_f3e577d60a83.slice/crio-249cdb33709041d6b31c477f3e786d409313bfcecd9e11afdb43836971fb0025 WatchSource:0}: Error finding container 249cdb33709041d6b31c477f3e786d409313bfcecd9e11afdb43836971fb0025: Status 404 returned error can't find the container with id 249cdb33709041d6b31c477f3e786d409313bfcecd9e11afdb43836971fb0025
Jul 24 21:24:52.037608 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.037578    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj"]
Jul 24 21:24:52.042428 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.042413    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj"
Jul 24 21:24:52.044664 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.044647    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-predictor-serving-cert\""
Jul 24 21:24:52.044876 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.044861    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-kube-rbac-proxy-sar-config\""
Jul 24 21:24:52.052612 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.052595    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/91c1b8bf-206a-4c81-8439-de3b355e3ec4-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-k52wj\" (UID: \"91c1b8bf-206a-4c81-8439-de3b355e3ec4\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj"
Jul 24 21:24:52.052689 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.052622    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/91c1b8bf-206a-4c81-8439-de3b355e3ec4-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-k52wj\" (UID: \"91c1b8bf-206a-4c81-8439-de3b355e3ec4\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj"
Jul 24 21:24:52.052689 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.052641    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpgcb\" (UniqueName: \"kubernetes.io/projected/91c1b8bf-206a-4c81-8439-de3b355e3ec4-kube-api-access-gpgcb\") pod \"isvc-xgboost-graph-predictor-555fc69d56-k52wj\" (UID: \"91c1b8bf-206a-4c81-8439-de3b355e3ec4\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj"
Jul 24 21:24:52.052689 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.052669    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/91c1b8bf-206a-4c81-8439-de3b355e3ec4-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-k52wj\" (UID: \"91c1b8bf-206a-4c81-8439-de3b355e3ec4\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj"
Jul 24 21:24:52.052783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.052744    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/91c1b8bf-206a-4c81-8439-de3b355e3ec4-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-k52wj\" (UID: \"91c1b8bf-206a-4c81-8439-de3b355e3ec4\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj"
Jul 24 21:24:52.058708 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.058688    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj"]
Jul 24 21:24:52.153285 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.153191    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/91c1b8bf-206a-4c81-8439-de3b355e3ec4-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-k52wj\" (UID: \"91c1b8bf-206a-4c81-8439-de3b355e3ec4\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj"
Jul 24 21:24:52.153285 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.153246    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/91c1b8bf-206a-4c81-8439-de3b355e3ec4-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-k52wj\" (UID: \"91c1b8bf-206a-4c81-8439-de3b355e3ec4\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj"
Jul 24 21:24:52.153285 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.153270    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpgcb\" (UniqueName: \"kubernetes.io/projected/91c1b8bf-206a-4c81-8439-de3b355e3ec4-kube-api-access-gpgcb\") pod \"isvc-xgboost-graph-predictor-555fc69d56-k52wj\" (UID: \"91c1b8bf-206a-4c81-8439-de3b355e3ec4\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj"
Jul 24 21:24:52.153536 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.153304    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/91c1b8bf-206a-4c81-8439-de3b355e3ec4-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-k52wj\" (UID: \"91c1b8bf-206a-4c81-8439-de3b355e3ec4\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj"
Jul 24 21:24:52.153536 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.153336    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/91c1b8bf-206a-4c81-8439-de3b355e3ec4-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-k52wj\" (UID: \"91c1b8bf-206a-4c81-8439-de3b355e3ec4\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj"
Jul 24 21:24:52.153536 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:24:52.153416    2561 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-xgboost-graph-predictor-serving-cert: secret "isvc-xgboost-graph-predictor-serving-cert" not found
Jul 24 21:24:52.153536 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:24:52.153482    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91c1b8bf-206a-4c81-8439-de3b355e3ec4-proxy-tls podName:91c1b8bf-206a-4c81-8439-de3b355e3ec4 nodeName:}" failed. No retries permitted until 2026-07-24 21:24:52.653461914 +0000 UTC m=+609.098053624 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/91c1b8bf-206a-4c81-8439-de3b355e3ec4-proxy-tls") pod "isvc-xgboost-graph-predictor-555fc69d56-k52wj" (UID: "91c1b8bf-206a-4c81-8439-de3b355e3ec4") : secret "isvc-xgboost-graph-predictor-serving-cert" not found
Jul 24 21:24:52.153754 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.153737    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/91c1b8bf-206a-4c81-8439-de3b355e3ec4-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-k52wj\" (UID: \"91c1b8bf-206a-4c81-8439-de3b355e3ec4\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj"
Jul 24 21:24:52.153941 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.153927    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/91c1b8bf-206a-4c81-8439-de3b355e3ec4-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-k52wj\" (UID: \"91c1b8bf-206a-4c81-8439-de3b355e3ec4\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj"
Jul 24 21:24:52.153982 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.153928    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/91c1b8bf-206a-4c81-8439-de3b355e3ec4-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-k52wj\" (UID: \"91c1b8bf-206a-4c81-8439-de3b355e3ec4\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj"
Jul 24 21:24:52.162652 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.162634    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpgcb\" (UniqueName: \"kubernetes.io/projected/91c1b8bf-206a-4c81-8439-de3b355e3ec4-kube-api-access-gpgcb\") pod \"isvc-xgboost-graph-predictor-555fc69d56-k52wj\" (UID: \"91c1b8bf-206a-4c81-8439-de3b355e3ec4\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj"
Jul 24 21:24:52.232299 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.232269    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn"]
Jul 24 21:24:52.235898 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.235884    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn"
Jul 24 21:24:52.246950 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.246932    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-predictor-serving-cert\""
Jul 24 21:24:52.248551 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.248537    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\""
Jul 24 21:24:52.254483 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.254465    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c2906e30-cc2e-4938-bf3d-476410e6a7e2-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-96447656d-6bksn\" (UID: \"c2906e30-cc2e-4938-bf3d-476410e6a7e2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn"
Jul 24 21:24:52.254584 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.254490    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c2906e30-cc2e-4938-bf3d-476410e6a7e2-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-96447656d-6bksn\" (UID: \"c2906e30-cc2e-4938-bf3d-476410e6a7e2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn"
Jul 24 21:24:52.254584 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.254522    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znzcn\" (UniqueName: \"kubernetes.io/projected/c2906e30-cc2e-4938-bf3d-476410e6a7e2-kube-api-access-znzcn\") pod \"isvc-sklearn-graph-2-predictor-96447656d-6bksn\" (UID: \"c2906e30-cc2e-4938-bf3d-476410e6a7e2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn"
Jul 24 21:24:52.254584 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.254554    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c2906e30-cc2e-4938-bf3d-476410e6a7e2-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-96447656d-6bksn\" (UID: \"c2906e30-cc2e-4938-bf3d-476410e6a7e2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn"
Jul 24 21:24:52.254584 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.254573    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c2906e30-cc2e-4938-bf3d-476410e6a7e2-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-96447656d-6bksn\" (UID: \"c2906e30-cc2e-4938-bf3d-476410e6a7e2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn"
Jul 24 21:24:52.259856 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.259838    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn"]
Jul 24 21:24:52.355133 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.355106    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c2906e30-cc2e-4938-bf3d-476410e6a7e2-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-96447656d-6bksn\" (UID: \"c2906e30-cc2e-4938-bf3d-476410e6a7e2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn"
Jul 24 21:24:52.355301 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.355161    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znzcn\" (UniqueName: \"kubernetes.io/projected/c2906e30-cc2e-4938-bf3d-476410e6a7e2-kube-api-access-znzcn\") pod \"isvc-sklearn-graph-2-predictor-96447656d-6bksn\" (UID: \"c2906e30-cc2e-4938-bf3d-476410e6a7e2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn"
Jul 24 21:24:52.355301 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.355209    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c2906e30-cc2e-4938-bf3d-476410e6a7e2-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-96447656d-6bksn\" (UID: \"c2906e30-cc2e-4938-bf3d-476410e6a7e2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn"
Jul 24 21:24:52.355301 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.355265    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c2906e30-cc2e-4938-bf3d-476410e6a7e2-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-96447656d-6bksn\" (UID: \"c2906e30-cc2e-4938-bf3d-476410e6a7e2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn"
Jul 24 21:24:52.355416 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.355370    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c2906e30-cc2e-4938-bf3d-476410e6a7e2-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-96447656d-6bksn\" (UID: \"c2906e30-cc2e-4938-bf3d-476410e6a7e2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn"
Jul 24 21:24:52.355706 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.355681    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c2906e30-cc2e-4938-bf3d-476410e6a7e2-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-96447656d-6bksn\" (UID: \"c2906e30-cc2e-4938-bf3d-476410e6a7e2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn"
Jul 24 21:24:52.356008 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.355991    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c2906e30-cc2e-4938-bf3d-476410e6a7e2-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-96447656d-6bksn\" (UID: \"c2906e30-cc2e-4938-bf3d-476410e6a7e2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn"
Jul 24 21:24:52.356093 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.356003    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c2906e30-cc2e-4938-bf3d-476410e6a7e2-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-96447656d-6bksn\" (UID: \"c2906e30-cc2e-4938-bf3d-476410e6a7e2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn"
Jul 24 21:24:52.358095 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.358076    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c2906e30-cc2e-4938-bf3d-476410e6a7e2-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-96447656d-6bksn\" (UID: \"c2906e30-cc2e-4938-bf3d-476410e6a7e2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn"
Jul 24 21:24:52.364583 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.364564    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znzcn\" (UniqueName: \"kubernetes.io/projected/c2906e30-cc2e-4938-bf3d-476410e6a7e2-kube-api-access-znzcn\") pod \"isvc-sklearn-graph-2-predictor-96447656d-6bksn\" (UID: \"c2906e30-cc2e-4938-bf3d-476410e6a7e2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn"
Jul 24 21:24:52.456746 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.456671    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-7656b4965b-sbh72\" (UID: \"d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72"
Jul 24 21:24:52.456875 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:24:52.456818    2561 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-serving-cert: secret "isvc-sklearn-graph-1-predictor-serving-cert" not found
Jul 24 21:24:52.456913 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:24:52.456877    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb-proxy-tls podName:d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb nodeName:}" failed. No retries permitted until 2026-07-24 21:24:53.456859278 +0000 UTC m=+609.901450987 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb-proxy-tls") pod "isvc-sklearn-graph-1-predictor-7656b4965b-sbh72" (UID: "d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb") : secret "isvc-sklearn-graph-1-predictor-serving-cert" not found
Jul 24 21:24:52.545427 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.545394    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn"
Jul 24 21:24:52.563313 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.563153    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb" event={"ID":"bb1a3190-0dee-4710-880c-f3e577d60a83","Type":"ContainerStarted","Data":"249cdb33709041d6b31c477f3e786d409313bfcecd9e11afdb43836971fb0025"}
Jul 24 21:24:52.658779 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.658737    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/91c1b8bf-206a-4c81-8439-de3b355e3ec4-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-k52wj\" (UID: \"91c1b8bf-206a-4c81-8439-de3b355e3ec4\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj"
Jul 24 21:24:52.666537 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.666508    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/91c1b8bf-206a-4c81-8439-de3b355e3ec4-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-k52wj\" (UID: \"91c1b8bf-206a-4c81-8439-de3b355e3ec4\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj"
Jul 24 21:24:52.748470 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.747050    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn"]
Jul 24 21:24:52.952923 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:52.952856    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj"
Jul 24 21:24:53.219403 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:53.219368    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj"]
Jul 24 21:24:53.224035 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:24:53.224002    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91c1b8bf_206a_4c81_8439_de3b355e3ec4.slice/crio-ec00e0df9d66b5e08df4980c520809b2114a9978001063322afa35d94509bef2 WatchSource:0}: Error finding container ec00e0df9d66b5e08df4980c520809b2114a9978001063322afa35d94509bef2: Status 404 returned error can't find the container with id ec00e0df9d66b5e08df4980c520809b2114a9978001063322afa35d94509bef2
Jul 24 21:24:53.466869 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:53.466267    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-7656b4965b-sbh72\" (UID: \"d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72"
Jul 24 21:24:53.478948 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:53.478776    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-7656b4965b-sbh72\" (UID: \"d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72"
Jul 24 21:24:53.578393 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:53.578350    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn" event={"ID":"c2906e30-cc2e-4938-bf3d-476410e6a7e2","Type":"ContainerStarted","Data":"95cb6191eb93cba7f121af7f71d0249040d3e917b0e9cf00b8c2333f57f899bd"}
Jul 24 21:24:53.578856 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:53.578429    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn" event={"ID":"c2906e30-cc2e-4938-bf3d-476410e6a7e2","Type":"ContainerStarted","Data":"8b1eebef79a7e2637f14383ef5d0f8732249da45c454e0f4c3d66e3e09800bd6"}
Jul 24 21:24:53.580729 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:53.580697    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj" event={"ID":"91c1b8bf-206a-4c81-8439-de3b355e3ec4","Type":"ContainerStarted","Data":"b1e7a7beb58c20725408338180cef0bece9ff675a48de2254f8d83f2ce7d430d"}
Jul 24 21:24:53.580862 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:53.580763    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj" event={"ID":"91c1b8bf-206a-4c81-8439-de3b355e3ec4","Type":"ContainerStarted","Data":"ec00e0df9d66b5e08df4980c520809b2114a9978001063322afa35d94509bef2"}
Jul 24 21:24:53.649122 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:53.649047    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72"
Jul 24 21:24:53.880965 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:53.880927    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72"]
Jul 24 21:24:53.887153 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:24:53.887120    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5bab9a9_4aa2_41e0_8aa4_34eddd2e5abb.slice/crio-58894349e24b39a16e70098bbbcfdd5056b3745ebe5ca74a1071bdf71149c976 WatchSource:0}: Error finding container 58894349e24b39a16e70098bbbcfdd5056b3745ebe5ca74a1071bdf71149c976: Status 404 returned error can't find the container with id 58894349e24b39a16e70098bbbcfdd5056b3745ebe5ca74a1071bdf71149c976
Jul 24 21:24:54.592561 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:54.591325    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72" event={"ID":"d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb","Type":"ContainerStarted","Data":"3fc9f87e1c396cf9b4fec0a0e4a67cb867a95e9480aecfbc1d4ac45a24789bb8"}
Jul 24 21:24:54.592561 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:54.591391    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72" event={"ID":"d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb","Type":"ContainerStarted","Data":"58894349e24b39a16e70098bbbcfdd5056b3745ebe5ca74a1071bdf71149c976"}
Jul 24 21:24:58.617878 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:58.617795    2561 generic.go:356] "Generic (PLEG): container finished" podID="c2906e30-cc2e-4938-bf3d-476410e6a7e2" containerID="95cb6191eb93cba7f121af7f71d0249040d3e917b0e9cf00b8c2333f57f899bd" exitCode=0
Jul 24 21:24:58.618447 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:58.617877    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn" event={"ID":"c2906e30-cc2e-4938-bf3d-476410e6a7e2","Type":"ContainerDied","Data":"95cb6191eb93cba7f121af7f71d0249040d3e917b0e9cf00b8c2333f57f899bd"}
Jul 24 21:24:58.619862 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:58.619736    2561 generic.go:356] "Generic (PLEG): container finished" podID="91c1b8bf-206a-4c81-8439-de3b355e3ec4" containerID="b1e7a7beb58c20725408338180cef0bece9ff675a48de2254f8d83f2ce7d430d" exitCode=0
Jul 24 21:24:58.619862 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:24:58.619815    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj" event={"ID":"91c1b8bf-206a-4c81-8439-de3b355e3ec4","Type":"ContainerDied","Data":"b1e7a7beb58c20725408338180cef0bece9ff675a48de2254f8d83f2ce7d430d"}
Jul 24 21:25:01.641717 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:01.641625    2561 generic.go:356] "Generic (PLEG): container finished" podID="d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb" containerID="3fc9f87e1c396cf9b4fec0a0e4a67cb867a95e9480aecfbc1d4ac45a24789bb8" exitCode=0
Jul 24 21:25:01.641717 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:01.641699    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72" event={"ID":"d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb","Type":"ContainerDied","Data":"3fc9f87e1c396cf9b4fec0a0e4a67cb867a95e9480aecfbc1d4ac45a24789bb8"}
Jul 24 21:25:08.688513 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:08.688469    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn" event={"ID":"c2906e30-cc2e-4938-bf3d-476410e6a7e2","Type":"ContainerStarted","Data":"03e9df37ee79ac628e1fda2285943cc1ffbd9a0b4a7be92f0833bb9241fff045"}
Jul 24 21:25:08.690311 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:08.690243    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb" event={"ID":"bb1a3190-0dee-4710-880c-f3e577d60a83","Type":"ContainerStarted","Data":"a3957fece7840985f00555ce7f5c602fb476ef9666b16f046b45efc623eb62fe"}
Jul 24 21:25:09.698940 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:09.698903    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72" event={"ID":"d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb","Type":"ContainerStarted","Data":"688b9ebd04b48ede0e713999c6c6259675a4ec4b329bd70fb8dd1ffe2b032cd5"}
Jul 24 21:25:14.741701 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:14.741616    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb" event={"ID":"bb1a3190-0dee-4710-880c-f3e577d60a83","Type":"ContainerStarted","Data":"b706c8dc7c67b559decd19e2ba22b847b5681fbb05a677ac4b9b3c8e4491d56a"}
Jul 24 21:25:14.742164 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:14.741815    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb"
Jul 24 21:25:14.742164 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:14.741986    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb"
Jul 24 21:25:14.743506 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:14.743447    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb" podUID="bb1a3190-0dee-4710-880c-f3e577d60a83" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused"
Jul 24 21:25:14.744532 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:14.744506    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72" event={"ID":"d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb","Type":"ContainerStarted","Data":"847d6e24b61bd2d32b3b467371a10baee2b64cb73c1e622f158c3334f3092768"}
Jul 24 21:25:14.744664 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:14.744639    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72"
Jul 24 21:25:14.744723 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:14.744687    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72"
Jul 24 21:25:14.746026 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:14.746001    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72" podUID="d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused"
Jul 24 21:25:14.747138 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:14.747110    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn" event={"ID":"c2906e30-cc2e-4938-bf3d-476410e6a7e2","Type":"ContainerStarted","Data":"f0cd950155f49468b3c34ea61066bec4a3f47740cb72e23bc575257aa3e606c7"}
Jul 24 21:25:14.747283 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:14.747266    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn"
Jul 24 21:25:14.760955 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:14.760917    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb" podStartSLOduration=1.977558852 podStartE2EDuration="23.760905036s" totalImagesPullingTime="21.783346184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:24:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:25:14.759864553 +0000 UTC m=+631.204456289" watchObservedRunningTime="2026-07-24 21:25:14.760905036 +0000 UTC m=+631.205496766"
Jul 24 21:25:14.779282 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:14.779217    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72" podStartSLOduration=7.195533428 podStartE2EDuration="23.779202447s" totalImagesPullingTime="12.271540561s" totalInitContainerRuntime="4.312128458s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:24:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:25:14.777604742 +0000 UTC m=+631.222196473" watchObservedRunningTime="2026-07-24 21:25:14.779202447 +0000 UTC m=+631.223794177"
Jul 24 21:25:14.796339 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:14.796298    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn" podStartSLOduration=3.431637696 podStartE2EDuration="22.796285455s" totalImagesPullingTime="15.130740565s" totalInitContainerRuntime="4.233907194s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:24:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:25:14.794632745 +0000 UTC m=+631.239224475" watchObservedRunningTime="2026-07-24 21:25:14.796285455 +0000 UTC m=+631.240877185"
Jul 24 21:25:15.753502 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:15.753069    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72" podUID="d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused"
Jul 24 21:25:15.753502 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:15.753072    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb" podUID="bb1a3190-0dee-4710-880c-f3e577d60a83" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused"
Jul 24 21:25:15.753502 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:15.753365    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn"
Jul 24 21:25:15.754190 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:15.754169    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn" podUID="c2906e30-cc2e-4938-bf3d-476410e6a7e2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused"
Jul 24 21:25:16.757168 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:16.757124    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn" podUID="c2906e30-cc2e-4938-bf3d-476410e6a7e2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused"
Jul 24 21:25:20.758241 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:20.758193    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb"
Jul 24 21:25:20.772558 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:20.758693    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72"
Jul 24 21:25:20.772558 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:20.758779    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb" podUID="bb1a3190-0dee-4710-880c-f3e577d60a83" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused"
Jul 24 21:25:20.772558 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:20.759143    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72" podUID="d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused"
Jul 24 21:25:21.762433 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:21.762402    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn"
Jul 24 21:25:21.763159 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:21.763120    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn" podUID="c2906e30-cc2e-4938-bf3d-476410e6a7e2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused"
Jul 24 21:25:28.824824 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:28.824789    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj" event={"ID":"91c1b8bf-206a-4c81-8439-de3b355e3ec4","Type":"ContainerStarted","Data":"d5043cdd84a20bb978410ab89560d7b921e0517e2453bbd258e79eff9a989328"}
Jul 24 21:25:28.825321 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:28.824901    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj" event={"ID":"91c1b8bf-206a-4c81-8439-de3b355e3ec4","Type":"ContainerStarted","Data":"61f34356010801e20fd3514b02df53789654b0ceb47a605b1136d64ec4a07293"}
Jul 24 21:25:28.825321 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:28.825119    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj"
Jul 24 21:25:28.845460 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:28.845412    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj" podStartSLOduration=2.932318366 podStartE2EDuration="36.845398459s" totalImagesPullingTime="29.789457957s" totalInitContainerRuntime="4.123622136s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:24:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:25:28.843205086 +0000 UTC m=+645.287796817" watchObservedRunningTime="2026-07-24 21:25:28.845398459 +0000 UTC m=+645.289990188"
Jul 24 21:25:29.829856 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:29.829827    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj"
Jul 24 21:25:29.831120 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:29.831094    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj" podUID="91c1b8bf-206a-4c81-8439-de3b355e3ec4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused"
Jul 24 21:25:30.759502 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:30.759465    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb" podUID="bb1a3190-0dee-4710-880c-f3e577d60a83" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused"
Jul 24 21:25:30.759670 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:30.759466    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72" podUID="d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused"
Jul 24 21:25:30.834231 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:30.834198    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj" podUID="91c1b8bf-206a-4c81-8439-de3b355e3ec4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused"
Jul 24 21:25:31.763186 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:31.763143    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn" podUID="c2906e30-cc2e-4938-bf3d-476410e6a7e2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused"
Jul 24 21:25:35.839327 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:35.839297    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj"
Jul 24 21:25:35.839834 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:35.839799    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj" podUID="91c1b8bf-206a-4c81-8439-de3b355e3ec4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused"
Jul 24 21:25:40.759370 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:40.759330    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72" podUID="d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused"
Jul 24 21:25:40.759370 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:40.759347    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb" podUID="bb1a3190-0dee-4710-880c-f3e577d60a83" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused"
Jul 24 21:25:41.763502 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:41.763462    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn" podUID="c2906e30-cc2e-4938-bf3d-476410e6a7e2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused"
Jul 24 21:25:45.839969 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:45.839929    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj" podUID="91c1b8bf-206a-4c81-8439-de3b355e3ec4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused"
Jul 24 21:25:50.759785 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:50.759751    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb" podUID="bb1a3190-0dee-4710-880c-f3e577d60a83" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused"
Jul 24 21:25:50.760159 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:50.759748    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72" podUID="d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused"
Jul 24 21:25:51.763262 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:51.763205    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn" podUID="c2906e30-cc2e-4938-bf3d-476410e6a7e2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused"
Jul 24 21:25:55.839699 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:25:55.839665    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj" podUID="91c1b8bf-206a-4c81-8439-de3b355e3ec4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused"
Jul 24 21:26:00.759403 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:00.759370    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb"
Jul 24 21:26:00.759917 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:00.759605    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72" podUID="d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused"
Jul 24 21:26:01.763162 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:01.763123    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn" podUID="c2906e30-cc2e-4938-bf3d-476410e6a7e2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused"
Jul 24 21:26:05.840475 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:05.840435    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj" podUID="91c1b8bf-206a-4c81-8439-de3b355e3ec4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused"
Jul 24 21:26:10.759452 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:10.759412    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72" podUID="d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused"
Jul 24 21:26:11.763296 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:11.763255    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn" podUID="c2906e30-cc2e-4938-bf3d-476410e6a7e2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused"
Jul 24 21:26:15.840535 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:15.840494    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj" podUID="91c1b8bf-206a-4c81-8439-de3b355e3ec4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused"
Jul 24 21:26:20.759628 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:20.759578    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72" podUID="d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused"
Jul 24 21:26:21.763470 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:21.763433    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn" podUID="c2906e30-cc2e-4938-bf3d-476410e6a7e2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused"
Jul 24 21:26:21.798743 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:21.798714    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb"]
Jul 24 21:26:21.798968 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:21.798940    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb" podUID="bb1a3190-0dee-4710-880c-f3e577d60a83" containerName="kserve-container" containerID="cri-o://a3957fece7840985f00555ce7f5c602fb476ef9666b16f046b45efc623eb62fe" gracePeriod=30
Jul 24 21:26:21.799082 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:21.799054    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb" podUID="bb1a3190-0dee-4710-880c-f3e577d60a83" containerName="kube-rbac-proxy" containerID="cri-o://b706c8dc7c67b559decd19e2ba22b847b5681fbb05a677ac4b9b3c8e4491d56a" gracePeriod=30
Jul 24 21:26:21.882434 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:21.882406    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv"]
Jul 24 21:26:21.886454 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:21.886433    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv"
Jul 24 21:26:21.889351 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:21.889330    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-eea53-kube-rbac-proxy-sar-config\""
Jul 24 21:26:21.889621 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:21.889605    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-eea53-predictor-serving-cert\""
Jul 24 21:26:21.904482 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:21.904457    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv"]
Jul 24 21:26:21.990668 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:21.990636    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9a287bba-7e81-4f6b-b3db-2b004c7ff3a8-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-eea53-predictor-8566895f48-bpxhv\" (UID: \"9a287bba-7e81-4f6b-b3db-2b004c7ff3a8\") " pod="kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv"
Jul 24 21:26:21.990810 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:21.990685    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a287bba-7e81-4f6b-b3db-2b004c7ff3a8-proxy-tls\") pod \"success-200-isvc-eea53-predictor-8566895f48-bpxhv\" (UID: \"9a287bba-7e81-4f6b-b3db-2b004c7ff3a8\") " pod="kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv"
Jul 24 21:26:21.990810 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:21.990764    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sqpl\" (UniqueName: \"kubernetes.io/projected/9a287bba-7e81-4f6b-b3db-2b004c7ff3a8-kube-api-access-4sqpl\") pod \"success-200-isvc-eea53-predictor-8566895f48-bpxhv\" (UID: \"9a287bba-7e81-4f6b-b3db-2b004c7ff3a8\") " pod="kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv"
Jul 24 21:26:22.079170 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:22.079075    2561 generic.go:356] "Generic (PLEG): container finished" podID="bb1a3190-0dee-4710-880c-f3e577d60a83" containerID="b706c8dc7c67b559decd19e2ba22b847b5681fbb05a677ac4b9b3c8e4491d56a" exitCode=2
Jul 24 21:26:22.079170 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:22.079155    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb" event={"ID":"bb1a3190-0dee-4710-880c-f3e577d60a83","Type":"ContainerDied","Data":"b706c8dc7c67b559decd19e2ba22b847b5681fbb05a677ac4b9b3c8e4491d56a"}
Jul 24 21:26:22.091199 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:22.091179    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sqpl\" (UniqueName: \"kubernetes.io/projected/9a287bba-7e81-4f6b-b3db-2b004c7ff3a8-kube-api-access-4sqpl\") pod \"success-200-isvc-eea53-predictor-8566895f48-bpxhv\" (UID: \"9a287bba-7e81-4f6b-b3db-2b004c7ff3a8\") " pod="kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv"
Jul 24 21:26:22.091327 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:22.091219    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9a287bba-7e81-4f6b-b3db-2b004c7ff3a8-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-eea53-predictor-8566895f48-bpxhv\" (UID: \"9a287bba-7e81-4f6b-b3db-2b004c7ff3a8\") " pod="kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv"
Jul 24 21:26:22.091327 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:22.091280    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a287bba-7e81-4f6b-b3db-2b004c7ff3a8-proxy-tls\") pod \"success-200-isvc-eea53-predictor-8566895f48-bpxhv\" (UID: \"9a287bba-7e81-4f6b-b3db-2b004c7ff3a8\") " pod="kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv"
Jul 24 21:26:22.091408 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:26:22.091375    2561 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-eea53-predictor-serving-cert: secret "success-200-isvc-eea53-predictor-serving-cert" not found
Jul 24 21:26:22.091461 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:26:22.091420    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a287bba-7e81-4f6b-b3db-2b004c7ff3a8-proxy-tls podName:9a287bba-7e81-4f6b-b3db-2b004c7ff3a8 nodeName:}" failed. No retries permitted until 2026-07-24 21:26:22.59140163 +0000 UTC m=+699.035993338 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/9a287bba-7e81-4f6b-b3db-2b004c7ff3a8-proxy-tls") pod "success-200-isvc-eea53-predictor-8566895f48-bpxhv" (UID: "9a287bba-7e81-4f6b-b3db-2b004c7ff3a8") : secret "success-200-isvc-eea53-predictor-serving-cert" not found
Jul 24 21:26:22.091905 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:22.091886    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9a287bba-7e81-4f6b-b3db-2b004c7ff3a8-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-eea53-predictor-8566895f48-bpxhv\" (UID: \"9a287bba-7e81-4f6b-b3db-2b004c7ff3a8\") " pod="kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv"
Jul 24 21:26:22.100030 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:22.099997    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sqpl\" (UniqueName: \"kubernetes.io/projected/9a287bba-7e81-4f6b-b3db-2b004c7ff3a8-kube-api-access-4sqpl\") pod \"success-200-isvc-eea53-predictor-8566895f48-bpxhv\" (UID: \"9a287bba-7e81-4f6b-b3db-2b004c7ff3a8\") " pod="kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv"
Jul 24 21:26:22.596751 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:22.596714    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a287bba-7e81-4f6b-b3db-2b004c7ff3a8-proxy-tls\") pod \"success-200-isvc-eea53-predictor-8566895f48-bpxhv\" (UID: \"9a287bba-7e81-4f6b-b3db-2b004c7ff3a8\") " pod="kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv"
Jul 24 21:26:22.599162 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:22.599131    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a287bba-7e81-4f6b-b3db-2b004c7ff3a8-proxy-tls\") pod \"success-200-isvc-eea53-predictor-8566895f48-bpxhv\" (UID: \"9a287bba-7e81-4f6b-b3db-2b004c7ff3a8\") " pod="kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv"
Jul 24 21:26:22.796664 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:22.796633    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv"
Jul 24 21:26:22.946211 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:22.946187    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv"]
Jul 24 21:26:22.948116 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:26:22.948085    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a287bba_7e81_4f6b_b3db_2b004c7ff3a8.slice/crio-f9e5a4988a71bd443aecfc8b4fe2b894ff7a90b703c97ea293e2ed2158dc9fd5 WatchSource:0}: Error finding container f9e5a4988a71bd443aecfc8b4fe2b894ff7a90b703c97ea293e2ed2158dc9fd5: Status 404 returned error can't find the container with id f9e5a4988a71bd443aecfc8b4fe2b894ff7a90b703c97ea293e2ed2158dc9fd5
Jul 24 21:26:22.948350 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:22.948326    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn" podUID="c2906e30-cc2e-4938-bf3d-476410e6a7e2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused"
Jul 24 21:26:23.086700 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:23.086671    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv" event={"ID":"9a287bba-7e81-4f6b-b3db-2b004c7ff3a8","Type":"ContainerStarted","Data":"c8991b98dfb0c1dce1750234bdbc803347e7857f84ed2b07d9d2121d43ed5059"}
Jul 24 21:26:23.086808 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:23.086740    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv" event={"ID":"9a287bba-7e81-4f6b-b3db-2b004c7ff3a8","Type":"ContainerStarted","Data":"3ba8c1dff65a466060adadfe5f7eece9f2e83ecdf7d96f18d1a17a2ec450f01c"}
Jul 24 21:26:23.086808 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:23.086788    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv"
Jul 24 21:26:23.086904 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:23.086816    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv" event={"ID":"9a287bba-7e81-4f6b-b3db-2b004c7ff3a8","Type":"ContainerStarted","Data":"f9e5a4988a71bd443aecfc8b4fe2b894ff7a90b703c97ea293e2ed2158dc9fd5"}
Jul 24 21:26:23.105175 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:23.105133    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv" podStartSLOduration=2.105118975 podStartE2EDuration="2.105118975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:26:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:26:23.103427264 +0000 UTC m=+699.548018996" watchObservedRunningTime="2026-07-24 21:26:23.105118975 +0000 UTC m=+699.549710704"
Jul 24 21:26:24.091481 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:24.091446    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv"
Jul 24 21:26:24.092909 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:24.092881    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv" podUID="9a287bba-7e81-4f6b-b3db-2b004c7ff3a8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused"
Jul 24 21:26:25.051969 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:25.051943    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb"
Jul 24 21:26:25.097524 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:25.097487    2561 generic.go:356] "Generic (PLEG): container finished" podID="bb1a3190-0dee-4710-880c-f3e577d60a83" containerID="a3957fece7840985f00555ce7f5c602fb476ef9666b16f046b45efc623eb62fe" exitCode=0
Jul 24 21:26:25.097937 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:25.097533    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb"
Jul 24 21:26:25.097937 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:25.097542    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb" event={"ID":"bb1a3190-0dee-4710-880c-f3e577d60a83","Type":"ContainerDied","Data":"a3957fece7840985f00555ce7f5c602fb476ef9666b16f046b45efc623eb62fe"}
Jul 24 21:26:25.097937 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:25.097610    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb" event={"ID":"bb1a3190-0dee-4710-880c-f3e577d60a83","Type":"ContainerDied","Data":"249cdb33709041d6b31c477f3e786d409313bfcecd9e11afdb43836971fb0025"}
Jul 24 21:26:25.097937 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:25.097655    2561 scope.go:117] "RemoveContainer" containerID="b706c8dc7c67b559decd19e2ba22b847b5681fbb05a677ac4b9b3c8e4491d56a"
Jul 24 21:26:25.098145 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:25.097942    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv" podUID="9a287bba-7e81-4f6b-b3db-2b004c7ff3a8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused"
Jul 24 21:26:25.106386 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:25.106372    2561 scope.go:117] "RemoveContainer" containerID="a3957fece7840985f00555ce7f5c602fb476ef9666b16f046b45efc623eb62fe"
Jul 24 21:26:25.113751 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:25.113734    2561 scope.go:117] "RemoveContainer" containerID="b706c8dc7c67b559decd19e2ba22b847b5681fbb05a677ac4b9b3c8e4491d56a"
Jul 24 21:26:25.113992 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:26:25.113975    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b706c8dc7c67b559decd19e2ba22b847b5681fbb05a677ac4b9b3c8e4491d56a\": container with ID starting with b706c8dc7c67b559decd19e2ba22b847b5681fbb05a677ac4b9b3c8e4491d56a not found: ID does not exist" containerID="b706c8dc7c67b559decd19e2ba22b847b5681fbb05a677ac4b9b3c8e4491d56a"
Jul 24 21:26:25.114034 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:25.114001    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b706c8dc7c67b559decd19e2ba22b847b5681fbb05a677ac4b9b3c8e4491d56a"} err="failed to get container status \"b706c8dc7c67b559decd19e2ba22b847b5681fbb05a677ac4b9b3c8e4491d56a\": rpc error: code = NotFound desc = could not find container \"b706c8dc7c67b559decd19e2ba22b847b5681fbb05a677ac4b9b3c8e4491d56a\": container with ID starting with b706c8dc7c67b559decd19e2ba22b847b5681fbb05a677ac4b9b3c8e4491d56a not found: ID does not exist"
Jul 24 21:26:25.114034 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:25.114018    2561 scope.go:117] "RemoveContainer" containerID="a3957fece7840985f00555ce7f5c602fb476ef9666b16f046b45efc623eb62fe"
Jul 24 21:26:25.114249 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:26:25.114212    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3957fece7840985f00555ce7f5c602fb476ef9666b16f046b45efc623eb62fe\": container with ID starting with a3957fece7840985f00555ce7f5c602fb476ef9666b16f046b45efc623eb62fe not found: ID does not exist" containerID="a3957fece7840985f00555ce7f5c602fb476ef9666b16f046b45efc623eb62fe"
Jul 24 21:26:25.114421 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:25.114249    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3957fece7840985f00555ce7f5c602fb476ef9666b16f046b45efc623eb62fe"} err="failed to get container status \"a3957fece7840985f00555ce7f5c602fb476ef9666b16f046b45efc623eb62fe\": rpc error: code = NotFound desc = could not find container \"a3957fece7840985f00555ce7f5c602fb476ef9666b16f046b45efc623eb62fe\": container with ID starting with a3957fece7840985f00555ce7f5c602fb476ef9666b16f046b45efc623eb62fe not found: ID does not exist"
Jul 24 21:26:25.117497 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:25.117482    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bb1a3190-0dee-4710-880c-f3e577d60a83-proxy-tls\") pod \"bb1a3190-0dee-4710-880c-f3e577d60a83\" (UID: \"bb1a3190-0dee-4710-880c-f3e577d60a83\") "
Jul 24 21:26:25.117552 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:25.117529    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bb1a3190-0dee-4710-880c-f3e577d60a83-kube-rbac-proxy-sar-config\") pod \"bb1a3190-0dee-4710-880c-f3e577d60a83\" (UID: \"bb1a3190-0dee-4710-880c-f3e577d60a83\") "
Jul 24 21:26:25.117666 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:25.117648    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzstx\" (UniqueName: \"kubernetes.io/projected/bb1a3190-0dee-4710-880c-f3e577d60a83-kube-api-access-zzstx\") pod \"bb1a3190-0dee-4710-880c-f3e577d60a83\" (UID: \"bb1a3190-0dee-4710-880c-f3e577d60a83\") "
Jul 24 21:26:25.117867 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:25.117848    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb1a3190-0dee-4710-880c-f3e577d60a83-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "bb1a3190-0dee-4710-880c-f3e577d60a83" (UID: "bb1a3190-0dee-4710-880c-f3e577d60a83"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:26:25.118036 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:25.118020    2561 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bb1a3190-0dee-4710-880c-f3e577d60a83-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:26:25.119759 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:25.119737    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb1a3190-0dee-4710-880c-f3e577d60a83-kube-api-access-zzstx" (OuterVolumeSpecName: "kube-api-access-zzstx") pod "bb1a3190-0dee-4710-880c-f3e577d60a83" (UID: "bb1a3190-0dee-4710-880c-f3e577d60a83"). InnerVolumeSpecName "kube-api-access-zzstx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 21:26:25.119856 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:25.119827    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb1a3190-0dee-4710-880c-f3e577d60a83-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "bb1a3190-0dee-4710-880c-f3e577d60a83" (UID: "bb1a3190-0dee-4710-880c-f3e577d60a83"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 21:26:25.218555 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:25.218476    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzstx\" (UniqueName: \"kubernetes.io/projected/bb1a3190-0dee-4710-880c-f3e577d60a83-kube-api-access-zzstx\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:26:25.218555 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:25.218505    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bb1a3190-0dee-4710-880c-f3e577d60a83-proxy-tls\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:26:25.419765 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:25.419738    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb"]
Jul 24 21:26:25.425289 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:25.425264    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-77ecc-predictor-86d6bd8d6d-25ldb"]
Jul 24 21:26:25.840019 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:25.839980    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj" podUID="91c1b8bf-206a-4c81-8439-de3b355e3ec4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused"
Jul 24 21:26:25.948109 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:25.948063    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72" podUID="d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused"
Jul 24 21:26:25.953783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:25.953756    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb1a3190-0dee-4710-880c-f3e577d60a83" path="/var/lib/kubelet/pods/bb1a3190-0dee-4710-880c-f3e577d60a83/volumes"
Jul 24 21:26:30.102806 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:30.102776    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv"
Jul 24 21:26:30.103256 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:30.103216    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv" podUID="9a287bba-7e81-4f6b-b3db-2b004c7ff3a8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused"
Jul 24 21:26:32.949057 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:32.949028    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn"
Jul 24 21:26:35.840446 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:35.840354    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj"
Jul 24 21:26:35.953214 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:35.953191    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72"
Jul 24 21:26:40.103915 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:40.103873    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv" podUID="9a287bba-7e81-4f6b-b3db-2b004c7ff3a8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused"
Jul 24 21:26:50.104133 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:26:50.104089    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv" podUID="9a287bba-7e81-4f6b-b3db-2b004c7ff3a8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused"
Jul 24 21:27:00.103336 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:00.103298    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv" podUID="9a287bba-7e81-4f6b-b3db-2b004c7ff3a8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused"
Jul 24 21:27:10.104011 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:10.103984    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv"
Jul 24 21:27:11.760460 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:11.760426    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn"]
Jul 24 21:27:11.760871 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:11.760680    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn" podUID="c2906e30-cc2e-4938-bf3d-476410e6a7e2" containerName="kserve-container" containerID="cri-o://03e9df37ee79ac628e1fda2285943cc1ffbd9a0b4a7be92f0833bb9241fff045" gracePeriod=30
Jul 24 21:27:11.760871 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:11.760719    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn" podUID="c2906e30-cc2e-4938-bf3d-476410e6a7e2" containerName="kube-rbac-proxy" containerID="cri-o://f0cd950155f49468b3c34ea61066bec4a3f47740cb72e23bc575257aa3e606c7" gracePeriod=30
Jul 24 21:27:11.815300 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:11.815266    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72"]
Jul 24 21:27:11.815535 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:11.815508    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72" podUID="d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb" containerName="kserve-container" containerID="cri-o://688b9ebd04b48ede0e713999c6c6259675a4ec4b329bd70fb8dd1ffe2b032cd5" gracePeriod=30
Jul 24 21:27:11.815612 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:11.815566    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72" podUID="d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb" containerName="kube-rbac-proxy" containerID="cri-o://847d6e24b61bd2d32b3b467371a10baee2b64cb73c1e622f158c3334f3092768" gracePeriod=30
Jul 24 21:27:11.842918 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:11.842896    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr"]
Jul 24 21:27:11.843286 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:11.843274    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb1a3190-0dee-4710-880c-f3e577d60a83" containerName="kube-rbac-proxy"
Jul 24 21:27:11.843332 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:11.843288    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb1a3190-0dee-4710-880c-f3e577d60a83" containerName="kube-rbac-proxy"
Jul 24 21:27:11.843332 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:11.843307    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb1a3190-0dee-4710-880c-f3e577d60a83" containerName="kserve-container"
Jul 24 21:27:11.843332 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:11.843315    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb1a3190-0dee-4710-880c-f3e577d60a83" containerName="kserve-container"
Jul 24 21:27:11.843463 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:11.843394    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb1a3190-0dee-4710-880c-f3e577d60a83" containerName="kserve-container"
Jul 24 21:27:11.843463 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:11.843408    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb1a3190-0dee-4710-880c-f3e577d60a83" containerName="kube-rbac-proxy"
Jul 24 21:27:11.846665 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:11.846646    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr"
Jul 24 21:27:11.848915 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:11.848891    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-c3da7-predictor-serving-cert\""
Jul 24 21:27:11.851495 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:11.851472    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-c3da7-kube-rbac-proxy-sar-config\""
Jul 24 21:27:11.860778 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:11.860728    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr"]
Jul 24 21:27:11.883799 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:11.883774    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj"]
Jul 24 21:27:11.884075 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:11.884026    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj" podUID="91c1b8bf-206a-4c81-8439-de3b355e3ec4" containerName="kserve-container" containerID="cri-o://61f34356010801e20fd3514b02df53789654b0ceb47a605b1136d64ec4a07293" gracePeriod=30
Jul 24 21:27:11.884164 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:11.884061    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj" podUID="91c1b8bf-206a-4c81-8439-de3b355e3ec4" containerName="kube-rbac-proxy" containerID="cri-o://d5043cdd84a20bb978410ab89560d7b921e0517e2453bbd258e79eff9a989328" gracePeriod=30
Jul 24 21:27:11.923047 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:11.923018    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/34921a6f-8ea9-4879-8925-9240df8703f9-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-c3da7-predictor-594869d894-mh5zr\" (UID: \"34921a6f-8ea9-4879-8925-9240df8703f9\") " pod="kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr"
Jul 24 21:27:11.923143 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:11.923067    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sttr\" (UniqueName: \"kubernetes.io/projected/34921a6f-8ea9-4879-8925-9240df8703f9-kube-api-access-8sttr\") pod \"success-200-isvc-c3da7-predictor-594869d894-mh5zr\" (UID: \"34921a6f-8ea9-4879-8925-9240df8703f9\") " pod="kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr"
Jul 24 21:27:11.923143 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:11.923111    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/34921a6f-8ea9-4879-8925-9240df8703f9-proxy-tls\") pod \"success-200-isvc-c3da7-predictor-594869d894-mh5zr\" (UID: \"34921a6f-8ea9-4879-8925-9240df8703f9\") " pod="kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr"
Jul 24 21:27:12.024258 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:12.024189    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/34921a6f-8ea9-4879-8925-9240df8703f9-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-c3da7-predictor-594869d894-mh5zr\" (UID: \"34921a6f-8ea9-4879-8925-9240df8703f9\") " pod="kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr"
Jul 24 21:27:12.024258 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:12.024248    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sttr\" (UniqueName: \"kubernetes.io/projected/34921a6f-8ea9-4879-8925-9240df8703f9-kube-api-access-8sttr\") pod \"success-200-isvc-c3da7-predictor-594869d894-mh5zr\" (UID: \"34921a6f-8ea9-4879-8925-9240df8703f9\") " pod="kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr"
Jul 24 21:27:12.024386 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:12.024272    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/34921a6f-8ea9-4879-8925-9240df8703f9-proxy-tls\") pod \"success-200-isvc-c3da7-predictor-594869d894-mh5zr\" (UID: \"34921a6f-8ea9-4879-8925-9240df8703f9\") " pod="kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr"
Jul 24 21:27:12.024445 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:27:12.024384    2561 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-serving-cert: secret "success-200-isvc-c3da7-predictor-serving-cert" not found
Jul 24 21:27:12.024445 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:27:12.024443    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34921a6f-8ea9-4879-8925-9240df8703f9-proxy-tls podName:34921a6f-8ea9-4879-8925-9240df8703f9 nodeName:}" failed. No retries permitted until 2026-07-24 21:27:12.524427833 +0000 UTC m=+748.969019541 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/34921a6f-8ea9-4879-8925-9240df8703f9-proxy-tls") pod "success-200-isvc-c3da7-predictor-594869d894-mh5zr" (UID: "34921a6f-8ea9-4879-8925-9240df8703f9") : secret "success-200-isvc-c3da7-predictor-serving-cert" not found
Jul 24 21:27:12.024796 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:12.024778    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/34921a6f-8ea9-4879-8925-9240df8703f9-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-c3da7-predictor-594869d894-mh5zr\" (UID: \"34921a6f-8ea9-4879-8925-9240df8703f9\") " pod="kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr"
Jul 24 21:27:12.041952 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:12.041928    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sttr\" (UniqueName: \"kubernetes.io/projected/34921a6f-8ea9-4879-8925-9240df8703f9-kube-api-access-8sttr\") pod \"success-200-isvc-c3da7-predictor-594869d894-mh5zr\" (UID: \"34921a6f-8ea9-4879-8925-9240df8703f9\") " pod="kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr"
Jul 24 21:27:12.333085 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:12.333005    2561 generic.go:356] "Generic (PLEG): container finished" podID="c2906e30-cc2e-4938-bf3d-476410e6a7e2" containerID="f0cd950155f49468b3c34ea61066bec4a3f47740cb72e23bc575257aa3e606c7" exitCode=2
Jul 24 21:27:12.333219 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:12.333081    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn" event={"ID":"c2906e30-cc2e-4938-bf3d-476410e6a7e2","Type":"ContainerDied","Data":"f0cd950155f49468b3c34ea61066bec4a3f47740cb72e23bc575257aa3e606c7"}
Jul 24 21:27:12.334962 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:12.334939    2561 generic.go:356] "Generic (PLEG): container finished" podID="91c1b8bf-206a-4c81-8439-de3b355e3ec4" containerID="d5043cdd84a20bb978410ab89560d7b921e0517e2453bbd258e79eff9a989328" exitCode=2
Jul 24 21:27:12.335085 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:12.335008    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj" event={"ID":"91c1b8bf-206a-4c81-8439-de3b355e3ec4","Type":"ContainerDied","Data":"d5043cdd84a20bb978410ab89560d7b921e0517e2453bbd258e79eff9a989328"}
Jul 24 21:27:12.337062 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:12.337039    2561 generic.go:356] "Generic (PLEG): container finished" podID="d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb" containerID="847d6e24b61bd2d32b3b467371a10baee2b64cb73c1e622f158c3334f3092768" exitCode=2
Jul 24 21:27:12.337166 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:12.337077    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72" event={"ID":"d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb","Type":"ContainerDied","Data":"847d6e24b61bd2d32b3b467371a10baee2b64cb73c1e622f158c3334f3092768"}
Jul 24 21:27:12.529425 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:12.529398    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/34921a6f-8ea9-4879-8925-9240df8703f9-proxy-tls\") pod \"success-200-isvc-c3da7-predictor-594869d894-mh5zr\" (UID: \"34921a6f-8ea9-4879-8925-9240df8703f9\") " pod="kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr"
Jul 24 21:27:12.531952 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:12.531928    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/34921a6f-8ea9-4879-8925-9240df8703f9-proxy-tls\") pod \"success-200-isvc-c3da7-predictor-594869d894-mh5zr\" (UID: \"34921a6f-8ea9-4879-8925-9240df8703f9\") " pod="kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr"
Jul 24 21:27:12.757998 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:12.757974    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr"
Jul 24 21:27:12.893731 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:12.893706    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr"]
Jul 24 21:27:12.896176 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:27:12.896145    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34921a6f_8ea9_4879_8925_9240df8703f9.slice/crio-117a90aa5ec1796613c0d13bc0c9d0ff2eecbc66f922d1b986602dae07912daf WatchSource:0}: Error finding container 117a90aa5ec1796613c0d13bc0c9d0ff2eecbc66f922d1b986602dae07912daf: Status 404 returned error can't find the container with id 117a90aa5ec1796613c0d13bc0c9d0ff2eecbc66f922d1b986602dae07912daf
Jul 24 21:27:12.948528 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:12.948493    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn" podUID="c2906e30-cc2e-4938-bf3d-476410e6a7e2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused"
Jul 24 21:27:13.343328 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:13.343219    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr" event={"ID":"34921a6f-8ea9-4879-8925-9240df8703f9","Type":"ContainerStarted","Data":"9e19f9c2f580cb4b74136f983f3932a59c4799ebdbf46e9a68951286c5eff2f7"}
Jul 24 21:27:13.343328 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:13.343301    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr" event={"ID":"34921a6f-8ea9-4879-8925-9240df8703f9","Type":"ContainerStarted","Data":"b2f0da0348ab39542fb4ec505cad272e682bc052d28454050cd7e83694ecb80b"}
Jul 24 21:27:13.343512 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:13.343361    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr" event={"ID":"34921a6f-8ea9-4879-8925-9240df8703f9","Type":"ContainerStarted","Data":"117a90aa5ec1796613c0d13bc0c9d0ff2eecbc66f922d1b986602dae07912daf"}
Jul 24 21:27:13.343512 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:13.343396    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr"
Jul 24 21:27:13.343512 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:13.343423    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr"
Jul 24 21:27:13.344946 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:13.344921    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr" podUID="34921a6f-8ea9-4879-8925-9240df8703f9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused"
Jul 24 21:27:13.363182 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:13.363140    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr" podStartSLOduration=2.363126591 podStartE2EDuration="2.363126591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:27:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:27:13.360439529 +0000 UTC m=+749.805031259" watchObservedRunningTime="2026-07-24 21:27:13.363126591 +0000 UTC m=+749.807718321"
Jul 24 21:27:14.348960 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:14.348918    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr" podUID="34921a6f-8ea9-4879-8925-9240df8703f9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused"
Jul 24 21:27:15.645189 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:15.645162    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj"
Jul 24 21:27:15.753156 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:15.753068    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72" podUID="d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.31:8643/healthz\": dial tcp 10.133.0.31:8643: connect: connection refused"
Jul 24 21:27:15.758458 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:15.758439    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/91c1b8bf-206a-4c81-8439-de3b355e3ec4-kube-rbac-proxy-sar-config\") pod \"91c1b8bf-206a-4c81-8439-de3b355e3ec4\" (UID: \"91c1b8bf-206a-4c81-8439-de3b355e3ec4\") "
Jul 24 21:27:15.758538 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:15.758474    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/91c1b8bf-206a-4c81-8439-de3b355e3ec4-cabundle-cert\") pod \"91c1b8bf-206a-4c81-8439-de3b355e3ec4\" (UID: \"91c1b8bf-206a-4c81-8439-de3b355e3ec4\") "
Jul 24 21:27:15.758538 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:15.758526    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpgcb\" (UniqueName: \"kubernetes.io/projected/91c1b8bf-206a-4c81-8439-de3b355e3ec4-kube-api-access-gpgcb\") pod \"91c1b8bf-206a-4c81-8439-de3b355e3ec4\" (UID: \"91c1b8bf-206a-4c81-8439-de3b355e3ec4\") "
Jul 24 21:27:15.758611 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:15.758560    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/91c1b8bf-206a-4c81-8439-de3b355e3ec4-kserve-provision-location\") pod \"91c1b8bf-206a-4c81-8439-de3b355e3ec4\" (UID: \"91c1b8bf-206a-4c81-8439-de3b355e3ec4\") "
Jul 24 21:27:15.758611 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:15.758595    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/91c1b8bf-206a-4c81-8439-de3b355e3ec4-proxy-tls\") pod \"91c1b8bf-206a-4c81-8439-de3b355e3ec4\" (UID: \"91c1b8bf-206a-4c81-8439-de3b355e3ec4\") "
Jul 24 21:27:15.758949 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:15.758925    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91c1b8bf-206a-4c81-8439-de3b355e3ec4-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "91c1b8bf-206a-4c81-8439-de3b355e3ec4" (UID: "91c1b8bf-206a-4c81-8439-de3b355e3ec4"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:27:15.759050 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:15.758950    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91c1b8bf-206a-4c81-8439-de3b355e3ec4-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "91c1b8bf-206a-4c81-8439-de3b355e3ec4" (UID: "91c1b8bf-206a-4c81-8439-de3b355e3ec4"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 21:27:15.759050 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:15.758975    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91c1b8bf-206a-4c81-8439-de3b355e3ec4-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "91c1b8bf-206a-4c81-8439-de3b355e3ec4" (UID: "91c1b8bf-206a-4c81-8439-de3b355e3ec4"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:27:15.760736 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:15.760714    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91c1b8bf-206a-4c81-8439-de3b355e3ec4-kube-api-access-gpgcb" (OuterVolumeSpecName: "kube-api-access-gpgcb") pod "91c1b8bf-206a-4c81-8439-de3b355e3ec4" (UID: "91c1b8bf-206a-4c81-8439-de3b355e3ec4"). InnerVolumeSpecName "kube-api-access-gpgcb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 21:27:15.760807 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:15.760788    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91c1b8bf-206a-4c81-8439-de3b355e3ec4-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "91c1b8bf-206a-4c81-8439-de3b355e3ec4" (UID: "91c1b8bf-206a-4c81-8439-de3b355e3ec4"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 21:27:15.860062 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:15.860026    2561 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/91c1b8bf-206a-4c81-8439-de3b355e3ec4-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:27:15.860062 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:15.860056    2561 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/91c1b8bf-206a-4c81-8439-de3b355e3ec4-cabundle-cert\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:27:15.860062 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:15.860066    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpgcb\" (UniqueName: \"kubernetes.io/projected/91c1b8bf-206a-4c81-8439-de3b355e3ec4-kube-api-access-gpgcb\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:27:15.860062 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:15.860074    2561 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/91c1b8bf-206a-4c81-8439-de3b355e3ec4-kserve-provision-location\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:27:15.860383 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:15.860083    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/91c1b8bf-206a-4c81-8439-de3b355e3ec4-proxy-tls\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:27:15.948651 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:15.948603    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72" podUID="d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused"
Jul 24 21:27:16.359598 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:16.359558    2561 generic.go:356] "Generic (PLEG): container finished" podID="91c1b8bf-206a-4c81-8439-de3b355e3ec4" containerID="61f34356010801e20fd3514b02df53789654b0ceb47a605b1136d64ec4a07293" exitCode=0
Jul 24 21:27:16.359765 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:16.359626    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj"
Jul 24 21:27:16.359765 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:16.359639    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj" event={"ID":"91c1b8bf-206a-4c81-8439-de3b355e3ec4","Type":"ContainerDied","Data":"61f34356010801e20fd3514b02df53789654b0ceb47a605b1136d64ec4a07293"}
Jul 24 21:27:16.359765 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:16.359729    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj" event={"ID":"91c1b8bf-206a-4c81-8439-de3b355e3ec4","Type":"ContainerDied","Data":"ec00e0df9d66b5e08df4980c520809b2114a9978001063322afa35d94509bef2"}
Jul 24 21:27:16.359765 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:16.359759    2561 scope.go:117] "RemoveContainer" containerID="d5043cdd84a20bb978410ab89560d7b921e0517e2453bbd258e79eff9a989328"
Jul 24 21:27:16.368390 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:16.368372    2561 scope.go:117] "RemoveContainer" containerID="61f34356010801e20fd3514b02df53789654b0ceb47a605b1136d64ec4a07293"
Jul 24 21:27:16.377377 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:16.377352    2561 scope.go:117] "RemoveContainer" containerID="b1e7a7beb58c20725408338180cef0bece9ff675a48de2254f8d83f2ce7d430d"
Jul 24 21:27:16.383373 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:16.383350    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj"]
Jul 24 21:27:16.387380 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:16.387355    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-k52wj"]
Jul 24 21:27:16.388080 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:16.388063    2561 scope.go:117] "RemoveContainer" containerID="d5043cdd84a20bb978410ab89560d7b921e0517e2453bbd258e79eff9a989328"
Jul 24 21:27:16.388383 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:27:16.388365    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5043cdd84a20bb978410ab89560d7b921e0517e2453bbd258e79eff9a989328\": container with ID starting with d5043cdd84a20bb978410ab89560d7b921e0517e2453bbd258e79eff9a989328 not found: ID does not exist" containerID="d5043cdd84a20bb978410ab89560d7b921e0517e2453bbd258e79eff9a989328"
Jul 24 21:27:16.388438 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:16.388393    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5043cdd84a20bb978410ab89560d7b921e0517e2453bbd258e79eff9a989328"} err="failed to get container status \"d5043cdd84a20bb978410ab89560d7b921e0517e2453bbd258e79eff9a989328\": rpc error: code = NotFound desc = could not find container \"d5043cdd84a20bb978410ab89560d7b921e0517e2453bbd258e79eff9a989328\": container with ID starting with d5043cdd84a20bb978410ab89560d7b921e0517e2453bbd258e79eff9a989328 not found: ID does not exist"
Jul 24 21:27:16.388438 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:16.388411    2561 scope.go:117] "RemoveContainer" containerID="61f34356010801e20fd3514b02df53789654b0ceb47a605b1136d64ec4a07293"
Jul 24 21:27:16.388612 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:27:16.388594    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61f34356010801e20fd3514b02df53789654b0ceb47a605b1136d64ec4a07293\": container with ID starting with 61f34356010801e20fd3514b02df53789654b0ceb47a605b1136d64ec4a07293 not found: ID does not exist" containerID="61f34356010801e20fd3514b02df53789654b0ceb47a605b1136d64ec4a07293"
Jul 24 21:27:16.388652 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:16.388616    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61f34356010801e20fd3514b02df53789654b0ceb47a605b1136d64ec4a07293"} err="failed to get container status \"61f34356010801e20fd3514b02df53789654b0ceb47a605b1136d64ec4a07293\": rpc error: code = NotFound desc = could not find container \"61f34356010801e20fd3514b02df53789654b0ceb47a605b1136d64ec4a07293\": container with ID starting with 61f34356010801e20fd3514b02df53789654b0ceb47a605b1136d64ec4a07293 not found: ID does not exist"
Jul 24 21:27:16.388652 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:16.388630    2561 scope.go:117] "RemoveContainer" containerID="b1e7a7beb58c20725408338180cef0bece9ff675a48de2254f8d83f2ce7d430d"
Jul 24 21:27:16.388807 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:27:16.388790    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1e7a7beb58c20725408338180cef0bece9ff675a48de2254f8d83f2ce7d430d\": container with ID starting with b1e7a7beb58c20725408338180cef0bece9ff675a48de2254f8d83f2ce7d430d not found: ID does not exist" containerID="b1e7a7beb58c20725408338180cef0bece9ff675a48de2254f8d83f2ce7d430d"
Jul 24 21:27:16.388846 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:16.388820    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1e7a7beb58c20725408338180cef0bece9ff675a48de2254f8d83f2ce7d430d"} err="failed to get container status \"b1e7a7beb58c20725408338180cef0bece9ff675a48de2254f8d83f2ce7d430d\": rpc error: code = NotFound desc = could not find container \"b1e7a7beb58c20725408338180cef0bece9ff675a48de2254f8d83f2ce7d430d\": container with ID starting with b1e7a7beb58c20725408338180cef0bece9ff675a48de2254f8d83f2ce7d430d not found: ID does not exist"
Jul 24 21:27:16.839093 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:16.839071    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn"
Jul 24 21:27:16.968052 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:16.968031    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72"
Jul 24 21:27:16.972679 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:16.972657    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c2906e30-cc2e-4938-bf3d-476410e6a7e2-kube-rbac-proxy-sar-config\") pod \"c2906e30-cc2e-4938-bf3d-476410e6a7e2\" (UID: \"c2906e30-cc2e-4938-bf3d-476410e6a7e2\") "
Jul 24 21:27:16.972816 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:16.972706    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c2906e30-cc2e-4938-bf3d-476410e6a7e2-kserve-provision-location\") pod \"c2906e30-cc2e-4938-bf3d-476410e6a7e2\" (UID: \"c2906e30-cc2e-4938-bf3d-476410e6a7e2\") "
Jul 24 21:27:16.972816 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:16.972726    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c2906e30-cc2e-4938-bf3d-476410e6a7e2-proxy-tls\") pod \"c2906e30-cc2e-4938-bf3d-476410e6a7e2\" (UID: \"c2906e30-cc2e-4938-bf3d-476410e6a7e2\") "
Jul 24 21:27:16.972816 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:16.972751    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znzcn\" (UniqueName: \"kubernetes.io/projected/c2906e30-cc2e-4938-bf3d-476410e6a7e2-kube-api-access-znzcn\") pod \"c2906e30-cc2e-4938-bf3d-476410e6a7e2\" (UID: \"c2906e30-cc2e-4938-bf3d-476410e6a7e2\") "
Jul 24 21:27:16.972979 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:16.972875    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c2906e30-cc2e-4938-bf3d-476410e6a7e2-cabundle-cert\") pod \"c2906e30-cc2e-4938-bf3d-476410e6a7e2\" (UID: \"c2906e30-cc2e-4938-bf3d-476410e6a7e2\") "
Jul 24 21:27:16.973054 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:16.973031    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2906e30-cc2e-4938-bf3d-476410e6a7e2-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "c2906e30-cc2e-4938-bf3d-476410e6a7e2" (UID: "c2906e30-cc2e-4938-bf3d-476410e6a7e2"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 21:27:16.973106 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:16.973053    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2906e30-cc2e-4938-bf3d-476410e6a7e2-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "c2906e30-cc2e-4938-bf3d-476410e6a7e2" (UID: "c2906e30-cc2e-4938-bf3d-476410e6a7e2"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:27:16.973275 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:16.973243    2561 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c2906e30-cc2e-4938-bf3d-476410e6a7e2-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:27:16.973343 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:16.973278    2561 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c2906e30-cc2e-4938-bf3d-476410e6a7e2-kserve-provision-location\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:27:16.973343 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:16.973305    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2906e30-cc2e-4938-bf3d-476410e6a7e2-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "c2906e30-cc2e-4938-bf3d-476410e6a7e2" (UID: "c2906e30-cc2e-4938-bf3d-476410e6a7e2"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:27:16.974912 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:16.974887    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2906e30-cc2e-4938-bf3d-476410e6a7e2-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "c2906e30-cc2e-4938-bf3d-476410e6a7e2" (UID: "c2906e30-cc2e-4938-bf3d-476410e6a7e2"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 21:27:16.975277 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:16.975253    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2906e30-cc2e-4938-bf3d-476410e6a7e2-kube-api-access-znzcn" (OuterVolumeSpecName: "kube-api-access-znzcn") pod "c2906e30-cc2e-4938-bf3d-476410e6a7e2" (UID: "c2906e30-cc2e-4938-bf3d-476410e6a7e2"). InnerVolumeSpecName "kube-api-access-znzcn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 21:27:17.073691 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.073657    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb-kserve-provision-location\") pod \"d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb\" (UID: \"d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb\") "
Jul 24 21:27:17.073838 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.073705    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb-cabundle-cert\") pod \"d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb\" (UID: \"d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb\") "
Jul 24 21:27:17.073838 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.073766    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb-kube-rbac-proxy-sar-config\") pod \"d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb\" (UID: \"d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb\") "
Jul 24 21:27:17.073838 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.073818    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2mc8\" (UniqueName: \"kubernetes.io/projected/d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb-kube-api-access-c2mc8\") pod \"d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb\" (UID: \"d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb\") "
Jul 24 21:27:17.073983 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.073843    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb-proxy-tls\") pod \"d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb\" (UID: \"d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb\") "
Jul 24 21:27:17.074056 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.074029    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb" (UID: "d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 21:27:17.074113 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.074104    2561 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c2906e30-cc2e-4938-bf3d-476410e6a7e2-cabundle-cert\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:27:17.074171 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.074121    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c2906e30-cc2e-4938-bf3d-476410e6a7e2-proxy-tls\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:27:17.074171 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.074136    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znzcn\" (UniqueName: \"kubernetes.io/projected/c2906e30-cc2e-4938-bf3d-476410e6a7e2-kube-api-access-znzcn\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:27:17.074171 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.074150    2561 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb-kserve-provision-location\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:27:17.074300 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.074169    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb" (UID: "d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:27:17.074300 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.074175    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb" (UID: "d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:27:17.076068 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.076047    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb" (UID: "d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 21:27:17.076178 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.076115    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb-kube-api-access-c2mc8" (OuterVolumeSpecName: "kube-api-access-c2mc8") pod "d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb" (UID: "d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb"). InnerVolumeSpecName "kube-api-access-c2mc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 21:27:17.175543 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.175508    2561 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb-cabundle-cert\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:27:17.175543 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.175538    2561 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:27:17.175543 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.175547    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2mc8\" (UniqueName: \"kubernetes.io/projected/d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb-kube-api-access-c2mc8\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:27:17.175767 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.175556    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb-proxy-tls\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:27:17.365673 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.365635    2561 generic.go:356] "Generic (PLEG): container finished" podID="d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb" containerID="688b9ebd04b48ede0e713999c6c6259675a4ec4b329bd70fb8dd1ffe2b032cd5" exitCode=0
Jul 24 21:27:17.365852 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.365700    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72"
Jul 24 21:27:17.365852 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.365714    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72" event={"ID":"d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb","Type":"ContainerDied","Data":"688b9ebd04b48ede0e713999c6c6259675a4ec4b329bd70fb8dd1ffe2b032cd5"}
Jul 24 21:27:17.365852 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.365773    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72" event={"ID":"d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb","Type":"ContainerDied","Data":"58894349e24b39a16e70098bbbcfdd5056b3745ebe5ca74a1071bdf71149c976"}
Jul 24 21:27:17.365852 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.365804    2561 scope.go:117] "RemoveContainer" containerID="847d6e24b61bd2d32b3b467371a10baee2b64cb73c1e622f158c3334f3092768"
Jul 24 21:27:17.367709 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.367686    2561 generic.go:356] "Generic (PLEG): container finished" podID="c2906e30-cc2e-4938-bf3d-476410e6a7e2" containerID="03e9df37ee79ac628e1fda2285943cc1ffbd9a0b4a7be92f0833bb9241fff045" exitCode=0
Jul 24 21:27:17.367817 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.367753    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn"
Jul 24 21:27:17.367817 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.367771    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn" event={"ID":"c2906e30-cc2e-4938-bf3d-476410e6a7e2","Type":"ContainerDied","Data":"03e9df37ee79ac628e1fda2285943cc1ffbd9a0b4a7be92f0833bb9241fff045"}
Jul 24 21:27:17.367922 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.367830    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn" event={"ID":"c2906e30-cc2e-4938-bf3d-476410e6a7e2","Type":"ContainerDied","Data":"8b1eebef79a7e2637f14383ef5d0f8732249da45c454e0f4c3d66e3e09800bd6"}
Jul 24 21:27:17.375890 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.375871    2561 scope.go:117] "RemoveContainer" containerID="688b9ebd04b48ede0e713999c6c6259675a4ec4b329bd70fb8dd1ffe2b032cd5"
Jul 24 21:27:17.387951 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.387934    2561 scope.go:117] "RemoveContainer" containerID="3fc9f87e1c396cf9b4fec0a0e4a67cb867a95e9480aecfbc1d4ac45a24789bb8"
Jul 24 21:27:17.396092 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.396069    2561 scope.go:117] "RemoveContainer" containerID="847d6e24b61bd2d32b3b467371a10baee2b64cb73c1e622f158c3334f3092768"
Jul 24 21:27:17.396410 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:27:17.396391    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"847d6e24b61bd2d32b3b467371a10baee2b64cb73c1e622f158c3334f3092768\": container with ID starting with 847d6e24b61bd2d32b3b467371a10baee2b64cb73c1e622f158c3334f3092768 not found: ID does not exist" containerID="847d6e24b61bd2d32b3b467371a10baee2b64cb73c1e622f158c3334f3092768"
Jul 24 21:27:17.396491 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.396424    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"847d6e24b61bd2d32b3b467371a10baee2b64cb73c1e622f158c3334f3092768"} err="failed to get container status \"847d6e24b61bd2d32b3b467371a10baee2b64cb73c1e622f158c3334f3092768\": rpc error: code = NotFound desc = could not find container \"847d6e24b61bd2d32b3b467371a10baee2b64cb73c1e622f158c3334f3092768\": container with ID starting with 847d6e24b61bd2d32b3b467371a10baee2b64cb73c1e622f158c3334f3092768 not found: ID does not exist"
Jul 24 21:27:17.396491 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.396455    2561 scope.go:117] "RemoveContainer" containerID="688b9ebd04b48ede0e713999c6c6259675a4ec4b329bd70fb8dd1ffe2b032cd5"
Jul 24 21:27:17.396739 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:27:17.396721    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"688b9ebd04b48ede0e713999c6c6259675a4ec4b329bd70fb8dd1ffe2b032cd5\": container with ID starting with 688b9ebd04b48ede0e713999c6c6259675a4ec4b329bd70fb8dd1ffe2b032cd5 not found: ID does not exist" containerID="688b9ebd04b48ede0e713999c6c6259675a4ec4b329bd70fb8dd1ffe2b032cd5"
Jul 24 21:27:17.396789 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.396743    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"688b9ebd04b48ede0e713999c6c6259675a4ec4b329bd70fb8dd1ffe2b032cd5"} err="failed to get container status \"688b9ebd04b48ede0e713999c6c6259675a4ec4b329bd70fb8dd1ffe2b032cd5\": rpc error: code = NotFound desc = could not find container \"688b9ebd04b48ede0e713999c6c6259675a4ec4b329bd70fb8dd1ffe2b032cd5\": container with ID starting with 688b9ebd04b48ede0e713999c6c6259675a4ec4b329bd70fb8dd1ffe2b032cd5 not found: ID does not exist"
Jul 24 21:27:17.396789 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.396759    2561 scope.go:117] "RemoveContainer" containerID="3fc9f87e1c396cf9b4fec0a0e4a67cb867a95e9480aecfbc1d4ac45a24789bb8"
Jul 24 21:27:17.397028 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:27:17.397007    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fc9f87e1c396cf9b4fec0a0e4a67cb867a95e9480aecfbc1d4ac45a24789bb8\": container with ID starting with 3fc9f87e1c396cf9b4fec0a0e4a67cb867a95e9480aecfbc1d4ac45a24789bb8 not found: ID does not exist" containerID="3fc9f87e1c396cf9b4fec0a0e4a67cb867a95e9480aecfbc1d4ac45a24789bb8"
Jul 24 21:27:17.397071 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.397036    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fc9f87e1c396cf9b4fec0a0e4a67cb867a95e9480aecfbc1d4ac45a24789bb8"} err="failed to get container status \"3fc9f87e1c396cf9b4fec0a0e4a67cb867a95e9480aecfbc1d4ac45a24789bb8\": rpc error: code = NotFound desc = could not find container \"3fc9f87e1c396cf9b4fec0a0e4a67cb867a95e9480aecfbc1d4ac45a24789bb8\": container with ID starting with 3fc9f87e1c396cf9b4fec0a0e4a67cb867a95e9480aecfbc1d4ac45a24789bb8 not found: ID does not exist"
Jul 24 21:27:17.397071 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.397057    2561 scope.go:117] "RemoveContainer" containerID="f0cd950155f49468b3c34ea61066bec4a3f47740cb72e23bc575257aa3e606c7"
Jul 24 21:27:17.397353 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.397334    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn"]
Jul 24 21:27:17.402050 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.402030    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn"]
Jul 24 21:27:17.405782 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.405751    2561 scope.go:117] "RemoveContainer" containerID="03e9df37ee79ac628e1fda2285943cc1ffbd9a0b4a7be92f0833bb9241fff045"
Jul 24 21:27:17.412080 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.412058    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72"]
Jul 24 21:27:17.413645 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.413627    2561 scope.go:117] "RemoveContainer" containerID="95cb6191eb93cba7f121af7f71d0249040d3e917b0e9cf00b8c2333f57f899bd"
Jul 24 21:27:17.417912 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.417887    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7656b4965b-sbh72"]
Jul 24 21:27:17.421513 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.421497    2561 scope.go:117] "RemoveContainer" containerID="f0cd950155f49468b3c34ea61066bec4a3f47740cb72e23bc575257aa3e606c7"
Jul 24 21:27:17.421797 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:27:17.421779    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0cd950155f49468b3c34ea61066bec4a3f47740cb72e23bc575257aa3e606c7\": container with ID starting with f0cd950155f49468b3c34ea61066bec4a3f47740cb72e23bc575257aa3e606c7 not found: ID does not exist" containerID="f0cd950155f49468b3c34ea61066bec4a3f47740cb72e23bc575257aa3e606c7"
Jul 24 21:27:17.421849 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.421808    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0cd950155f49468b3c34ea61066bec4a3f47740cb72e23bc575257aa3e606c7"} err="failed to get container status \"f0cd950155f49468b3c34ea61066bec4a3f47740cb72e23bc575257aa3e606c7\": rpc error: code = NotFound desc = could not find container \"f0cd950155f49468b3c34ea61066bec4a3f47740cb72e23bc575257aa3e606c7\": container with ID starting with f0cd950155f49468b3c34ea61066bec4a3f47740cb72e23bc575257aa3e606c7 not found: ID does not exist"
Jul 24 21:27:17.421849 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.421829    2561 scope.go:117] "RemoveContainer" containerID="03e9df37ee79ac628e1fda2285943cc1ffbd9a0b4a7be92f0833bb9241fff045"
Jul 24 21:27:17.422102 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:27:17.422082    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03e9df37ee79ac628e1fda2285943cc1ffbd9a0b4a7be92f0833bb9241fff045\": container with ID starting with 03e9df37ee79ac628e1fda2285943cc1ffbd9a0b4a7be92f0833bb9241fff045 not found: ID does not exist" containerID="03e9df37ee79ac628e1fda2285943cc1ffbd9a0b4a7be92f0833bb9241fff045"
Jul 24 21:27:17.422145 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.422109    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03e9df37ee79ac628e1fda2285943cc1ffbd9a0b4a7be92f0833bb9241fff045"} err="failed to get container status \"03e9df37ee79ac628e1fda2285943cc1ffbd9a0b4a7be92f0833bb9241fff045\": rpc error: code = NotFound desc = could not find container \"03e9df37ee79ac628e1fda2285943cc1ffbd9a0b4a7be92f0833bb9241fff045\": container with ID starting with 03e9df37ee79ac628e1fda2285943cc1ffbd9a0b4a7be92f0833bb9241fff045 not found: ID does not exist"
Jul 24 21:27:17.422145 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.422126    2561 scope.go:117] "RemoveContainer" containerID="95cb6191eb93cba7f121af7f71d0249040d3e917b0e9cf00b8c2333f57f899bd"
Jul 24 21:27:17.422449 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:27:17.422432    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95cb6191eb93cba7f121af7f71d0249040d3e917b0e9cf00b8c2333f57f899bd\": container with ID starting with 95cb6191eb93cba7f121af7f71d0249040d3e917b0e9cf00b8c2333f57f899bd not found: ID does not exist" containerID="95cb6191eb93cba7f121af7f71d0249040d3e917b0e9cf00b8c2333f57f899bd"
Jul 24 21:27:17.422487 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.422452    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95cb6191eb93cba7f121af7f71d0249040d3e917b0e9cf00b8c2333f57f899bd"} err="failed to get container status \"95cb6191eb93cba7f121af7f71d0249040d3e917b0e9cf00b8c2333f57f899bd\": rpc error: code = NotFound desc = could not find container \"95cb6191eb93cba7f121af7f71d0249040d3e917b0e9cf00b8c2333f57f899bd\": container with ID starting with 95cb6191eb93cba7f121af7f71d0249040d3e917b0e9cf00b8c2333f57f899bd not found: ID does not exist"
Jul 24 21:27:17.757564 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.757522    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-96447656d-6bksn" podUID="c2906e30-cc2e-4938-bf3d-476410e6a7e2" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.33:8643/healthz\": context deadline exceeded"
Jul 24 21:27:17.953893 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.953863    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91c1b8bf-206a-4c81-8439-de3b355e3ec4" path="/var/lib/kubelet/pods/91c1b8bf-206a-4c81-8439-de3b355e3ec4/volumes"
Jul 24 21:27:17.954372 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.954358    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2906e30-cc2e-4938-bf3d-476410e6a7e2" path="/var/lib/kubelet/pods/c2906e30-cc2e-4938-bf3d-476410e6a7e2/volumes"
Jul 24 21:27:17.955097 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:17.955083    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb" path="/var/lib/kubelet/pods/d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb/volumes"
Jul 24 21:27:19.352922 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:19.352893    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr"
Jul 24 21:27:19.353456 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:19.353428    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr" podUID="34921a6f-8ea9-4879-8925-9240df8703f9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused"
Jul 24 21:27:29.353708 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:29.353671    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr" podUID="34921a6f-8ea9-4879-8925-9240df8703f9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused"
Jul 24 21:27:39.353598 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:39.353560    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr" podUID="34921a6f-8ea9-4879-8925-9240df8703f9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused"
Jul 24 21:27:49.353448 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:49.353404    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr" podUID="34921a6f-8ea9-4879-8925-9240df8703f9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused"
Jul 24 21:27:59.353981 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:27:59.353953    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr"
Jul 24 21:29:43.917801 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:29:43.917734    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nsjrg_87f18cf4-62ce-48a0-99b0-fe22bc19f701/console-operator/1.log"
Jul 24 21:29:43.917801 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:29:43.917743    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nsjrg_87f18cf4-62ce-48a0-99b0-fe22bc19f701/console-operator/1.log"
Jul 24 21:34:43.944823 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:34:43.944793    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nsjrg_87f18cf4-62ce-48a0-99b0-fe22bc19f701/console-operator/1.log"
Jul 24 21:34:43.945793 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:34:43.945771    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nsjrg_87f18cf4-62ce-48a0-99b0-fe22bc19f701/console-operator/1.log"
Jul 24 21:35:36.758060 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:36.757973    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv"]
Jul 24 21:35:36.758629 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:36.758255    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv" podUID="9a287bba-7e81-4f6b-b3db-2b004c7ff3a8" containerName="kserve-container" containerID="cri-o://3ba8c1dff65a466060adadfe5f7eece9f2e83ecdf7d96f18d1a17a2ec450f01c" gracePeriod=30
Jul 24 21:35:36.758629 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:36.758281    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv" podUID="9a287bba-7e81-4f6b-b3db-2b004c7ff3a8" containerName="kube-rbac-proxy" containerID="cri-o://c8991b98dfb0c1dce1750234bdbc803347e7857f84ed2b07d9d2121d43ed5059" gracePeriod=30
Jul 24 21:35:36.825185 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:36.825156    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7"]
Jul 24 21:35:36.825701 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:36.825684    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb" containerName="kube-rbac-proxy"
Jul 24 21:35:36.825758 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:36.825704    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb" containerName="kube-rbac-proxy"
Jul 24 21:35:36.825758 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:36.825721    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91c1b8bf-206a-4c81-8439-de3b355e3ec4" containerName="storage-initializer"
Jul 24 21:35:36.825758 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:36.825727    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="91c1b8bf-206a-4c81-8439-de3b355e3ec4" containerName="storage-initializer"
Jul 24 21:35:36.825758 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:36.825736    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2906e30-cc2e-4938-bf3d-476410e6a7e2" containerName="kserve-container"
Jul 24 21:35:36.825758 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:36.825742    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2906e30-cc2e-4938-bf3d-476410e6a7e2" containerName="kserve-container"
Jul 24 21:35:36.825758 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:36.825752    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91c1b8bf-206a-4c81-8439-de3b355e3ec4" containerName="kube-rbac-proxy"
Jul 24 21:35:36.825758 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:36.825759    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="91c1b8bf-206a-4c81-8439-de3b355e3ec4" containerName="kube-rbac-proxy"
Jul 24 21:35:36.825988 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:36.825773    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb" containerName="storage-initializer"
Jul 24 21:35:36.825988 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:36.825779    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb" containerName="storage-initializer"
Jul 24 21:35:36.825988 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:36.825785    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91c1b8bf-206a-4c81-8439-de3b355e3ec4" containerName="kserve-container"
Jul 24 21:35:36.825988 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:36.825791    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="91c1b8bf-206a-4c81-8439-de3b355e3ec4" containerName="kserve-container"
Jul 24 21:35:36.825988 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:36.825803    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb" containerName="kserve-container"
Jul 24 21:35:36.825988 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:36.825807    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb" containerName="kserve-container"
Jul 24 21:35:36.825988 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:36.825814    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2906e30-cc2e-4938-bf3d-476410e6a7e2" containerName="kube-rbac-proxy"
Jul 24 21:35:36.825988 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:36.825819    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2906e30-cc2e-4938-bf3d-476410e6a7e2" containerName="kube-rbac-proxy"
Jul 24 21:35:36.825988 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:36.825826    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2906e30-cc2e-4938-bf3d-476410e6a7e2" containerName="storage-initializer"
Jul 24 21:35:36.825988 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:36.825830    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2906e30-cc2e-4938-bf3d-476410e6a7e2" containerName="storage-initializer"
Jul 24 21:35:36.825988 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:36.825883    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2906e30-cc2e-4938-bf3d-476410e6a7e2" containerName="kserve-container"
Jul 24 21:35:36.825988 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:36.825891    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb" containerName="kube-rbac-proxy"
Jul 24 21:35:36.825988 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:36.825901    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5bab9a9-4aa2-41e0-8aa4-34eddd2e5abb" containerName="kserve-container"
Jul 24 21:35:36.825988 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:36.825906    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2906e30-cc2e-4938-bf3d-476410e6a7e2" containerName="kube-rbac-proxy"
Jul 24 21:35:36.825988 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:36.825912    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="91c1b8bf-206a-4c81-8439-de3b355e3ec4" containerName="kserve-container"
Jul 24 21:35:36.825988 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:36.825917    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="91c1b8bf-206a-4c81-8439-de3b355e3ec4" containerName="kube-rbac-proxy"
Jul 24 21:35:36.828930 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:36.828913    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7"
Jul 24 21:35:36.831319 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:36.831300    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-b6aba-predictor-serving-cert\""
Jul 24 21:35:36.831319 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:36.831313    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-b6aba-kube-rbac-proxy-sar-config\""
Jul 24 21:35:36.839619 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:36.838353    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7"]
Jul 24 21:35:36.913055 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:36.913023    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a414b0d0-2b72-43b5-bcb2-723d0d0775ae-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7\" (UID: \"a414b0d0-2b72-43b5-bcb2-723d0d0775ae\") " pod="kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7"
Jul 24 21:35:36.913187 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:36.913082    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a414b0d0-2b72-43b5-bcb2-723d0d0775ae-proxy-tls\") pod \"success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7\" (UID: \"a414b0d0-2b72-43b5-bcb2-723d0d0775ae\") " pod="kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7"
Jul 24 21:35:36.913187 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:36.913134    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrr8n\" (UniqueName: \"kubernetes.io/projected/a414b0d0-2b72-43b5-bcb2-723d0d0775ae-kube-api-access-lrr8n\") pod \"success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7\" (UID: \"a414b0d0-2b72-43b5-bcb2-723d0d0775ae\") " pod="kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7"
Jul 24 21:35:37.014515 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:37.014431    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrr8n\" (UniqueName: \"kubernetes.io/projected/a414b0d0-2b72-43b5-bcb2-723d0d0775ae-kube-api-access-lrr8n\") pod \"success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7\" (UID: \"a414b0d0-2b72-43b5-bcb2-723d0d0775ae\") " pod="kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7"
Jul 24 21:35:37.014673 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:37.014544    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a414b0d0-2b72-43b5-bcb2-723d0d0775ae-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7\" (UID: \"a414b0d0-2b72-43b5-bcb2-723d0d0775ae\") " pod="kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7"
Jul 24 21:35:37.014673 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:37.014583    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a414b0d0-2b72-43b5-bcb2-723d0d0775ae-proxy-tls\") pod \"success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7\" (UID: \"a414b0d0-2b72-43b5-bcb2-723d0d0775ae\") " pod="kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7"
Jul 24 21:35:37.015218 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:37.015197    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a414b0d0-2b72-43b5-bcb2-723d0d0775ae-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7\" (UID: \"a414b0d0-2b72-43b5-bcb2-723d0d0775ae\") " pod="kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7"
Jul 24 21:35:37.017042 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:37.017022    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a414b0d0-2b72-43b5-bcb2-723d0d0775ae-proxy-tls\") pod \"success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7\" (UID: \"a414b0d0-2b72-43b5-bcb2-723d0d0775ae\") " pod="kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7"
Jul 24 21:35:37.022771 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:37.022749    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrr8n\" (UniqueName: \"kubernetes.io/projected/a414b0d0-2b72-43b5-bcb2-723d0d0775ae-kube-api-access-lrr8n\") pod \"success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7\" (UID: \"a414b0d0-2b72-43b5-bcb2-723d0d0775ae\") " pod="kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7"
Jul 24 21:35:37.142635 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:37.142614    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7"
Jul 24 21:35:37.273552 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:37.273479    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7"]
Jul 24 21:35:37.276794 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:35:37.276769    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda414b0d0_2b72_43b5_bcb2_723d0d0775ae.slice/crio-ec554286d8f5f061286d4a822ea402c60a88a52f494c9796e182613556847600 WatchSource:0}: Error finding container ec554286d8f5f061286d4a822ea402c60a88a52f494c9796e182613556847600: Status 404 returned error can't find the container with id ec554286d8f5f061286d4a822ea402c60a88a52f494c9796e182613556847600
Jul 24 21:35:37.617362 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:37.617267    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7" event={"ID":"a414b0d0-2b72-43b5-bcb2-723d0d0775ae","Type":"ContainerStarted","Data":"dd958573e6de3de2acdcec54dad0e5d5586c66f0929100ed6e2ce6d5e9e5d418"}
Jul 24 21:35:37.617362 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:37.617344    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7" event={"ID":"a414b0d0-2b72-43b5-bcb2-723d0d0775ae","Type":"ContainerStarted","Data":"fefdad6f4797ebba04fc5fe1caeaba795539866ad288c96cf5e96e391c454508"}
Jul 24 21:35:37.617568 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:37.617379    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7" event={"ID":"a414b0d0-2b72-43b5-bcb2-723d0d0775ae","Type":"ContainerStarted","Data":"ec554286d8f5f061286d4a822ea402c60a88a52f494c9796e182613556847600"}
Jul 24 21:35:37.617568 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:37.617413    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7"
Jul 24 21:35:37.619044 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:37.619014    2561 generic.go:356] "Generic (PLEG): container finished" podID="9a287bba-7e81-4f6b-b3db-2b004c7ff3a8" containerID="c8991b98dfb0c1dce1750234bdbc803347e7857f84ed2b07d9d2121d43ed5059" exitCode=2
Jul 24 21:35:37.619153 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:37.619052    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv" event={"ID":"9a287bba-7e81-4f6b-b3db-2b004c7ff3a8","Type":"ContainerDied","Data":"c8991b98dfb0c1dce1750234bdbc803347e7857f84ed2b07d9d2121d43ed5059"}
Jul 24 21:35:37.635434 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:37.635393    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7" podStartSLOduration=1.6353789810000001 podStartE2EDuration="1.635378981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:35:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:35:37.634873788 +0000 UTC m=+1254.079465520" watchObservedRunningTime="2026-07-24 21:35:37.635378981 +0000 UTC m=+1254.079970712"
Jul 24 21:35:38.624235 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:38.624199    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7"
Jul 24 21:35:38.625805 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:38.625777    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7" podUID="a414b0d0-2b72-43b5-bcb2-723d0d0775ae" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.36:8080: connect: connection refused"
Jul 24 21:35:39.628278 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:39.628213    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7" podUID="a414b0d0-2b72-43b5-bcb2-723d0d0775ae" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.36:8080: connect: connection refused"
Jul 24 21:35:40.118358 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:40.118337    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv"
Jul 24 21:35:40.246368 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:40.246282    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a287bba-7e81-4f6b-b3db-2b004c7ff3a8-proxy-tls\") pod \"9a287bba-7e81-4f6b-b3db-2b004c7ff3a8\" (UID: \"9a287bba-7e81-4f6b-b3db-2b004c7ff3a8\") "
Jul 24 21:35:40.246516 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:40.246388    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9a287bba-7e81-4f6b-b3db-2b004c7ff3a8-kube-rbac-proxy-sar-config\") pod \"9a287bba-7e81-4f6b-b3db-2b004c7ff3a8\" (UID: \"9a287bba-7e81-4f6b-b3db-2b004c7ff3a8\") "
Jul 24 21:35:40.246516 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:40.246424    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4sqpl\" (UniqueName: \"kubernetes.io/projected/9a287bba-7e81-4f6b-b3db-2b004c7ff3a8-kube-api-access-4sqpl\") pod \"9a287bba-7e81-4f6b-b3db-2b004c7ff3a8\" (UID: \"9a287bba-7e81-4f6b-b3db-2b004c7ff3a8\") "
Jul 24 21:35:40.246789 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:40.246754    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a287bba-7e81-4f6b-b3db-2b004c7ff3a8-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "9a287bba-7e81-4f6b-b3db-2b004c7ff3a8" (UID: "9a287bba-7e81-4f6b-b3db-2b004c7ff3a8"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:35:40.248540 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:40.248513    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a287bba-7e81-4f6b-b3db-2b004c7ff3a8-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "9a287bba-7e81-4f6b-b3db-2b004c7ff3a8" (UID: "9a287bba-7e81-4f6b-b3db-2b004c7ff3a8"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 21:35:40.248628 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:40.248584    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a287bba-7e81-4f6b-b3db-2b004c7ff3a8-kube-api-access-4sqpl" (OuterVolumeSpecName: "kube-api-access-4sqpl") pod "9a287bba-7e81-4f6b-b3db-2b004c7ff3a8" (UID: "9a287bba-7e81-4f6b-b3db-2b004c7ff3a8"). InnerVolumeSpecName "kube-api-access-4sqpl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 21:35:40.347499 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:40.347473    2561 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9a287bba-7e81-4f6b-b3db-2b004c7ff3a8-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:35:40.347499 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:40.347496    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sqpl\" (UniqueName: \"kubernetes.io/projected/9a287bba-7e81-4f6b-b3db-2b004c7ff3a8-kube-api-access-4sqpl\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:35:40.347631 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:40.347507    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a287bba-7e81-4f6b-b3db-2b004c7ff3a8-proxy-tls\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:35:40.634312 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:40.634279    2561 generic.go:356] "Generic (PLEG): container finished" podID="9a287bba-7e81-4f6b-b3db-2b004c7ff3a8" containerID="3ba8c1dff65a466060adadfe5f7eece9f2e83ecdf7d96f18d1a17a2ec450f01c" exitCode=0
Jul 24 21:35:40.634712 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:40.634329    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv"
Jul 24 21:35:40.634712 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:40.634361    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv" event={"ID":"9a287bba-7e81-4f6b-b3db-2b004c7ff3a8","Type":"ContainerDied","Data":"3ba8c1dff65a466060adadfe5f7eece9f2e83ecdf7d96f18d1a17a2ec450f01c"}
Jul 24 21:35:40.634712 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:40.634415    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv" event={"ID":"9a287bba-7e81-4f6b-b3db-2b004c7ff3a8","Type":"ContainerDied","Data":"f9e5a4988a71bd443aecfc8b4fe2b894ff7a90b703c97ea293e2ed2158dc9fd5"}
Jul 24 21:35:40.634712 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:40.634439    2561 scope.go:117] "RemoveContainer" containerID="c8991b98dfb0c1dce1750234bdbc803347e7857f84ed2b07d9d2121d43ed5059"
Jul 24 21:35:40.643840 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:40.643826    2561 scope.go:117] "RemoveContainer" containerID="3ba8c1dff65a466060adadfe5f7eece9f2e83ecdf7d96f18d1a17a2ec450f01c"
Jul 24 21:35:40.651214 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:40.651198    2561 scope.go:117] "RemoveContainer" containerID="c8991b98dfb0c1dce1750234bdbc803347e7857f84ed2b07d9d2121d43ed5059"
Jul 24 21:35:40.651480 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:35:40.651462    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8991b98dfb0c1dce1750234bdbc803347e7857f84ed2b07d9d2121d43ed5059\": container with ID starting with c8991b98dfb0c1dce1750234bdbc803347e7857f84ed2b07d9d2121d43ed5059 not found: ID does not exist" containerID="c8991b98dfb0c1dce1750234bdbc803347e7857f84ed2b07d9d2121d43ed5059"
Jul 24 21:35:40.651522 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:40.651488    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8991b98dfb0c1dce1750234bdbc803347e7857f84ed2b07d9d2121d43ed5059"} err="failed to get container status \"c8991b98dfb0c1dce1750234bdbc803347e7857f84ed2b07d9d2121d43ed5059\": rpc error: code = NotFound desc = could not find container \"c8991b98dfb0c1dce1750234bdbc803347e7857f84ed2b07d9d2121d43ed5059\": container with ID starting with c8991b98dfb0c1dce1750234bdbc803347e7857f84ed2b07d9d2121d43ed5059 not found: ID does not exist"
Jul 24 21:35:40.651522 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:40.651504    2561 scope.go:117] "RemoveContainer" containerID="3ba8c1dff65a466060adadfe5f7eece9f2e83ecdf7d96f18d1a17a2ec450f01c"
Jul 24 21:35:40.651724 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:35:40.651710    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ba8c1dff65a466060adadfe5f7eece9f2e83ecdf7d96f18d1a17a2ec450f01c\": container with ID starting with 3ba8c1dff65a466060adadfe5f7eece9f2e83ecdf7d96f18d1a17a2ec450f01c not found: ID does not exist" containerID="3ba8c1dff65a466060adadfe5f7eece9f2e83ecdf7d96f18d1a17a2ec450f01c"
Jul 24 21:35:40.651769 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:40.651727    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ba8c1dff65a466060adadfe5f7eece9f2e83ecdf7d96f18d1a17a2ec450f01c"} err="failed to get container status \"3ba8c1dff65a466060adadfe5f7eece9f2e83ecdf7d96f18d1a17a2ec450f01c\": rpc error: code = NotFound desc = could not find container \"3ba8c1dff65a466060adadfe5f7eece9f2e83ecdf7d96f18d1a17a2ec450f01c\": container with ID starting with 3ba8c1dff65a466060adadfe5f7eece9f2e83ecdf7d96f18d1a17a2ec450f01c not found: ID does not exist"
Jul 24 21:35:40.657073 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:40.657051    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv"]
Jul 24 21:35:40.659969 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:40.659948    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv"]
Jul 24 21:35:41.099117 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:41.099080    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv" podUID="9a287bba-7e81-4f6b-b3db-2b004c7ff3a8" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.34:8643/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 24 21:35:41.103628 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:41.103594    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-eea53-predictor-8566895f48-bpxhv" podUID="9a287bba-7e81-4f6b-b3db-2b004c7ff3a8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: i/o timeout"
Jul 24 21:35:41.953952 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:41.953916    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a287bba-7e81-4f6b-b3db-2b004c7ff3a8" path="/var/lib/kubelet/pods/9a287bba-7e81-4f6b-b3db-2b004c7ff3a8/volumes"
Jul 24 21:35:44.632669 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:44.632643    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7"
Jul 24 21:35:44.633168 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:44.633141    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7" podUID="a414b0d0-2b72-43b5-bcb2-723d0d0775ae" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.36:8080: connect: connection refused"
Jul 24 21:35:54.634101 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:35:54.634063    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7" podUID="a414b0d0-2b72-43b5-bcb2-723d0d0775ae" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.36:8080: connect: connection refused"
Jul 24 21:36:04.633214 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:04.633171    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7" podUID="a414b0d0-2b72-43b5-bcb2-723d0d0775ae" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.36:8080: connect: connection refused"
Jul 24 21:36:14.633881 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:14.633840    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7" podUID="a414b0d0-2b72-43b5-bcb2-723d0d0775ae" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.36:8080: connect: connection refused"
Jul 24 21:36:24.633880 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:24.633850    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7"
Jul 24 21:36:26.825692 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:26.825661    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr"]
Jul 24 21:36:26.826087 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:26.825870    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr" podUID="34921a6f-8ea9-4879-8925-9240df8703f9" containerName="kserve-container" containerID="cri-o://b2f0da0348ab39542fb4ec505cad272e682bc052d28454050cd7e83694ecb80b" gracePeriod=30
Jul 24 21:36:26.826087 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:26.825927    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr" podUID="34921a6f-8ea9-4879-8925-9240df8703f9" containerName="kube-rbac-proxy" containerID="cri-o://9e19f9c2f580cb4b74136f983f3932a59c4799ebdbf46e9a68951286c5eff2f7" gracePeriod=30
Jul 24 21:36:26.866595 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:26.866567    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc"]
Jul 24 21:36:26.866908 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:26.866896    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a287bba-7e81-4f6b-b3db-2b004c7ff3a8" containerName="kube-rbac-proxy"
Jul 24 21:36:26.866908 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:26.866909    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a287bba-7e81-4f6b-b3db-2b004c7ff3a8" containerName="kube-rbac-proxy"
Jul 24 21:36:26.866995 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:26.866934    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a287bba-7e81-4f6b-b3db-2b004c7ff3a8" containerName="kserve-container"
Jul 24 21:36:26.866995 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:26.866940    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a287bba-7e81-4f6b-b3db-2b004c7ff3a8" containerName="kserve-container"
Jul 24 21:36:26.869666 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:26.867524    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a287bba-7e81-4f6b-b3db-2b004c7ff3a8" containerName="kserve-container"
Jul 24 21:36:26.869666 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:26.867577    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a287bba-7e81-4f6b-b3db-2b004c7ff3a8" containerName="kube-rbac-proxy"
Jul 24 21:36:26.872398 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:26.872000    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc"
Jul 24 21:36:26.876631 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:26.876610    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-f761f-predictor-serving-cert\""
Jul 24 21:36:26.876631 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:26.876621    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-f761f-kube-rbac-proxy-sar-config\""
Jul 24 21:36:26.884247 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:26.884198    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc"]
Jul 24 21:36:26.953219 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:26.953194    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtg78\" (UniqueName: \"kubernetes.io/projected/e697e3ca-f04e-4c0a-8ba9-8330e0b2990b-kube-api-access-dtg78\") pod \"success-200-isvc-f761f-predictor-588776b94-kkrwc\" (UID: \"e697e3ca-f04e-4c0a-8ba9-8330e0b2990b\") " pod="kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc"
Jul 24 21:36:26.953343 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:26.953266    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e697e3ca-f04e-4c0a-8ba9-8330e0b2990b-proxy-tls\") pod \"success-200-isvc-f761f-predictor-588776b94-kkrwc\" (UID: \"e697e3ca-f04e-4c0a-8ba9-8330e0b2990b\") " pod="kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc"
Jul 24 21:36:26.953343 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:26.953303    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e697e3ca-f04e-4c0a-8ba9-8330e0b2990b-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-f761f-predictor-588776b94-kkrwc\" (UID: \"e697e3ca-f04e-4c0a-8ba9-8330e0b2990b\") " pod="kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc"
Jul 24 21:36:27.054593 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:27.054563    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtg78\" (UniqueName: \"kubernetes.io/projected/e697e3ca-f04e-4c0a-8ba9-8330e0b2990b-kube-api-access-dtg78\") pod \"success-200-isvc-f761f-predictor-588776b94-kkrwc\" (UID: \"e697e3ca-f04e-4c0a-8ba9-8330e0b2990b\") " pod="kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc"
Jul 24 21:36:27.054734 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:27.054606    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e697e3ca-f04e-4c0a-8ba9-8330e0b2990b-proxy-tls\") pod \"success-200-isvc-f761f-predictor-588776b94-kkrwc\" (UID: \"e697e3ca-f04e-4c0a-8ba9-8330e0b2990b\") " pod="kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc"
Jul 24 21:36:27.054734 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:27.054649    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e697e3ca-f04e-4c0a-8ba9-8330e0b2990b-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-f761f-predictor-588776b94-kkrwc\" (UID: \"e697e3ca-f04e-4c0a-8ba9-8330e0b2990b\") " pod="kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc"
Jul 24 21:36:27.054811 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:36:27.054787    2561 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-f761f-predictor-serving-cert: secret "success-200-isvc-f761f-predictor-serving-cert" not found
Jul 24 21:36:27.054875 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:36:27.054862    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e697e3ca-f04e-4c0a-8ba9-8330e0b2990b-proxy-tls podName:e697e3ca-f04e-4c0a-8ba9-8330e0b2990b nodeName:}" failed. No retries permitted until 2026-07-24 21:36:27.554841107 +0000 UTC m=+1303.999432819 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/e697e3ca-f04e-4c0a-8ba9-8330e0b2990b-proxy-tls") pod "success-200-isvc-f761f-predictor-588776b94-kkrwc" (UID: "e697e3ca-f04e-4c0a-8ba9-8330e0b2990b") : secret "success-200-isvc-f761f-predictor-serving-cert" not found
Jul 24 21:36:27.055362 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:27.055345    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e697e3ca-f04e-4c0a-8ba9-8330e0b2990b-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-f761f-predictor-588776b94-kkrwc\" (UID: \"e697e3ca-f04e-4c0a-8ba9-8330e0b2990b\") " pod="kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc"
Jul 24 21:36:27.069023 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:27.069003    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtg78\" (UniqueName: \"kubernetes.io/projected/e697e3ca-f04e-4c0a-8ba9-8330e0b2990b-kube-api-access-dtg78\") pod \"success-200-isvc-f761f-predictor-588776b94-kkrwc\" (UID: \"e697e3ca-f04e-4c0a-8ba9-8330e0b2990b\") " pod="kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc"
Jul 24 21:36:27.560192 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:27.560161    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e697e3ca-f04e-4c0a-8ba9-8330e0b2990b-proxy-tls\") pod \"success-200-isvc-f761f-predictor-588776b94-kkrwc\" (UID: \"e697e3ca-f04e-4c0a-8ba9-8330e0b2990b\") " pod="kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc"
Jul 24 21:36:27.562568 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:27.562547    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e697e3ca-f04e-4c0a-8ba9-8330e0b2990b-proxy-tls\") pod \"success-200-isvc-f761f-predictor-588776b94-kkrwc\" (UID: \"e697e3ca-f04e-4c0a-8ba9-8330e0b2990b\") " pod="kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc"
Jul 24 21:36:27.783403 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:27.783371    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc"
Jul 24 21:36:27.848749 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:27.848628    2561 generic.go:356] "Generic (PLEG): container finished" podID="34921a6f-8ea9-4879-8925-9240df8703f9" containerID="9e19f9c2f580cb4b74136f983f3932a59c4799ebdbf46e9a68951286c5eff2f7" exitCode=2
Jul 24 21:36:27.848749 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:27.848662    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr" event={"ID":"34921a6f-8ea9-4879-8925-9240df8703f9","Type":"ContainerDied","Data":"9e19f9c2f580cb4b74136f983f3932a59c4799ebdbf46e9a68951286c5eff2f7"}
Jul 24 21:36:27.919008 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:27.918986    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc"]
Jul 24 21:36:27.920724 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:36:27.920691    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode697e3ca_f04e_4c0a_8ba9_8330e0b2990b.slice/crio-5917ef8a1fd4a9c03e0204365be9dfe7189078e2da8f7cdbeb095243a9640f81 WatchSource:0}: Error finding container 5917ef8a1fd4a9c03e0204365be9dfe7189078e2da8f7cdbeb095243a9640f81: Status 404 returned error can't find the container with id 5917ef8a1fd4a9c03e0204365be9dfe7189078e2da8f7cdbeb095243a9640f81
Jul 24 21:36:28.856735 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:28.856692    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc" event={"ID":"e697e3ca-f04e-4c0a-8ba9-8330e0b2990b","Type":"ContainerStarted","Data":"b83da1b67fba3a641abd95e9dcf2c2e3d2801a21d7b6f520ad4f6d162f95f946"}
Jul 24 21:36:28.857145 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:28.856756    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc" event={"ID":"e697e3ca-f04e-4c0a-8ba9-8330e0b2990b","Type":"ContainerStarted","Data":"52f84bc40f0393d3cf32e71bec90e280ec6f172be39e7cd3d905b3470e63cd2a"}
Jul 24 21:36:28.857145 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:28.856786    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc" event={"ID":"e697e3ca-f04e-4c0a-8ba9-8330e0b2990b","Type":"ContainerStarted","Data":"5917ef8a1fd4a9c03e0204365be9dfe7189078e2da8f7cdbeb095243a9640f81"}
Jul 24 21:36:28.857145 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:28.856904    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc"
Jul 24 21:36:28.857145 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:28.857054    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc"
Jul 24 21:36:28.858146 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:28.858121    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc" podUID="e697e3ca-f04e-4c0a-8ba9-8330e0b2990b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused"
Jul 24 21:36:29.349614 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:29.349580    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr" podUID="34921a6f-8ea9-4879-8925-9240df8703f9" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.35:8643/healthz\": dial tcp 10.133.0.35:8643: connect: connection refused"
Jul 24 21:36:29.353490 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:29.353467    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr" podUID="34921a6f-8ea9-4879-8925-9240df8703f9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused"
Jul 24 21:36:29.784578 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:29.784555    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr"
Jul 24 21:36:29.818147 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:29.818090    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc" podStartSLOduration=3.818070239 podStartE2EDuration="3.818070239s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:36:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:36:28.881273189 +0000 UTC m=+1305.325864918" watchObservedRunningTime="2026-07-24 21:36:29.818070239 +0000 UTC m=+1306.262662103"
Jul 24 21:36:29.862758 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:29.862734    2561 generic.go:356] "Generic (PLEG): container finished" podID="34921a6f-8ea9-4879-8925-9240df8703f9" containerID="b2f0da0348ab39542fb4ec505cad272e682bc052d28454050cd7e83694ecb80b" exitCode=0
Jul 24 21:36:29.863110 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:29.862780    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr"
Jul 24 21:36:29.863110 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:29.862822    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr" event={"ID":"34921a6f-8ea9-4879-8925-9240df8703f9","Type":"ContainerDied","Data":"b2f0da0348ab39542fb4ec505cad272e682bc052d28454050cd7e83694ecb80b"}
Jul 24 21:36:29.863110 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:29.862885    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr" event={"ID":"34921a6f-8ea9-4879-8925-9240df8703f9","Type":"ContainerDied","Data":"117a90aa5ec1796613c0d13bc0c9d0ff2eecbc66f922d1b986602dae07912daf"}
Jul 24 21:36:29.863110 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:29.862914    2561 scope.go:117] "RemoveContainer" containerID="9e19f9c2f580cb4b74136f983f3932a59c4799ebdbf46e9a68951286c5eff2f7"
Jul 24 21:36:29.863315 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:29.863098    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc" podUID="e697e3ca-f04e-4c0a-8ba9-8330e0b2990b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused"
Jul 24 21:36:29.871288 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:29.871269    2561 scope.go:117] "RemoveContainer" containerID="b2f0da0348ab39542fb4ec505cad272e682bc052d28454050cd7e83694ecb80b"
Jul 24 21:36:29.881423 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:29.881401    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/34921a6f-8ea9-4879-8925-9240df8703f9-kube-rbac-proxy-sar-config\") pod \"34921a6f-8ea9-4879-8925-9240df8703f9\" (UID: \"34921a6f-8ea9-4879-8925-9240df8703f9\") "
Jul 24 21:36:29.881512 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:29.881441    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8sttr\" (UniqueName: \"kubernetes.io/projected/34921a6f-8ea9-4879-8925-9240df8703f9-kube-api-access-8sttr\") pod \"34921a6f-8ea9-4879-8925-9240df8703f9\" (UID: \"34921a6f-8ea9-4879-8925-9240df8703f9\") "
Jul 24 21:36:29.881512 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:29.881503    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/34921a6f-8ea9-4879-8925-9240df8703f9-proxy-tls\") pod \"34921a6f-8ea9-4879-8925-9240df8703f9\" (UID: \"34921a6f-8ea9-4879-8925-9240df8703f9\") "
Jul 24 21:36:29.881776 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:29.881748    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34921a6f-8ea9-4879-8925-9240df8703f9-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "34921a6f-8ea9-4879-8925-9240df8703f9" (UID: "34921a6f-8ea9-4879-8925-9240df8703f9"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:36:29.883089 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:29.883068    2561 scope.go:117] "RemoveContainer" containerID="9e19f9c2f580cb4b74136f983f3932a59c4799ebdbf46e9a68951286c5eff2f7"
Jul 24 21:36:29.883420 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:36:29.883396    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e19f9c2f580cb4b74136f983f3932a59c4799ebdbf46e9a68951286c5eff2f7\": container with ID starting with 9e19f9c2f580cb4b74136f983f3932a59c4799ebdbf46e9a68951286c5eff2f7 not found: ID does not exist" containerID="9e19f9c2f580cb4b74136f983f3932a59c4799ebdbf46e9a68951286c5eff2f7"
Jul 24 21:36:29.883523 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:29.883430    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e19f9c2f580cb4b74136f983f3932a59c4799ebdbf46e9a68951286c5eff2f7"} err="failed to get container status \"9e19f9c2f580cb4b74136f983f3932a59c4799ebdbf46e9a68951286c5eff2f7\": rpc error: code = NotFound desc = could not find container \"9e19f9c2f580cb4b74136f983f3932a59c4799ebdbf46e9a68951286c5eff2f7\": container with ID starting with 9e19f9c2f580cb4b74136f983f3932a59c4799ebdbf46e9a68951286c5eff2f7 not found: ID does not exist"
Jul 24 21:36:29.883523 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:29.883445    2561 scope.go:117] "RemoveContainer" containerID="b2f0da0348ab39542fb4ec505cad272e682bc052d28454050cd7e83694ecb80b"
Jul 24 21:36:29.883629 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:29.883607    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34921a6f-8ea9-4879-8925-9240df8703f9-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "34921a6f-8ea9-4879-8925-9240df8703f9" (UID: "34921a6f-8ea9-4879-8925-9240df8703f9"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 21:36:29.883742 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:36:29.883717    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2f0da0348ab39542fb4ec505cad272e682bc052d28454050cd7e83694ecb80b\": container with ID starting with b2f0da0348ab39542fb4ec505cad272e682bc052d28454050cd7e83694ecb80b not found: ID does not exist" containerID="b2f0da0348ab39542fb4ec505cad272e682bc052d28454050cd7e83694ecb80b"
Jul 24 21:36:29.883783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:29.883757    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34921a6f-8ea9-4879-8925-9240df8703f9-kube-api-access-8sttr" (OuterVolumeSpecName: "kube-api-access-8sttr") pod "34921a6f-8ea9-4879-8925-9240df8703f9" (UID: "34921a6f-8ea9-4879-8925-9240df8703f9"). InnerVolumeSpecName "kube-api-access-8sttr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 21:36:29.883783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:29.883753    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2f0da0348ab39542fb4ec505cad272e682bc052d28454050cd7e83694ecb80b"} err="failed to get container status \"b2f0da0348ab39542fb4ec505cad272e682bc052d28454050cd7e83694ecb80b\": rpc error: code = NotFound desc = could not find container \"b2f0da0348ab39542fb4ec505cad272e682bc052d28454050cd7e83694ecb80b\": container with ID starting with b2f0da0348ab39542fb4ec505cad272e682bc052d28454050cd7e83694ecb80b not found: ID does not exist"
Jul 24 21:36:29.982372 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:29.982351    2561 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/34921a6f-8ea9-4879-8925-9240df8703f9-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:36:29.982372 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:29.982372    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8sttr\" (UniqueName: \"kubernetes.io/projected/34921a6f-8ea9-4879-8925-9240df8703f9-kube-api-access-8sttr\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:36:29.982372 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:29.982383    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/34921a6f-8ea9-4879-8925-9240df8703f9-proxy-tls\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:36:30.183103 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:30.183057    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr"]
Jul 24 21:36:30.185380 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:30.185358    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c3da7-predictor-594869d894-mh5zr"]
Jul 24 21:36:31.953792 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:31.953757    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34921a6f-8ea9-4879-8925-9240df8703f9" path="/var/lib/kubelet/pods/34921a6f-8ea9-4879-8925-9240df8703f9/volumes"
Jul 24 21:36:34.867551 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:34.867523    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc"
Jul 24 21:36:34.867962 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:34.867939    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc" podUID="e697e3ca-f04e-4c0a-8ba9-8330e0b2990b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused"
Jul 24 21:36:44.868925 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:44.868883    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc" podUID="e697e3ca-f04e-4c0a-8ba9-8330e0b2990b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused"
Jul 24 21:36:47.117811 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:47.117778    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7"]
Jul 24 21:36:47.118241 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:47.118056    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7" podUID="a414b0d0-2b72-43b5-bcb2-723d0d0775ae" containerName="kserve-container" containerID="cri-o://fefdad6f4797ebba04fc5fe1caeaba795539866ad288c96cf5e96e391c454508" gracePeriod=30
Jul 24 21:36:47.118241 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:47.118130    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7" podUID="a414b0d0-2b72-43b5-bcb2-723d0d0775ae" containerName="kube-rbac-proxy" containerID="cri-o://dd958573e6de3de2acdcec54dad0e5d5586c66f0929100ed6e2ce6d5e9e5d418" gracePeriod=30
Jul 24 21:36:47.196197 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:47.196101    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx"]
Jul 24 21:36:47.204855 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:47.196481    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34921a6f-8ea9-4879-8925-9240df8703f9" containerName="kube-rbac-proxy"
Jul 24 21:36:47.204855 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:47.196497    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="34921a6f-8ea9-4879-8925-9240df8703f9" containerName="kube-rbac-proxy"
Jul 24 21:36:47.204855 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:47.196528    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34921a6f-8ea9-4879-8925-9240df8703f9" containerName="kserve-container"
Jul 24 21:36:47.204855 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:47.196534    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="34921a6f-8ea9-4879-8925-9240df8703f9" containerName="kserve-container"
Jul 24 21:36:47.204855 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:47.196600    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="34921a6f-8ea9-4879-8925-9240df8703f9" containerName="kube-rbac-proxy"
Jul 24 21:36:47.204855 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:47.196608    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="34921a6f-8ea9-4879-8925-9240df8703f9" containerName="kserve-container"
Jul 24 21:36:47.204855 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:47.201568    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx"
Jul 24 21:36:47.205790 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:47.205768    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-6de22-kube-rbac-proxy-sar-config\""
Jul 24 21:36:47.205902 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:47.205806    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-6de22-predictor-serving-cert\""
Jul 24 21:36:47.217735 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:47.217710    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx"]
Jul 24 21:36:47.324962 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:47.324935    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cb2b02f6-5377-4a12-bab2-fb98f929fb23-proxy-tls\") pod \"success-200-isvc-6de22-predictor-b49bb5776-zh2fx\" (UID: \"cb2b02f6-5377-4a12-bab2-fb98f929fb23\") " pod="kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx"
Jul 24 21:36:47.325116 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:47.324977    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj7wd\" (UniqueName: \"kubernetes.io/projected/cb2b02f6-5377-4a12-bab2-fb98f929fb23-kube-api-access-rj7wd\") pod \"success-200-isvc-6de22-predictor-b49bb5776-zh2fx\" (UID: \"cb2b02f6-5377-4a12-bab2-fb98f929fb23\") " pod="kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx"
Jul 24 21:36:47.325116 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:47.325006    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cb2b02f6-5377-4a12-bab2-fb98f929fb23-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-6de22-predictor-b49bb5776-zh2fx\" (UID: \"cb2b02f6-5377-4a12-bab2-fb98f929fb23\") " pod="kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx"
Jul 24 21:36:47.425862 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:47.425782    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cb2b02f6-5377-4a12-bab2-fb98f929fb23-proxy-tls\") pod \"success-200-isvc-6de22-predictor-b49bb5776-zh2fx\" (UID: \"cb2b02f6-5377-4a12-bab2-fb98f929fb23\") " pod="kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx"
Jul 24 21:36:47.425862 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:47.425843    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj7wd\" (UniqueName: \"kubernetes.io/projected/cb2b02f6-5377-4a12-bab2-fb98f929fb23-kube-api-access-rj7wd\") pod \"success-200-isvc-6de22-predictor-b49bb5776-zh2fx\" (UID: \"cb2b02f6-5377-4a12-bab2-fb98f929fb23\") " pod="kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx"
Jul 24 21:36:47.426093 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:47.425890    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cb2b02f6-5377-4a12-bab2-fb98f929fb23-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-6de22-predictor-b49bb5776-zh2fx\" (UID: \"cb2b02f6-5377-4a12-bab2-fb98f929fb23\") " pod="kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx"
Jul 24 21:36:47.426591 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:47.426569    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cb2b02f6-5377-4a12-bab2-fb98f929fb23-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-6de22-predictor-b49bb5776-zh2fx\" (UID: \"cb2b02f6-5377-4a12-bab2-fb98f929fb23\") " pod="kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx"
Jul 24 21:36:47.428373 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:47.428354    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cb2b02f6-5377-4a12-bab2-fb98f929fb23-proxy-tls\") pod \"success-200-isvc-6de22-predictor-b49bb5776-zh2fx\" (UID: \"cb2b02f6-5377-4a12-bab2-fb98f929fb23\") " pod="kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx"
Jul 24 21:36:47.435602 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:47.435579    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj7wd\" (UniqueName: \"kubernetes.io/projected/cb2b02f6-5377-4a12-bab2-fb98f929fb23-kube-api-access-rj7wd\") pod \"success-200-isvc-6de22-predictor-b49bb5776-zh2fx\" (UID: \"cb2b02f6-5377-4a12-bab2-fb98f929fb23\") " pod="kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx"
Jul 24 21:36:47.511524 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:47.511500    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx"
Jul 24 21:36:47.649056 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:47.649024    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx"]
Jul 24 21:36:47.651804 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:36:47.651780    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb2b02f6_5377_4a12_bab2_fb98f929fb23.slice/crio-7984e0301669ddb66bdfcae5f72f00bc514fb0c3fea19ea2f6eef409c6cbcd90 WatchSource:0}: Error finding container 7984e0301669ddb66bdfcae5f72f00bc514fb0c3fea19ea2f6eef409c6cbcd90: Status 404 returned error can't find the container with id 7984e0301669ddb66bdfcae5f72f00bc514fb0c3fea19ea2f6eef409c6cbcd90
Jul 24 21:36:47.957727 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:47.957641    2561 generic.go:356] "Generic (PLEG): container finished" podID="a414b0d0-2b72-43b5-bcb2-723d0d0775ae" containerID="dd958573e6de3de2acdcec54dad0e5d5586c66f0929100ed6e2ce6d5e9e5d418" exitCode=2
Jul 24 21:36:47.959203 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:47.959175    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7" event={"ID":"a414b0d0-2b72-43b5-bcb2-723d0d0775ae","Type":"ContainerDied","Data":"dd958573e6de3de2acdcec54dad0e5d5586c66f0929100ed6e2ce6d5e9e5d418"}
Jul 24 21:36:47.959648 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:47.959615    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx" event={"ID":"cb2b02f6-5377-4a12-bab2-fb98f929fb23","Type":"ContainerStarted","Data":"dcd340441cb9c83068799a08e674ba74ef69b96dca744624daabd990f022ad45"}
Jul 24 21:36:47.959726 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:47.959691    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx" event={"ID":"cb2b02f6-5377-4a12-bab2-fb98f929fb23","Type":"ContainerStarted","Data":"b868c9cbfe535dc9876b8a9ff9b4b320b104adc3bc66eee34f0fea59398b0769"}
Jul 24 21:36:47.959763 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:47.959732    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx" event={"ID":"cb2b02f6-5377-4a12-bab2-fb98f929fb23","Type":"ContainerStarted","Data":"7984e0301669ddb66bdfcae5f72f00bc514fb0c3fea19ea2f6eef409c6cbcd90"}
Jul 24 21:36:47.959923 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:47.959901    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx"
Jul 24 21:36:47.960010 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:47.959955    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx"
Jul 24 21:36:47.961205 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:47.961180    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx" podUID="cb2b02f6-5377-4a12-bab2-fb98f929fb23" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.38:8080: connect: connection refused"
Jul 24 21:36:47.981489 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:47.981446    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx" podStartSLOduration=0.981431063 podStartE2EDuration="981.431063ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:36:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:36:47.980207055 +0000 UTC m=+1324.424798790" watchObservedRunningTime="2026-07-24 21:36:47.981431063 +0000 UTC m=+1324.426022792"
Jul 24 21:36:48.964426 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:48.964382    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx" podUID="cb2b02f6-5377-4a12-bab2-fb98f929fb23" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.38:8080: connect: connection refused"
Jul 24 21:36:49.628816 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:49.628770    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7" podUID="a414b0d0-2b72-43b5-bcb2-723d0d0775ae" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.36:8643/healthz\": dial tcp 10.133.0.36:8643: connect: connection refused"
Jul 24 21:36:49.971824 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:49.971787    2561 generic.go:356] "Generic (PLEG): container finished" podID="a414b0d0-2b72-43b5-bcb2-723d0d0775ae" containerID="fefdad6f4797ebba04fc5fe1caeaba795539866ad288c96cf5e96e391c454508" exitCode=0
Jul 24 21:36:49.971824 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:49.971820    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7" event={"ID":"a414b0d0-2b72-43b5-bcb2-723d0d0775ae","Type":"ContainerDied","Data":"fefdad6f4797ebba04fc5fe1caeaba795539866ad288c96cf5e96e391c454508"}
Jul 24 21:36:50.076642 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:50.076616    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7"
Jul 24 21:36:50.250961 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:50.250880    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrr8n\" (UniqueName: \"kubernetes.io/projected/a414b0d0-2b72-43b5-bcb2-723d0d0775ae-kube-api-access-lrr8n\") pod \"a414b0d0-2b72-43b5-bcb2-723d0d0775ae\" (UID: \"a414b0d0-2b72-43b5-bcb2-723d0d0775ae\") "
Jul 24 21:36:50.251101 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:50.250956    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a414b0d0-2b72-43b5-bcb2-723d0d0775ae-kube-rbac-proxy-sar-config\") pod \"a414b0d0-2b72-43b5-bcb2-723d0d0775ae\" (UID: \"a414b0d0-2b72-43b5-bcb2-723d0d0775ae\") "
Jul 24 21:36:50.251141 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:50.251124    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a414b0d0-2b72-43b5-bcb2-723d0d0775ae-proxy-tls\") pod \"a414b0d0-2b72-43b5-bcb2-723d0d0775ae\" (UID: \"a414b0d0-2b72-43b5-bcb2-723d0d0775ae\") "
Jul 24 21:36:50.251307 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:50.251276    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a414b0d0-2b72-43b5-bcb2-723d0d0775ae-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "a414b0d0-2b72-43b5-bcb2-723d0d0775ae" (UID: "a414b0d0-2b72-43b5-bcb2-723d0d0775ae"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:36:50.251488 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:50.251471    2561 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a414b0d0-2b72-43b5-bcb2-723d0d0775ae-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:36:50.253101 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:50.253080    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a414b0d0-2b72-43b5-bcb2-723d0d0775ae-kube-api-access-lrr8n" (OuterVolumeSpecName: "kube-api-access-lrr8n") pod "a414b0d0-2b72-43b5-bcb2-723d0d0775ae" (UID: "a414b0d0-2b72-43b5-bcb2-723d0d0775ae"). InnerVolumeSpecName "kube-api-access-lrr8n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 21:36:50.253295 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:50.253272    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a414b0d0-2b72-43b5-bcb2-723d0d0775ae-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "a414b0d0-2b72-43b5-bcb2-723d0d0775ae" (UID: "a414b0d0-2b72-43b5-bcb2-723d0d0775ae"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 21:36:50.352575 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:50.352548    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrr8n\" (UniqueName: \"kubernetes.io/projected/a414b0d0-2b72-43b5-bcb2-723d0d0775ae-kube-api-access-lrr8n\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:36:50.352575 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:50.352574    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a414b0d0-2b72-43b5-bcb2-723d0d0775ae-proxy-tls\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:36:50.979392 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:50.979356    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7" event={"ID":"a414b0d0-2b72-43b5-bcb2-723d0d0775ae","Type":"ContainerDied","Data":"ec554286d8f5f061286d4a822ea402c60a88a52f494c9796e182613556847600"}
Jul 24 21:36:50.979392 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:50.979379    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7"
Jul 24 21:36:50.979817 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:50.979426    2561 scope.go:117] "RemoveContainer" containerID="dd958573e6de3de2acdcec54dad0e5d5586c66f0929100ed6e2ce6d5e9e5d418"
Jul 24 21:36:50.989036 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:50.989016    2561 scope.go:117] "RemoveContainer" containerID="fefdad6f4797ebba04fc5fe1caeaba795539866ad288c96cf5e96e391c454508"
Jul 24 21:36:51.002459 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:51.002439    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7"]
Jul 24 21:36:51.010129 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:51.010109    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-b6aba-predictor-75f57dcdb6-tpnh7"]
Jul 24 21:36:51.954351 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:51.954310    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a414b0d0-2b72-43b5-bcb2-723d0d0775ae" path="/var/lib/kubelet/pods/a414b0d0-2b72-43b5-bcb2-723d0d0775ae/volumes"
Jul 24 21:36:53.970022 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:53.969996    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx"
Jul 24 21:36:53.970503 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:53.970472    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx" podUID="cb2b02f6-5377-4a12-bab2-fb98f929fb23" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.38:8080: connect: connection refused"
Jul 24 21:36:54.868401 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:36:54.868359    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc" podUID="e697e3ca-f04e-4c0a-8ba9-8330e0b2990b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused"
Jul 24 21:37:03.971019 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:03.970977    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx" podUID="cb2b02f6-5377-4a12-bab2-fb98f929fb23" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.38:8080: connect: connection refused"
Jul 24 21:37:04.868477 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:04.868391    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc" podUID="e697e3ca-f04e-4c0a-8ba9-8330e0b2990b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused"
Jul 24 21:37:13.970797 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:13.970755    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx" podUID="cb2b02f6-5377-4a12-bab2-fb98f929fb23" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.38:8080: connect: connection refused"
Jul 24 21:37:14.874072 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:14.874038    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc"
Jul 24 21:37:23.970754 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:23.970714    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx" podUID="cb2b02f6-5377-4a12-bab2-fb98f929fb23" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.38:8080: connect: connection refused"
Jul 24 21:37:33.971372 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:33.971339    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx"
Jul 24 21:37:37.022340 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:37.022310    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc"]
Jul 24 21:37:37.022831 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:37.022525    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc" podUID="e697e3ca-f04e-4c0a-8ba9-8330e0b2990b" containerName="kserve-container" containerID="cri-o://52f84bc40f0393d3cf32e71bec90e280ec6f172be39e7cd3d905b3470e63cd2a" gracePeriod=30
Jul 24 21:37:37.022831 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:37.022564    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc" podUID="e697e3ca-f04e-4c0a-8ba9-8330e0b2990b" containerName="kube-rbac-proxy" containerID="cri-o://b83da1b67fba3a641abd95e9dcf2c2e3d2801a21d7b6f520ad4f6d162f95f946" gracePeriod=30
Jul 24 21:37:37.101743 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:37.101713    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26"]
Jul 24 21:37:37.102147 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:37.102131    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a414b0d0-2b72-43b5-bcb2-723d0d0775ae" containerName="kube-rbac-proxy"
Jul 24 21:37:37.102147 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:37.102150    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a414b0d0-2b72-43b5-bcb2-723d0d0775ae" containerName="kube-rbac-proxy"
Jul 24 21:37:37.102339 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:37.102167    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a414b0d0-2b72-43b5-bcb2-723d0d0775ae" containerName="kserve-container"
Jul 24 21:37:37.102339 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:37.102174    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a414b0d0-2b72-43b5-bcb2-723d0d0775ae" containerName="kserve-container"
Jul 24 21:37:37.102339 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:37.102285    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a414b0d0-2b72-43b5-bcb2-723d0d0775ae" containerName="kserve-container"
Jul 24 21:37:37.102339 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:37.102297    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a414b0d0-2b72-43b5-bcb2-723d0d0775ae" containerName="kube-rbac-proxy"
Jul 24 21:37:37.105631 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:37.105606    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26"
Jul 24 21:37:37.109433 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:37.109403    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-59fd1-predictor-serving-cert\""
Jul 24 21:37:37.109433 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:37.109425    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-59fd1-kube-rbac-proxy-sar-config\""
Jul 24 21:37:37.118449 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:37.118426    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26"]
Jul 24 21:37:37.187764 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:37.187729    2561 generic.go:356] "Generic (PLEG): container finished" podID="e697e3ca-f04e-4c0a-8ba9-8330e0b2990b" containerID="b83da1b67fba3a641abd95e9dcf2c2e3d2801a21d7b6f520ad4f6d162f95f946" exitCode=2
Jul 24 21:37:37.187914 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:37.187804    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc" event={"ID":"e697e3ca-f04e-4c0a-8ba9-8330e0b2990b","Type":"ContainerDied","Data":"b83da1b67fba3a641abd95e9dcf2c2e3d2801a21d7b6f520ad4f6d162f95f946"}
Jul 24 21:37:37.234064 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:37.234030    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2ec2fea9-5fb1-49cd-a93d-0c328df00f87-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-59fd1-predictor-54b67dc744-8wc26\" (UID: \"2ec2fea9-5fb1-49cd-a93d-0c328df00f87\") " pod="kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26"
Jul 24 21:37:37.234262 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:37.234092    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8kkl\" (UniqueName: \"kubernetes.io/projected/2ec2fea9-5fb1-49cd-a93d-0c328df00f87-kube-api-access-b8kkl\") pod \"success-200-isvc-59fd1-predictor-54b67dc744-8wc26\" (UID: \"2ec2fea9-5fb1-49cd-a93d-0c328df00f87\") " pod="kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26"
Jul 24 21:37:37.234262 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:37.234145    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2ec2fea9-5fb1-49cd-a93d-0c328df00f87-proxy-tls\") pod \"success-200-isvc-59fd1-predictor-54b67dc744-8wc26\" (UID: \"2ec2fea9-5fb1-49cd-a93d-0c328df00f87\") " pod="kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26"
Jul 24 21:37:37.335734 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:37.335642    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2ec2fea9-5fb1-49cd-a93d-0c328df00f87-proxy-tls\") pod \"success-200-isvc-59fd1-predictor-54b67dc744-8wc26\" (UID: \"2ec2fea9-5fb1-49cd-a93d-0c328df00f87\") " pod="kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26"
Jul 24 21:37:37.335734 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:37.335716    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2ec2fea9-5fb1-49cd-a93d-0c328df00f87-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-59fd1-predictor-54b67dc744-8wc26\" (UID: \"2ec2fea9-5fb1-49cd-a93d-0c328df00f87\") " pod="kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26"
Jul 24 21:37:37.335963 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:37.335770    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8kkl\" (UniqueName: \"kubernetes.io/projected/2ec2fea9-5fb1-49cd-a93d-0c328df00f87-kube-api-access-b8kkl\") pod \"success-200-isvc-59fd1-predictor-54b67dc744-8wc26\" (UID: \"2ec2fea9-5fb1-49cd-a93d-0c328df00f87\") " pod="kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26"
Jul 24 21:37:37.336493 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:37.336469    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2ec2fea9-5fb1-49cd-a93d-0c328df00f87-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-59fd1-predictor-54b67dc744-8wc26\" (UID: \"2ec2fea9-5fb1-49cd-a93d-0c328df00f87\") " pod="kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26"
Jul 24 21:37:37.338383 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:37.338364    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2ec2fea9-5fb1-49cd-a93d-0c328df00f87-proxy-tls\") pod \"success-200-isvc-59fd1-predictor-54b67dc744-8wc26\" (UID: \"2ec2fea9-5fb1-49cd-a93d-0c328df00f87\") " pod="kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26"
Jul 24 21:37:37.344626 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:37.344600    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8kkl\" (UniqueName: \"kubernetes.io/projected/2ec2fea9-5fb1-49cd-a93d-0c328df00f87-kube-api-access-b8kkl\") pod \"success-200-isvc-59fd1-predictor-54b67dc744-8wc26\" (UID: \"2ec2fea9-5fb1-49cd-a93d-0c328df00f87\") " pod="kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26"
Jul 24 21:37:37.415800 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:37.415771    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26"
Jul 24 21:37:37.554545 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:37.554519    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26"]
Jul 24 21:37:37.556418 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:37:37.556391    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ec2fea9_5fb1_49cd_a93d_0c328df00f87.slice/crio-6ce0b8700c9f874a0c464befb4f429dd8ac3a8fce147db8827cf8aeaedef0ca2 WatchSource:0}: Error finding container 6ce0b8700c9f874a0c464befb4f429dd8ac3a8fce147db8827cf8aeaedef0ca2: Status 404 returned error can't find the container with id 6ce0b8700c9f874a0c464befb4f429dd8ac3a8fce147db8827cf8aeaedef0ca2
Jul 24 21:37:38.194918 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:38.194882    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26" event={"ID":"2ec2fea9-5fb1-49cd-a93d-0c328df00f87","Type":"ContainerStarted","Data":"d944bff54f32e5b64b7e1ecdfe2f1d8e035338f38eeb4f5bffcba13766c29035"}
Jul 24 21:37:38.195390 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:38.194949    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26"
Jul 24 21:37:38.195390 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:38.194973    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26" event={"ID":"2ec2fea9-5fb1-49cd-a93d-0c328df00f87","Type":"ContainerStarted","Data":"11f2c7557cb04cdda7390e23e52234143c6ddcb8ea8c41b01016e69485b6454c"}
Jul 24 21:37:38.195390 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:38.195001    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26" event={"ID":"2ec2fea9-5fb1-49cd-a93d-0c328df00f87","Type":"ContainerStarted","Data":"6ce0b8700c9f874a0c464befb4f429dd8ac3a8fce147db8827cf8aeaedef0ca2"}
Jul 24 21:37:38.195390 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:38.195134    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26"
Jul 24 21:37:38.196498 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:38.196470    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26" podUID="2ec2fea9-5fb1-49cd-a93d-0c328df00f87" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.39:8080: connect: connection refused"
Jul 24 21:37:38.219299 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:38.219259    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26" podStartSLOduration=1.219244988 podStartE2EDuration="1.219244988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:37:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:37:38.216860172 +0000 UTC m=+1374.661451921" watchObservedRunningTime="2026-07-24 21:37:38.219244988 +0000 UTC m=+1374.663836710"
Jul 24 21:37:39.201381 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:39.201341    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26" podUID="2ec2fea9-5fb1-49cd-a93d-0c328df00f87" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.39:8080: connect: connection refused"
Jul 24 21:37:39.863914 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:39.863868    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc" podUID="e697e3ca-f04e-4c0a-8ba9-8330e0b2990b" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.37:8643/healthz\": dial tcp 10.133.0.37:8643: connect: connection refused"
Jul 24 21:37:40.209762 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:40.209727    2561 generic.go:356] "Generic (PLEG): container finished" podID="e697e3ca-f04e-4c0a-8ba9-8330e0b2990b" containerID="52f84bc40f0393d3cf32e71bec90e280ec6f172be39e7cd3d905b3470e63cd2a" exitCode=0
Jul 24 21:37:40.210094 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:40.209795    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc" event={"ID":"e697e3ca-f04e-4c0a-8ba9-8330e0b2990b","Type":"ContainerDied","Data":"52f84bc40f0393d3cf32e71bec90e280ec6f172be39e7cd3d905b3470e63cd2a"}
Jul 24 21:37:40.272103 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:40.272067    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc"
Jul 24 21:37:40.359673 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:40.359633    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtg78\" (UniqueName: \"kubernetes.io/projected/e697e3ca-f04e-4c0a-8ba9-8330e0b2990b-kube-api-access-dtg78\") pod \"e697e3ca-f04e-4c0a-8ba9-8330e0b2990b\" (UID: \"e697e3ca-f04e-4c0a-8ba9-8330e0b2990b\") "
Jul 24 21:37:40.359855 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:40.359750    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e697e3ca-f04e-4c0a-8ba9-8330e0b2990b-proxy-tls\") pod \"e697e3ca-f04e-4c0a-8ba9-8330e0b2990b\" (UID: \"e697e3ca-f04e-4c0a-8ba9-8330e0b2990b\") "
Jul 24 21:37:40.359855 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:40.359780    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e697e3ca-f04e-4c0a-8ba9-8330e0b2990b-kube-rbac-proxy-sar-config\") pod \"e697e3ca-f04e-4c0a-8ba9-8330e0b2990b\" (UID: \"e697e3ca-f04e-4c0a-8ba9-8330e0b2990b\") "
Jul 24 21:37:40.360167 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:40.360142    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e697e3ca-f04e-4c0a-8ba9-8330e0b2990b-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "e697e3ca-f04e-4c0a-8ba9-8330e0b2990b" (UID: "e697e3ca-f04e-4c0a-8ba9-8330e0b2990b"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:37:40.361889 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:40.361863    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e697e3ca-f04e-4c0a-8ba9-8330e0b2990b-kube-api-access-dtg78" (OuterVolumeSpecName: "kube-api-access-dtg78") pod "e697e3ca-f04e-4c0a-8ba9-8330e0b2990b" (UID: "e697e3ca-f04e-4c0a-8ba9-8330e0b2990b"). InnerVolumeSpecName "kube-api-access-dtg78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 21:37:40.361978 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:40.361917    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e697e3ca-f04e-4c0a-8ba9-8330e0b2990b-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "e697e3ca-f04e-4c0a-8ba9-8330e0b2990b" (UID: "e697e3ca-f04e-4c0a-8ba9-8330e0b2990b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 21:37:40.461056 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:40.460972    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e697e3ca-f04e-4c0a-8ba9-8330e0b2990b-proxy-tls\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:37:40.461056 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:40.461003    2561 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e697e3ca-f04e-4c0a-8ba9-8330e0b2990b-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:37:40.461056 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:40.461017    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtg78\" (UniqueName: \"kubernetes.io/projected/e697e3ca-f04e-4c0a-8ba9-8330e0b2990b-kube-api-access-dtg78\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:37:41.216103 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:41.216069    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc"
Jul 24 21:37:41.216103 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:41.216075    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc" event={"ID":"e697e3ca-f04e-4c0a-8ba9-8330e0b2990b","Type":"ContainerDied","Data":"5917ef8a1fd4a9c03e0204365be9dfe7189078e2da8f7cdbeb095243a9640f81"}
Jul 24 21:37:41.216641 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:41.216165    2561 scope.go:117] "RemoveContainer" containerID="b83da1b67fba3a641abd95e9dcf2c2e3d2801a21d7b6f520ad4f6d162f95f946"
Jul 24 21:37:41.226781 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:41.226762    2561 scope.go:117] "RemoveContainer" containerID="52f84bc40f0393d3cf32e71bec90e280ec6f172be39e7cd3d905b3470e63cd2a"
Jul 24 21:37:41.239011 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:41.238992    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc"]
Jul 24 21:37:41.243135 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:41.243112    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-f761f-predictor-588776b94-kkrwc"]
Jul 24 21:37:41.953667 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:41.953633    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e697e3ca-f04e-4c0a-8ba9-8330e0b2990b" path="/var/lib/kubelet/pods/e697e3ca-f04e-4c0a-8ba9-8330e0b2990b/volumes"
Jul 24 21:37:44.205783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:44.205758    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26"
Jul 24 21:37:44.206309 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:44.206283    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26" podUID="2ec2fea9-5fb1-49cd-a93d-0c328df00f87" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.39:8080: connect: connection refused"
Jul 24 21:37:54.206285 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:37:54.206218    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26" podUID="2ec2fea9-5fb1-49cd-a93d-0c328df00f87" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.39:8080: connect: connection refused"
Jul 24 21:38:04.206944 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:38:04.206901    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26" podUID="2ec2fea9-5fb1-49cd-a93d-0c328df00f87" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.39:8080: connect: connection refused"
Jul 24 21:38:14.206469 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:38:14.206422    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26" podUID="2ec2fea9-5fb1-49cd-a93d-0c328df00f87" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.39:8080: connect: connection refused"
Jul 24 21:38:24.207316 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:38:24.207290    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26"
Jul 24 21:39:43.976726 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:39:43.976694    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nsjrg_87f18cf4-62ce-48a0-99b0-fe22bc19f701/console-operator/1.log"
Jul 24 21:39:43.979651 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:39:43.979627    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nsjrg_87f18cf4-62ce-48a0-99b0-fe22bc19f701/console-operator/1.log"
Jul 24 21:44:44.003779 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:44:44.003748    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nsjrg_87f18cf4-62ce-48a0-99b0-fe22bc19f701/console-operator/1.log"
Jul 24 21:44:44.007983 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:44:44.007958    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nsjrg_87f18cf4-62ce-48a0-99b0-fe22bc19f701/console-operator/1.log"
Jul 24 21:46:02.126641 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:02.126607    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx"]
Jul 24 21:46:02.127271 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:02.126814    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx" podUID="cb2b02f6-5377-4a12-bab2-fb98f929fb23" containerName="kserve-container" containerID="cri-o://b868c9cbfe535dc9876b8a9ff9b4b320b104adc3bc66eee34f0fea59398b0769" gracePeriod=30
Jul 24 21:46:02.127271 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:02.126854    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx" podUID="cb2b02f6-5377-4a12-bab2-fb98f929fb23" containerName="kube-rbac-proxy" containerID="cri-o://dcd340441cb9c83068799a08e674ba74ef69b96dca744624daabd990f022ad45" gracePeriod=30
Jul 24 21:46:02.206657 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:02.206625    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8"]
Jul 24 21:46:02.206983 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:02.206969    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e697e3ca-f04e-4c0a-8ba9-8330e0b2990b" containerName="kserve-container"
Jul 24 21:46:02.206983 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:02.206984    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e697e3ca-f04e-4c0a-8ba9-8330e0b2990b" containerName="kserve-container"
Jul 24 21:46:02.207076 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:02.207007    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e697e3ca-f04e-4c0a-8ba9-8330e0b2990b" containerName="kube-rbac-proxy"
Jul 24 21:46:02.207076 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:02.207012    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e697e3ca-f04e-4c0a-8ba9-8330e0b2990b" containerName="kube-rbac-proxy"
Jul 24 21:46:02.207076 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:02.207060    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e697e3ca-f04e-4c0a-8ba9-8330e0b2990b" containerName="kube-rbac-proxy"
Jul 24 21:46:02.207076 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:02.207068    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e697e3ca-f04e-4c0a-8ba9-8330e0b2990b" containerName="kserve-container"
Jul 24 21:46:02.210145 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:02.210130    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8"
Jul 24 21:46:02.212723 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:02.212705    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-9739a-kube-rbac-proxy-sar-config\""
Jul 24 21:46:02.212817 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:02.212708    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-9739a-predictor-serving-cert\""
Jul 24 21:46:02.221599 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:02.221576    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8"]
Jul 24 21:46:02.259429 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:02.259406    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7b389104-8e8a-4de4-960b-10bf8781d481-proxy-tls\") pod \"success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8\" (UID: \"7b389104-8e8a-4de4-960b-10bf8781d481\") " pod="kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8"
Jul 24 21:46:02.259543 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:02.259460    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7b389104-8e8a-4de4-960b-10bf8781d481-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8\" (UID: \"7b389104-8e8a-4de4-960b-10bf8781d481\") " pod="kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8"
Jul 24 21:46:02.259595 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:02.259562    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4qk7\" (UniqueName: \"kubernetes.io/projected/7b389104-8e8a-4de4-960b-10bf8781d481-kube-api-access-v4qk7\") pod \"success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8\" (UID: \"7b389104-8e8a-4de4-960b-10bf8781d481\") " pod="kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8"
Jul 24 21:46:02.360631 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:02.360595    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7b389104-8e8a-4de4-960b-10bf8781d481-proxy-tls\") pod \"success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8\" (UID: \"7b389104-8e8a-4de4-960b-10bf8781d481\") " pod="kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8"
Jul 24 21:46:02.360771 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:02.360657    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7b389104-8e8a-4de4-960b-10bf8781d481-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8\" (UID: \"7b389104-8e8a-4de4-960b-10bf8781d481\") " pod="kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8"
Jul 24 21:46:02.360771 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:02.360728    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4qk7\" (UniqueName: \"kubernetes.io/projected/7b389104-8e8a-4de4-960b-10bf8781d481-kube-api-access-v4qk7\") pod \"success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8\" (UID: \"7b389104-8e8a-4de4-960b-10bf8781d481\") " pod="kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8"
Jul 24 21:46:02.361477 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:02.361453    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7b389104-8e8a-4de4-960b-10bf8781d481-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8\" (UID: \"7b389104-8e8a-4de4-960b-10bf8781d481\") " pod="kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8"
Jul 24 21:46:02.363079 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:02.363052    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7b389104-8e8a-4de4-960b-10bf8781d481-proxy-tls\") pod \"success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8\" (UID: \"7b389104-8e8a-4de4-960b-10bf8781d481\") " pod="kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8"
Jul 24 21:46:02.372411 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:02.372389    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4qk7\" (UniqueName: \"kubernetes.io/projected/7b389104-8e8a-4de4-960b-10bf8781d481-kube-api-access-v4qk7\") pod \"success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8\" (UID: \"7b389104-8e8a-4de4-960b-10bf8781d481\") " pod="kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8"
Jul 24 21:46:02.464946 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:02.464888    2561 generic.go:356] "Generic (PLEG): container finished" podID="cb2b02f6-5377-4a12-bab2-fb98f929fb23" containerID="dcd340441cb9c83068799a08e674ba74ef69b96dca744624daabd990f022ad45" exitCode=2
Jul 24 21:46:02.465024 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:02.464960    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx" event={"ID":"cb2b02f6-5377-4a12-bab2-fb98f929fb23","Type":"ContainerDied","Data":"dcd340441cb9c83068799a08e674ba74ef69b96dca744624daabd990f022ad45"}
Jul 24 21:46:02.521051 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:02.521029    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8"
Jul 24 21:46:02.653200 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:02.653176    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8"]
Jul 24 21:46:02.655030 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:46:02.655001    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b389104_8e8a_4de4_960b_10bf8781d481.slice/crio-466bbcefca757a100a3bca31a530a872d4a30f34839dabd580c36ef40a723aa4 WatchSource:0}: Error finding container 466bbcefca757a100a3bca31a530a872d4a30f34839dabd580c36ef40a723aa4: Status 404 returned error can't find the container with id 466bbcefca757a100a3bca31a530a872d4a30f34839dabd580c36ef40a723aa4
Jul 24 21:46:03.481522 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:03.481469    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8" event={"ID":"7b389104-8e8a-4de4-960b-10bf8781d481","Type":"ContainerStarted","Data":"9e4cd8eb9f40490eec75947a475cdca93c1978989061318bacf336035dbf3cb9"}
Jul 24 21:46:03.482141 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:03.481649    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8"
Jul 24 21:46:03.482141 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:03.481689    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8" event={"ID":"7b389104-8e8a-4de4-960b-10bf8781d481","Type":"ContainerStarted","Data":"dd7a8f3f2e2a50bf52b596b89055272b2d309d99241f6025572b3831eee2ab13"}
Jul 24 21:46:03.482141 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:03.481720    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8" event={"ID":"7b389104-8e8a-4de4-960b-10bf8781d481","Type":"ContainerStarted","Data":"466bbcefca757a100a3bca31a530a872d4a30f34839dabd580c36ef40a723aa4"}
Jul 24 21:46:03.482141 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:03.481751    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8"
Jul 24 21:46:03.482805 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:03.482776    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8" podUID="7b389104-8e8a-4de4-960b-10bf8781d481" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.40:8080: connect: connection refused"
Jul 24 21:46:03.501778 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:03.501732    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8" podStartSLOduration=1.501716873 podStartE2EDuration="1.501716873s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:46:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:46:03.500587486 +0000 UTC m=+1879.945179228" watchObservedRunningTime="2026-07-24 21:46:03.501716873 +0000 UTC m=+1879.946308603"
Jul 24 21:46:03.964699 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:03.964665    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx" podUID="cb2b02f6-5377-4a12-bab2-fb98f929fb23" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.38:8643/healthz\": dial tcp 10.133.0.38:8643: connect: connection refused"
Jul 24 21:46:03.970841 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:03.970800    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx" podUID="cb2b02f6-5377-4a12-bab2-fb98f929fb23" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.38:8080: connect: connection refused"
Jul 24 21:46:04.486278 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:04.486238    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8" podUID="7b389104-8e8a-4de4-960b-10bf8781d481" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.40:8080: connect: connection refused"
Jul 24 21:46:05.179815 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:05.179789    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx"
Jul 24 21:46:05.284607 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:05.284581    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cb2b02f6-5377-4a12-bab2-fb98f929fb23-proxy-tls\") pod \"cb2b02f6-5377-4a12-bab2-fb98f929fb23\" (UID: \"cb2b02f6-5377-4a12-bab2-fb98f929fb23\") "
Jul 24 21:46:05.284758 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:05.284641    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cb2b02f6-5377-4a12-bab2-fb98f929fb23-kube-rbac-proxy-sar-config\") pod \"cb2b02f6-5377-4a12-bab2-fb98f929fb23\" (UID: \"cb2b02f6-5377-4a12-bab2-fb98f929fb23\") "
Jul 24 21:46:05.284758 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:05.284685    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rj7wd\" (UniqueName: \"kubernetes.io/projected/cb2b02f6-5377-4a12-bab2-fb98f929fb23-kube-api-access-rj7wd\") pod \"cb2b02f6-5377-4a12-bab2-fb98f929fb23\" (UID: \"cb2b02f6-5377-4a12-bab2-fb98f929fb23\") "
Jul 24 21:46:05.285055 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:05.285030    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb2b02f6-5377-4a12-bab2-fb98f929fb23-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "cb2b02f6-5377-4a12-bab2-fb98f929fb23" (UID: "cb2b02f6-5377-4a12-bab2-fb98f929fb23"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:46:05.286895 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:05.286875    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb2b02f6-5377-4a12-bab2-fb98f929fb23-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "cb2b02f6-5377-4a12-bab2-fb98f929fb23" (UID: "cb2b02f6-5377-4a12-bab2-fb98f929fb23"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 21:46:05.287007 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:05.286938    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb2b02f6-5377-4a12-bab2-fb98f929fb23-kube-api-access-rj7wd" (OuterVolumeSpecName: "kube-api-access-rj7wd") pod "cb2b02f6-5377-4a12-bab2-fb98f929fb23" (UID: "cb2b02f6-5377-4a12-bab2-fb98f929fb23"). InnerVolumeSpecName "kube-api-access-rj7wd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 21:46:05.385768 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:05.385737    2561 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cb2b02f6-5377-4a12-bab2-fb98f929fb23-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:46:05.385768 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:05.385764    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rj7wd\" (UniqueName: \"kubernetes.io/projected/cb2b02f6-5377-4a12-bab2-fb98f929fb23-kube-api-access-rj7wd\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:46:05.385768 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:05.385774    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cb2b02f6-5377-4a12-bab2-fb98f929fb23-proxy-tls\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:46:05.492596 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:05.492564    2561 generic.go:356] "Generic (PLEG): container finished" podID="cb2b02f6-5377-4a12-bab2-fb98f929fb23" containerID="b868c9cbfe535dc9876b8a9ff9b4b320b104adc3bc66eee34f0fea59398b0769" exitCode=0
Jul 24 21:46:05.493003 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:05.492622    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx"
Jul 24 21:46:05.493003 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:05.492649    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx" event={"ID":"cb2b02f6-5377-4a12-bab2-fb98f929fb23","Type":"ContainerDied","Data":"b868c9cbfe535dc9876b8a9ff9b4b320b104adc3bc66eee34f0fea59398b0769"}
Jul 24 21:46:05.493003 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:05.492713    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx" event={"ID":"cb2b02f6-5377-4a12-bab2-fb98f929fb23","Type":"ContainerDied","Data":"7984e0301669ddb66bdfcae5f72f00bc514fb0c3fea19ea2f6eef409c6cbcd90"}
Jul 24 21:46:05.493003 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:05.492743    2561 scope.go:117] "RemoveContainer" containerID="dcd340441cb9c83068799a08e674ba74ef69b96dca744624daabd990f022ad45"
Jul 24 21:46:05.501878 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:05.501862    2561 scope.go:117] "RemoveContainer" containerID="b868c9cbfe535dc9876b8a9ff9b4b320b104adc3bc66eee34f0fea59398b0769"
Jul 24 21:46:05.509102 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:05.509085    2561 scope.go:117] "RemoveContainer" containerID="dcd340441cb9c83068799a08e674ba74ef69b96dca744624daabd990f022ad45"
Jul 24 21:46:05.509365 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:46:05.509348    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcd340441cb9c83068799a08e674ba74ef69b96dca744624daabd990f022ad45\": container with ID starting with dcd340441cb9c83068799a08e674ba74ef69b96dca744624daabd990f022ad45 not found: ID does not exist" containerID="dcd340441cb9c83068799a08e674ba74ef69b96dca744624daabd990f022ad45"
Jul 24 21:46:05.509427 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:05.509375    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcd340441cb9c83068799a08e674ba74ef69b96dca744624daabd990f022ad45"} err="failed to get container status \"dcd340441cb9c83068799a08e674ba74ef69b96dca744624daabd990f022ad45\": rpc error: code = NotFound desc = could not find container \"dcd340441cb9c83068799a08e674ba74ef69b96dca744624daabd990f022ad45\": container with ID starting with dcd340441cb9c83068799a08e674ba74ef69b96dca744624daabd990f022ad45 not found: ID does not exist"
Jul 24 21:46:05.509427 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:05.509391    2561 scope.go:117] "RemoveContainer" containerID="b868c9cbfe535dc9876b8a9ff9b4b320b104adc3bc66eee34f0fea59398b0769"
Jul 24 21:46:05.509615 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:46:05.509597    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b868c9cbfe535dc9876b8a9ff9b4b320b104adc3bc66eee34f0fea59398b0769\": container with ID starting with b868c9cbfe535dc9876b8a9ff9b4b320b104adc3bc66eee34f0fea59398b0769 not found: ID does not exist" containerID="b868c9cbfe535dc9876b8a9ff9b4b320b104adc3bc66eee34f0fea59398b0769"
Jul 24 21:46:05.509657 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:05.509619    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b868c9cbfe535dc9876b8a9ff9b4b320b104adc3bc66eee34f0fea59398b0769"} err="failed to get container status \"b868c9cbfe535dc9876b8a9ff9b4b320b104adc3bc66eee34f0fea59398b0769\": rpc error: code = NotFound desc = could not find container \"b868c9cbfe535dc9876b8a9ff9b4b320b104adc3bc66eee34f0fea59398b0769\": container with ID starting with b868c9cbfe535dc9876b8a9ff9b4b320b104adc3bc66eee34f0fea59398b0769 not found: ID does not exist"
Jul 24 21:46:05.540503 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:05.540434    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx"]
Jul 24 21:46:05.541937 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:05.541920    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-6de22-predictor-b49bb5776-zh2fx"]
Jul 24 21:46:05.953238 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:05.953146    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb2b02f6-5377-4a12-bab2-fb98f929fb23" path="/var/lib/kubelet/pods/cb2b02f6-5377-4a12-bab2-fb98f929fb23/volumes"
Jul 24 21:46:09.491105 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:09.491078    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8"
Jul 24 21:46:09.491578 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:09.491551    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8" podUID="7b389104-8e8a-4de4-960b-10bf8781d481" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.40:8080: connect: connection refused"
Jul 24 21:46:19.491673 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:19.491630    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8" podUID="7b389104-8e8a-4de4-960b-10bf8781d481" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.40:8080: connect: connection refused"
Jul 24 21:46:29.491612 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:29.491574    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8" podUID="7b389104-8e8a-4de4-960b-10bf8781d481" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.40:8080: connect: connection refused"
Jul 24 21:46:39.491480 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:39.491439    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8" podUID="7b389104-8e8a-4de4-960b-10bf8781d481" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.40:8080: connect: connection refused"
Jul 24 21:46:49.492887 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:49.492857    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8"
Jul 24 21:46:51.988445 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:51.988409    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26"]
Jul 24 21:46:51.988832 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:51.988714    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26" podUID="2ec2fea9-5fb1-49cd-a93d-0c328df00f87" containerName="kserve-container" containerID="cri-o://11f2c7557cb04cdda7390e23e52234143c6ddcb8ea8c41b01016e69485b6454c" gracePeriod=30
Jul 24 21:46:51.988832 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:51.988770    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26" podUID="2ec2fea9-5fb1-49cd-a93d-0c328df00f87" containerName="kube-rbac-proxy" containerID="cri-o://d944bff54f32e5b64b7e1ecdfe2f1d8e035338f38eeb4f5bffcba13766c29035" gracePeriod=30
Jul 24 21:46:52.038412 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:52.038387    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt"]
Jul 24 21:46:52.038739 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:52.038727    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb2b02f6-5377-4a12-bab2-fb98f929fb23" containerName="kserve-container"
Jul 24 21:46:52.038793 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:52.038740    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb2b02f6-5377-4a12-bab2-fb98f929fb23" containerName="kserve-container"
Jul 24 21:46:52.038793 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:52.038760    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb2b02f6-5377-4a12-bab2-fb98f929fb23" containerName="kube-rbac-proxy"
Jul 24 21:46:52.038793 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:52.038766    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb2b02f6-5377-4a12-bab2-fb98f929fb23" containerName="kube-rbac-proxy"
Jul 24 21:46:52.038902 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:52.038820    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb2b02f6-5377-4a12-bab2-fb98f929fb23" containerName="kube-rbac-proxy"
Jul 24 21:46:52.038902 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:52.038829    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb2b02f6-5377-4a12-bab2-fb98f929fb23" containerName="kserve-container"
Jul 24 21:46:52.041974 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:52.041959    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt"
Jul 24 21:46:52.044715 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:52.044696    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-a916f-kube-rbac-proxy-sar-config\""
Jul 24 21:46:52.044802 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:52.044726    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-a916f-predictor-serving-cert\""
Jul 24 21:46:52.051212 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:52.051193    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt"]
Jul 24 21:46:52.151373 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:52.151344    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/751d85fc-12f4-44b5-8106-42e38a8743de-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-a916f-predictor-698dc55bcb-b57tt\" (UID: \"751d85fc-12f4-44b5-8106-42e38a8743de\") " pod="kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt"
Jul 24 21:46:52.151528 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:52.151393    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/751d85fc-12f4-44b5-8106-42e38a8743de-proxy-tls\") pod \"success-200-isvc-a916f-predictor-698dc55bcb-b57tt\" (UID: \"751d85fc-12f4-44b5-8106-42e38a8743de\") " pod="kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt"
Jul 24 21:46:52.151528 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:52.151463    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt8jz\" (UniqueName: \"kubernetes.io/projected/751d85fc-12f4-44b5-8106-42e38a8743de-kube-api-access-dt8jz\") pod \"success-200-isvc-a916f-predictor-698dc55bcb-b57tt\" (UID: \"751d85fc-12f4-44b5-8106-42e38a8743de\") " pod="kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt"
Jul 24 21:46:52.252250 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:52.252151    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt8jz\" (UniqueName: \"kubernetes.io/projected/751d85fc-12f4-44b5-8106-42e38a8743de-kube-api-access-dt8jz\") pod \"success-200-isvc-a916f-predictor-698dc55bcb-b57tt\" (UID: \"751d85fc-12f4-44b5-8106-42e38a8743de\") " pod="kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt"
Jul 24 21:46:52.252442 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:52.252312    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/751d85fc-12f4-44b5-8106-42e38a8743de-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-a916f-predictor-698dc55bcb-b57tt\" (UID: \"751d85fc-12f4-44b5-8106-42e38a8743de\") " pod="kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt"
Jul 24 21:46:52.252442 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:52.252359    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/751d85fc-12f4-44b5-8106-42e38a8743de-proxy-tls\") pod \"success-200-isvc-a916f-predictor-698dc55bcb-b57tt\" (UID: \"751d85fc-12f4-44b5-8106-42e38a8743de\") " pod="kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt"
Jul 24 21:46:52.252615 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:46:52.252474    2561 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-a916f-predictor-serving-cert: secret "success-200-isvc-a916f-predictor-serving-cert" not found
Jul 24 21:46:52.252615 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:46:52.252531    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/751d85fc-12f4-44b5-8106-42e38a8743de-proxy-tls podName:751d85fc-12f4-44b5-8106-42e38a8743de nodeName:}" failed. No retries permitted until 2026-07-24 21:46:52.752511542 +0000 UTC m=+1929.197103254 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/751d85fc-12f4-44b5-8106-42e38a8743de-proxy-tls") pod "success-200-isvc-a916f-predictor-698dc55bcb-b57tt" (UID: "751d85fc-12f4-44b5-8106-42e38a8743de") : secret "success-200-isvc-a916f-predictor-serving-cert" not found
Jul 24 21:46:52.252977 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:52.252956    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/751d85fc-12f4-44b5-8106-42e38a8743de-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-a916f-predictor-698dc55bcb-b57tt\" (UID: \"751d85fc-12f4-44b5-8106-42e38a8743de\") " pod="kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt"
Jul 24 21:46:52.264141 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:52.264115    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt8jz\" (UniqueName: \"kubernetes.io/projected/751d85fc-12f4-44b5-8106-42e38a8743de-kube-api-access-dt8jz\") pod \"success-200-isvc-a916f-predictor-698dc55bcb-b57tt\" (UID: \"751d85fc-12f4-44b5-8106-42e38a8743de\") " pod="kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt"
Jul 24 21:46:52.711616 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:52.711580    2561 generic.go:356] "Generic (PLEG): container finished" podID="2ec2fea9-5fb1-49cd-a93d-0c328df00f87" containerID="d944bff54f32e5b64b7e1ecdfe2f1d8e035338f38eeb4f5bffcba13766c29035" exitCode=2
Jul 24 21:46:52.711799 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:52.711652    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26" event={"ID":"2ec2fea9-5fb1-49cd-a93d-0c328df00f87","Type":"ContainerDied","Data":"d944bff54f32e5b64b7e1ecdfe2f1d8e035338f38eeb4f5bffcba13766c29035"}
Jul 24 21:46:52.756188 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:52.756160    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/751d85fc-12f4-44b5-8106-42e38a8743de-proxy-tls\") pod \"success-200-isvc-a916f-predictor-698dc55bcb-b57tt\" (UID: \"751d85fc-12f4-44b5-8106-42e38a8743de\") " pod="kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt"
Jul 24 21:46:52.758624 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:52.758601    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/751d85fc-12f4-44b5-8106-42e38a8743de-proxy-tls\") pod \"success-200-isvc-a916f-predictor-698dc55bcb-b57tt\" (UID: \"751d85fc-12f4-44b5-8106-42e38a8743de\") " pod="kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt"
Jul 24 21:46:52.953169 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:52.953136    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt"
Jul 24 21:46:53.083701 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:53.083669    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt"]
Jul 24 21:46:53.087800 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:46:53.087770    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod751d85fc_12f4_44b5_8106_42e38a8743de.slice/crio-5e3b4594330324909653e0dc8597bcffbd0d2621403741b733be470098143903 WatchSource:0}: Error finding container 5e3b4594330324909653e0dc8597bcffbd0d2621403741b733be470098143903: Status 404 returned error can't find the container with id 5e3b4594330324909653e0dc8597bcffbd0d2621403741b733be470098143903
Jul 24 21:46:53.718017 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:53.717982    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt" event={"ID":"751d85fc-12f4-44b5-8106-42e38a8743de","Type":"ContainerStarted","Data":"71ad407d5cf7577c29344c6f7111c6a67f5ad1b79ef4d63a7250b880bcb7420e"}
Jul 24 21:46:53.718191 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:53.718039    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt" event={"ID":"751d85fc-12f4-44b5-8106-42e38a8743de","Type":"ContainerStarted","Data":"ba1d34be80ac76ef29faeb4806541b8695c6219010d6bdb3ac9375d2b0c038a1"}
Jul 24 21:46:53.718191 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:53.718068    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt" event={"ID":"751d85fc-12f4-44b5-8106-42e38a8743de","Type":"ContainerStarted","Data":"5e3b4594330324909653e0dc8597bcffbd0d2621403741b733be470098143903"}
Jul 24 21:46:53.718191 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:53.718092    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt"
Jul 24 21:46:53.737973 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:53.737928    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt" podStartSLOduration=1.737915776 podStartE2EDuration="1.737915776s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:46:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:46:53.736572906 +0000 UTC m=+1930.181164636" watchObservedRunningTime="2026-07-24 21:46:53.737915776 +0000 UTC m=+1930.182507569"
Jul 24 21:46:54.202149 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:54.202110    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26" podUID="2ec2fea9-5fb1-49cd-a93d-0c328df00f87" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.39:8643/healthz\": dial tcp 10.133.0.39:8643: connect: connection refused"
Jul 24 21:46:54.206452 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:54.206420    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26" podUID="2ec2fea9-5fb1-49cd-a93d-0c328df00f87" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.39:8080: connect: connection refused"
Jul 24 21:46:54.722818 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:54.722782    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt"
Jul 24 21:46:54.724307 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:54.724277    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt" podUID="751d85fc-12f4-44b5-8106-42e38a8743de" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.41:8080: connect: connection refused"
Jul 24 21:46:54.931405 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:54.931381    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26"
Jul 24 21:46:55.076168 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:55.076131    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2ec2fea9-5fb1-49cd-a93d-0c328df00f87-kube-rbac-proxy-sar-config\") pod \"2ec2fea9-5fb1-49cd-a93d-0c328df00f87\" (UID: \"2ec2fea9-5fb1-49cd-a93d-0c328df00f87\") "
Jul 24 21:46:55.076365 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:55.076163    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8kkl\" (UniqueName: \"kubernetes.io/projected/2ec2fea9-5fb1-49cd-a93d-0c328df00f87-kube-api-access-b8kkl\") pod \"2ec2fea9-5fb1-49cd-a93d-0c328df00f87\" (UID: \"2ec2fea9-5fb1-49cd-a93d-0c328df00f87\") "
Jul 24 21:46:55.076365 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:55.076242    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2ec2fea9-5fb1-49cd-a93d-0c328df00f87-proxy-tls\") pod \"2ec2fea9-5fb1-49cd-a93d-0c328df00f87\" (UID: \"2ec2fea9-5fb1-49cd-a93d-0c328df00f87\") "
Jul 24 21:46:55.076551 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:55.076522    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ec2fea9-5fb1-49cd-a93d-0c328df00f87-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "2ec2fea9-5fb1-49cd-a93d-0c328df00f87" (UID: "2ec2fea9-5fb1-49cd-a93d-0c328df00f87"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:46:55.078455 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:55.078430    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ec2fea9-5fb1-49cd-a93d-0c328df00f87-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "2ec2fea9-5fb1-49cd-a93d-0c328df00f87" (UID: "2ec2fea9-5fb1-49cd-a93d-0c328df00f87"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 21:46:55.078600 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:55.078474    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ec2fea9-5fb1-49cd-a93d-0c328df00f87-kube-api-access-b8kkl" (OuterVolumeSpecName: "kube-api-access-b8kkl") pod "2ec2fea9-5fb1-49cd-a93d-0c328df00f87" (UID: "2ec2fea9-5fb1-49cd-a93d-0c328df00f87"). InnerVolumeSpecName "kube-api-access-b8kkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 21:46:55.177501 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:55.177468    2561 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2ec2fea9-5fb1-49cd-a93d-0c328df00f87-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:46:55.177501 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:55.177491    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8kkl\" (UniqueName: \"kubernetes.io/projected/2ec2fea9-5fb1-49cd-a93d-0c328df00f87-kube-api-access-b8kkl\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:46:55.177501 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:55.177500    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2ec2fea9-5fb1-49cd-a93d-0c328df00f87-proxy-tls\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:46:55.729355 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:55.729324    2561 generic.go:356] "Generic (PLEG): container finished" podID="2ec2fea9-5fb1-49cd-a93d-0c328df00f87" containerID="11f2c7557cb04cdda7390e23e52234143c6ddcb8ea8c41b01016e69485b6454c" exitCode=0
Jul 24 21:46:55.729747 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:55.729375    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26"
Jul 24 21:46:55.729747 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:55.729408    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26" event={"ID":"2ec2fea9-5fb1-49cd-a93d-0c328df00f87","Type":"ContainerDied","Data":"11f2c7557cb04cdda7390e23e52234143c6ddcb8ea8c41b01016e69485b6454c"}
Jul 24 21:46:55.729747 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:55.729457    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26" event={"ID":"2ec2fea9-5fb1-49cd-a93d-0c328df00f87","Type":"ContainerDied","Data":"6ce0b8700c9f874a0c464befb4f429dd8ac3a8fce147db8827cf8aeaedef0ca2"}
Jul 24 21:46:55.729747 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:55.729486    2561 scope.go:117] "RemoveContainer" containerID="d944bff54f32e5b64b7e1ecdfe2f1d8e035338f38eeb4f5bffcba13766c29035"
Jul 24 21:46:55.730102 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:55.730061    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt" podUID="751d85fc-12f4-44b5-8106-42e38a8743de" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.41:8080: connect: connection refused"
Jul 24 21:46:55.738574 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:55.738558    2561 scope.go:117] "RemoveContainer" containerID="11f2c7557cb04cdda7390e23e52234143c6ddcb8ea8c41b01016e69485b6454c"
Jul 24 21:46:55.746031 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:55.746017    2561 scope.go:117] "RemoveContainer" containerID="d944bff54f32e5b64b7e1ecdfe2f1d8e035338f38eeb4f5bffcba13766c29035"
Jul 24 21:46:55.746270 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:46:55.746255    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d944bff54f32e5b64b7e1ecdfe2f1d8e035338f38eeb4f5bffcba13766c29035\": container with ID starting with d944bff54f32e5b64b7e1ecdfe2f1d8e035338f38eeb4f5bffcba13766c29035 not found: ID does not exist" containerID="d944bff54f32e5b64b7e1ecdfe2f1d8e035338f38eeb4f5bffcba13766c29035"
Jul 24 21:46:55.746338 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:55.746277    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d944bff54f32e5b64b7e1ecdfe2f1d8e035338f38eeb4f5bffcba13766c29035"} err="failed to get container status \"d944bff54f32e5b64b7e1ecdfe2f1d8e035338f38eeb4f5bffcba13766c29035\": rpc error: code = NotFound desc = could not find container \"d944bff54f32e5b64b7e1ecdfe2f1d8e035338f38eeb4f5bffcba13766c29035\": container with ID starting with d944bff54f32e5b64b7e1ecdfe2f1d8e035338f38eeb4f5bffcba13766c29035 not found: ID does not exist"
Jul 24 21:46:55.746338 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:55.746293    2561 scope.go:117] "RemoveContainer" containerID="11f2c7557cb04cdda7390e23e52234143c6ddcb8ea8c41b01016e69485b6454c"
Jul 24 21:46:55.746496 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:46:55.746482    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11f2c7557cb04cdda7390e23e52234143c6ddcb8ea8c41b01016e69485b6454c\": container with ID starting with 11f2c7557cb04cdda7390e23e52234143c6ddcb8ea8c41b01016e69485b6454c not found: ID does not exist" containerID="11f2c7557cb04cdda7390e23e52234143c6ddcb8ea8c41b01016e69485b6454c"
Jul 24 21:46:55.746538 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:55.746499    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11f2c7557cb04cdda7390e23e52234143c6ddcb8ea8c41b01016e69485b6454c"} err="failed to get container status \"11f2c7557cb04cdda7390e23e52234143c6ddcb8ea8c41b01016e69485b6454c\": rpc error: code = NotFound desc = could not find container \"11f2c7557cb04cdda7390e23e52234143c6ddcb8ea8c41b01016e69485b6454c\": container with ID starting with 11f2c7557cb04cdda7390e23e52234143c6ddcb8ea8c41b01016e69485b6454c not found: ID does not exist"
Jul 24 21:46:55.751704 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:55.751681    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26"]
Jul 24 21:46:55.756454 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:55.756435    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-59fd1-predictor-54b67dc744-8wc26"]
Jul 24 21:46:55.954962 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:46:55.954932    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ec2fea9-5fb1-49cd-a93d-0c328df00f87" path="/var/lib/kubelet/pods/2ec2fea9-5fb1-49cd-a93d-0c328df00f87/volumes"
Jul 24 21:47:00.734905 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:00.734874    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt"
Jul 24 21:47:00.735340 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:00.735311    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt" podUID="751d85fc-12f4-44b5-8106-42e38a8743de" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.41:8080: connect: connection refused"
Jul 24 21:47:10.735606 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:10.735563    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt" podUID="751d85fc-12f4-44b5-8106-42e38a8743de" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.41:8080: connect: connection refused"
Jul 24 21:47:12.408052 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:12.408022    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8"]
Jul 24 21:47:12.408613 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:12.408345    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8" podUID="7b389104-8e8a-4de4-960b-10bf8781d481" containerName="kserve-container" containerID="cri-o://dd7a8f3f2e2a50bf52b596b89055272b2d309d99241f6025572b3831eee2ab13" gracePeriod=30
Jul 24 21:47:12.408613 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:12.408351    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8" podUID="7b389104-8e8a-4de4-960b-10bf8781d481" containerName="kube-rbac-proxy" containerID="cri-o://9e4cd8eb9f40490eec75947a475cdca93c1978989061318bacf336035dbf3cb9" gracePeriod=30
Jul 24 21:47:12.453616 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:12.453586    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j"]
Jul 24 21:47:12.453960 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:12.453945    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ec2fea9-5fb1-49cd-a93d-0c328df00f87" containerName="kserve-container"
Jul 24 21:47:12.454007 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:12.453963    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ec2fea9-5fb1-49cd-a93d-0c328df00f87" containerName="kserve-container"
Jul 24 21:47:12.454007 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:12.453977    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ec2fea9-5fb1-49cd-a93d-0c328df00f87" containerName="kube-rbac-proxy"
Jul 24 21:47:12.454007 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:12.453983    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ec2fea9-5fb1-49cd-a93d-0c328df00f87" containerName="kube-rbac-proxy"
Jul 24 21:47:12.454104 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:12.454043    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ec2fea9-5fb1-49cd-a93d-0c328df00f87" containerName="kserve-container"
Jul 24 21:47:12.454104 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:12.454055    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ec2fea9-5fb1-49cd-a93d-0c328df00f87" containerName="kube-rbac-proxy"
Jul 24 21:47:12.458400 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:12.458383    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j"
Jul 24 21:47:12.460707 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:12.460684    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-bce0e-predictor-serving-cert\""
Jul 24 21:47:12.460815 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:12.460684    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-bce0e-kube-rbac-proxy-sar-config\""
Jul 24 21:47:12.467212 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:12.467193    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j"]
Jul 24 21:47:12.519174 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:12.519148    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1596af97-aee1-48e6-bd5d-683b67ad2864-proxy-tls\") pod \"success-200-isvc-bce0e-predictor-9867f5768-ttq7j\" (UID: \"1596af97-aee1-48e6-bd5d-683b67ad2864\") " pod="kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j"
Jul 24 21:47:12.519322 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:12.519274    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1596af97-aee1-48e6-bd5d-683b67ad2864-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-bce0e-predictor-9867f5768-ttq7j\" (UID: \"1596af97-aee1-48e6-bd5d-683b67ad2864\") " pod="kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j"
Jul 24 21:47:12.519373 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:12.519357    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5cnn\" (UniqueName: \"kubernetes.io/projected/1596af97-aee1-48e6-bd5d-683b67ad2864-kube-api-access-b5cnn\") pod \"success-200-isvc-bce0e-predictor-9867f5768-ttq7j\" (UID: \"1596af97-aee1-48e6-bd5d-683b67ad2864\") " pod="kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j"
Jul 24 21:47:12.620052 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:12.620007    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1596af97-aee1-48e6-bd5d-683b67ad2864-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-bce0e-predictor-9867f5768-ttq7j\" (UID: \"1596af97-aee1-48e6-bd5d-683b67ad2864\") " pod="kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j"
Jul 24 21:47:12.620052 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:12.620061    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5cnn\" (UniqueName: \"kubernetes.io/projected/1596af97-aee1-48e6-bd5d-683b67ad2864-kube-api-access-b5cnn\") pod \"success-200-isvc-bce0e-predictor-9867f5768-ttq7j\" (UID: \"1596af97-aee1-48e6-bd5d-683b67ad2864\") " pod="kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j"
Jul 24 21:47:12.620323 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:12.620107    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1596af97-aee1-48e6-bd5d-683b67ad2864-proxy-tls\") pod \"success-200-isvc-bce0e-predictor-9867f5768-ttq7j\" (UID: \"1596af97-aee1-48e6-bd5d-683b67ad2864\") " pod="kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j"
Jul 24 21:47:12.620734 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:12.620713    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1596af97-aee1-48e6-bd5d-683b67ad2864-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-bce0e-predictor-9867f5768-ttq7j\" (UID: \"1596af97-aee1-48e6-bd5d-683b67ad2864\") " pod="kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j"
Jul 24 21:47:12.622575 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:12.622558    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1596af97-aee1-48e6-bd5d-683b67ad2864-proxy-tls\") pod \"success-200-isvc-bce0e-predictor-9867f5768-ttq7j\" (UID: \"1596af97-aee1-48e6-bd5d-683b67ad2864\") " pod="kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j"
Jul 24 21:47:12.627783 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:12.627761    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5cnn\" (UniqueName: \"kubernetes.io/projected/1596af97-aee1-48e6-bd5d-683b67ad2864-kube-api-access-b5cnn\") pod \"success-200-isvc-bce0e-predictor-9867f5768-ttq7j\" (UID: \"1596af97-aee1-48e6-bd5d-683b67ad2864\") " pod="kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j"
Jul 24 21:47:12.768666 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:12.768642    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j"
Jul 24 21:47:12.810085 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:12.810059    2561 generic.go:356] "Generic (PLEG): container finished" podID="7b389104-8e8a-4de4-960b-10bf8781d481" containerID="9e4cd8eb9f40490eec75947a475cdca93c1978989061318bacf336035dbf3cb9" exitCode=2
Jul 24 21:47:12.810219 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:12.810130    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8" event={"ID":"7b389104-8e8a-4de4-960b-10bf8781d481","Type":"ContainerDied","Data":"9e4cd8eb9f40490eec75947a475cdca93c1978989061318bacf336035dbf3cb9"}
Jul 24 21:47:12.905385 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:12.905359    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j"]
Jul 24 21:47:12.907453 ip-10-0-137-226 kubenswrapper[2561]: W0724 21:47:12.907425    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1596af97_aee1_48e6_bd5d_683b67ad2864.slice/crio-1f0c880ce5b5b6db2d43eb8ab9b3e227994be2d92671a8f743d783da5ac0d511 WatchSource:0}: Error finding container 1f0c880ce5b5b6db2d43eb8ab9b3e227994be2d92671a8f743d783da5ac0d511: Status 404 returned error can't find the container with id 1f0c880ce5b5b6db2d43eb8ab9b3e227994be2d92671a8f743d783da5ac0d511
Jul 24 21:47:13.816361 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:13.816327    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j" event={"ID":"1596af97-aee1-48e6-bd5d-683b67ad2864","Type":"ContainerStarted","Data":"e795b6bdad745547772a1aaa18f16ef765de0c38325558d1a35aae108a8bb58e"}
Jul 24 21:47:13.816806 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:13.816385    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j" event={"ID":"1596af97-aee1-48e6-bd5d-683b67ad2864","Type":"ContainerStarted","Data":"d7c85ee26f7cae54a30154ea762c2ea0a2a9eb7f6fea1fb5d35833a568a3ea21"}
Jul 24 21:47:13.816806 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:13.816406    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j" event={"ID":"1596af97-aee1-48e6-bd5d-683b67ad2864","Type":"ContainerStarted","Data":"1f0c880ce5b5b6db2d43eb8ab9b3e227994be2d92671a8f743d783da5ac0d511"}
Jul 24 21:47:13.816806 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:13.816429    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j"
Jul 24 21:47:13.816806 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:13.816468    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j"
Jul 24 21:47:13.817899 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:13.817876    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j" podUID="1596af97-aee1-48e6-bd5d-683b67ad2864" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.42:8080: connect: connection refused"
Jul 24 21:47:13.838260 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:13.838195    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j" podStartSLOduration=1.838183435 podStartE2EDuration="1.838183435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:47:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:47:13.836726143 +0000 UTC m=+1950.281317872" watchObservedRunningTime="2026-07-24 21:47:13.838183435 +0000 UTC m=+1950.282775247"
Jul 24 21:47:14.487477 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:14.487439    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8" podUID="7b389104-8e8a-4de4-960b-10bf8781d481" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.40:8643/healthz\": dial tcp 10.133.0.40:8643: connect: connection refused"
Jul 24 21:47:14.820600 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:14.820564    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j" podUID="1596af97-aee1-48e6-bd5d-683b67ad2864" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.42:8080: connect: connection refused"
Jul 24 21:47:15.827785 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:15.827753    2561 generic.go:356] "Generic (PLEG): container finished" podID="7b389104-8e8a-4de4-960b-10bf8781d481" containerID="dd7a8f3f2e2a50bf52b596b89055272b2d309d99241f6025572b3831eee2ab13" exitCode=0
Jul 24 21:47:15.828115 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:15.827791    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8" event={"ID":"7b389104-8e8a-4de4-960b-10bf8781d481","Type":"ContainerDied","Data":"dd7a8f3f2e2a50bf52b596b89055272b2d309d99241f6025572b3831eee2ab13"}
Jul 24 21:47:15.863862 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:15.863840    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8"
Jul 24 21:47:15.949478 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:15.949408    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4qk7\" (UniqueName: \"kubernetes.io/projected/7b389104-8e8a-4de4-960b-10bf8781d481-kube-api-access-v4qk7\") pod \"7b389104-8e8a-4de4-960b-10bf8781d481\" (UID: \"7b389104-8e8a-4de4-960b-10bf8781d481\") "
Jul 24 21:47:15.949599 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:15.949480    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7b389104-8e8a-4de4-960b-10bf8781d481-kube-rbac-proxy-sar-config\") pod \"7b389104-8e8a-4de4-960b-10bf8781d481\" (UID: \"7b389104-8e8a-4de4-960b-10bf8781d481\") "
Jul 24 21:47:15.949599 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:15.949504    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7b389104-8e8a-4de4-960b-10bf8781d481-proxy-tls\") pod \"7b389104-8e8a-4de4-960b-10bf8781d481\" (UID: \"7b389104-8e8a-4de4-960b-10bf8781d481\") "
Jul 24 21:47:15.949845 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:15.949822    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b389104-8e8a-4de4-960b-10bf8781d481-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "7b389104-8e8a-4de4-960b-10bf8781d481" (UID: "7b389104-8e8a-4de4-960b-10bf8781d481"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:47:15.951779 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:15.951750    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b389104-8e8a-4de4-960b-10bf8781d481-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "7b389104-8e8a-4de4-960b-10bf8781d481" (UID: "7b389104-8e8a-4de4-960b-10bf8781d481"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 21:47:15.951885 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:15.951847    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b389104-8e8a-4de4-960b-10bf8781d481-kube-api-access-v4qk7" (OuterVolumeSpecName: "kube-api-access-v4qk7") pod "7b389104-8e8a-4de4-960b-10bf8781d481" (UID: "7b389104-8e8a-4de4-960b-10bf8781d481"). InnerVolumeSpecName "kube-api-access-v4qk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 21:47:16.050276 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:16.050215    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4qk7\" (UniqueName: \"kubernetes.io/projected/7b389104-8e8a-4de4-960b-10bf8781d481-kube-api-access-v4qk7\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:47:16.050276 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:16.050274    2561 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7b389104-8e8a-4de4-960b-10bf8781d481-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:47:16.050490 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:16.050289    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7b389104-8e8a-4de4-960b-10bf8781d481-proxy-tls\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:47:16.834204 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:16.834178    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8"
Jul 24 21:47:16.834204 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:16.834195    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8" event={"ID":"7b389104-8e8a-4de4-960b-10bf8781d481","Type":"ContainerDied","Data":"466bbcefca757a100a3bca31a530a872d4a30f34839dabd580c36ef40a723aa4"}
Jul 24 21:47:16.834716 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:16.834315    2561 scope.go:117] "RemoveContainer" containerID="9e4cd8eb9f40490eec75947a475cdca93c1978989061318bacf336035dbf3cb9"
Jul 24 21:47:16.843302 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:16.843286    2561 scope.go:117] "RemoveContainer" containerID="dd7a8f3f2e2a50bf52b596b89055272b2d309d99241f6025572b3831eee2ab13"
Jul 24 21:47:16.852026 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:16.852006    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8"]
Jul 24 21:47:16.855638 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:16.855619    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9739a-predictor-9fcd7d8d4-bfbq8"]
Jul 24 21:47:17.953332 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:17.953296    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b389104-8e8a-4de4-960b-10bf8781d481" path="/var/lib/kubelet/pods/7b389104-8e8a-4de4-960b-10bf8781d481/volumes"
Jul 24 21:47:19.824742 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:19.824711    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j"
Jul 24 21:47:19.825351 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:19.825325    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j" podUID="1596af97-aee1-48e6-bd5d-683b67ad2864" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.42:8080: connect: connection refused"
Jul 24 21:47:20.735779 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:20.735741    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt" podUID="751d85fc-12f4-44b5-8106-42e38a8743de" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.41:8080: connect: connection refused"
Jul 24 21:47:29.826310 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:29.826273    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j" podUID="1596af97-aee1-48e6-bd5d-683b67ad2864" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.42:8080: connect: connection refused"
Jul 24 21:47:30.735911 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:30.735875    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt" podUID="751d85fc-12f4-44b5-8106-42e38a8743de" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.41:8080: connect: connection refused"
Jul 24 21:47:39.825495 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:39.825403    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j" podUID="1596af97-aee1-48e6-bd5d-683b67ad2864" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.42:8080: connect: connection refused"
Jul 24 21:47:40.736157 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:40.736129    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt"
Jul 24 21:47:49.825413 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:49.825369    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j" podUID="1596af97-aee1-48e6-bd5d-683b67ad2864" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.42:8080: connect: connection refused"
Jul 24 21:47:59.825827 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:47:59.825799    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j"
Jul 24 21:49:44.031196 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:49:44.031164    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nsjrg_87f18cf4-62ce-48a0-99b0-fe22bc19f701/console-operator/1.log"
Jul 24 21:49:44.035553 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:49:44.035532    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nsjrg_87f18cf4-62ce-48a0-99b0-fe22bc19f701/console-operator/1.log"
Jul 24 21:54:44.058301 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:54:44.058171    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nsjrg_87f18cf4-62ce-48a0-99b0-fe22bc19f701/console-operator/1.log"
Jul 24 21:54:44.063840 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:54:44.063821    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nsjrg_87f18cf4-62ce-48a0-99b0-fe22bc19f701/console-operator/1.log"
Jul 24 21:56:27.327811 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:56:27.327780    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j"]
Jul 24 21:56:27.328375 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:56:27.328000    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j" podUID="1596af97-aee1-48e6-bd5d-683b67ad2864" containerName="kserve-container" containerID="cri-o://d7c85ee26f7cae54a30154ea762c2ea0a2a9eb7f6fea1fb5d35833a568a3ea21" gracePeriod=30
Jul 24 21:56:27.328375 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:56:27.328038    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j" podUID="1596af97-aee1-48e6-bd5d-683b67ad2864" containerName="kube-rbac-proxy" containerID="cri-o://e795b6bdad745547772a1aaa18f16ef765de0c38325558d1a35aae108a8bb58e" gracePeriod=30
Jul 24 21:56:28.277157 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:56:28.277119    2561 generic.go:356] "Generic (PLEG): container finished" podID="1596af97-aee1-48e6-bd5d-683b67ad2864" containerID="e795b6bdad745547772a1aaa18f16ef765de0c38325558d1a35aae108a8bb58e" exitCode=2
Jul 24 21:56:28.277361 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:56:28.277195    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j" event={"ID":"1596af97-aee1-48e6-bd5d-683b67ad2864","Type":"ContainerDied","Data":"e795b6bdad745547772a1aaa18f16ef765de0c38325558d1a35aae108a8bb58e"}
Jul 24 21:56:29.821309 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:56:29.821273    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j" podUID="1596af97-aee1-48e6-bd5d-683b67ad2864" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.42:8643/healthz\": dial tcp 10.133.0.42:8643: connect: connection refused"
Jul 24 21:56:29.825592 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:56:29.825564    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j" podUID="1596af97-aee1-48e6-bd5d-683b67ad2864" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.42:8080: connect: connection refused"
Jul 24 21:56:30.084125 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:56:30.084072    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j"
Jul 24 21:56:30.193279 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:56:30.193249    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5cnn\" (UniqueName: \"kubernetes.io/projected/1596af97-aee1-48e6-bd5d-683b67ad2864-kube-api-access-b5cnn\") pod \"1596af97-aee1-48e6-bd5d-683b67ad2864\" (UID: \"1596af97-aee1-48e6-bd5d-683b67ad2864\") "
Jul 24 21:56:30.193476 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:56:30.193300    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1596af97-aee1-48e6-bd5d-683b67ad2864-kube-rbac-proxy-sar-config\") pod \"1596af97-aee1-48e6-bd5d-683b67ad2864\" (UID: \"1596af97-aee1-48e6-bd5d-683b67ad2864\") "
Jul 24 21:56:30.193476 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:56:30.193371    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1596af97-aee1-48e6-bd5d-683b67ad2864-proxy-tls\") pod \"1596af97-aee1-48e6-bd5d-683b67ad2864\" (UID: \"1596af97-aee1-48e6-bd5d-683b67ad2864\") "
Jul 24 21:56:30.193700 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:56:30.193675    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1596af97-aee1-48e6-bd5d-683b67ad2864-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "1596af97-aee1-48e6-bd5d-683b67ad2864" (UID: "1596af97-aee1-48e6-bd5d-683b67ad2864"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:56:30.195626 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:56:30.195596    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1596af97-aee1-48e6-bd5d-683b67ad2864-kube-api-access-b5cnn" (OuterVolumeSpecName: "kube-api-access-b5cnn") pod "1596af97-aee1-48e6-bd5d-683b67ad2864" (UID: "1596af97-aee1-48e6-bd5d-683b67ad2864"). InnerVolumeSpecName "kube-api-access-b5cnn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 21:56:30.195626 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:56:30.195595    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1596af97-aee1-48e6-bd5d-683b67ad2864-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "1596af97-aee1-48e6-bd5d-683b67ad2864" (UID: "1596af97-aee1-48e6-bd5d-683b67ad2864"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 21:56:30.287747 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:56:30.287719    2561 generic.go:356] "Generic (PLEG): container finished" podID="1596af97-aee1-48e6-bd5d-683b67ad2864" containerID="d7c85ee26f7cae54a30154ea762c2ea0a2a9eb7f6fea1fb5d35833a568a3ea21" exitCode=0
Jul 24 21:56:30.287859 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:56:30.287773    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j"
Jul 24 21:56:30.287859 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:56:30.287811    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j" event={"ID":"1596af97-aee1-48e6-bd5d-683b67ad2864","Type":"ContainerDied","Data":"d7c85ee26f7cae54a30154ea762c2ea0a2a9eb7f6fea1fb5d35833a568a3ea21"}
Jul 24 21:56:30.287939 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:56:30.287878    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j" event={"ID":"1596af97-aee1-48e6-bd5d-683b67ad2864","Type":"ContainerDied","Data":"1f0c880ce5b5b6db2d43eb8ab9b3e227994be2d92671a8f743d783da5ac0d511"}
Jul 24 21:56:30.287939 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:56:30.287916    2561 scope.go:117] "RemoveContainer" containerID="e795b6bdad745547772a1aaa18f16ef765de0c38325558d1a35aae108a8bb58e"
Jul 24 21:56:30.293934 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:56:30.293901    2561 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1596af97-aee1-48e6-bd5d-683b67ad2864-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:56:30.293934 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:56:30.293932    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1596af97-aee1-48e6-bd5d-683b67ad2864-proxy-tls\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:56:30.294073 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:56:30.293947    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5cnn\" (UniqueName: \"kubernetes.io/projected/1596af97-aee1-48e6-bd5d-683b67ad2864-kube-api-access-b5cnn\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 21:56:30.296897 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:56:30.296882    2561 scope.go:117] "RemoveContainer" containerID="d7c85ee26f7cae54a30154ea762c2ea0a2a9eb7f6fea1fb5d35833a568a3ea21"
Jul 24 21:56:30.304500 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:56:30.304478    2561 scope.go:117] "RemoveContainer" containerID="e795b6bdad745547772a1aaa18f16ef765de0c38325558d1a35aae108a8bb58e"
Jul 24 21:56:30.304755 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:56:30.304738    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e795b6bdad745547772a1aaa18f16ef765de0c38325558d1a35aae108a8bb58e\": container with ID starting with e795b6bdad745547772a1aaa18f16ef765de0c38325558d1a35aae108a8bb58e not found: ID does not exist" containerID="e795b6bdad745547772a1aaa18f16ef765de0c38325558d1a35aae108a8bb58e"
Jul 24 21:56:30.304810 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:56:30.304765    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e795b6bdad745547772a1aaa18f16ef765de0c38325558d1a35aae108a8bb58e"} err="failed to get container status \"e795b6bdad745547772a1aaa18f16ef765de0c38325558d1a35aae108a8bb58e\": rpc error: code = NotFound desc = could not find container \"e795b6bdad745547772a1aaa18f16ef765de0c38325558d1a35aae108a8bb58e\": container with ID starting with e795b6bdad745547772a1aaa18f16ef765de0c38325558d1a35aae108a8bb58e not found: ID does not exist"
Jul 24 21:56:30.304810 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:56:30.304782    2561 scope.go:117] "RemoveContainer" containerID="d7c85ee26f7cae54a30154ea762c2ea0a2a9eb7f6fea1fb5d35833a568a3ea21"
Jul 24 21:56:30.304999 ip-10-0-137-226 kubenswrapper[2561]: E0724 21:56:30.304984    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7c85ee26f7cae54a30154ea762c2ea0a2a9eb7f6fea1fb5d35833a568a3ea21\": container with ID starting with d7c85ee26f7cae54a30154ea762c2ea0a2a9eb7f6fea1fb5d35833a568a3ea21 not found: ID does not exist" containerID="d7c85ee26f7cae54a30154ea762c2ea0a2a9eb7f6fea1fb5d35833a568a3ea21"
Jul 24 21:56:30.305040 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:56:30.305006    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7c85ee26f7cae54a30154ea762c2ea0a2a9eb7f6fea1fb5d35833a568a3ea21"} err="failed to get container status \"d7c85ee26f7cae54a30154ea762c2ea0a2a9eb7f6fea1fb5d35833a568a3ea21\": rpc error: code = NotFound desc = could not find container \"d7c85ee26f7cae54a30154ea762c2ea0a2a9eb7f6fea1fb5d35833a568a3ea21\": container with ID starting with d7c85ee26f7cae54a30154ea762c2ea0a2a9eb7f6fea1fb5d35833a568a3ea21 not found: ID does not exist"
Jul 24 21:56:30.310173 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:56:30.310154    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j"]
Jul 24 21:56:30.315321 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:56:30.315290    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-bce0e-predictor-9867f5768-ttq7j"]
Jul 24 21:56:31.952908 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:56:31.952878    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1596af97-aee1-48e6-bd5d-683b67ad2864" path="/var/lib/kubelet/pods/1596af97-aee1-48e6-bd5d-683b67ad2864/volumes"
Jul 24 21:59:44.086347 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:59:44.086215    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nsjrg_87f18cf4-62ce-48a0-99b0-fe22bc19f701/console-operator/1.log"
Jul 24 21:59:44.091805 ip-10-0-137-226 kubenswrapper[2561]: I0724 21:59:44.091781    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nsjrg_87f18cf4-62ce-48a0-99b0-fe22bc19f701/console-operator/1.log"
Jul 24 22:04:11.518139 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:11.518054    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt"]
Jul 24 22:04:11.518732 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:11.518361    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt" podUID="751d85fc-12f4-44b5-8106-42e38a8743de" containerName="kserve-container" containerID="cri-o://ba1d34be80ac76ef29faeb4806541b8695c6219010d6bdb3ac9375d2b0c038a1" gracePeriod=30
Jul 24 22:04:11.518732 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:11.518407    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt" podUID="751d85fc-12f4-44b5-8106-42e38a8743de" containerName="kube-rbac-proxy" containerID="cri-o://71ad407d5cf7577c29344c6f7111c6a67f5ad1b79ef4d63a7250b880bcb7420e" gracePeriod=30
Jul 24 22:04:12.355217 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:12.355172    2561 generic.go:356] "Generic (PLEG): container finished" podID="751d85fc-12f4-44b5-8106-42e38a8743de" containerID="71ad407d5cf7577c29344c6f7111c6a67f5ad1b79ef4d63a7250b880bcb7420e" exitCode=2
Jul 24 22:04:12.355217 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:12.355239    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt" event={"ID":"751d85fc-12f4-44b5-8106-42e38a8743de","Type":"ContainerDied","Data":"71ad407d5cf7577c29344c6f7111c6a67f5ad1b79ef4d63a7250b880bcb7420e"}
Jul 24 22:04:14.765337 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:14.765312    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt"
Jul 24 22:04:14.818712 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:14.818682    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/751d85fc-12f4-44b5-8106-42e38a8743de-proxy-tls\") pod \"751d85fc-12f4-44b5-8106-42e38a8743de\" (UID: \"751d85fc-12f4-44b5-8106-42e38a8743de\") "
Jul 24 22:04:14.818878 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:14.818751    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/751d85fc-12f4-44b5-8106-42e38a8743de-kube-rbac-proxy-sar-config\") pod \"751d85fc-12f4-44b5-8106-42e38a8743de\" (UID: \"751d85fc-12f4-44b5-8106-42e38a8743de\") "
Jul 24 22:04:14.818878 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:14.818821    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dt8jz\" (UniqueName: \"kubernetes.io/projected/751d85fc-12f4-44b5-8106-42e38a8743de-kube-api-access-dt8jz\") pod \"751d85fc-12f4-44b5-8106-42e38a8743de\" (UID: \"751d85fc-12f4-44b5-8106-42e38a8743de\") "
Jul 24 22:04:14.819157 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:14.819130    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/751d85fc-12f4-44b5-8106-42e38a8743de-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "751d85fc-12f4-44b5-8106-42e38a8743de" (UID: "751d85fc-12f4-44b5-8106-42e38a8743de"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 22:04:14.820983 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:14.820957    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/751d85fc-12f4-44b5-8106-42e38a8743de-kube-api-access-dt8jz" (OuterVolumeSpecName: "kube-api-access-dt8jz") pod "751d85fc-12f4-44b5-8106-42e38a8743de" (UID: "751d85fc-12f4-44b5-8106-42e38a8743de"). InnerVolumeSpecName "kube-api-access-dt8jz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 22:04:14.820983 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:14.820974    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/751d85fc-12f4-44b5-8106-42e38a8743de-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "751d85fc-12f4-44b5-8106-42e38a8743de" (UID: "751d85fc-12f4-44b5-8106-42e38a8743de"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 22:04:14.919714 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:14.919679    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dt8jz\" (UniqueName: \"kubernetes.io/projected/751d85fc-12f4-44b5-8106-42e38a8743de-kube-api-access-dt8jz\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 22:04:14.919714 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:14.919711    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/751d85fc-12f4-44b5-8106-42e38a8743de-proxy-tls\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 22:04:14.919917 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:14.919724    2561 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/751d85fc-12f4-44b5-8106-42e38a8743de-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Jul 24 22:04:15.369540 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:15.369506    2561 generic.go:356] "Generic (PLEG): container finished" podID="751d85fc-12f4-44b5-8106-42e38a8743de" containerID="ba1d34be80ac76ef29faeb4806541b8695c6219010d6bdb3ac9375d2b0c038a1" exitCode=0
Jul 24 22:04:15.369751 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:15.369556    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt" event={"ID":"751d85fc-12f4-44b5-8106-42e38a8743de","Type":"ContainerDied","Data":"ba1d34be80ac76ef29faeb4806541b8695c6219010d6bdb3ac9375d2b0c038a1"}
Jul 24 22:04:15.369751 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:15.369564    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt"
Jul 24 22:04:15.369751 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:15.369606    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt" event={"ID":"751d85fc-12f4-44b5-8106-42e38a8743de","Type":"ContainerDied","Data":"5e3b4594330324909653e0dc8597bcffbd0d2621403741b733be470098143903"}
Jul 24 22:04:15.369751 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:15.369632    2561 scope.go:117] "RemoveContainer" containerID="71ad407d5cf7577c29344c6f7111c6a67f5ad1b79ef4d63a7250b880bcb7420e"
Jul 24 22:04:15.378789 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:15.378768    2561 scope.go:117] "RemoveContainer" containerID="ba1d34be80ac76ef29faeb4806541b8695c6219010d6bdb3ac9375d2b0c038a1"
Jul 24 22:04:15.386758 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:15.386737    2561 scope.go:117] "RemoveContainer" containerID="71ad407d5cf7577c29344c6f7111c6a67f5ad1b79ef4d63a7250b880bcb7420e"
Jul 24 22:04:15.387025 ip-10-0-137-226 kubenswrapper[2561]: E0724 22:04:15.387006    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71ad407d5cf7577c29344c6f7111c6a67f5ad1b79ef4d63a7250b880bcb7420e\": container with ID starting with 71ad407d5cf7577c29344c6f7111c6a67f5ad1b79ef4d63a7250b880bcb7420e not found: ID does not exist" containerID="71ad407d5cf7577c29344c6f7111c6a67f5ad1b79ef4d63a7250b880bcb7420e"
Jul 24 22:04:15.387066 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:15.387036    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71ad407d5cf7577c29344c6f7111c6a67f5ad1b79ef4d63a7250b880bcb7420e"} err="failed to get container status \"71ad407d5cf7577c29344c6f7111c6a67f5ad1b79ef4d63a7250b880bcb7420e\": rpc error: code = NotFound desc = could not find container \"71ad407d5cf7577c29344c6f7111c6a67f5ad1b79ef4d63a7250b880bcb7420e\": container with ID starting with 71ad407d5cf7577c29344c6f7111c6a67f5ad1b79ef4d63a7250b880bcb7420e not found: ID does not exist"
Jul 24 22:04:15.387066 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:15.387055    2561 scope.go:117] "RemoveContainer" containerID="ba1d34be80ac76ef29faeb4806541b8695c6219010d6bdb3ac9375d2b0c038a1"
Jul 24 22:04:15.387294 ip-10-0-137-226 kubenswrapper[2561]: E0724 22:04:15.387274    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba1d34be80ac76ef29faeb4806541b8695c6219010d6bdb3ac9375d2b0c038a1\": container with ID starting with ba1d34be80ac76ef29faeb4806541b8695c6219010d6bdb3ac9375d2b0c038a1 not found: ID does not exist" containerID="ba1d34be80ac76ef29faeb4806541b8695c6219010d6bdb3ac9375d2b0c038a1"
Jul 24 22:04:15.387339 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:15.387303    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba1d34be80ac76ef29faeb4806541b8695c6219010d6bdb3ac9375d2b0c038a1"} err="failed to get container status \"ba1d34be80ac76ef29faeb4806541b8695c6219010d6bdb3ac9375d2b0c038a1\": rpc error: code = NotFound desc = could not find container \"ba1d34be80ac76ef29faeb4806541b8695c6219010d6bdb3ac9375d2b0c038a1\": container with ID starting with ba1d34be80ac76ef29faeb4806541b8695c6219010d6bdb3ac9375d2b0c038a1 not found: ID does not exist"
Jul 24 22:04:15.391583 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:15.391560    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt"]
Jul 24 22:04:15.396996 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:15.396971    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-a916f-predictor-698dc55bcb-b57tt"]
Jul 24 22:04:15.953650 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:15.953609    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="751d85fc-12f4-44b5-8106-42e38a8743de" path="/var/lib/kubelet/pods/751d85fc-12f4-44b5-8106-42e38a8743de/volumes"
Jul 24 22:04:41.320648 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:41.320617    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9x45t/must-gather-g7fq5"]
Jul 24 22:04:41.321023 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:41.320952    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1596af97-aee1-48e6-bd5d-683b67ad2864" containerName="kserve-container"
Jul 24 22:04:41.321023 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:41.320962    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1596af97-aee1-48e6-bd5d-683b67ad2864" containerName="kserve-container"
Jul 24 22:04:41.321023 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:41.320974    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b389104-8e8a-4de4-960b-10bf8781d481" containerName="kserve-container"
Jul 24 22:04:41.321023 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:41.320980    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b389104-8e8a-4de4-960b-10bf8781d481" containerName="kserve-container"
Jul 24 22:04:41.321023 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:41.320992    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b389104-8e8a-4de4-960b-10bf8781d481" containerName="kube-rbac-proxy"
Jul 24 22:04:41.321023 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:41.320997    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b389104-8e8a-4de4-960b-10bf8781d481" containerName="kube-rbac-proxy"
Jul 24 22:04:41.321023 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:41.321008    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="751d85fc-12f4-44b5-8106-42e38a8743de" containerName="kube-rbac-proxy"
Jul 24 22:04:41.321023 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:41.321013    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="751d85fc-12f4-44b5-8106-42e38a8743de" containerName="kube-rbac-proxy"
Jul 24 22:04:41.321023 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:41.321019    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1596af97-aee1-48e6-bd5d-683b67ad2864" containerName="kube-rbac-proxy"
Jul 24 22:04:41.321023 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:41.321024    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1596af97-aee1-48e6-bd5d-683b67ad2864" containerName="kube-rbac-proxy"
Jul 24 22:04:41.321362 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:41.321032    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="751d85fc-12f4-44b5-8106-42e38a8743de" containerName="kserve-container"
Jul 24 22:04:41.321362 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:41.321037    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="751d85fc-12f4-44b5-8106-42e38a8743de" containerName="kserve-container"
Jul 24 22:04:41.321362 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:41.321086    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1596af97-aee1-48e6-bd5d-683b67ad2864" containerName="kserve-container"
Jul 24 22:04:41.321362 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:41.321095    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b389104-8e8a-4de4-960b-10bf8781d481" containerName="kserve-container"
Jul 24 22:04:41.321362 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:41.321101    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="751d85fc-12f4-44b5-8106-42e38a8743de" containerName="kserve-container"
Jul 24 22:04:41.321362 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:41.321107    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="751d85fc-12f4-44b5-8106-42e38a8743de" containerName="kube-rbac-proxy"
Jul 24 22:04:41.321362 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:41.321113    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1596af97-aee1-48e6-bd5d-683b67ad2864" containerName="kube-rbac-proxy"
Jul 24 22:04:41.321362 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:41.321118    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b389104-8e8a-4de4-960b-10bf8781d481" containerName="kube-rbac-proxy"
Jul 24 22:04:41.324134 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:41.324118    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9x45t/must-gather-g7fq5"
Jul 24 22:04:41.326700 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:41.326671    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9x45t\"/\"default-dockercfg-4m76b\""
Jul 24 22:04:41.326926 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:41.326909    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9x45t\"/\"openshift-service-ca.crt\""
Jul 24 22:04:41.327008 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:41.326914    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9x45t\"/\"kube-root-ca.crt\""
Jul 24 22:04:41.335169 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:41.335147    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9x45t/must-gather-g7fq5"]
Jul 24 22:04:41.436557 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:41.436525    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/60793b32-021f-4ba5-8a3e-068b43c30e51-must-gather-output\") pod \"must-gather-g7fq5\" (UID: \"60793b32-021f-4ba5-8a3e-068b43c30e51\") " pod="openshift-must-gather-9x45t/must-gather-g7fq5"
Jul 24 22:04:41.436718 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:41.436641    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm5zv\" (UniqueName: \"kubernetes.io/projected/60793b32-021f-4ba5-8a3e-068b43c30e51-kube-api-access-nm5zv\") pod \"must-gather-g7fq5\" (UID: \"60793b32-021f-4ba5-8a3e-068b43c30e51\") " pod="openshift-must-gather-9x45t/must-gather-g7fq5"
Jul 24 22:04:41.537331 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:41.537301    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm5zv\" (UniqueName: \"kubernetes.io/projected/60793b32-021f-4ba5-8a3e-068b43c30e51-kube-api-access-nm5zv\") pod \"must-gather-g7fq5\" (UID: \"60793b32-021f-4ba5-8a3e-068b43c30e51\") " pod="openshift-must-gather-9x45t/must-gather-g7fq5"
Jul 24 22:04:41.537511 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:41.537339    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/60793b32-021f-4ba5-8a3e-068b43c30e51-must-gather-output\") pod \"must-gather-g7fq5\" (UID: \"60793b32-021f-4ba5-8a3e-068b43c30e51\") " pod="openshift-must-gather-9x45t/must-gather-g7fq5"
Jul 24 22:04:41.537633 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:41.537619    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/60793b32-021f-4ba5-8a3e-068b43c30e51-must-gather-output\") pod \"must-gather-g7fq5\" (UID: \"60793b32-021f-4ba5-8a3e-068b43c30e51\") " pod="openshift-must-gather-9x45t/must-gather-g7fq5"
Jul 24 22:04:41.546388 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:41.546361    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm5zv\" (UniqueName: \"kubernetes.io/projected/60793b32-021f-4ba5-8a3e-068b43c30e51-kube-api-access-nm5zv\") pod \"must-gather-g7fq5\" (UID: \"60793b32-021f-4ba5-8a3e-068b43c30e51\") " pod="openshift-must-gather-9x45t/must-gather-g7fq5"
Jul 24 22:04:41.644673 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:41.644607    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9x45t/must-gather-g7fq5"
Jul 24 22:04:41.772336 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:41.772309    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9x45t/must-gather-g7fq5"]
Jul 24 22:04:41.774945 ip-10-0-137-226 kubenswrapper[2561]: W0724 22:04:41.774909    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60793b32_021f_4ba5_8a3e_068b43c30e51.slice/crio-4579d4660fd820fd263f1476bc9eb1983abf042a2d8aa6c8a1db7a1c0efd2b57 WatchSource:0}: Error finding container 4579d4660fd820fd263f1476bc9eb1983abf042a2d8aa6c8a1db7a1c0efd2b57: Status 404 returned error can't find the container with id 4579d4660fd820fd263f1476bc9eb1983abf042a2d8aa6c8a1db7a1c0efd2b57
Jul 24 22:04:41.776707 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:41.776690    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 22:04:42.493860 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:42.493827    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9x45t/must-gather-g7fq5" event={"ID":"60793b32-021f-4ba5-8a3e-068b43c30e51","Type":"ContainerStarted","Data":"4579d4660fd820fd263f1476bc9eb1983abf042a2d8aa6c8a1db7a1c0efd2b57"}
Jul 24 22:04:43.504191 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:43.504147    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9x45t/must-gather-g7fq5" event={"ID":"60793b32-021f-4ba5-8a3e-068b43c30e51","Type":"ContainerStarted","Data":"619e86029cd0876ef1a207f167538f1c3f5fd7160524c3b8980af4b33de82569"}
Jul 24 22:04:43.504676 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:43.504203    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9x45t/must-gather-g7fq5" event={"ID":"60793b32-021f-4ba5-8a3e-068b43c30e51","Type":"ContainerStarted","Data":"273c3d3dd1e8c0a04c64f24d51e373d70a3d0661e4cbebf1a5b425bd39315168"}
Jul 24 22:04:43.520634 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:43.520569    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9x45t/must-gather-g7fq5" podStartSLOduration=1.714063069 podStartE2EDuration="2.520548554s" totalImagesPullingTime="806.485485ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 22:04:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:04:43.520268685 +0000 UTC m=+2999.964860415" watchObservedRunningTime="2026-07-24 22:04:43.520548554 +0000 UTC m=+2999.965140285"
Jul 24 22:04:43.983016 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:43.982987    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zb8df_78033d56-f0fa-4c50-be00-b86a2e8667e6/global-pull-secret-syncer/0.log"
Jul 24 22:04:44.112060 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:44.111948    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jmzq6_b1b822a6-97f4-48cb-8de9-20e36637d53b/konnectivity-agent/0.log"
Jul 24 22:04:44.123028 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:44.120466    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nsjrg_87f18cf4-62ce-48a0-99b0-fe22bc19f701/console-operator/1.log"
Jul 24 22:04:44.124628 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:44.124558    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nsjrg_87f18cf4-62ce-48a0-99b0-fe22bc19f701/console-operator/1.log"
Jul 24 22:04:44.157211 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:44.157175    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-226.ec2.internal_e4f17126843a86705fdd26207b6a7db0/haproxy/0.log"
Jul 24 22:04:48.821471 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:48.821433    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-9bd6ff4d6-clbgq_9d70963b-1629-4622-918f-8603f9533d22/metrics-server/0.log"
Jul 24 22:04:48.847661 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:48.847603    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-s2lmc_1318bbfb-d91f-4b45-b9c3-6c02f7ac7c0f/monitoring-plugin/0.log"
Jul 24 22:04:49.060195 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:49.060165    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rgr69_4eed8790-d1de-470c-ab2d-f8a7618848c5/node-exporter/0.log"
Jul 24 22:04:49.082704 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:49.082590    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rgr69_4eed8790-d1de-470c-ab2d-f8a7618848c5/kube-rbac-proxy/0.log"
Jul 24 22:04:49.104483 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:49.104454    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rgr69_4eed8790-d1de-470c-ab2d-f8a7618848c5/init-textfile/0.log"
Jul 24 22:04:49.571623 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:49.571596    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-fbfcd779c-shsmf_5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f/telemeter-client/0.log"
Jul 24 22:04:49.607365 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:49.607343    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-fbfcd779c-shsmf_5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f/reload/0.log"
Jul 24 22:04:49.635033 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:49.635007    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-fbfcd779c-shsmf_5b5f4e0e-5d3e-417b-9f6f-1a1fe597f20f/kube-rbac-proxy/0.log"
Jul 24 22:04:49.680667 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:49.680640    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f796fdb98-9vpg7_b0ee441f-50e6-4c37-936e-637360dd3b85/thanos-query/0.log"
Jul 24 22:04:49.714010 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:49.713944    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f796fdb98-9vpg7_b0ee441f-50e6-4c37-936e-637360dd3b85/kube-rbac-proxy-web/0.log"
Jul 24 22:04:49.749409 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:49.749216    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f796fdb98-9vpg7_b0ee441f-50e6-4c37-936e-637360dd3b85/kube-rbac-proxy/0.log"
Jul 24 22:04:49.775058 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:49.775004    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f796fdb98-9vpg7_b0ee441f-50e6-4c37-936e-637360dd3b85/prom-label-proxy/0.log"
Jul 24 22:04:49.800382 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:49.800339    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f796fdb98-9vpg7_b0ee441f-50e6-4c37-936e-637360dd3b85/kube-rbac-proxy-rules/0.log"
Jul 24 22:04:49.825820 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:49.825750    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f796fdb98-9vpg7_b0ee441f-50e6-4c37-936e-637360dd3b85/kube-rbac-proxy-metrics/0.log"
Jul 24 22:04:50.928163 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:50.928121    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-f4gmz_7dbf35e8-d81a-439f-99b3-6bca86301cd9/networking-console-plugin/0.log"
Jul 24 22:04:51.398517 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:51.398488    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nsjrg_87f18cf4-62ce-48a0-99b0-fe22bc19f701/console-operator/1.log"
Jul 24 22:04:51.405158 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:51.405133    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nsjrg_87f18cf4-62ce-48a0-99b0-fe22bc19f701/console-operator/2.log"
Jul 24 22:04:51.784645 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:51.784619    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6845b948c7-zw4nl_b7b0e951-2cff-4974-a9cc-ec547470b1c9/console/0.log"
Jul 24 22:04:51.828201 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:51.828168    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-v7wlt_5df1f115-30a2-4f8a-934e-22d4596da803/download-server/0.log"
Jul 24 22:04:52.054846 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:52.054760    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9x45t/perf-node-gather-daemonset-m7hwg"]
Jul 24 22:04:52.063724 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:52.063696    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9x45t/perf-node-gather-daemonset-m7hwg"
Jul 24 22:04:52.067956 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:52.067831    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9x45t/perf-node-gather-daemonset-m7hwg"]
Jul 24 22:04:52.153195 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:52.152916    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a432eb0f-db8e-45c3-9fb6-cdb39fa511a0-proc\") pod \"perf-node-gather-daemonset-m7hwg\" (UID: \"a432eb0f-db8e-45c3-9fb6-cdb39fa511a0\") " pod="openshift-must-gather-9x45t/perf-node-gather-daemonset-m7hwg"
Jul 24 22:04:52.153195 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:52.153013    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a432eb0f-db8e-45c3-9fb6-cdb39fa511a0-sys\") pod \"perf-node-gather-daemonset-m7hwg\" (UID: \"a432eb0f-db8e-45c3-9fb6-cdb39fa511a0\") " pod="openshift-must-gather-9x45t/perf-node-gather-daemonset-m7hwg"
Jul 24 22:04:52.153195 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:52.153062    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a432eb0f-db8e-45c3-9fb6-cdb39fa511a0-podres\") pod \"perf-node-gather-daemonset-m7hwg\" (UID: \"a432eb0f-db8e-45c3-9fb6-cdb39fa511a0\") " pod="openshift-must-gather-9x45t/perf-node-gather-daemonset-m7hwg"
Jul 24 22:04:52.153195 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:52.153088    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a432eb0f-db8e-45c3-9fb6-cdb39fa511a0-lib-modules\") pod \"perf-node-gather-daemonset-m7hwg\" (UID: \"a432eb0f-db8e-45c3-9fb6-cdb39fa511a0\") " pod="openshift-must-gather-9x45t/perf-node-gather-daemonset-m7hwg"
Jul 24 22:04:52.153195 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:52.153114    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ctpz\" (UniqueName: \"kubernetes.io/projected/a432eb0f-db8e-45c3-9fb6-cdb39fa511a0-kube-api-access-4ctpz\") pod \"perf-node-gather-daemonset-m7hwg\" (UID: \"a432eb0f-db8e-45c3-9fb6-cdb39fa511a0\") " pod="openshift-must-gather-9x45t/perf-node-gather-daemonset-m7hwg"
Jul 24 22:04:52.254904 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:52.254423    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a432eb0f-db8e-45c3-9fb6-cdb39fa511a0-sys\") pod \"perf-node-gather-daemonset-m7hwg\" (UID: \"a432eb0f-db8e-45c3-9fb6-cdb39fa511a0\") " pod="openshift-must-gather-9x45t/perf-node-gather-daemonset-m7hwg"
Jul 24 22:04:52.254904 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:52.254501    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a432eb0f-db8e-45c3-9fb6-cdb39fa511a0-podres\") pod \"perf-node-gather-daemonset-m7hwg\" (UID: \"a432eb0f-db8e-45c3-9fb6-cdb39fa511a0\") " pod="openshift-must-gather-9x45t/perf-node-gather-daemonset-m7hwg"
Jul 24 22:04:52.254904 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:52.254532    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a432eb0f-db8e-45c3-9fb6-cdb39fa511a0-lib-modules\") pod \"perf-node-gather-daemonset-m7hwg\" (UID: \"a432eb0f-db8e-45c3-9fb6-cdb39fa511a0\") " pod="openshift-must-gather-9x45t/perf-node-gather-daemonset-m7hwg"
Jul 24 22:04:52.254904 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:52.254560    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ctpz\" (UniqueName: \"kubernetes.io/projected/a432eb0f-db8e-45c3-9fb6-cdb39fa511a0-kube-api-access-4ctpz\") pod \"perf-node-gather-daemonset-m7hwg\" (UID: \"a432eb0f-db8e-45c3-9fb6-cdb39fa511a0\") " pod="openshift-must-gather-9x45t/perf-node-gather-daemonset-m7hwg"
Jul 24 22:04:52.254904 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:52.254620    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a432eb0f-db8e-45c3-9fb6-cdb39fa511a0-proc\") pod \"perf-node-gather-daemonset-m7hwg\" (UID: \"a432eb0f-db8e-45c3-9fb6-cdb39fa511a0\") " pod="openshift-must-gather-9x45t/perf-node-gather-daemonset-m7hwg"
Jul 24 22:04:52.254904 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:52.254762    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a432eb0f-db8e-45c3-9fb6-cdb39fa511a0-proc\") pod \"perf-node-gather-daemonset-m7hwg\" (UID: \"a432eb0f-db8e-45c3-9fb6-cdb39fa511a0\") " pod="openshift-must-gather-9x45t/perf-node-gather-daemonset-m7hwg"
Jul 24 22:04:52.254904 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:52.254824    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a432eb0f-db8e-45c3-9fb6-cdb39fa511a0-sys\") pod \"perf-node-gather-daemonset-m7hwg\" (UID: \"a432eb0f-db8e-45c3-9fb6-cdb39fa511a0\") " pod="openshift-must-gather-9x45t/perf-node-gather-daemonset-m7hwg"
Jul 24 22:04:52.254904 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:52.254846    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a432eb0f-db8e-45c3-9fb6-cdb39fa511a0-podres\") pod \"perf-node-gather-daemonset-m7hwg\" (UID: \"a432eb0f-db8e-45c3-9fb6-cdb39fa511a0\") " pod="openshift-must-gather-9x45t/perf-node-gather-daemonset-m7hwg"
Jul 24 22:04:52.254904 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:52.254852    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a432eb0f-db8e-45c3-9fb6-cdb39fa511a0-lib-modules\") pod \"perf-node-gather-daemonset-m7hwg\" (UID: \"a432eb0f-db8e-45c3-9fb6-cdb39fa511a0\") " pod="openshift-must-gather-9x45t/perf-node-gather-daemonset-m7hwg"
Jul 24 22:04:52.264545 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:52.264522    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ctpz\" (UniqueName: \"kubernetes.io/projected/a432eb0f-db8e-45c3-9fb6-cdb39fa511a0-kube-api-access-4ctpz\") pod \"perf-node-gather-daemonset-m7hwg\" (UID: \"a432eb0f-db8e-45c3-9fb6-cdb39fa511a0\") " pod="openshift-must-gather-9x45t/perf-node-gather-daemonset-m7hwg"
Jul 24 22:04:52.356524 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:52.356449    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-x5hfl_e9728021-57be-4ee8-80a6-cfb8f2ec27aa/volume-data-source-validator/0.log"
Jul 24 22:04:52.378390 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:52.378139    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9x45t/perf-node-gather-daemonset-m7hwg"
Jul 24 22:04:52.543898 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:52.543872    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9x45t/perf-node-gather-daemonset-m7hwg"]
Jul 24 22:04:52.546210 ip-10-0-137-226 kubenswrapper[2561]: W0724 22:04:52.546177    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda432eb0f_db8e_45c3_9fb6_cdb39fa511a0.slice/crio-5ecb666e8fdc147570df896431bfdf78954914068a724e19ac34f7ab6199b6e3 WatchSource:0}: Error finding container 5ecb666e8fdc147570df896431bfdf78954914068a724e19ac34f7ab6199b6e3: Status 404 returned error can't find the container with id 5ecb666e8fdc147570df896431bfdf78954914068a724e19ac34f7ab6199b6e3
Jul 24 22:04:52.561730 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:52.560459    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9x45t/perf-node-gather-daemonset-m7hwg" event={"ID":"a432eb0f-db8e-45c3-9fb6-cdb39fa511a0","Type":"ContainerStarted","Data":"5ecb666e8fdc147570df896431bfdf78954914068a724e19ac34f7ab6199b6e3"}
Jul 24 22:04:53.271042 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:53.271016    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k5vbz_c86f2249-21df-498b-afa2-ff795d234e97/dns/0.log"
Jul 24 22:04:53.292717 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:53.292691    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k5vbz_c86f2249-21df-498b-afa2-ff795d234e97/kube-rbac-proxy/0.log"
Jul 24 22:04:53.358543 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:53.358519    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5jw4h_115c393f-0d8f-4d21-8247-546a7f0bef21/dns-node-resolver/0.log"
Jul 24 22:04:53.570076 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:53.569996    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9x45t/perf-node-gather-daemonset-m7hwg" event={"ID":"a432eb0f-db8e-45c3-9fb6-cdb39fa511a0","Type":"ContainerStarted","Data":"25169277bf5fb3d4cd439247a962fe2b63b06de4b833ba88bd32f87df4d4b4e8"}
Jul 24 22:04:53.571043 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:53.571018    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9x45t/perf-node-gather-daemonset-m7hwg"
Jul 24 22:04:53.589795 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:53.589750    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9x45t/perf-node-gather-daemonset-m7hwg" podStartSLOduration=1.58973496 podStartE2EDuration="1.58973496s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 22:04:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 22:04:53.589212095 +0000 UTC m=+3010.033803850" watchObservedRunningTime="2026-07-24 22:04:53.58973496 +0000 UTC m=+3010.034326690"
Jul 24 22:04:53.848875 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:53.848786    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5498cb8547-jn4vc_a74ed62d-678c-4d60-a2c1-85293b8f31c1/registry/0.log"
Jul 24 22:04:53.899835 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:53.899799    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jnddc_53ed5a58-5ef1-4847-9a34-a06435831d4a/node-ca/0.log"
Jul 24 22:04:54.989398 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:54.989367    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vc495_51dfbcfc-876c-4227-bb8c-15ec65b23e56/serve-healthcheck-canary/0.log"
Jul 24 22:04:55.356884 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:55.356847    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-9p7nm_c2353455-ff61-45d7-8f21-e18e09680380/insights-operator/0.log"
Jul 24 22:04:55.357196 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:55.357181    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-9p7nm_c2353455-ff61-45d7-8f21-e18e09680380/insights-operator/1.log"
Jul 24 22:04:55.386595 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:55.386560    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jrhqv_f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96/kube-rbac-proxy/0.log"
Jul 24 22:04:55.414482 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:55.414453    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jrhqv_f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96/exporter/0.log"
Jul 24 22:04:55.441082 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:55.441059    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jrhqv_f7fcf7b7-9e8e-40a3-b5f7-29e8a7069b96/extractor/0.log"
Jul 24 22:04:57.849408 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:57.849376    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-7b954ffc95-sh59l_6aee5646-91c8-4354-985f-9da42d7110eb/server/0.log"
Jul 24 22:04:57.958095 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:57.958056    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-75d9cdbddf-v9s7f_4e279b73-d916-4eb2-b601-14a8d9dc09cd/manager/0.log"
Jul 24 22:04:57.991440 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:57.991413    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-82bfz_5abca1fc-c22d-4f08-b04d-d2bd15e78660/s3-init/0.log"
Jul 24 22:04:58.006360 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:58.006339    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-82bfz_5abca1fc-c22d-4f08-b04d-d2bd15e78660/download-hf-model/0.log"
Jul 24 22:04:58.036820 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:04:58.036787    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-csqxg_97c449e6-1f88-43e6-8272-aed54ab683d7/seaweedfs/0.log"
Jul 24 22:05:00.588533 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:05:00.588507    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9x45t/perf-node-gather-daemonset-m7hwg"
Jul 24 22:05:02.156128 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:05:02.156096    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-qcxgx_0a7bfbf1-0e0b-485b-a9bd-8434ae053d3f/kube-storage-version-migrator-operator/1.log"
Jul 24 22:05:02.157251 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:05:02.157207    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-qcxgx_0a7bfbf1-0e0b-485b-a9bd-8434ae053d3f/kube-storage-version-migrator-operator/0.log"
Jul 24 22:05:03.176679 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:05:03.176649    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8rtjq_0f7f530a-6040-4754-b0c9-f08325ec5b2e/kube-multus/0.log"
Jul 24 22:05:03.201584 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:05:03.201561    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jhsvn_92b9098e-caea-4f9b-bfb6-d6757c2d19d6/kube-multus-additional-cni-plugins/0.log"
Jul 24 22:05:03.225999 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:05:03.225974    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jhsvn_92b9098e-caea-4f9b-bfb6-d6757c2d19d6/egress-router-binary-copy/0.log"
Jul 24 22:05:03.246999 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:05:03.246942    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jhsvn_92b9098e-caea-4f9b-bfb6-d6757c2d19d6/cni-plugins/0.log"
Jul 24 22:05:03.267893 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:05:03.267873    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jhsvn_92b9098e-caea-4f9b-bfb6-d6757c2d19d6/bond-cni-plugin/0.log"
Jul 24 22:05:03.288150 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:05:03.288127    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jhsvn_92b9098e-caea-4f9b-bfb6-d6757c2d19d6/routeoverride-cni/0.log"
Jul 24 22:05:03.307925 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:05:03.307907    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jhsvn_92b9098e-caea-4f9b-bfb6-d6757c2d19d6/whereabouts-cni-bincopy/0.log"
Jul 24 22:05:03.329147 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:05:03.329123    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jhsvn_92b9098e-caea-4f9b-bfb6-d6757c2d19d6/whereabouts-cni/0.log"
Jul 24 22:05:03.742451 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:05:03.742423    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-25fb5_4ff19854-c536-4ba4-b2fc-29a8f87ff1a7/network-metrics-daemon/0.log"
Jul 24 22:05:03.763739 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:05:03.763713    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-25fb5_4ff19854-c536-4ba4-b2fc-29a8f87ff1a7/kube-rbac-proxy/0.log"
Jul 24 22:05:05.099197 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:05:05.099172    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z4l6m_c360c906-f525-4df3-9776-9b9b6cea64c6/ovn-controller/0.log"
Jul 24 22:05:05.115630 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:05:05.115605    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z4l6m_c360c906-f525-4df3-9776-9b9b6cea64c6/ovn-acl-logging/0.log"
Jul 24 22:05:05.139781 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:05:05.139752    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z4l6m_c360c906-f525-4df3-9776-9b9b6cea64c6/kube-rbac-proxy-node/0.log"
Jul 24 22:05:05.161609 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:05:05.161570    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z4l6m_c360c906-f525-4df3-9776-9b9b6cea64c6/kube-rbac-proxy-ovn-metrics/0.log"
Jul 24 22:05:05.183030 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:05:05.183002    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z4l6m_c360c906-f525-4df3-9776-9b9b6cea64c6/northd/0.log"
Jul 24 22:05:05.240379 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:05:05.240353    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z4l6m_c360c906-f525-4df3-9776-9b9b6cea64c6/nbdb/0.log"
Jul 24 22:05:05.277369 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:05:05.277345    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z4l6m_c360c906-f525-4df3-9776-9b9b6cea64c6/sbdb/0.log"
Jul 24 22:05:05.327914 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:05:05.327882    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z4l6m_c360c906-f525-4df3-9776-9b9b6cea64c6/ovnkube-controller/0.log"
Jul 24 22:05:06.376050 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:05:06.375978    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-l4zhw_35503db5-115c-40a6-a785-ca16352ed1b2/network-check-target-container/0.log"
Jul 24 22:05:07.248526 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:05:07.248499    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-m9952_c38305ec-8b35-4d35-861e-381f6d679ae9/iptables-alerter/0.log"
Jul 24 22:05:07.930434 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:05:07.930404    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-nwlgt_f85fa254-5b39-4c72-878d-8743bdaead48/tuned/0.log"
Jul 24 22:05:09.702889 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:05:09.702856    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-6748489656-pl9b8_294caa54-48f2-4b87-aef7-2eda691fd0e3/cluster-samples-operator/0.log"
Jul 24 22:05:09.720676 ip-10-0-137-226 kubenswrapper[2561]: I0724 22:05:09.720646    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-6748489656-pl9b8_294caa54-48f2-4b87-aef7-2eda691fd0e3/cluster-samples-operator-watch/0.log"