Sep 18 16:46:50.851506 ip-10-0-132-41 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 18 16:46:50.851518 ip-10-0-132-41 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 18 16:46:50.851527 ip-10-0-132-41 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 18 16:46:50.851849 ip-10-0-132-41 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 18 16:47:01.076913 ip-10-0-132-41 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 18 16:47:01.076929 ip-10-0-132-41 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 3e30f656bd4a44ae829e86870ea3571a --
Sep 18 16:48:45.222951 ip-10-0-132-41 systemd[1]: Starting Kubernetes Kubelet...
Sep 18 16:48:48.904748 ip-10-0-132-41 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 16:48:48.904748 ip-10-0-132-41 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 18 16:48:48.904748 ip-10-0-132-41 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 16:48:48.904748 ip-10-0-132-41 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 18 16:48:48.904748 ip-10-0-132-41 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 16:48:48.905567 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.904826    2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 18 16:48:48.908495 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908476    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 16:48:48.908495 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908494    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 16:48:48.908567 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908499    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 16:48:48.908567 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908503    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 16:48:48.908567 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908508    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 16:48:48.908567 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908511    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 16:48:48.908567 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908514    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 16:48:48.908567 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908517    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 16:48:48.908567 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908520    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 16:48:48.908567 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908523    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 16:48:48.908567 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908526    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 16:48:48.908567 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908529    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 16:48:48.908567 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908532    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 16:48:48.908567 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908535    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 16:48:48.908567 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908539    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 16:48:48.908567 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908542    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 16:48:48.908567 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908545    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 16:48:48.908567 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908547    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 16:48:48.908567 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908550    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 16:48:48.908567 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908553    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 16:48:48.908567 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908556    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 16:48:48.908567 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908559    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 16:48:48.909098 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908562    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 16:48:48.909098 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908565    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 16:48:48.909098 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908568    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 16:48:48.909098 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908571    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 16:48:48.909098 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908574    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 16:48:48.909098 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908577    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 16:48:48.909098 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908581    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 16:48:48.909098 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908584    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 16:48:48.909098 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908587    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 16:48:48.909098 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908589    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 16:48:48.909098 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908592    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 16:48:48.909098 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908594    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 16:48:48.909098 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908597    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 16:48:48.909098 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908601    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 16:48:48.909098 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908603    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 16:48:48.909098 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908619    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 16:48:48.909098 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908622    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 16:48:48.909098 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908625    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 16:48:48.909098 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908628    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 16:48:48.909616 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908631    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 16:48:48.909616 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908634    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 16:48:48.909616 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908640    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 16:48:48.909616 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908643    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 16:48:48.909616 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908646    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 16:48:48.909616 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908651    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 16:48:48.909616 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908655    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 16:48:48.909616 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908658    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 16:48:48.909616 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908661    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 16:48:48.909616 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908664    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 16:48:48.909616 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908667    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 16:48:48.909616 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908670    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 16:48:48.909616 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908673    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 16:48:48.909616 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908675    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 16:48:48.909616 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908680    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 16:48:48.909616 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908683    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 16:48:48.909616 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908686    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 16:48:48.909616 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908689    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 16:48:48.909616 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908692    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 16:48:48.910131 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908695    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 16:48:48.910131 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908698    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 16:48:48.910131 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908701    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 16:48:48.910131 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908704    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 16:48:48.910131 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908706    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 16:48:48.910131 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908709    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 16:48:48.910131 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908712    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 16:48:48.910131 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908715    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 16:48:48.910131 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908717    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 16:48:48.910131 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908720    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 16:48:48.910131 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908723    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 16:48:48.910131 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908726    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 16:48:48.910131 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908729    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 16:48:48.910131 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908731    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 16:48:48.910131 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908734    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 16:48:48.910131 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908737    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 16:48:48.910131 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908740    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 16:48:48.910131 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908743    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 16:48:48.910131 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908746    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 16:48:48.910131 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908748    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 16:48:48.910712 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908751    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 16:48:48.910712 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908755    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 16:48:48.910712 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908758    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 16:48:48.910712 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908761    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 16:48:48.910712 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908763    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 16:48:48.910712 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908766    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 16:48:48.910712 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908769    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 16:48:48.910712 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908772    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 16:48:48.910712 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908775    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 16:48:48.910712 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908780    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 16:48:48.910712 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908784    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 16:48:48.910712 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908787    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 16:48:48.910712 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908790    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 16:48:48.910712 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908793    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 16:48:48.910712 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908796    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 16:48:48.910712 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908800    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 16:48:48.910712 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908805    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 16:48:48.910712 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908808    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 16:48:48.910712 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.908811    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 16:48:48.911207 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909547    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 16:48:48.911207 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909554    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 16:48:48.911207 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909557    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 16:48:48.911207 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909560    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 16:48:48.911207 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909563    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 16:48:48.911207 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909567    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 16:48:48.911207 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909569    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 16:48:48.911207 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909572    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 16:48:48.911207 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909575    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 16:48:48.911207 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909578    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 16:48:48.911207 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909581    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 16:48:48.911207 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909584    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 16:48:48.911207 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909588    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 16:48:48.911207 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909591    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 16:48:48.911207 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909594    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 16:48:48.911207 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909596    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 16:48:48.911207 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909599    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 16:48:48.911207 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909602    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 16:48:48.911207 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909621    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 16:48:48.911207 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909625    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 16:48:48.911761 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909628    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 16:48:48.911761 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909631    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 16:48:48.911761 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909634    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 16:48:48.911761 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909637    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 16:48:48.911761 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909640    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 16:48:48.911761 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909643    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 16:48:48.911761 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909646    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 16:48:48.911761 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909649    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 16:48:48.911761 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909652    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 16:48:48.911761 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909655    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 16:48:48.911761 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909658    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 16:48:48.911761 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909660    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 16:48:48.911761 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909663    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 16:48:48.911761 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909666    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 16:48:48.911761 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909669    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 16:48:48.911761 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909672    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 16:48:48.911761 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909674    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 16:48:48.911761 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909677    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 16:48:48.911761 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909680    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 16:48:48.911761 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909684    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 16:48:48.912289 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909687    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 16:48:48.912289 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909690    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 16:48:48.912289 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909692    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 16:48:48.912289 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909695    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 16:48:48.912289 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909698    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 16:48:48.912289 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909701    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 16:48:48.912289 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909704    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 16:48:48.912289 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909706    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 16:48:48.912289 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909709    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 16:48:48.912289 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909712    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 16:48:48.912289 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909714    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 16:48:48.912289 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909717    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 16:48:48.912289 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909721    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 16:48:48.912289 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909724    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 16:48:48.912289 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909727    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 16:48:48.912289 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909730    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 16:48:48.912289 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909734    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 16:48:48.912289 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909737    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 16:48:48.912289 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909739    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 16:48:48.912289 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909742    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 16:48:48.912842 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909745    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 16:48:48.912842 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909750    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 16:48:48.912842 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909754    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 16:48:48.912842 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909757    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 16:48:48.912842 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909760    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 16:48:48.912842 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909763    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 16:48:48.912842 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909766    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 16:48:48.912842 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909769    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 16:48:48.912842 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909771    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 16:48:48.912842 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909774    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 16:48:48.912842 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909777    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 16:48:48.912842 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909780    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 16:48:48.912842 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909783    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 16:48:48.912842 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909786    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 16:48:48.912842 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909789    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 16:48:48.912842 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909792    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 16:48:48.912842 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909795    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 16:48:48.912842 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909798    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 16:48:48.912842 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909800    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 16:48:48.912842 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909803    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 16:48:48.913368 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909807    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 16:48:48.913368 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909810    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 16:48:48.913368 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909813    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 16:48:48.913368 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909816    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 16:48:48.913368 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909819    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 16:48:48.913368 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909822    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 16:48:48.913368 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909825    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 16:48:48.913368 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909829    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 16:48:48.913368 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909834    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 16:48:48.913368 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909837    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 16:48:48.913368 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909840    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 16:48:48.913368 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909842    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 16:48:48.913368 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909847    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 16:48:48.913368 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909850    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 16:48:48.913368 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909853    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 16:48:48.913368 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909856    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 16:48:48.913368 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909859    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 16:48:48.913368 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909862    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 16:48:48.913368 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.909865    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 16:48:48.913874 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910281    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 16:48:48.913874 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910286    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 16:48:48.913874 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910290    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 16:48:48.913874 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910293    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 16:48:48.913874 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910297    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 16:48:48.913874 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910300    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 16:48:48.913874 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910303    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 16:48:48.913874 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910306    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 16:48:48.913874 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910309    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 16:48:48.913874 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910312    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 16:48:48.913874 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910315    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 16:48:48.913874 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910318    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 16:48:48.913874 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910321    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 16:48:48.913874 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910324    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 16:48:48.913874 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910327    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 16:48:48.913874 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910329    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 16:48:48.913874 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910332    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 16:48:48.913874 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910335    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 16:48:48.913874 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910338    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 16:48:48.913874 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910341    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 16:48:48.914398 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910344    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 16:48:48.914398 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910347    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 16:48:48.914398 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910350    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 16:48:48.914398 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910352    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 16:48:48.914398 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910355    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 16:48:48.914398 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910358    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 16:48:48.914398 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910361    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 16:48:48.914398 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910364    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 16:48:48.914398 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910366    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 16:48:48.914398 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910369    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 16:48:48.914398 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910372    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 16:48:48.914398 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910375    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 16:48:48.914398 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910378    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 16:48:48.914398 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910381    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 16:48:48.914398 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910384    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 16:48:48.914398 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910387    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 16:48:48.914398 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910390    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 16:48:48.914398 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910393    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 16:48:48.914398 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910396    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 16:48:48.914398 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910399    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 16:48:48.914942 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910401    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 16:48:48.914942 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910405    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 16:48:48.914942 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910407    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 16:48:48.914942 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910410    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 16:48:48.914942 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910412    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 16:48:48.914942 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910415    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 16:48:48.914942 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910418    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 16:48:48.914942 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910423    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 16:48:48.914942 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910426    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 16:48:48.914942 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910429    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 16:48:48.914942 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910432    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 16:48:48.914942 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910435    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 16:48:48.914942 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910439    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 16:48:48.914942 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910442    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 16:48:48.914942 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910446    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 16:48:48.914942 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910449    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 16:48:48.914942 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910452    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 16:48:48.914942 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910455    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 16:48:48.914942 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910458    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 16:48:48.915425 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910461    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 16:48:48.915425 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910463    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 16:48:48.915425 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910466    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 16:48:48.915425 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910469    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 16:48:48.915425 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910472    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 16:48:48.915425 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910475    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 16:48:48.915425 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910478    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 16:48:48.915425 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910481    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 16:48:48.915425 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910484    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 16:48:48.915425 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910487    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 16:48:48.915425 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910489    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 16:48:48.915425 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910493    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 16:48:48.915425 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910495    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 16:48:48.915425 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910498    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 16:48:48.915425 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910501    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 16:48:48.915425 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910504    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 16:48:48.915425 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910507    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 16:48:48.915425 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910510    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 16:48:48.915425 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910512    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 16:48:48.915425 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910515    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 16:48:48.916030 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910518    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 16:48:48.916030 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910520    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 16:48:48.916030 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910523    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 16:48:48.916030 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910526    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 16:48:48.916030 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910528    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 16:48:48.916030 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910531    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 16:48:48.916030 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910534    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 16:48:48.916030 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910536    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 16:48:48.916030 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910540    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 16:48:48.916030 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910542    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 16:48:48.916030 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910545    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 16:48:48.916030 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910547    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 16:48:48.916030 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910550    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 16:48:48.916030 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910553    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 16:48:48.916030 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910556    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 16:48:48.916030 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910559    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 16:48:48.916030 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910562    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 16:48:48.916030 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910569    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 16:48:48.916030 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910572    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 16:48:48.916536 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.910575    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 16:48:48.916536 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910674    2577 flags.go:64] FLAG: --address="0.0.0.0"
Sep 18 16:48:48.916536 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910708    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 18 16:48:48.916536 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910715    2577 flags.go:64] FLAG: --anonymous-auth="true"
Sep 18 16:48:48.916536 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910720    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 18 16:48:48.916536 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910726    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 18 16:48:48.916536 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910729    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 18 16:48:48.916536 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910734    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 18 16:48:48.916536 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910739    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 18 16:48:48.916536 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910742    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 18 16:48:48.916536 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910745    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 18 16:48:48.916536 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910749    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 18 16:48:48.916536 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910753    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 18 16:48:48.916536 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910757    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 18 16:48:48.916536 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910760    2577 flags.go:64] FLAG: --cgroup-root=""
Sep 18 16:48:48.916536 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910764    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 18 16:48:48.916536 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910767    2577 flags.go:64] FLAG: --client-ca-file=""
Sep 18 16:48:48.916536 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910770    2577 flags.go:64] FLAG: --cloud-provider="external"
Sep 18 16:48:48.916536 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910773    2577 flags.go:64] FLAG: --cluster-dns="[]"
Sep 18 16:48:48.916536 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910778    2577 flags.go:64] FLAG: --cluster-domain=""
Sep 18 16:48:48.916536 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910781    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 18 16:48:48.916536 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910785    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 18 16:48:48.916536 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910788    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 18 16:48:48.916536 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910792    2577 flags.go:64] FLAG: --container-log-max-files="5"
Sep 18 16:48:48.917185 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910800    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 18 16:48:48.917185 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910803    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 18 16:48:48.917185 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910807    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 18 16:48:48.917185 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910813    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 18 16:48:48.917185 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910816    2577 flags.go:64] FLAG: --contention-profiling="false"
Sep 18 16:48:48.917185 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910819    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 18 16:48:48.917185 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910824    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 18 16:48:48.917185 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910828    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 18 16:48:48.917185 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910831    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 18 16:48:48.917185 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910835    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 18 16:48:48.917185 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910838    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 18 16:48:48.917185 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910842    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 18 16:48:48.917185 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910845    2577 flags.go:64] FLAG: --enable-load-reader="false"
Sep 18 16:48:48.917185 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910849    2577 flags.go:64] FLAG: --enable-server="true"
Sep 18 16:48:48.917185 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910852    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 18 16:48:48.917185 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910857    2577 flags.go:64] FLAG: --event-burst="100"
Sep 18 16:48:48.917185 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910860    2577 flags.go:64] FLAG: --event-qps="50"
Sep 18 16:48:48.917185 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910864    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 18 16:48:48.917185 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910867    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 18 16:48:48.917185 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910870    2577 flags.go:64] FLAG: --eviction-hard=""
Sep 18 16:48:48.917185 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910874    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 18 16:48:48.917185 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910877    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 18 16:48:48.917185 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910880    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 18 16:48:48.917185 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910884    2577 flags.go:64] FLAG: --eviction-soft=""
Sep 18 16:48:48.917185 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910887    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 18 16:48:48.917847 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910890    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 18 16:48:48.917847 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910893    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 18 16:48:48.917847 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910896    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 18 16:48:48.917847 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910900    2577 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 18 16:48:48.917847 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910903    2577 flags.go:64] FLAG: --fail-swap-on="true"
Sep 18 16:48:48.917847 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910906    2577 flags.go:64] FLAG: --feature-gates=""
Sep 18 16:48:48.917847 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910909    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 18 16:48:48.917847 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910913    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 18 16:48:48.917847 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910916    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 18 16:48:48.917847 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910920    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 18 16:48:48.917847 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910925    2577 flags.go:64] FLAG: --healthz-port="10248"
Sep 18 16:48:48.917847 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910928    2577 flags.go:64] FLAG: --help="false"
Sep 18 16:48:48.917847 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910931    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-132-41.ec2.internal"
Sep 18 16:48:48.917847 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910936    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 18 16:48:48.917847 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910940    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 18 16:48:48.917847 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910943    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 18 16:48:48.917847 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910946    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 18 16:48:48.917847 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910950    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 18 16:48:48.917847 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910953    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 18 16:48:48.917847 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910956    2577 flags.go:64] FLAG: --image-service-endpoint=""
Sep 18 16:48:48.917847 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910959    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 18 16:48:48.917847 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910963    2577 flags.go:64] FLAG: --kube-api-burst="100"
Sep 18 16:48:48.917847 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910967    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 18 16:48:48.918480 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910970    2577 flags.go:64] FLAG: --kube-api-qps="50"
Sep 18 16:48:48.918480 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910974    2577 flags.go:64] FLAG: --kube-reserved=""
Sep 18 16:48:48.918480 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910977    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 18 16:48:48.918480 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910980    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 18 16:48:48.918480 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910984    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 18 16:48:48.918480 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910987    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 18 16:48:48.918480 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910990    2577 flags.go:64] FLAG: --lock-file=""
Sep 18 16:48:48.918480 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910993    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 18 16:48:48.918480 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910996    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 18 16:48:48.918480 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.910999    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 18 16:48:48.918480 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911005    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 18 16:48:48.918480 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911008    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 18 16:48:48.918480 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911012    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 18 16:48:48.918480 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911015    2577 flags.go:64] FLAG: --logging-format="text"
Sep 18 16:48:48.918480 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911018    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 18 16:48:48.918480 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911021    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 18 16:48:48.918480 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911025    2577 flags.go:64] FLAG: --manifest-url=""
Sep 18 16:48:48.918480 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911028    2577 flags.go:64] FLAG: --manifest-url-header=""
Sep 18 16:48:48.918480 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911032    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 18 16:48:48.918480 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911037    2577 flags.go:64] FLAG: --max-open-files="1000000"
Sep 18 16:48:48.918480 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911041    2577 flags.go:64] FLAG: --max-pods="110"
Sep 18 16:48:48.918480 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911044    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 18 16:48:48.918480 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911049    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 18 16:48:48.918480 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911052    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 18 16:48:48.918480 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911055    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 18 16:48:48.919275 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911059    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 18 16:48:48.919275 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911062    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 18 16:48:48.919275 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911065    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 18 16:48:48.919275 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911072    2577 flags.go:64] FLAG: --node-status-max-images="50"
Sep 18 16:48:48.919275 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911076    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 18 16:48:48.919275 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911079    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 18 16:48:48.919275 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911082    2577 flags.go:64] FLAG: --pod-cidr=""
Sep 18 16:48:48.919275 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911086    2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 18 16:48:48.919275 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911092    2577 flags.go:64] FLAG: --pod-manifest-path=""
Sep 18 16:48:48.919275 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911095    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 18 16:48:48.919275 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911099    2577 flags.go:64] FLAG: --pods-per-core="0"
Sep 18 16:48:48.919275 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911102    2577 flags.go:64] FLAG: --port="10250"
Sep 18 16:48:48.919275 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911105    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 18 16:48:48.919275 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911109    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08c8db46e20f72bbe"
Sep 18 16:48:48.919275 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911112    2577 flags.go:64] FLAG: --qos-reserved=""
Sep 18 16:48:48.919275 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911115    2577 flags.go:64] FLAG: --read-only-port="10255"
Sep 18 16:48:48.919275 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911119    2577 flags.go:64] FLAG: --register-node="true"
Sep 18 16:48:48.919275 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911122    2577 flags.go:64] FLAG: --register-with-taints=""
Sep 18 16:48:48.919275 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911126    2577 flags.go:64] FLAG: --registry-burst="10"
Sep 18 16:48:48.919275 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911129    2577 flags.go:64] FLAG: --registry-qps="5"
Sep 18 16:48:48.919275 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911131    2577 flags.go:64] FLAG: --reserved-cpus=""
Sep 18 16:48:48.919275 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911134    2577 flags.go:64] FLAG: --reserved-memory=""
Sep 18 16:48:48.919275 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911138    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 18 16:48:48.919275 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911142    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 18 16:48:48.919275 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911145    2577 flags.go:64] FLAG: --rotate-certificates="false"
Sep 18 16:48:48.919988 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911148    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 18 16:48:48.919988 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911151    2577 flags.go:64] FLAG: --runonce="false"
Sep 18 16:48:48.919988 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911155    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 18 16:48:48.919988 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911159    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 18 16:48:48.919988 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911163    2577 flags.go:64] FLAG: --seccomp-default="false"
Sep 18 16:48:48.919988 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911166    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 18 16:48:48.919988 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911169    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 18 16:48:48.919988 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911173    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 18 16:48:48.919988 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911176    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 18 16:48:48.919988 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911180    2577 flags.go:64] FLAG: --storage-driver-password="root"
Sep 18 16:48:48.919988 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911183    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 18 16:48:48.919988 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911186    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 18 16:48:48.919988 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911189    2577 flags.go:64] FLAG: --storage-driver-user="root"
Sep 18 16:48:48.919988 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911193    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 18 16:48:48.919988 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911196    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 18 16:48:48.919988 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911200    2577 flags.go:64] FLAG: --system-cgroups=""
Sep 18 16:48:48.919988 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911203    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 18 16:48:48.919988 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911209    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 18 16:48:48.919988 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911212    2577 flags.go:64] FLAG: --tls-cert-file=""
Sep 18 16:48:48.919988 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911216    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 18 16:48:48.919988 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911221    2577 flags.go:64] FLAG: --tls-min-version=""
Sep 18 16:48:48.919988 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911224    2577 flags.go:64] FLAG: --tls-private-key-file=""
Sep 18 16:48:48.919988 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911227    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 18 16:48:48.919988 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911230    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 18 16:48:48.919988 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911233    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 18 16:48:48.920669 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911237    2577 flags.go:64] FLAG: --v="2"
Sep 18 16:48:48.920669 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911241    2577 flags.go:64] FLAG: --version="false"
Sep 18 16:48:48.920669 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911245    2577 flags.go:64] FLAG: --vmodule=""
Sep 18 16:48:48.920669 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911249    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 18 16:48:48.920669 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.911253    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 18 16:48:48.920669 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911375    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 16:48:48.920669 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911379    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 16:48:48.920669 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911383    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 16:48:48.920669 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911386    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 16:48:48.920669 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911390    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 16:48:48.920669 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911393    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 16:48:48.920669 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911398    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 16:48:48.920669 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911402    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 16:48:48.920669 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911405    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 16:48:48.920669 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911407    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 16:48:48.920669 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911410    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 16:48:48.920669 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911413    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 16:48:48.920669 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911416    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 16:48:48.920669 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911419    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 16:48:48.920669 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911422    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 16:48:48.920669 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911425    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 16:48:48.921275 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911428    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 16:48:48.921275 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911431    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 16:48:48.921275 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911443    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 16:48:48.921275 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911446    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 16:48:48.921275 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911449    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 16:48:48.921275 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911452    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 16:48:48.921275 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911455    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 16:48:48.921275 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911458    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 16:48:48.921275 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911461    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 16:48:48.921275 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911464    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 16:48:48.921275 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911467    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 16:48:48.921275 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911470    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 16:48:48.921275 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911472    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 16:48:48.921275 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911475    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 16:48:48.921275 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911478    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 16:48:48.921275 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911481    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 16:48:48.921275 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911484    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 16:48:48.921275 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911486    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 16:48:48.921275 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911489    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 16:48:48.921275 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911492    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 16:48:48.921813 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911496    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 16:48:48.921813 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911499    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 16:48:48.921813 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911503    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 16:48:48.921813 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911506    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 16:48:48.921813 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911509    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 16:48:48.921813 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911512    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 16:48:48.921813 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911515    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 16:48:48.921813 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911518    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 16:48:48.921813 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911521    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 16:48:48.921813 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911524    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 16:48:48.921813 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911527    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 16:48:48.921813 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911530    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 16:48:48.921813 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911533    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 16:48:48.921813 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911536    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 16:48:48.921813 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911540    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 16:48:48.921813 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911545    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 16:48:48.921813 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911548    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 16:48:48.921813 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911551    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 16:48:48.921813 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911554    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 16:48:48.922309 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911557    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 16:48:48.922309 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911559    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 16:48:48.922309 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911562    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 16:48:48.922309 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911566    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 16:48:48.922309 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911570    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 16:48:48.922309 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911573    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 16:48:48.922309 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911576    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 16:48:48.922309 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911580    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 16:48:48.922309 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911583    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 16:48:48.922309 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911595    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 16:48:48.922309 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911599    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 16:48:48.922309 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911602    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 16:48:48.922309 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911618    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 16:48:48.922309 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911623    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 16:48:48.922309 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911626    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 16:48:48.922309 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911630    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 16:48:48.922309 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911633    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 16:48:48.922309 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911636    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 16:48:48.922309 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911639    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 16:48:48.922309 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911641    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 16:48:48.922926 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911644    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 16:48:48.922926 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911647    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 16:48:48.922926 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911650    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 16:48:48.922926 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911653    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 16:48:48.922926 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911656    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 16:48:48.922926 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911659    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 16:48:48.922926 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911661    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 16:48:48.922926 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911664    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 16:48:48.922926 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911667    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 16:48:48.922926 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911670    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 16:48:48.922926 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911673    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 16:48:48.922926 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911676    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 16:48:48.922926 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911679    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 16:48:48.922926 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911682    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 16:48:48.922926 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911686    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 16:48:48.922926 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911690    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 16:48:48.922926 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911693    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 16:48:48.922926 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911696    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 16:48:48.922926 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911699    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 16:48:48.923467 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911702    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 16:48:48.923467 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911705    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 16:48:48.923467 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911707    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 16:48:48.923467 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911710    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 16:48:48.923467 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.911713    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 16:48:48.923467 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.912560    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 16:48:48.923467 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.920464    2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 18 16:48:48.923467 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.920481    2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 18 16:48:48.923467 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.920495    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 18 16:48:48.923467 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.920501    2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 18 16:48:48.923467 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920570    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 16:48:48.923467 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920575    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 16:48:48.923467 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920580    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 16:48:48.923467 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920583    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 16:48:48.923467 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920586    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 16:48:48.923895 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920589    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 16:48:48.923895 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920593    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 16:48:48.923895 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920595    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 16:48:48.923895 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920599    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 16:48:48.923895 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920601    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 16:48:48.923895 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920621    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 16:48:48.923895 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920626    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 16:48:48.923895 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920630    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 16:48:48.923895 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920633    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 16:48:48.923895 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920636    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 16:48:48.923895 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920639    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 16:48:48.923895 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920642    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 16:48:48.923895 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920645    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 16:48:48.923895 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920648    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 16:48:48.923895 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920651    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 16:48:48.923895 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920654    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 16:48:48.923895 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920656    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 16:48:48.923895 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920659    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 16:48:48.923895 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920662    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 16:48:48.923895 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920664    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 16:48:48.924444 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920668    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 16:48:48.924444 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920670    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 16:48:48.924444 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920673    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 16:48:48.924444 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920676    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 16:48:48.924444 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920680    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 16:48:48.924444 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920683    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 16:48:48.924444 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920686    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 16:48:48.924444 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920689    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 16:48:48.924444 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920693    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 16:48:48.924444 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920698    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 16:48:48.924444 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920701    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 16:48:48.924444 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920704    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 16:48:48.924444 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920707    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 16:48:48.924444 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920710    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 16:48:48.924444 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920713    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 16:48:48.924444 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920716    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 16:48:48.924444 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920718    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 16:48:48.924444 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920721    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 16:48:48.924444 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920724    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 16:48:48.924979 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920727    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 16:48:48.924979 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920730    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 16:48:48.924979 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920733    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 16:48:48.924979 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920736    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 16:48:48.924979 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920739    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 16:48:48.924979 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920742    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 16:48:48.924979 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920744    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 16:48:48.924979 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920747    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 16:48:48.924979 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920750    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 16:48:48.924979 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920754    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 16:48:48.924979 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920758    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 16:48:48.924979 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920761    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 16:48:48.924979 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920765    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 16:48:48.924979 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920767    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 16:48:48.924979 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920770    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 16:48:48.924979 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920773    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 16:48:48.924979 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920776    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 16:48:48.924979 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920780    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 16:48:48.924979 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920784    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 16:48:48.924979 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920786    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 16:48:48.925518 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920789    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 16:48:48.925518 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920792    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 16:48:48.925518 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920794    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 16:48:48.925518 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920797    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 16:48:48.925518 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920800    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 16:48:48.925518 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920803    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 16:48:48.925518 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920806    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 16:48:48.925518 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920808    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 16:48:48.925518 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920811    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 16:48:48.925518 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920814    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 16:48:48.925518 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920817    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 16:48:48.925518 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920820    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 16:48:48.925518 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920822    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 16:48:48.925518 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920825    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 16:48:48.925518 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920828    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 16:48:48.925518 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920831    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 16:48:48.925518 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920835    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 16:48:48.925518 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920838    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 16:48:48.925518 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920840    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 16:48:48.925518 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920843    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 16:48:48.926079 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920846    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 16:48:48.926079 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920849    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 16:48:48.926079 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920852    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 16:48:48.926079 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920855    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 16:48:48.926079 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920857    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 16:48:48.926079 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920860    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 16:48:48.926079 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920863    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 16:48:48.926079 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920865    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 16:48:48.926079 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920868    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 16:48:48.926079 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920871    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 16:48:48.926079 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920874    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 16:48:48.926079 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920879    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 16:48:48.926079 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920882    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 16:48:48.926079 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920885    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 16:48:48.926079 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.920889    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 16:48:48.926471 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.920895    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 16:48:48.926471 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921014    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 16:48:48.926471 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921019    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 16:48:48.926471 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921022    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 16:48:48.926471 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921025    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 16:48:48.926471 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921028    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 16:48:48.926471 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921031    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 16:48:48.926471 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921035    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 16:48:48.926471 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921038    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 16:48:48.926471 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921041    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 16:48:48.926471 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921044    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 16:48:48.926471 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921047    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 16:48:48.926471 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921050    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 16:48:48.926471 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921053    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 16:48:48.926471 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921056    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 16:48:48.926920 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921059    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 16:48:48.926920 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921061    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 16:48:48.926920 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921064    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 16:48:48.926920 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921068    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 16:48:48.926920 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921071    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 16:48:48.926920 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921075    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 16:48:48.926920 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921078    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 16:48:48.926920 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921081    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 16:48:48.926920 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921084    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 16:48:48.926920 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921087    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 16:48:48.926920 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921090    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 16:48:48.926920 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921093    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 16:48:48.926920 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921096    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 16:48:48.926920 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921099    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 16:48:48.926920 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921101    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 16:48:48.926920 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921104    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 16:48:48.926920 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921107    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 16:48:48.926920 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921110    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 16:48:48.926920 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921113    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 16:48:48.926920 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921115    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 16:48:48.927454 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921120    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 16:48:48.927454 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921123    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 16:48:48.927454 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921126    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 16:48:48.927454 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921129    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 16:48:48.927454 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921132    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 16:48:48.927454 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921135    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 16:48:48.927454 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921137    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 16:48:48.927454 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921140    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 16:48:48.927454 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921143    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 16:48:48.927454 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921146    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 16:48:48.927454 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921149    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 16:48:48.927454 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921152    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 16:48:48.927454 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921155    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 16:48:48.927454 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921158    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 16:48:48.927454 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921161    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 16:48:48.927454 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921163    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 16:48:48.927454 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921166    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 16:48:48.927454 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921169    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 16:48:48.927454 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921172    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 16:48:48.927962 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921175    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 16:48:48.927962 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921177    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 16:48:48.927962 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921180    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 16:48:48.927962 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921183    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 16:48:48.927962 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921186    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 16:48:48.927962 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921189    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 16:48:48.927962 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921193    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 16:48:48.927962 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921196    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 16:48:48.927962 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921198    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 16:48:48.927962 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921201    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 16:48:48.927962 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921204    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 16:48:48.927962 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921207    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 16:48:48.927962 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921209    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 16:48:48.927962 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921212    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 16:48:48.927962 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921215    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 16:48:48.927962 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921217    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 16:48:48.927962 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921220    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 16:48:48.927962 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921223    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 16:48:48.927962 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921226    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 16:48:48.927962 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921228    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 16:48:48.928480 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921231    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 16:48:48.928480 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921234    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 16:48:48.928480 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921237    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 16:48:48.928480 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921239    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 16:48:48.928480 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921244    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 16:48:48.928480 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921247    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 16:48:48.928480 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921250    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 16:48:48.928480 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921252    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 16:48:48.928480 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921255    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 16:48:48.928480 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921258    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 16:48:48.928480 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921261    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 16:48:48.928480 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921264    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 16:48:48.928480 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921266    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 16:48:48.928480 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921269    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 16:48:48.928480 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921272    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 16:48:48.928480 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921274    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 16:48:48.928480 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921278    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 16:48:48.928480 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921281    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 16:48:48.928480 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921284    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 16:48:48.928480 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921287    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 16:48:48.929016 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921289    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 16:48:48.929016 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921294    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 16:48:48.929016 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921298    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 16:48:48.929016 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921301    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 16:48:48.929016 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921304    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 16:48:48.929016 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:48.921307    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 16:48:48.929016 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.921312    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 16:48:48.929016 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.921415    2577 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 18 16:48:48.929016 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.923804    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 18 16:48:48.929016 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.924994    2577 server.go:1019] "Starting client certificate rotation"
Sep 18 16:48:48.929016 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.925102    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 18 16:48:48.929016 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.925130    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 18 16:48:48.929467 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.929452    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 18 16:48:48.934413 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.934386    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 18 16:48:48.939570 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.939551    2577 log.go:25] "Validated CRI v1 runtime API"
Sep 18 16:48:48.941333 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.941317    2577 log.go:25] "Validated CRI v1 image API"
Sep 18 16:48:48.942307 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.942289    2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 18 16:48:48.945791 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.945763    2577 fs.go:135] Filesystem UUIDs: map[0c9014a2-3bda-4a5a-9c08-3477b19a09a2:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f1f8f5f0-cbe5-46fa-b359-9c7e446f7a6c:/dev/nvme0n1p3]
Sep 18 16:48:48.945881 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.945790    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 18 16:48:48.950423 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.950299    2577 manager.go:216] Machine: {Timestamp:2026-09-18 16:48:48.949795651 +0000 UTC m=+2.007085173 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3082865 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c4ea8d2826293afb02a9fd2f0f538 SystemUUID:ec2c4ea8-d282-6293-afb0-2a9fd2f0f538 BootID:3e30f656-bd4a-44ae-829e-86870ea3571a Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:dd:60:6e:89 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:dd:60:6e:89 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:7a:e1:2d:19:66 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 18 16:48:48.950423 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.950407    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 18 16:48:48.950596 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.950514    2577 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 18 16:48:48.952445 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.952420    2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 18 16:48:48.952589 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.952448    2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-41.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 18 16:48:48.954144 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.954132    2577 topology_manager.go:138] "Creating topology manager with none policy"
Sep 18 16:48:48.954183 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.954148    2577 container_manager_linux.go:309] "Creating device plugin manager"
Sep 18 16:48:48.954183 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.954156    2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 18 16:48:48.954183 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.954167    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 18 16:48:48.954274 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.954245    2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 18 16:48:48.959124 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.959111    2577 state_mem.go:36] "Initialized new in-memory state store"
Sep 18 16:48:48.959244 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.959235    2577 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 18 16:48:48.959288 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.959272    2577 kubelet.go:486] "Attempting to sync node with API server"
Sep 18 16:48:48.959288 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.959283    2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 18 16:48:48.959343 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.959297    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 18 16:48:48.959343 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.959307    2577 kubelet.go:398] "Adding apiserver pod source"
Sep 18 16:48:48.959343 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.959316    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 18 16:48:48.959709 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.959696    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 18 16:48:48.959758 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.959716    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 18 16:48:48.964390 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.962867    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 18 16:48:48.964740 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.964721    2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 18 16:48:48.967927 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.967912    2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 18 16:48:48.967989 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.967946    2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 18 16:48:48.970508 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:48.970480    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-41.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 18 16:48:48.970632 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:48.970565    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 18 16:48:48.970752 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.970738    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 18 16:48:48.970822 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.970762    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 18 16:48:48.970822 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.970773    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 18 16:48:48.970822 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.970782    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 18 16:48:48.970822 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.970798    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 18 16:48:48.970822 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.970807    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 18 16:48:48.971039 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.970830    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 18 16:48:48.971039 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.970839    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 18 16:48:48.971039 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.970850    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 18 16:48:48.971039 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.970860    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 18 16:48:48.971039 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.970874    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 18 16:48:48.971039 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.970883    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 18 16:48:48.971039 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.970918    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 18 16:48:48.971039 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.970927    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 18 16:48:48.973165 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.973140    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-41.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 18 16:48:48.975010 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.974993    2577 server.go:1268] "Started kubelet"
Sep 18 16:48:48.975096 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.975058    2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 18 16:48:48.975218 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.975162    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 18 16:48:48.975266 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.975242    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 18 16:48:48.975935 ip-10-0-132-41 systemd[1]: Started Kubernetes Kubelet.
Sep 18 16:48:48.976393 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.976288    2577 server.go:310] "Adding debug handlers to kubelet server"
Sep 18 16:48:48.976738 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.976721    2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 18 16:48:48.980051 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:48.980032    2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 18 16:48:48.983632 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.983601    2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 18 16:48:48.983632 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.983625    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 18 16:48:48.983765 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:48.983720    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-41.ec2.internal\" not found"
Sep 18 16:48:48.984391 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.984374    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 18 16:48:48.984475 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.984393    2577 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 18 16:48:48.984475 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.984412    2577 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 18 16:48:48.984602 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.984483    2577 reconstruct.go:97] "Volume reconstruction finished"
Sep 18 16:48:48.984602 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.984491    2577 reconciler.go:29] "Reconciler: start to sync state"
Sep 18 16:48:48.984853 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.984835    2577 factory.go:153] Registering CRI-O factory
Sep 18 16:48:48.984853 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.984854    2577 factory.go:223] Registration of the crio container factory successfully
Sep 18 16:48:48.985014 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.984910    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 18 16:48:48.985014 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.984920    2577 factory.go:55] Registering systemd factory
Sep 18 16:48:48.985014 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.984928    2577 factory.go:223] Registration of the systemd container factory successfully
Sep 18 16:48:48.985014 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.984944    2577 factory.go:103] Registering Raw factory
Sep 18 16:48:48.985014 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.984957    2577 manager.go:1196] Started watching for new ooms in manager
Sep 18 16:48:48.985389 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.985374    2577 manager.go:349] Starting recovery of all containers
Sep 18 16:48:48.991396 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.991363    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 18 16:48:48.993893 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:48.993870    2577 manager.go:354] Recovery completed
Sep 18 16:48:48.994581 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:48.994554    2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-41.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 18 16:48:48.994729 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:48.994708    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 18 16:48:49.019259 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:49.019169    2577 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 18 16:48:49.022695 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.022672    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ls427"
Sep 18 16:48:49.024052 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.024034    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 16:48:49.026058 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.026044    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-41.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 16:48:49.026129 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.026078    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-41.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 16:48:49.026129 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.026090    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-41.ec2.internal" event="NodeHasSufficientPID"
Sep 18 16:48:49.026718 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.026704    2577 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 18 16:48:49.026718 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.026717    2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 18 16:48:49.026822 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.026732    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 16:48:49.026822 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.026738    2577 state_mem.go:36] "Initialized new in-memory state store"
Sep 18 16:48:49.027482 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.027465    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-41.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 16:48:49.027568 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.027494    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-41.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 16:48:49.027568 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.027510    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-41.ec2.internal" event="NodeHasSufficientPID"
Sep 18 16:48:49.028217 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.028203    2577 policy_none.go:49] "None policy: Start"
Sep 18 16:48:49.028270 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.028220    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 18 16:48:49.028270 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.028231    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 18 16:48:49.029478 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.029467    2577 policy_none.go:47] "Start"
Sep 18 16:48:49.031928 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.031780    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ls427"
Sep 18 16:48:49.060650 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:49.023956    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-41.ec2.internal.18d6784282432530  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-41.ec2.internal,UID:ip-10-0-132-41.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-41.ec2.internal,},FirstTimestamp:2026-09-18 16:48:48.974964016 +0000 UTC m=+2.032253538,LastTimestamp:2026-09-18 16:48:48.974964016 +0000 UTC m=+2.032253538,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-41.ec2.internal,}"
Sep 18 16:48:49.068283 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.068265    2577 manager.go:337] "Starting Device Plugin manager"
Sep 18 16:48:49.078716 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:49.068321    2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 18 16:48:49.078716 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.068336    2577 server.go:87] "Starting device plugin registration server"
Sep 18 16:48:49.078716 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.068656    2577 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 18 16:48:49.078716 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.068677    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 18 16:48:49.078716 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.068753    2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 18 16:48:49.078716 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.068895    2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 18 16:48:49.078716 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.068909    2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 18 16:48:49.078716 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:49.069572    2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 18 16:48:49.078716 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:49.069626    2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-41.ec2.internal\" not found"
Sep 18 16:48:49.115752 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.115721    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 18 16:48:49.115874 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.115778    2577 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 18 16:48:49.115874 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.115800    2577 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 18 16:48:49.115874 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:49.115836    2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 18 16:48:49.118156 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.118117    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 16:48:49.171184 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.171082    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 16:48:49.175333 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.175304    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-41.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 16:48:49.175449 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.175341    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-41.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 16:48:49.175449 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.175357    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-41.ec2.internal" event="NodeHasSufficientPID"
Sep 18 16:48:49.175449 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.175385    2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-41.ec2.internal"
Sep 18 16:48:49.188862 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.188842    2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-41.ec2.internal"
Sep 18 16:48:49.188932 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:49.188865    2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-41.ec2.internal\": node \"ip-10-0-132-41.ec2.internal\" not found"
Sep 18 16:48:49.212092 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:49.212068    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-41.ec2.internal\" not found"
Sep 18 16:48:49.216497 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.216476    2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-41.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-41.ec2.internal"]
Sep 18 16:48:49.216592 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.216579    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 16:48:49.218347 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.218331    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-41.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 16:48:49.218450 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.218366    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-41.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 16:48:49.218450 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.218380    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-41.ec2.internal" event="NodeHasSufficientPID"
Sep 18 16:48:49.219968 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.219952    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 16:48:49.220092 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.220078    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-41.ec2.internal"
Sep 18 16:48:49.220140 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.220109    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 16:48:49.220845 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.220828    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-41.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 16:48:49.220845 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.220839    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-41.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 16:48:49.220970 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.220856    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-41.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 16:48:49.220970 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.220862    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-41.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 16:48:49.220970 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.220871    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-41.ec2.internal" event="NodeHasSufficientPID"
Sep 18 16:48:49.220970 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.220872    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-41.ec2.internal" event="NodeHasSufficientPID"
Sep 18 16:48:49.222201 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.222187    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-41.ec2.internal"
Sep 18 16:48:49.222278 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.222212    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 16:48:49.222981 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.222963    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-41.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 16:48:49.223084 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.222998    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-41.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 16:48:49.223084 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.223014    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-41.ec2.internal" event="NodeHasSufficientPID"
Sep 18 16:48:49.247571 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:49.247550    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-41.ec2.internal\" not found" node="ip-10-0-132-41.ec2.internal"
Sep 18 16:48:49.252414 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:49.252398    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-41.ec2.internal\" not found" node="ip-10-0-132-41.ec2.internal"
Sep 18 16:48:49.285934 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.285899    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9ae31834f4280439711acddc59629bae-config\") pod \"kube-apiserver-proxy-ip-10-0-132-41.ec2.internal\" (UID: \"9ae31834f4280439711acddc59629bae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-41.ec2.internal"
Sep 18 16:48:49.286049 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.285942    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d8d19fe14a09d468a2dde486d300cd1c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-41.ec2.internal\" (UID: \"d8d19fe14a09d468a2dde486d300cd1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-41.ec2.internal"
Sep 18 16:48:49.286049 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.285962    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8d19fe14a09d468a2dde486d300cd1c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-41.ec2.internal\" (UID: \"d8d19fe14a09d468a2dde486d300cd1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-41.ec2.internal"
Sep 18 16:48:49.313212 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:49.313187    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-41.ec2.internal\" not found"
Sep 18 16:48:49.386477 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.386430    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9ae31834f4280439711acddc59629bae-config\") pod \"kube-apiserver-proxy-ip-10-0-132-41.ec2.internal\" (UID: \"9ae31834f4280439711acddc59629bae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-41.ec2.internal"
Sep 18 16:48:49.386477 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.386483    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d8d19fe14a09d468a2dde486d300cd1c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-41.ec2.internal\" (UID: \"d8d19fe14a09d468a2dde486d300cd1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-41.ec2.internal"
Sep 18 16:48:49.386682 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.386501    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8d19fe14a09d468a2dde486d300cd1c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-41.ec2.internal\" (UID: \"d8d19fe14a09d468a2dde486d300cd1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-41.ec2.internal"
Sep 18 16:48:49.386682 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.386541    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8d19fe14a09d468a2dde486d300cd1c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-41.ec2.internal\" (UID: \"d8d19fe14a09d468a2dde486d300cd1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-41.ec2.internal"
Sep 18 16:48:49.386682 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.386529    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9ae31834f4280439711acddc59629bae-config\") pod \"kube-apiserver-proxy-ip-10-0-132-41.ec2.internal\" (UID: \"9ae31834f4280439711acddc59629bae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-41.ec2.internal"
Sep 18 16:48:49.386682 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.386598    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d8d19fe14a09d468a2dde486d300cd1c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-41.ec2.internal\" (UID: \"d8d19fe14a09d468a2dde486d300cd1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-41.ec2.internal"
Sep 18 16:48:49.414695 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:49.414663    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-41.ec2.internal\" not found"
Sep 18 16:48:49.516361 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:49.516287    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-41.ec2.internal\" not found"
Sep 18 16:48:49.554341 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.554306    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-41.ec2.internal"
Sep 18 16:48:49.557572 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.557552    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-41.ec2.internal"
Sep 18 16:48:49.618022 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:49.617981    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-41.ec2.internal\" not found"
Sep 18 16:48:49.718542 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:49.718500    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-41.ec2.internal\" not found"
Sep 18 16:48:49.820264 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:49.820192    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-41.ec2.internal\" not found"
Sep 18 16:48:49.839548 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.839505    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 16:48:49.922004 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:49.921969    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-41.ec2.internal\" not found"
Sep 18 16:48:49.924259 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.924237    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 18 16:48:49.924431 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.924410    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 18 16:48:49.924499 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:49.924440    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 18 16:48:50.022985 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:50.022941    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-41.ec2.internal\" not found"
Sep 18 16:48:50.037205 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.037166    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 16:43:49 +0000 UTC" deadline="2028-06-23 09:51:26.65064841 +0000 UTC"
Sep 18 16:48:50.037205 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.037200    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15449h2m36.613452545s"
Sep 18 16:48:50.123975 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:50.123897    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-41.ec2.internal\" not found"
Sep 18 16:48:50.151486 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:50.151452    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ae31834f4280439711acddc59629bae.slice/crio-5347b02257df787fd6f89605671eabf51664c0a1ae860d97c6992d866a5bebfa WatchSource:0}: Error finding container 5347b02257df787fd6f89605671eabf51664c0a1ae860d97c6992d866a5bebfa: Status 404 returned error can't find the container with id 5347b02257df787fd6f89605671eabf51664c0a1ae860d97c6992d866a5bebfa
Sep 18 16:48:50.151834 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:50.151812    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8d19fe14a09d468a2dde486d300cd1c.slice/crio-08fb7bbaa84ce5e4111106e3ce097101e3c91a6c3354280854771f90679b4306 WatchSource:0}: Error finding container 08fb7bbaa84ce5e4111106e3ce097101e3c91a6c3354280854771f90679b4306: Status 404 returned error can't find the container with id 08fb7bbaa84ce5e4111106e3ce097101e3c91a6c3354280854771f90679b4306
Sep 18 16:48:50.158022 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.158005    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 16:48:50.225137 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:50.225089    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-41.ec2.internal\" not found"
Sep 18 16:48:50.228534 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.228515    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 16:48:50.229909 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.229892    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-41.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 16:48:50.229990 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.229929    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-41.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 16:48:50.229990 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.229945    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-41.ec2.internal" event="NodeHasSufficientPID"
Sep 18 16:48:50.323669 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.323640    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 16:48:50.384080 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.384001    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-41.ec2.internal"
Sep 18 16:48:50.403380 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.403358    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 18 16:48:50.404399 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.404385    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-41.ec2.internal"
Sep 18 16:48:50.411752 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.411735    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 18 16:48:50.529287 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.529256    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 16:48:50.842553 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.842461    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 16:48:50.960939 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.960881    2577 apiserver.go:52] "Watching apiserver"
Sep 18 16:48:50.967357 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.967329    2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 18 16:48:50.967764 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.967738    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-xggf7","openshift-network-operator/iptables-alerter-95vmn","openshift-ovn-kubernetes/ovnkube-node-ktklw","kube-system/global-pull-secret-syncer-wrq7r","kube-system/kube-apiserver-proxy-ip-10-0-132-41.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qtj2k","openshift-cluster-node-tuning-operator/tuned-tnt8f","openshift-image-registry/node-ca-v7rt9","openshift-multus/multus-additional-cni-plugins-5lj92","openshift-multus/multus-mrfpx","openshift-network-diagnostics/network-check-target-9jp46","kube-system/konnectivity-agent-l2bv5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-41.ec2.internal"]
Sep 18 16:48:50.969407 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.969385    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:50.970889 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.970868    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-95vmn"
Sep 18 16:48:50.971631 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.971611    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 18 16:48:50.971631 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.971623    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8vfz2\""
Sep 18 16:48:50.971780 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.971745    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 18 16:48:50.972880 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.972227    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:50.972880 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.972437    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 18 16:48:50.972880 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.972796    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 18 16:48:50.973125 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.973092    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-p4vr7\""
Sep 18 16:48:50.973387 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.973221    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 18 16:48:50.973623 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.973603    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrq7r"
Sep 18 16:48:50.973747 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:50.973684    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrq7r" podUID="b7774138-6ff0-4571-8f2e-4a8020126c37"
Sep 18 16:48:50.974442 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.974296    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 18 16:48:50.974442 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.974316    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 18 16:48:50.974659 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.974626    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 18 16:48:50.974794 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.974778    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5qjbt\""
Sep 18 16:48:50.975064 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.975048    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qtj2k"
Sep 18 16:48:50.975294 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.975276    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 18 16:48:50.975614 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.975590    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 18 16:48:50.975785 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.975768    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 18 16:48:50.976852 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.976578    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xggf7"
Sep 18 16:48:50.976852 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:50.976685    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xggf7" podUID="056bb4ff-01e7-45b4-b5d0-e15f0779692b"
Sep 18 16:48:50.977041 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.977026    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 18 16:48:50.977112 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.977028    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 18 16:48:50.977708 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.977329    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-72crf\""
Sep 18 16:48:50.977708 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.977420    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 18 16:48:50.978809 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.978352    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v7rt9"
Sep 18 16:48:50.980333 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.980193    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 18 16:48:50.980333 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.980225    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 18 16:48:50.980558 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.980524    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5lj92"
Sep 18 16:48:50.981279 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.981260    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 18 16:48:50.983297 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.982723    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:50.984435 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.984146    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 18 16:48:50.984435 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.984229    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 18 16:48:50.985896 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.984876    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9jp46"
Sep 18 16:48:50.985896 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:50.985001    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9jp46" podUID="b91105d9-1858-489c-8b13-8086e49a730c"
Sep 18 16:48:50.986711 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.986266    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 18 16:48:50.986711 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.986482    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 18 16:48:50.987036 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.987017    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9nqlx\""
Sep 18 16:48:50.988162 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.987334    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 18 16:48:50.988162 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.987489    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 18 16:48:50.988162 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.987755    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 18 16:48:50.988162 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.987850    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rvczh\""
Sep 18 16:48:50.988162 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.988023    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-s48bl\""
Sep 18 16:48:50.988465 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.988197    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l2bv5"
Sep 18 16:48:50.990891 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.990748    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 18 16:48:50.990891 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.990768    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-k4885\""
Sep 18 16:48:50.990891 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.990769    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 18 16:48:50.994439 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.994409    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e45baf5d-f62f-40d2-b368-51925ce7d95c-system-cni-dir\") pod \"multus-additional-cni-plugins-5lj92\" (UID: \"e45baf5d-f62f-40d2-b368-51925ce7d95c\") " pod="openshift-multus/multus-additional-cni-plugins-5lj92"
Sep 18 16:48:50.994548 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.994442    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6f5452b4-e748-4bf0-a74d-6f0bf1cb2736-device-dir\") pod \"aws-ebs-csi-driver-node-qtj2k\" (UID: \"6f5452b4-e748-4bf0-a74d-6f0bf1cb2736\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qtj2k"
Sep 18 16:48:50.994548 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.994467    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-hostroot\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:50.994548 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.994496    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-systemd-units\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:50.994548 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.994519    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-host-slash\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:50.994752 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.994563    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-ovn-node-metrics-cert\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:50.994752 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.994586    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b7774138-6ff0-4571-8f2e-4a8020126c37-kubelet-config\") pod \"global-pull-secret-syncer-wrq7r\" (UID: \"b7774138-6ff0-4571-8f2e-4a8020126c37\") " pod="kube-system/global-pull-secret-syncer-wrq7r"
Sep 18 16:48:50.994752 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.994601    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-host-kubelet\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:50.994752 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.994616    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2091824-1069-4f53-8ed7-963ad1fb6076-cni-binary-copy\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:50.994752 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.994634    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-host-run-netns\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:50.994752 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.994656    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-host-var-lib-cni-bin\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:50.994752 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.994677    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cb0bea49-0666-42ee-9d96-221eee1b5aa8-serviceca\") pod \"node-ca-v7rt9\" (UID: \"cb0bea49-0666-42ee-9d96-221eee1b5aa8\") " pod="openshift-image-registry/node-ca-v7rt9"
Sep 18 16:48:50.994752 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.994698    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-run-systemd\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:50.994752 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.994717    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6f5452b4-e748-4bf0-a74d-6f0bf1cb2736-etc-selinux\") pod \"aws-ebs-csi-driver-node-qtj2k\" (UID: \"6f5452b4-e748-4bf0-a74d-6f0bf1cb2736\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qtj2k"
Sep 18 16:48:50.994752 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.994736    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-host-var-lib-kubelet\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:50.994752 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.994755    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f5060ba-247c-476d-b367-df9921e3e446-etc-kubernetes\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:50.995261 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.994775    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-host-run-netns\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:50.995261 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.994809    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-var-lib-openvswitch\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:50.995261 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.994841    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-host-run-ovn-kubernetes\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:50.995261 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.994865    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6f5452b4-e748-4bf0-a74d-6f0bf1cb2736-sys-fs\") pod \"aws-ebs-csi-driver-node-qtj2k\" (UID: \"6f5452b4-e748-4bf0-a74d-6f0bf1cb2736\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qtj2k"
Sep 18 16:48:50.995261 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.994889    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b2091824-1069-4f53-8ed7-963ad1fb6076-multus-daemon-config\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:50.995261 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.994917    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6f5060ba-247c-476d-b367-df9921e3e446-etc-sysctl-d\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:50.995261 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.994938    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f5060ba-247c-476d-b367-df9921e3e446-host\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:50.995261 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.994960    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hln98\" (UniqueName: \"kubernetes.io/projected/6f5060ba-247c-476d-b367-df9921e3e446-kube-api-access-hln98\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:50.995261 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.994983    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7774138-6ff0-4571-8f2e-4a8020126c37-original-pull-secret\") pod \"global-pull-secret-syncer-wrq7r\" (UID: \"b7774138-6ff0-4571-8f2e-4a8020126c37\") " pod="kube-system/global-pull-secret-syncer-wrq7r"
Sep 18 16:48:50.995261 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.995008    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e45baf5d-f62f-40d2-b368-51925ce7d95c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5lj92\" (UID: \"e45baf5d-f62f-40d2-b368-51925ce7d95c\") " pod="openshift-multus/multus-additional-cni-plugins-5lj92"
Sep 18 16:48:50.995261 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.995032    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-host-var-lib-cni-multus\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:50.995261 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.995055    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-host-run-multus-certs\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:50.995261 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.995079    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6f5060ba-247c-476d-b367-df9921e3e446-etc-sysctl-conf\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:50.995261 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.995112    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bnlh\" (UniqueName: \"kubernetes.io/projected/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-kube-api-access-2bnlh\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:50.995261 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.995135    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6f5452b4-e748-4bf0-a74d-6f0bf1cb2736-registration-dir\") pod \"aws-ebs-csi-driver-node-qtj2k\" (UID: \"6f5452b4-e748-4bf0-a74d-6f0bf1cb2736\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qtj2k"
Sep 18 16:48:50.995261 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.995169    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/056bb4ff-01e7-45b4-b5d0-e15f0779692b-metrics-certs\") pod \"network-metrics-daemon-xggf7\" (UID: \"056bb4ff-01e7-45b4-b5d0-e15f0779692b\") " pod="openshift-multus/network-metrics-daemon-xggf7"
Sep 18 16:48:50.996135 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.995193    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-multus-cni-dir\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:50.996135 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.995219    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6f5060ba-247c-476d-b367-df9921e3e446-etc-sysconfig\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:50.996135 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.995251    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6f5060ba-247c-476d-b367-df9921e3e446-etc-tuned\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:50.996135 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.995275    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n67kt\" (UniqueName: \"kubernetes.io/projected/ced56977-5e12-472f-af6d-f0a44d85db88-kube-api-access-n67kt\") pod \"iptables-alerter-95vmn\" (UID: \"ced56977-5e12-472f-af6d-f0a44d85db88\") " pod="openshift-network-operator/iptables-alerter-95vmn"
Sep 18 16:48:50.996135 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.995299    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-node-log\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:50.996135 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.995337    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e45baf5d-f62f-40d2-b368-51925ce7d95c-cni-binary-copy\") pod \"multus-additional-cni-plugins-5lj92\" (UID: \"e45baf5d-f62f-40d2-b368-51925ce7d95c\") " pod="openshift-multus/multus-additional-cni-plugins-5lj92"
Sep 18 16:48:50.996135 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.995393    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtm4p\" (UniqueName: \"kubernetes.io/projected/056bb4ff-01e7-45b4-b5d0-e15f0779692b-kube-api-access-jtm4p\") pod \"network-metrics-daemon-xggf7\" (UID: \"056bb4ff-01e7-45b4-b5d0-e15f0779692b\") " pod="openshift-multus/network-metrics-daemon-xggf7"
Sep 18 16:48:50.996135 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.995429    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-cnibin\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:50.996135 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.995506    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-host-run-k8s-cni-cncf-io\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:50.996135 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.995582    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-log-socket\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:50.996135 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.995615    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-env-overrides\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:50.996135 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.995646    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6f5060ba-247c-476d-b367-df9921e3e446-run\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:50.996135 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.995675    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f5060ba-247c-476d-b367-df9921e3e446-tmp\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:50.996135 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.995698    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ced56977-5e12-472f-af6d-f0a44d85db88-host-slash\") pod \"iptables-alerter-95vmn\" (UID: \"ced56977-5e12-472f-af6d-f0a44d85db88\") " pod="openshift-network-operator/iptables-alerter-95vmn"
Sep 18 16:48:50.996135 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.995723    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rnhf\" (UniqueName: \"kubernetes.io/projected/e45baf5d-f62f-40d2-b368-51925ce7d95c-kube-api-access-7rnhf\") pod \"multus-additional-cni-plugins-5lj92\" (UID: \"e45baf5d-f62f-40d2-b368-51925ce7d95c\") " pod="openshift-multus/multus-additional-cni-plugins-5lj92"
Sep 18 16:48:50.996135 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.995773    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-ovnkube-script-lib\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:50.996893 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.995806    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6f5452b4-e748-4bf0-a74d-6f0bf1cb2736-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qtj2k\" (UID: \"6f5452b4-e748-4bf0-a74d-6f0bf1cb2736\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qtj2k"
Sep 18 16:48:50.996893 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.995846    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9k4m\" (UniqueName: \"kubernetes.io/projected/b2091824-1069-4f53-8ed7-963ad1fb6076-kube-api-access-x9k4m\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:50.996893 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.995872    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6f5060ba-247c-476d-b367-df9921e3e446-etc-systemd\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:50.996893 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.995924    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b7774138-6ff0-4571-8f2e-4a8020126c37-dbus\") pod \"global-pull-secret-syncer-wrq7r\" (UID: \"b7774138-6ff0-4571-8f2e-4a8020126c37\") " pod="kube-system/global-pull-secret-syncer-wrq7r"
Sep 18 16:48:50.996893 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.995948    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cb0bea49-0666-42ee-9d96-221eee1b5aa8-host\") pod \"node-ca-v7rt9\" (UID: \"cb0bea49-0666-42ee-9d96-221eee1b5aa8\") " pod="openshift-image-registry/node-ca-v7rt9"
Sep 18 16:48:50.996893 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.995970    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-system-cni-dir\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:50.996893 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.996007    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ced56977-5e12-472f-af6d-f0a44d85db88-iptables-alerter-script\") pod \"iptables-alerter-95vmn\" (UID: \"ced56977-5e12-472f-af6d-f0a44d85db88\") " pod="openshift-network-operator/iptables-alerter-95vmn"
Sep 18 16:48:50.996893 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.996030    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-run-openvswitch\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:50.996893 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.996057    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:50.996893 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.996084    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-ovnkube-config\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:50.996893 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.996108    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f5060ba-247c-476d-b367-df9921e3e446-var-lib-kubelet\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:50.996893 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.996135    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9j22\" (UniqueName: \"kubernetes.io/projected/cb0bea49-0666-42ee-9d96-221eee1b5aa8-kube-api-access-l9j22\") pod \"node-ca-v7rt9\" (UID: \"cb0bea49-0666-42ee-9d96-221eee1b5aa8\") " pod="openshift-image-registry/node-ca-v7rt9"
Sep 18 16:48:50.996893 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.996213    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e45baf5d-f62f-40d2-b368-51925ce7d95c-cnibin\") pod \"multus-additional-cni-plugins-5lj92\" (UID: \"e45baf5d-f62f-40d2-b368-51925ce7d95c\") " pod="openshift-multus/multus-additional-cni-plugins-5lj92"
Sep 18 16:48:50.996893 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.996242    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e45baf5d-f62f-40d2-b368-51925ce7d95c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5lj92\" (UID: \"e45baf5d-f62f-40d2-b368-51925ce7d95c\") " pod="openshift-multus/multus-additional-cni-plugins-5lj92"
Sep 18 16:48:50.996893 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.996266    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqvc2\" (UniqueName: \"kubernetes.io/projected/b91105d9-1858-489c-8b13-8086e49a730c-kube-api-access-vqvc2\") pod \"network-check-target-9jp46\" (UID: \"b91105d9-1858-489c-8b13-8086e49a730c\") " pod="openshift-network-diagnostics/network-check-target-9jp46"
Sep 18 16:48:50.996893 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.996283    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-etc-openvswitch\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:50.997728 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.996297    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-host-cni-bin\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:50.997728 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.996313    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-multus-socket-dir-parent\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:50.997728 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.996328    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-run-ovn\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:50.997728 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.996342    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvcgs\" (UniqueName: \"kubernetes.io/projected/6f5452b4-e748-4bf0-a74d-6f0bf1cb2736-kube-api-access-hvcgs\") pod \"aws-ebs-csi-driver-node-qtj2k\" (UID: \"6f5452b4-e748-4bf0-a74d-6f0bf1cb2736\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qtj2k"
Sep 18 16:48:50.997728 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.996359    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-multus-conf-dir\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:50.997728 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.996374    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6f5060ba-247c-476d-b367-df9921e3e446-etc-modprobe-d\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:50.997728 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.996388    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f5060ba-247c-476d-b367-df9921e3e446-sys\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:50.997728 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.996406    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f5060ba-247c-476d-b367-df9921e3e446-lib-modules\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:50.997728 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.996433    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e45baf5d-f62f-40d2-b368-51925ce7d95c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5lj92\" (UID: \"e45baf5d-f62f-40d2-b368-51925ce7d95c\") " pod="openshift-multus/multus-additional-cni-plugins-5lj92"
Sep 18 16:48:50.997728 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.996500    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-host-cni-netd\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:50.997728 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.996516    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6f5452b4-e748-4bf0-a74d-6f0bf1cb2736-socket-dir\") pod \"aws-ebs-csi-driver-node-qtj2k\" (UID: \"6f5452b4-e748-4bf0-a74d-6f0bf1cb2736\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qtj2k"
Sep 18 16:48:50.997728 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.996548    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-etc-kubernetes\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:50.999244 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:50.999126    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 18 16:48:51.032030 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.032005    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-77dw6"
Sep 18 16:48:51.040756 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.040732    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-77dw6"
Sep 18 16:48:51.085657 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.085634    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 18 16:48:51.097570 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.097487    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e45baf5d-f62f-40d2-b368-51925ce7d95c-cni-binary-copy\") pod \"multus-additional-cni-plugins-5lj92\" (UID: \"e45baf5d-f62f-40d2-b368-51925ce7d95c\") " pod="openshift-multus/multus-additional-cni-plugins-5lj92"
Sep 18 16:48:51.097570 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.097544    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtm4p\" (UniqueName: \"kubernetes.io/projected/056bb4ff-01e7-45b4-b5d0-e15f0779692b-kube-api-access-jtm4p\") pod \"network-metrics-daemon-xggf7\" (UID: \"056bb4ff-01e7-45b4-b5d0-e15f0779692b\") " pod="openshift-multus/network-metrics-daemon-xggf7"
Sep 18 16:48:51.097773 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.097574    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-cnibin\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:51.097773 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.097592    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-host-run-k8s-cni-cncf-io\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:51.097773 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.097607    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-log-socket\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.097773 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.097624    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-env-overrides\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.097773 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.097645    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6f5060ba-247c-476d-b367-df9921e3e446-run\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:51.097773 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.097709    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-log-socket\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.097773 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.097710    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-cnibin\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:51.097773 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.097737    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-host-run-k8s-cni-cncf-io\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:51.098202 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.097801    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f5060ba-247c-476d-b367-df9921e3e446-tmp\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:51.098202 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.097835    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ced56977-5e12-472f-af6d-f0a44d85db88-host-slash\") pod \"iptables-alerter-95vmn\" (UID: \"ced56977-5e12-472f-af6d-f0a44d85db88\") " pod="openshift-network-operator/iptables-alerter-95vmn"
Sep 18 16:48:51.098202 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.097855    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6f5060ba-247c-476d-b367-df9921e3e446-run\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:51.098202 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.097881    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ced56977-5e12-472f-af6d-f0a44d85db88-host-slash\") pod \"iptables-alerter-95vmn\" (UID: \"ced56977-5e12-472f-af6d-f0a44d85db88\") " pod="openshift-network-operator/iptables-alerter-95vmn"
Sep 18 16:48:51.098202 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.097970    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rnhf\" (UniqueName: \"kubernetes.io/projected/e45baf5d-f62f-40d2-b368-51925ce7d95c-kube-api-access-7rnhf\") pod \"multus-additional-cni-plugins-5lj92\" (UID: \"e45baf5d-f62f-40d2-b368-51925ce7d95c\") " pod="openshift-multus/multus-additional-cni-plugins-5lj92"
Sep 18 16:48:51.098202 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098001    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-ovnkube-script-lib\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.098202 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098027    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6f5452b4-e748-4bf0-a74d-6f0bf1cb2736-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qtj2k\" (UID: \"6f5452b4-e748-4bf0-a74d-6f0bf1cb2736\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qtj2k"
Sep 18 16:48:51.098202 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098055    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9k4m\" (UniqueName: \"kubernetes.io/projected/b2091824-1069-4f53-8ed7-963ad1fb6076-kube-api-access-x9k4m\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:51.098202 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098083    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6f5060ba-247c-476d-b367-df9921e3e446-etc-systemd\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:51.098202 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098112    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b7774138-6ff0-4571-8f2e-4a8020126c37-dbus\") pod \"global-pull-secret-syncer-wrq7r\" (UID: \"b7774138-6ff0-4571-8f2e-4a8020126c37\") " pod="kube-system/global-pull-secret-syncer-wrq7r"
Sep 18 16:48:51.098202 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098138    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6f5452b4-e748-4bf0-a74d-6f0bf1cb2736-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qtj2k\" (UID: \"6f5452b4-e748-4bf0-a74d-6f0bf1cb2736\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qtj2k"
Sep 18 16:48:51.098202 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098146    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-env-overrides\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.098202 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098149    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cb0bea49-0666-42ee-9d96-221eee1b5aa8-host\") pod \"node-ca-v7rt9\" (UID: \"cb0bea49-0666-42ee-9d96-221eee1b5aa8\") " pod="openshift-image-registry/node-ca-v7rt9"
Sep 18 16:48:51.098202 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098202    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6f5060ba-247c-476d-b367-df9921e3e446-etc-systemd\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:51.098906 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098202    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-system-cni-dir\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:51.098906 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098246    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-system-cni-dir\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:51.098906 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098251    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ced56977-5e12-472f-af6d-f0a44d85db88-iptables-alerter-script\") pod \"iptables-alerter-95vmn\" (UID: \"ced56977-5e12-472f-af6d-f0a44d85db88\") " pod="openshift-network-operator/iptables-alerter-95vmn"
Sep 18 16:48:51.098906 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098263    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cb0bea49-0666-42ee-9d96-221eee1b5aa8-host\") pod \"node-ca-v7rt9\" (UID: \"cb0bea49-0666-42ee-9d96-221eee1b5aa8\") " pod="openshift-image-registry/node-ca-v7rt9"
Sep 18 16:48:51.098906 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098239    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e45baf5d-f62f-40d2-b368-51925ce7d95c-cni-binary-copy\") pod \"multus-additional-cni-plugins-5lj92\" (UID: \"e45baf5d-f62f-40d2-b368-51925ce7d95c\") " pod="openshift-multus/multus-additional-cni-plugins-5lj92"
Sep 18 16:48:51.098906 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098286    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-run-openvswitch\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.098906 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098144    2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 18 16:48:51.098906 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098314    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.098906 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098304    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b7774138-6ff0-4571-8f2e-4a8020126c37-dbus\") pod \"global-pull-secret-syncer-wrq7r\" (UID: \"b7774138-6ff0-4571-8f2e-4a8020126c37\") " pod="kube-system/global-pull-secret-syncer-wrq7r"
Sep 18 16:48:51.098906 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098353    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-ovnkube-config\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.098906 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098382    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f5060ba-247c-476d-b367-df9921e3e446-var-lib-kubelet\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:51.098906 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098416    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1534a00e-3417-441a-9df8-29be1ac81b77-agent-certs\") pod \"konnectivity-agent-l2bv5\" (UID: \"1534a00e-3417-441a-9df8-29be1ac81b77\") " pod="kube-system/konnectivity-agent-l2bv5"
Sep 18 16:48:51.098906 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098403    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.098906 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098452    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9j22\" (UniqueName: \"kubernetes.io/projected/cb0bea49-0666-42ee-9d96-221eee1b5aa8-kube-api-access-l9j22\") pod \"node-ca-v7rt9\" (UID: \"cb0bea49-0666-42ee-9d96-221eee1b5aa8\") " pod="openshift-image-registry/node-ca-v7rt9"
Sep 18 16:48:51.098906 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098482    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e45baf5d-f62f-40d2-b368-51925ce7d95c-cnibin\") pod \"multus-additional-cni-plugins-5lj92\" (UID: \"e45baf5d-f62f-40d2-b368-51925ce7d95c\") " pod="openshift-multus/multus-additional-cni-plugins-5lj92"
Sep 18 16:48:51.098906 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098499    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-run-openvswitch\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.098906 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098513    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e45baf5d-f62f-40d2-b368-51925ce7d95c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5lj92\" (UID: \"e45baf5d-f62f-40d2-b368-51925ce7d95c\") " pod="openshift-multus/multus-additional-cni-plugins-5lj92"
Sep 18 16:48:51.099755 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098565    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqvc2\" (UniqueName: \"kubernetes.io/projected/b91105d9-1858-489c-8b13-8086e49a730c-kube-api-access-vqvc2\") pod \"network-check-target-9jp46\" (UID: \"b91105d9-1858-489c-8b13-8086e49a730c\") " pod="openshift-network-diagnostics/network-check-target-9jp46"
Sep 18 16:48:51.099755 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098575    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f5060ba-247c-476d-b367-df9921e3e446-var-lib-kubelet\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:51.099755 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098596    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-etc-openvswitch\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.099755 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098626    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-host-cni-bin\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.099755 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098656    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-multus-socket-dir-parent\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:51.099755 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098682    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-run-ovn\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.099755 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098708    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvcgs\" (UniqueName: \"kubernetes.io/projected/6f5452b4-e748-4bf0-a74d-6f0bf1cb2736-kube-api-access-hvcgs\") pod \"aws-ebs-csi-driver-node-qtj2k\" (UID: \"6f5452b4-e748-4bf0-a74d-6f0bf1cb2736\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qtj2k"
Sep 18 16:48:51.099755 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098735    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-multus-conf-dir\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:51.099755 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098764    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6f5060ba-247c-476d-b367-df9921e3e446-etc-modprobe-d\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:51.099755 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098767    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-host-cni-bin\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.099755 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098788    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f5060ba-247c-476d-b367-df9921e3e446-sys\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:51.099755 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098811    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f5060ba-247c-476d-b367-df9921e3e446-lib-modules\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:51.099755 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098837    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e45baf5d-f62f-40d2-b368-51925ce7d95c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5lj92\" (UID: \"e45baf5d-f62f-40d2-b368-51925ce7d95c\") " pod="openshift-multus/multus-additional-cni-plugins-5lj92"
Sep 18 16:48:51.099755 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098859    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-host-cni-netd\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.099755 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098882    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6f5452b4-e748-4bf0-a74d-6f0bf1cb2736-socket-dir\") pod \"aws-ebs-csi-driver-node-qtj2k\" (UID: \"6f5452b4-e748-4bf0-a74d-6f0bf1cb2736\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qtj2k"
Sep 18 16:48:51.099755 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098895    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ced56977-5e12-472f-af6d-f0a44d85db88-iptables-alerter-script\") pod \"iptables-alerter-95vmn\" (UID: \"ced56977-5e12-472f-af6d-f0a44d85db88\") " pod="openshift-network-operator/iptables-alerter-95vmn"
Sep 18 16:48:51.099755 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098906    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-etc-kubernetes\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:51.100610 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098941    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e45baf5d-f62f-40d2-b368-51925ce7d95c-system-cni-dir\") pod \"multus-additional-cni-plugins-5lj92\" (UID: \"e45baf5d-f62f-40d2-b368-51925ce7d95c\") " pod="openshift-multus/multus-additional-cni-plugins-5lj92"
Sep 18 16:48:51.100610 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098948    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-etc-kubernetes\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:51.100610 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098969    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6f5452b4-e748-4bf0-a74d-6f0bf1cb2736-device-dir\") pod \"aws-ebs-csi-driver-node-qtj2k\" (UID: \"6f5452b4-e748-4bf0-a74d-6f0bf1cb2736\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qtj2k"
Sep 18 16:48:51.100610 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098988    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-etc-openvswitch\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.100610 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.098994    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-hostroot\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:51.100610 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099005    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-multus-socket-dir-parent\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:51.100610 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099040    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e45baf5d-f62f-40d2-b368-51925ce7d95c-system-cni-dir\") pod \"multus-additional-cni-plugins-5lj92\" (UID: \"e45baf5d-f62f-40d2-b368-51925ce7d95c\") " pod="openshift-multus/multus-additional-cni-plugins-5lj92"
Sep 18 16:48:51.100610 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099046    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-hostroot\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:51.100610 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099041    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-run-ovn\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.100610 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099054    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e45baf5d-f62f-40d2-b368-51925ce7d95c-cnibin\") pod \"multus-additional-cni-plugins-5lj92\" (UID: \"e45baf5d-f62f-40d2-b368-51925ce7d95c\") " pod="openshift-multus/multus-additional-cni-plugins-5lj92"
Sep 18 16:48:51.100610 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099051    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-ovnkube-config\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.100610 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099085    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-multus-conf-dir\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:51.100610 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099092    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e45baf5d-f62f-40d2-b368-51925ce7d95c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5lj92\" (UID: \"e45baf5d-f62f-40d2-b368-51925ce7d95c\") " pod="openshift-multus/multus-additional-cni-plugins-5lj92"
Sep 18 16:48:51.100610 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099096    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-systemd-units\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.100610 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099117    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f5060ba-247c-476d-b367-df9921e3e446-sys\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:51.100610 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099155    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-host-cni-netd\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.100610 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099159    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6f5452b4-e748-4bf0-a74d-6f0bf1cb2736-socket-dir\") pod \"aws-ebs-csi-driver-node-qtj2k\" (UID: \"6f5452b4-e748-4bf0-a74d-6f0bf1cb2736\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qtj2k"
Sep 18 16:48:51.100610 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099182    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6f5060ba-247c-476d-b367-df9921e3e446-etc-modprobe-d\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:51.101364 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099192    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-host-slash\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.101364 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099200    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-systemd-units\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.101364 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099240    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-ovnkube-script-lib\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.101364 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099251    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6f5452b4-e748-4bf0-a74d-6f0bf1cb2736-device-dir\") pod \"aws-ebs-csi-driver-node-qtj2k\" (UID: \"6f5452b4-e748-4bf0-a74d-6f0bf1cb2736\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qtj2k"
Sep 18 16:48:51.101364 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099269    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f5060ba-247c-476d-b367-df9921e3e446-lib-modules\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:51.101364 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099270    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-ovn-node-metrics-cert\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.101364 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099282    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-host-slash\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.101364 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099399    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b7774138-6ff0-4571-8f2e-4a8020126c37-kubelet-config\") pod \"global-pull-secret-syncer-wrq7r\" (UID: \"b7774138-6ff0-4571-8f2e-4a8020126c37\") " pod="kube-system/global-pull-secret-syncer-wrq7r"
Sep 18 16:48:51.101364 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099437    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-host-kubelet\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.101364 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099454    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b7774138-6ff0-4571-8f2e-4a8020126c37-kubelet-config\") pod \"global-pull-secret-syncer-wrq7r\" (UID: \"b7774138-6ff0-4571-8f2e-4a8020126c37\") " pod="kube-system/global-pull-secret-syncer-wrq7r"
Sep 18 16:48:51.101364 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099463    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2091824-1069-4f53-8ed7-963ad1fb6076-cni-binary-copy\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:51.101364 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099483    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-host-kubelet\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.101364 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099487    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-host-run-netns\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:51.101364 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099519    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-host-run-netns\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:51.101364 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099549    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-host-var-lib-cni-bin\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:51.101364 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099576    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cb0bea49-0666-42ee-9d96-221eee1b5aa8-serviceca\") pod \"node-ca-v7rt9\" (UID: \"cb0bea49-0666-42ee-9d96-221eee1b5aa8\") " pod="openshift-image-registry/node-ca-v7rt9"
Sep 18 16:48:51.101364 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099580    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e45baf5d-f62f-40d2-b368-51925ce7d95c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5lj92\" (UID: \"e45baf5d-f62f-40d2-b368-51925ce7d95c\") " pod="openshift-multus/multus-additional-cni-plugins-5lj92"
Sep 18 16:48:51.101364 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099601    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-run-systemd\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.102095 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099633    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-host-var-lib-cni-bin\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:51.102095 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099648    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-run-systemd\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.102095 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099706    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6f5452b4-e748-4bf0-a74d-6f0bf1cb2736-etc-selinux\") pod \"aws-ebs-csi-driver-node-qtj2k\" (UID: \"6f5452b4-e748-4bf0-a74d-6f0bf1cb2736\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qtj2k"
Sep 18 16:48:51.102095 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099740    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-host-var-lib-kubelet\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:51.102095 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099766    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f5060ba-247c-476d-b367-df9921e3e446-etc-kubernetes\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:51.102095 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099787    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-host-run-netns\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.102095 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099797    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6f5452b4-e748-4bf0-a74d-6f0bf1cb2736-etc-selinux\") pod \"aws-ebs-csi-driver-node-qtj2k\" (UID: \"6f5452b4-e748-4bf0-a74d-6f0bf1cb2736\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qtj2k"
Sep 18 16:48:51.102095 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099806    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-var-lib-openvswitch\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.102095 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099823    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-host-var-lib-kubelet\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:51.102095 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099827    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-host-run-ovn-kubernetes\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.102095 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099851    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f5060ba-247c-476d-b367-df9921e3e446-etc-kubernetes\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:51.102095 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099860    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-host-run-ovn-kubernetes\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.102095 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099864    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6f5452b4-e748-4bf0-a74d-6f0bf1cb2736-sys-fs\") pod \"aws-ebs-csi-driver-node-qtj2k\" (UID: \"6f5452b4-e748-4bf0-a74d-6f0bf1cb2736\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qtj2k"
Sep 18 16:48:51.102095 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099889    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b2091824-1069-4f53-8ed7-963ad1fb6076-multus-daemon-config\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:51.102095 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099896    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-host-run-netns\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.102095 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099915    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6f5060ba-247c-476d-b367-df9921e3e446-etc-sysctl-d\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:51.102095 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099938    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f5060ba-247c-476d-b367-df9921e3e446-host\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:51.102756 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099941    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6f5452b4-e748-4bf0-a74d-6f0bf1cb2736-sys-fs\") pod \"aws-ebs-csi-driver-node-qtj2k\" (UID: \"6f5452b4-e748-4bf0-a74d-6f0bf1cb2736\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qtj2k"
Sep 18 16:48:51.102756 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099899    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-var-lib-openvswitch\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.102756 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099968    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hln98\" (UniqueName: \"kubernetes.io/projected/6f5060ba-247c-476d-b367-df9921e3e446-kube-api-access-hln98\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:51.102756 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099997    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2091824-1069-4f53-8ed7-963ad1fb6076-cni-binary-copy\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:51.102756 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.099996    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7774138-6ff0-4571-8f2e-4a8020126c37-original-pull-secret\") pod \"global-pull-secret-syncer-wrq7r\" (UID: \"b7774138-6ff0-4571-8f2e-4a8020126c37\") " pod="kube-system/global-pull-secret-syncer-wrq7r"
Sep 18 16:48:51.102756 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.100036    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e45baf5d-f62f-40d2-b368-51925ce7d95c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5lj92\" (UID: \"e45baf5d-f62f-40d2-b368-51925ce7d95c\") " pod="openshift-multus/multus-additional-cni-plugins-5lj92"
Sep 18 16:48:51.102756 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.100055    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-host-var-lib-cni-multus\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:51.102756 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.100070    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-host-run-multus-certs\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:51.102756 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.100085    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6f5060ba-247c-476d-b367-df9921e3e446-etc-sysctl-conf\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:51.102756 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.100095    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6f5060ba-247c-476d-b367-df9921e3e446-etc-sysctl-d\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:51.102756 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.100106    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1534a00e-3417-441a-9df8-29be1ac81b77-konnectivity-ca\") pod \"konnectivity-agent-l2bv5\" (UID: \"1534a00e-3417-441a-9df8-29be1ac81b77\") " pod="kube-system/konnectivity-agent-l2bv5"
Sep 18 16:48:51.102756 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.100001    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f5060ba-247c-476d-b367-df9921e3e446-host\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:51.102756 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.100121    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cb0bea49-0666-42ee-9d96-221eee1b5aa8-serviceca\") pod \"node-ca-v7rt9\" (UID: \"cb0bea49-0666-42ee-9d96-221eee1b5aa8\") " pod="openshift-image-registry/node-ca-v7rt9"
Sep 18 16:48:51.102756 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.100135    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bnlh\" (UniqueName: \"kubernetes.io/projected/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-kube-api-access-2bnlh\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.102756 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:51.100212    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 16:48:51.102756 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.100219    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-host-run-multus-certs\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:51.102756 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.100263    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-host-var-lib-cni-multus\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:51.102756 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.100307    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6f5060ba-247c-476d-b367-df9921e3e446-etc-sysctl-conf\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:51.103629 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.100324    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b2091824-1069-4f53-8ed7-963ad1fb6076-multus-daemon-config\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:51.103629 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.100327    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6f5452b4-e748-4bf0-a74d-6f0bf1cb2736-registration-dir\") pod \"aws-ebs-csi-driver-node-qtj2k\" (UID: \"6f5452b4-e748-4bf0-a74d-6f0bf1cb2736\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qtj2k"
Sep 18 16:48:51.103629 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.100382    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/056bb4ff-01e7-45b4-b5d0-e15f0779692b-metrics-certs\") pod \"network-metrics-daemon-xggf7\" (UID: \"056bb4ff-01e7-45b4-b5d0-e15f0779692b\") " pod="openshift-multus/network-metrics-daemon-xggf7"
Sep 18 16:48:51.103629 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.100218    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e45baf5d-f62f-40d2-b368-51925ce7d95c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5lj92\" (UID: \"e45baf5d-f62f-40d2-b368-51925ce7d95c\") " pod="openshift-multus/multus-additional-cni-plugins-5lj92"
Sep 18 16:48:51.103629 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:51.100400    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7774138-6ff0-4571-8f2e-4a8020126c37-original-pull-secret podName:b7774138-6ff0-4571-8f2e-4a8020126c37 nodeName:}" failed. No retries permitted until 2026-09-18 16:48:51.600379694 +0000 UTC m=+4.657669432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7774138-6ff0-4571-8f2e-4a8020126c37-original-pull-secret") pod "global-pull-secret-syncer-wrq7r" (UID: "b7774138-6ff0-4571-8f2e-4a8020126c37") : object "kube-system"/"original-pull-secret" not registered
Sep 18 16:48:51.103629 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.100427    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6f5452b4-e748-4bf0-a74d-6f0bf1cb2736-registration-dir\") pod \"aws-ebs-csi-driver-node-qtj2k\" (UID: \"6f5452b4-e748-4bf0-a74d-6f0bf1cb2736\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qtj2k"
Sep 18 16:48:51.103629 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.100436    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-multus-cni-dir\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:51.103629 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:51.100456    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:48:51.103629 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.100489    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6f5060ba-247c-476d-b367-df9921e3e446-etc-sysconfig\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:51.103629 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.100492    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2091824-1069-4f53-8ed7-963ad1fb6076-multus-cni-dir\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:51.103629 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:51.100513    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/056bb4ff-01e7-45b4-b5d0-e15f0779692b-metrics-certs podName:056bb4ff-01e7-45b4-b5d0-e15f0779692b nodeName:}" failed. No retries permitted until 2026-09-18 16:48:51.600499389 +0000 UTC m=+4.657788898 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/056bb4ff-01e7-45b4-b5d0-e15f0779692b-metrics-certs") pod "network-metrics-daemon-xggf7" (UID: "056bb4ff-01e7-45b4-b5d0-e15f0779692b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:48:51.103629 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.100557    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6f5060ba-247c-476d-b367-df9921e3e446-etc-tuned\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:51.103629 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.100576    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6f5060ba-247c-476d-b367-df9921e3e446-etc-sysconfig\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:51.103629 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.100581    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n67kt\" (UniqueName: \"kubernetes.io/projected/ced56977-5e12-472f-af6d-f0a44d85db88-kube-api-access-n67kt\") pod \"iptables-alerter-95vmn\" (UID: \"ced56977-5e12-472f-af6d-f0a44d85db88\") " pod="openshift-network-operator/iptables-alerter-95vmn"
Sep 18 16:48:51.103629 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.100615    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-node-log\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.103629 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.100698    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-node-log\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.105068 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.102825    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f5060ba-247c-476d-b367-df9921e3e446-tmp\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:51.105068 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.102887    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6f5060ba-247c-476d-b367-df9921e3e446-etc-tuned\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:51.105068 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.102940    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-ovn-node-metrics-cert\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.105552 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:51.105395    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 16:48:51.105552 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:51.105421    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 16:48:51.105552 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:51.105434    2577 projected.go:196] Error preparing data for projected volume kube-api-access-vqvc2 for pod openshift-network-diagnostics/network-check-target-9jp46: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:48:51.105552 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:51.105499    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b91105d9-1858-489c-8b13-8086e49a730c-kube-api-access-vqvc2 podName:b91105d9-1858-489c-8b13-8086e49a730c nodeName:}" failed. No retries permitted until 2026-09-18 16:48:51.605481832 +0000 UTC m=+4.662771341 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vqvc2" (UniqueName: "kubernetes.io/projected/b91105d9-1858-489c-8b13-8086e49a730c-kube-api-access-vqvc2") pod "network-check-target-9jp46" (UID: "b91105d9-1858-489c-8b13-8086e49a730c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:48:51.106675 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.106651    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9j22\" (UniqueName: \"kubernetes.io/projected/cb0bea49-0666-42ee-9d96-221eee1b5aa8-kube-api-access-l9j22\") pod \"node-ca-v7rt9\" (UID: \"cb0bea49-0666-42ee-9d96-221eee1b5aa8\") " pod="openshift-image-registry/node-ca-v7rt9"
Sep 18 16:48:51.107147 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.107106    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9k4m\" (UniqueName: \"kubernetes.io/projected/b2091824-1069-4f53-8ed7-963ad1fb6076-kube-api-access-x9k4m\") pod \"multus-mrfpx\" (UID: \"b2091824-1069-4f53-8ed7-963ad1fb6076\") " pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:51.107391 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.107374    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rnhf\" (UniqueName: \"kubernetes.io/projected/e45baf5d-f62f-40d2-b368-51925ce7d95c-kube-api-access-7rnhf\") pod \"multus-additional-cni-plugins-5lj92\" (UID: \"e45baf5d-f62f-40d2-b368-51925ce7d95c\") " pod="openshift-multus/multus-additional-cni-plugins-5lj92"
Sep 18 16:48:51.107585 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.107559    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvcgs\" (UniqueName: \"kubernetes.io/projected/6f5452b4-e748-4bf0-a74d-6f0bf1cb2736-kube-api-access-hvcgs\") pod \"aws-ebs-csi-driver-node-qtj2k\" (UID: \"6f5452b4-e748-4bf0-a74d-6f0bf1cb2736\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qtj2k"
Sep 18 16:48:51.107870 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.107850    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtm4p\" (UniqueName: \"kubernetes.io/projected/056bb4ff-01e7-45b4-b5d0-e15f0779692b-kube-api-access-jtm4p\") pod \"network-metrics-daemon-xggf7\" (UID: \"056bb4ff-01e7-45b4-b5d0-e15f0779692b\") " pod="openshift-multus/network-metrics-daemon-xggf7"
Sep 18 16:48:51.115816 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.115785    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n67kt\" (UniqueName: \"kubernetes.io/projected/ced56977-5e12-472f-af6d-f0a44d85db88-kube-api-access-n67kt\") pod \"iptables-alerter-95vmn\" (UID: \"ced56977-5e12-472f-af6d-f0a44d85db88\") " pod="openshift-network-operator/iptables-alerter-95vmn"
Sep 18 16:48:51.116702 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.116678    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bnlh\" (UniqueName: \"kubernetes.io/projected/3c1064f0-18a0-4c28-8fb9-a320535dcbbf-kube-api-access-2bnlh\") pod \"ovnkube-node-ktklw\" (UID: \"3c1064f0-18a0-4c28-8fb9-a320535dcbbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.118287 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.118256    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hln98\" (UniqueName: \"kubernetes.io/projected/6f5060ba-247c-476d-b367-df9921e3e446-kube-api-access-hln98\") pod \"tuned-tnt8f\" (UID: \"6f5060ba-247c-476d-b367-df9921e3e446\") " pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:51.121455 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.121409    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-41.ec2.internal" event={"ID":"d8d19fe14a09d468a2dde486d300cd1c","Type":"ContainerStarted","Data":"08fb7bbaa84ce5e4111106e3ce097101e3c91a6c3354280854771f90679b4306"}
Sep 18 16:48:51.122717 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.122692    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-41.ec2.internal" event={"ID":"9ae31834f4280439711acddc59629bae","Type":"ContainerStarted","Data":"5347b02257df787fd6f89605671eabf51664c0a1ae860d97c6992d866a5bebfa"}
Sep 18 16:48:51.201284 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.201250    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1534a00e-3417-441a-9df8-29be1ac81b77-konnectivity-ca\") pod \"konnectivity-agent-l2bv5\" (UID: \"1534a00e-3417-441a-9df8-29be1ac81b77\") " pod="kube-system/konnectivity-agent-l2bv5"
Sep 18 16:48:51.201455 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.201317    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1534a00e-3417-441a-9df8-29be1ac81b77-agent-certs\") pod \"konnectivity-agent-l2bv5\" (UID: \"1534a00e-3417-441a-9df8-29be1ac81b77\") " pod="kube-system/konnectivity-agent-l2bv5"
Sep 18 16:48:51.201937 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.201915    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1534a00e-3417-441a-9df8-29be1ac81b77-konnectivity-ca\") pod \"konnectivity-agent-l2bv5\" (UID: \"1534a00e-3417-441a-9df8-29be1ac81b77\") " pod="kube-system/konnectivity-agent-l2bv5"
Sep 18 16:48:51.203864 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.203840    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1534a00e-3417-441a-9df8-29be1ac81b77-agent-certs\") pod \"konnectivity-agent-l2bv5\" (UID: \"1534a00e-3417-441a-9df8-29be1ac81b77\") " pod="kube-system/konnectivity-agent-l2bv5"
Sep 18 16:48:51.287052 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.287008    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tnt8f"
Sep 18 16:48:51.292175 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.292151    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-95vmn"
Sep 18 16:48:51.300270 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.300238    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:48:51.312158 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.312137    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qtj2k"
Sep 18 16:48:51.320932 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.320914    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v7rt9"
Sep 18 16:48:51.327598 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.327578    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5lj92"
Sep 18 16:48:51.335436 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.335415    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mrfpx"
Sep 18 16:48:51.341176 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.341155    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l2bv5"
Sep 18 16:48:51.603317 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.603276    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7774138-6ff0-4571-8f2e-4a8020126c37-original-pull-secret\") pod \"global-pull-secret-syncer-wrq7r\" (UID: \"b7774138-6ff0-4571-8f2e-4a8020126c37\") " pod="kube-system/global-pull-secret-syncer-wrq7r"
Sep 18 16:48:51.603511 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.603332    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/056bb4ff-01e7-45b4-b5d0-e15f0779692b-metrics-certs\") pod \"network-metrics-daemon-xggf7\" (UID: \"056bb4ff-01e7-45b4-b5d0-e15f0779692b\") " pod="openshift-multus/network-metrics-daemon-xggf7"
Sep 18 16:48:51.603511 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:51.603452    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:48:51.603648 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:51.603521    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/056bb4ff-01e7-45b4-b5d0-e15f0779692b-metrics-certs podName:056bb4ff-01e7-45b4-b5d0-e15f0779692b nodeName:}" failed. No retries permitted until 2026-09-18 16:48:52.603507554 +0000 UTC m=+5.660797061 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/056bb4ff-01e7-45b4-b5d0-e15f0779692b-metrics-certs") pod "network-metrics-daemon-xggf7" (UID: "056bb4ff-01e7-45b4-b5d0-e15f0779692b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:48:51.603648 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:51.603454    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 16:48:51.603648 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:51.603589    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7774138-6ff0-4571-8f2e-4a8020126c37-original-pull-secret podName:b7774138-6ff0-4571-8f2e-4a8020126c37 nodeName:}" failed. No retries permitted until 2026-09-18 16:48:52.603574346 +0000 UTC m=+5.660863859 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7774138-6ff0-4571-8f2e-4a8020126c37-original-pull-secret") pod "global-pull-secret-syncer-wrq7r" (UID: "b7774138-6ff0-4571-8f2e-4a8020126c37") : object "kube-system"/"original-pull-secret" not registered
Sep 18 16:48:51.660876 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.660843    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 16:48:51.703902 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:51.703872    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqvc2\" (UniqueName: \"kubernetes.io/projected/b91105d9-1858-489c-8b13-8086e49a730c-kube-api-access-vqvc2\") pod \"network-check-target-9jp46\" (UID: \"b91105d9-1858-489c-8b13-8086e49a730c\") " pod="openshift-network-diagnostics/network-check-target-9jp46"
Sep 18 16:48:51.704128 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:51.704062    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 16:48:51.704128 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:51.704089    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 16:48:51.704128 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:51.704101    2577 projected.go:196] Error preparing data for projected volume kube-api-access-vqvc2 for pod openshift-network-diagnostics/network-check-target-9jp46: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:48:51.704252 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:51.704165    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b91105d9-1858-489c-8b13-8086e49a730c-kube-api-access-vqvc2 podName:b91105d9-1858-489c-8b13-8086e49a730c nodeName:}" failed. No retries permitted until 2026-09-18 16:48:52.704147331 +0000 UTC m=+5.761436859 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqvc2" (UniqueName: "kubernetes.io/projected/b91105d9-1858-489c-8b13-8086e49a730c-kube-api-access-vqvc2") pod "network-check-target-9jp46" (UID: "b91105d9-1858-489c-8b13-8086e49a730c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:48:52.043033 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:52.043004    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 16:43:51 +0000 UTC" deadline="2028-06-10 23:48:08.001938884 +0000 UTC"
Sep 18 16:48:52.043033 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:52.043032    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15150h59m15.958910388s"
Sep 18 16:48:52.047435 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:52.047412    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podced56977_5e12_472f_af6d_f0a44d85db88.slice/crio-861abaf5a1169cc9edc170450a7150571a348f1e4c2cf6622e2b71c887855008 WatchSource:0}: Error finding container 861abaf5a1169cc9edc170450a7150571a348f1e4c2cf6622e2b71c887855008: Status 404 returned error can't find the container with id 861abaf5a1169cc9edc170450a7150571a348f1e4c2cf6622e2b71c887855008
Sep 18 16:48:52.050963 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:52.050941    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f5060ba_247c_476d_b367_df9921e3e446.slice/crio-92e80e850b7d68a31ac7146d545422667427bdafd0b564a2b2276eef350bcd3d WatchSource:0}: Error finding container 92e80e850b7d68a31ac7146d545422667427bdafd0b564a2b2276eef350bcd3d: Status 404 returned error can't find the container with id 92e80e850b7d68a31ac7146d545422667427bdafd0b564a2b2276eef350bcd3d
Sep 18 16:48:52.053951 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:52.053928    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode45baf5d_f62f_40d2_b368_51925ce7d95c.slice/crio-8e02c212e9af68835a5e110bc502f9eb0e55e8fe08621e3f9000c23743b348e6 WatchSource:0}: Error finding container 8e02c212e9af68835a5e110bc502f9eb0e55e8fe08621e3f9000c23743b348e6: Status 404 returned error can't find the container with id 8e02c212e9af68835a5e110bc502f9eb0e55e8fe08621e3f9000c23743b348e6
Sep 18 16:48:52.055114 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:52.055092    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2091824_1069_4f53_8ed7_963ad1fb6076.slice/crio-3ff3bb8b515610d243d45e54ff91126055ad86b7f4934af3e4a80bea33e9fcdf WatchSource:0}: Error finding container 3ff3bb8b515610d243d45e54ff91126055ad86b7f4934af3e4a80bea33e9fcdf: Status 404 returned error can't find the container with id 3ff3bb8b515610d243d45e54ff91126055ad86b7f4934af3e4a80bea33e9fcdf
Sep 18 16:48:52.056502 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:52.056475    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1534a00e_3417_441a_9df8_29be1ac81b77.slice/crio-4b3872abb717c6c690dbc12ea3fde8ae4ad2f7042a8900b1d602b2b48958139e WatchSource:0}: Error finding container 4b3872abb717c6c690dbc12ea3fde8ae4ad2f7042a8900b1d602b2b48958139e: Status 404 returned error can't find the container with id 4b3872abb717c6c690dbc12ea3fde8ae4ad2f7042a8900b1d602b2b48958139e
Sep 18 16:48:52.057319 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:52.057298    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb0bea49_0666_42ee_9d96_221eee1b5aa8.slice/crio-bf9017defec57b0a3fca4098487a42e018f83e506fc6c546f3e4c14fb2acb532 WatchSource:0}: Error finding container bf9017defec57b0a3fca4098487a42e018f83e506fc6c546f3e4c14fb2acb532: Status 404 returned error can't find the container with id bf9017defec57b0a3fca4098487a42e018f83e506fc6c546f3e4c14fb2acb532
Sep 18 16:48:52.058664 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:52.058497    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c1064f0_18a0_4c28_8fb9_a320535dcbbf.slice/crio-cb6c83a2ed7c3a94a1da9df4dca21f90d872feb0a3d0e0d36c8dca53a0467a66 WatchSource:0}: Error finding container cb6c83a2ed7c3a94a1da9df4dca21f90d872feb0a3d0e0d36c8dca53a0467a66: Status 404 returned error can't find the container with id cb6c83a2ed7c3a94a1da9df4dca21f90d872feb0a3d0e0d36c8dca53a0467a66
Sep 18 16:48:52.060014 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:48:52.059917    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f5452b4_e748_4bf0_a74d_6f0bf1cb2736.slice/crio-e9cc6b8e43033f45c4d26c72538388e6c2a67e8350b44540ba97d787b4d5b731 WatchSource:0}: Error finding container e9cc6b8e43033f45c4d26c72538388e6c2a67e8350b44540ba97d787b4d5b731: Status 404 returned error can't find the container with id e9cc6b8e43033f45c4d26c72538388e6c2a67e8350b44540ba97d787b4d5b731
Sep 18 16:48:52.126265 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:52.126239    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lj92" event={"ID":"e45baf5d-f62f-40d2-b368-51925ce7d95c","Type":"ContainerStarted","Data":"8e02c212e9af68835a5e110bc502f9eb0e55e8fe08621e3f9000c23743b348e6"}
Sep 18 16:48:52.128461 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:52.128435    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-95vmn" event={"ID":"ced56977-5e12-472f-af6d-f0a44d85db88","Type":"ContainerStarted","Data":"861abaf5a1169cc9edc170450a7150571a348f1e4c2cf6622e2b71c887855008"}
Sep 18 16:48:52.131059 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:52.131035    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktklw" event={"ID":"3c1064f0-18a0-4c28-8fb9-a320535dcbbf","Type":"ContainerStarted","Data":"cb6c83a2ed7c3a94a1da9df4dca21f90d872feb0a3d0e0d36c8dca53a0467a66"}
Sep 18 16:48:52.132270 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:52.132252    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v7rt9" event={"ID":"cb0bea49-0666-42ee-9d96-221eee1b5aa8","Type":"ContainerStarted","Data":"bf9017defec57b0a3fca4098487a42e018f83e506fc6c546f3e4c14fb2acb532"}
Sep 18 16:48:52.133336 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:52.133307    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l2bv5" event={"ID":"1534a00e-3417-441a-9df8-29be1ac81b77","Type":"ContainerStarted","Data":"4b3872abb717c6c690dbc12ea3fde8ae4ad2f7042a8900b1d602b2b48958139e"}
Sep 18 16:48:52.134508 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:52.134484    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tnt8f" event={"ID":"6f5060ba-247c-476d-b367-df9921e3e446","Type":"ContainerStarted","Data":"92e80e850b7d68a31ac7146d545422667427bdafd0b564a2b2276eef350bcd3d"}
Sep 18 16:48:52.139875 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:52.139840    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qtj2k" event={"ID":"6f5452b4-e748-4bf0-a74d-6f0bf1cb2736","Type":"ContainerStarted","Data":"e9cc6b8e43033f45c4d26c72538388e6c2a67e8350b44540ba97d787b4d5b731"}
Sep 18 16:48:52.140856 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:52.140830    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mrfpx" event={"ID":"b2091824-1069-4f53-8ed7-963ad1fb6076","Type":"ContainerStarted","Data":"3ff3bb8b515610d243d45e54ff91126055ad86b7f4934af3e4a80bea33e9fcdf"}
Sep 18 16:48:52.151046 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:52.151005    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-41.ec2.internal" podStartSLOduration=2.150992257 podStartE2EDuration="2.150992257s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:48:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:48:52.150520373 +0000 UTC m=+5.207809900" watchObservedRunningTime="2026-09-18 16:48:52.150992257 +0000 UTC m=+5.208281785"
Sep 18 16:48:52.613930 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:52.613508    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7774138-6ff0-4571-8f2e-4a8020126c37-original-pull-secret\") pod \"global-pull-secret-syncer-wrq7r\" (UID: \"b7774138-6ff0-4571-8f2e-4a8020126c37\") " pod="kube-system/global-pull-secret-syncer-wrq7r"
Sep 18 16:48:52.613930 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:52.613844    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/056bb4ff-01e7-45b4-b5d0-e15f0779692b-metrics-certs\") pod \"network-metrics-daemon-xggf7\" (UID: \"056bb4ff-01e7-45b4-b5d0-e15f0779692b\") " pod="openshift-multus/network-metrics-daemon-xggf7"
Sep 18 16:48:52.614174 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:52.613706    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 16:48:52.614174 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:52.614052    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7774138-6ff0-4571-8f2e-4a8020126c37-original-pull-secret podName:b7774138-6ff0-4571-8f2e-4a8020126c37 nodeName:}" failed. No retries permitted until 2026-09-18 16:48:54.614035639 +0000 UTC m=+7.671325189 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7774138-6ff0-4571-8f2e-4a8020126c37-original-pull-secret") pod "global-pull-secret-syncer-wrq7r" (UID: "b7774138-6ff0-4571-8f2e-4a8020126c37") : object "kube-system"/"original-pull-secret" not registered
Sep 18 16:48:52.614174 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:52.613988    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:48:52.614174 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:52.614134    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/056bb4ff-01e7-45b4-b5d0-e15f0779692b-metrics-certs podName:056bb4ff-01e7-45b4-b5d0-e15f0779692b nodeName:}" failed. No retries permitted until 2026-09-18 16:48:54.614120889 +0000 UTC m=+7.671410408 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/056bb4ff-01e7-45b4-b5d0-e15f0779692b-metrics-certs") pod "network-metrics-daemon-xggf7" (UID: "056bb4ff-01e7-45b4-b5d0-e15f0779692b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:48:52.715077 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:52.715041    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqvc2\" (UniqueName: \"kubernetes.io/projected/b91105d9-1858-489c-8b13-8086e49a730c-kube-api-access-vqvc2\") pod \"network-check-target-9jp46\" (UID: \"b91105d9-1858-489c-8b13-8086e49a730c\") " pod="openshift-network-diagnostics/network-check-target-9jp46"
Sep 18 16:48:52.715267 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:52.715250    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 16:48:52.715330 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:52.715277    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 16:48:52.715330 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:52.715289    2577 projected.go:196] Error preparing data for projected volume kube-api-access-vqvc2 for pod openshift-network-diagnostics/network-check-target-9jp46: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:48:52.715434 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:52.715349    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b91105d9-1858-489c-8b13-8086e49a730c-kube-api-access-vqvc2 podName:b91105d9-1858-489c-8b13-8086e49a730c nodeName:}" failed. No retries permitted until 2026-09-18 16:48:54.7153317 +0000 UTC m=+7.772621212 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqvc2" (UniqueName: "kubernetes.io/projected/b91105d9-1858-489c-8b13-8086e49a730c-kube-api-access-vqvc2") pod "network-check-target-9jp46" (UID: "b91105d9-1858-489c-8b13-8086e49a730c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:48:53.044247 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:53.044110    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 16:43:51 +0000 UTC" deadline="2028-07-02 11:09:56.205899186 +0000 UTC"
Sep 18 16:48:53.044247 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:53.044168    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15666h21m3.161735176s"
Sep 18 16:48:53.118118 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:53.117647    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrq7r"
Sep 18 16:48:53.118118 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:53.117663    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9jp46"
Sep 18 16:48:53.118118 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:53.117778    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrq7r" podUID="b7774138-6ff0-4571-8f2e-4a8020126c37"
Sep 18 16:48:53.118118 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:53.117848    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9jp46" podUID="b91105d9-1858-489c-8b13-8086e49a730c"
Sep 18 16:48:53.118118 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:53.117930    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xggf7"
Sep 18 16:48:53.118118 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:53.118013    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xggf7" podUID="056bb4ff-01e7-45b4-b5d0-e15f0779692b"
Sep 18 16:48:53.147120 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:53.146460    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-41.ec2.internal" event={"ID":"9ae31834f4280439711acddc59629bae","Type":"ContainerStarted","Data":"65ed1be4b857929969ba4782bf37ce02ccca706361af5831c37d6ea5f00790eb"}
Sep 18 16:48:53.159090 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:53.158411    2577 generic.go:356] "Generic (PLEG): container finished" podID="d8d19fe14a09d468a2dde486d300cd1c" containerID="461b9ba31d3028037ebb09a524f4b33c19ad6f0841cf3529322892d81aa809b0" exitCode=0
Sep 18 16:48:53.159090 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:53.158456    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-41.ec2.internal" event={"ID":"d8d19fe14a09d468a2dde486d300cd1c","Type":"ContainerDied","Data":"461b9ba31d3028037ebb09a524f4b33c19ad6f0841cf3529322892d81aa809b0"}
Sep 18 16:48:54.169705 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:54.169670    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-41.ec2.internal" event={"ID":"d8d19fe14a09d468a2dde486d300cd1c","Type":"ContainerStarted","Data":"8ee810dbb1ec5edfe14c5917bd9a60fc83bb66ff9c3086467a2944c6a9ccd994"}
Sep 18 16:48:54.632642 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:54.632549    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7774138-6ff0-4571-8f2e-4a8020126c37-original-pull-secret\") pod \"global-pull-secret-syncer-wrq7r\" (UID: \"b7774138-6ff0-4571-8f2e-4a8020126c37\") " pod="kube-system/global-pull-secret-syncer-wrq7r"
Sep 18 16:48:54.632642 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:54.632603    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/056bb4ff-01e7-45b4-b5d0-e15f0779692b-metrics-certs\") pod \"network-metrics-daemon-xggf7\" (UID: \"056bb4ff-01e7-45b4-b5d0-e15f0779692b\") " pod="openshift-multus/network-metrics-daemon-xggf7"
Sep 18 16:48:54.632904 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:54.632769    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:48:54.632904 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:54.632897    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/056bb4ff-01e7-45b4-b5d0-e15f0779692b-metrics-certs podName:056bb4ff-01e7-45b4-b5d0-e15f0779692b nodeName:}" failed. No retries permitted until 2026-09-18 16:48:58.632813962 +0000 UTC m=+11.690103474 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/056bb4ff-01e7-45b4-b5d0-e15f0779692b-metrics-certs") pod "network-metrics-daemon-xggf7" (UID: "056bb4ff-01e7-45b4-b5d0-e15f0779692b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:48:54.633446 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:54.633302    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 16:48:54.633446 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:54.633367    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7774138-6ff0-4571-8f2e-4a8020126c37-original-pull-secret podName:b7774138-6ff0-4571-8f2e-4a8020126c37 nodeName:}" failed. No retries permitted until 2026-09-18 16:48:58.633351311 +0000 UTC m=+11.690640818 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7774138-6ff0-4571-8f2e-4a8020126c37-original-pull-secret") pod "global-pull-secret-syncer-wrq7r" (UID: "b7774138-6ff0-4571-8f2e-4a8020126c37") : object "kube-system"/"original-pull-secret" not registered
Sep 18 16:48:54.734496 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:54.733860    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqvc2\" (UniqueName: \"kubernetes.io/projected/b91105d9-1858-489c-8b13-8086e49a730c-kube-api-access-vqvc2\") pod \"network-check-target-9jp46\" (UID: \"b91105d9-1858-489c-8b13-8086e49a730c\") " pod="openshift-network-diagnostics/network-check-target-9jp46"
Sep 18 16:48:54.734496 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:54.734062    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 16:48:54.734496 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:54.734083    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 16:48:54.734496 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:54.734095    2577 projected.go:196] Error preparing data for projected volume kube-api-access-vqvc2 for pod openshift-network-diagnostics/network-check-target-9jp46: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:48:54.734496 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:54.734158    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b91105d9-1858-489c-8b13-8086e49a730c-kube-api-access-vqvc2 podName:b91105d9-1858-489c-8b13-8086e49a730c nodeName:}" failed. No retries permitted until 2026-09-18 16:48:58.734139367 +0000 UTC m=+11.791428890 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqvc2" (UniqueName: "kubernetes.io/projected/b91105d9-1858-489c-8b13-8086e49a730c-kube-api-access-vqvc2") pod "network-check-target-9jp46" (UID: "b91105d9-1858-489c-8b13-8086e49a730c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:48:55.117241 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:55.116759    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrq7r"
Sep 18 16:48:55.117241 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:55.116770    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9jp46"
Sep 18 16:48:55.117241 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:55.116898    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrq7r" podUID="b7774138-6ff0-4571-8f2e-4a8020126c37"
Sep 18 16:48:55.117241 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:55.116914    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xggf7"
Sep 18 16:48:55.117241 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:55.117010    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9jp46" podUID="b91105d9-1858-489c-8b13-8086e49a730c"
Sep 18 16:48:55.117241 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:55.117099    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xggf7" podUID="056bb4ff-01e7-45b4-b5d0-e15f0779692b"
Sep 18 16:48:57.116254 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:57.116219    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9jp46"
Sep 18 16:48:57.116735 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:57.116357    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9jp46" podUID="b91105d9-1858-489c-8b13-8086e49a730c"
Sep 18 16:48:57.117127 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:57.117109    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xggf7"
Sep 18 16:48:57.117383 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:57.117351    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xggf7" podUID="056bb4ff-01e7-45b4-b5d0-e15f0779692b"
Sep 18 16:48:57.117822 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:57.117678    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrq7r"
Sep 18 16:48:57.117822 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:57.117761    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrq7r" podUID="b7774138-6ff0-4571-8f2e-4a8020126c37"
Sep 18 16:48:58.670064 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:58.670024    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7774138-6ff0-4571-8f2e-4a8020126c37-original-pull-secret\") pod \"global-pull-secret-syncer-wrq7r\" (UID: \"b7774138-6ff0-4571-8f2e-4a8020126c37\") " pod="kube-system/global-pull-secret-syncer-wrq7r"
Sep 18 16:48:58.670516 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:58.670072    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/056bb4ff-01e7-45b4-b5d0-e15f0779692b-metrics-certs\") pod \"network-metrics-daemon-xggf7\" (UID: \"056bb4ff-01e7-45b4-b5d0-e15f0779692b\") " pod="openshift-multus/network-metrics-daemon-xggf7"
Sep 18 16:48:58.670516 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:58.670189    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:48:58.670516 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:58.670191    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 16:48:58.670516 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:58.670256    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/056bb4ff-01e7-45b4-b5d0-e15f0779692b-metrics-certs podName:056bb4ff-01e7-45b4-b5d0-e15f0779692b nodeName:}" failed. No retries permitted until 2026-09-18 16:49:06.670236018 +0000 UTC m=+19.727525530 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/056bb4ff-01e7-45b4-b5d0-e15f0779692b-metrics-certs") pod "network-metrics-daemon-xggf7" (UID: "056bb4ff-01e7-45b4-b5d0-e15f0779692b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:48:58.670516 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:58.670283    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7774138-6ff0-4571-8f2e-4a8020126c37-original-pull-secret podName:b7774138-6ff0-4571-8f2e-4a8020126c37 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:06.670274108 +0000 UTC m=+19.727563616 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7774138-6ff0-4571-8f2e-4a8020126c37-original-pull-secret") pod "global-pull-secret-syncer-wrq7r" (UID: "b7774138-6ff0-4571-8f2e-4a8020126c37") : object "kube-system"/"original-pull-secret" not registered
Sep 18 16:48:58.771073 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:58.771039    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqvc2\" (UniqueName: \"kubernetes.io/projected/b91105d9-1858-489c-8b13-8086e49a730c-kube-api-access-vqvc2\") pod \"network-check-target-9jp46\" (UID: \"b91105d9-1858-489c-8b13-8086e49a730c\") " pod="openshift-network-diagnostics/network-check-target-9jp46"
Sep 18 16:48:58.771246 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:58.771206    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 16:48:58.771246 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:58.771229    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 16:48:58.771246 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:58.771241    2577 projected.go:196] Error preparing data for projected volume kube-api-access-vqvc2 for pod openshift-network-diagnostics/network-check-target-9jp46: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:48:58.771412 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:58.771296    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b91105d9-1858-489c-8b13-8086e49a730c-kube-api-access-vqvc2 podName:b91105d9-1858-489c-8b13-8086e49a730c nodeName:}" failed. No retries permitted until 2026-09-18 16:49:06.771279598 +0000 UTC m=+19.828569107 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqvc2" (UniqueName: "kubernetes.io/projected/b91105d9-1858-489c-8b13-8086e49a730c-kube-api-access-vqvc2") pod "network-check-target-9jp46" (UID: "b91105d9-1858-489c-8b13-8086e49a730c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:48:59.117889 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:59.117824    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrq7r"
Sep 18 16:48:59.118057 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:59.117935    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrq7r" podUID="b7774138-6ff0-4571-8f2e-4a8020126c37"
Sep 18 16:48:59.118419 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:59.118288    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9jp46"
Sep 18 16:48:59.118419 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:59.118385    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9jp46" podUID="b91105d9-1858-489c-8b13-8086e49a730c"
Sep 18 16:48:59.118419 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:48:59.118407    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xggf7"
Sep 18 16:48:59.118648 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:48:59.118496    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xggf7" podUID="056bb4ff-01e7-45b4-b5d0-e15f0779692b"
Sep 18 16:49:01.116800 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:01.116764    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xggf7"
Sep 18 16:49:01.116800 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:01.116782    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9jp46"
Sep 18 16:49:01.117325 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:01.116908    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrq7r"
Sep 18 16:49:01.117325 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:01.116909    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xggf7" podUID="056bb4ff-01e7-45b4-b5d0-e15f0779692b"
Sep 18 16:49:01.117325 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:01.117038    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9jp46" podUID="b91105d9-1858-489c-8b13-8086e49a730c"
Sep 18 16:49:01.117325 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:01.117114    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrq7r" podUID="b7774138-6ff0-4571-8f2e-4a8020126c37"
Sep 18 16:49:03.117095 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:03.117057    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9jp46"
Sep 18 16:49:03.117584 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:03.117066    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrq7r"
Sep 18 16:49:03.117584 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:03.117185    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9jp46" podUID="b91105d9-1858-489c-8b13-8086e49a730c"
Sep 18 16:49:03.117584 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:03.117066    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xggf7"
Sep 18 16:49:03.117584 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:03.117267    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrq7r" podUID="b7774138-6ff0-4571-8f2e-4a8020126c37"
Sep 18 16:49:03.117584 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:03.117347    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xggf7" podUID="056bb4ff-01e7-45b4-b5d0-e15f0779692b"
Sep 18 16:49:05.116561 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:05.116508    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9jp46"
Sep 18 16:49:05.116997 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:05.116519    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xggf7"
Sep 18 16:49:05.116997 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:05.116664    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9jp46" podUID="b91105d9-1858-489c-8b13-8086e49a730c"
Sep 18 16:49:05.116997 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:05.116685    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrq7r"
Sep 18 16:49:05.116997 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:05.116812    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xggf7" podUID="056bb4ff-01e7-45b4-b5d0-e15f0779692b"
Sep 18 16:49:05.116997 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:05.116944    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrq7r" podUID="b7774138-6ff0-4571-8f2e-4a8020126c37"
Sep 18 16:49:06.729104 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:06.729063    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7774138-6ff0-4571-8f2e-4a8020126c37-original-pull-secret\") pod \"global-pull-secret-syncer-wrq7r\" (UID: \"b7774138-6ff0-4571-8f2e-4a8020126c37\") " pod="kube-system/global-pull-secret-syncer-wrq7r"
Sep 18 16:49:06.729560 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:06.729119    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/056bb4ff-01e7-45b4-b5d0-e15f0779692b-metrics-certs\") pod \"network-metrics-daemon-xggf7\" (UID: \"056bb4ff-01e7-45b4-b5d0-e15f0779692b\") " pod="openshift-multus/network-metrics-daemon-xggf7"
Sep 18 16:49:06.729560 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:06.729188    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 16:49:06.729560 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:06.729211    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:49:06.729560 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:06.729257    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7774138-6ff0-4571-8f2e-4a8020126c37-original-pull-secret podName:b7774138-6ff0-4571-8f2e-4a8020126c37 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:22.729237833 +0000 UTC m=+35.786527347 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7774138-6ff0-4571-8f2e-4a8020126c37-original-pull-secret") pod "global-pull-secret-syncer-wrq7r" (UID: "b7774138-6ff0-4571-8f2e-4a8020126c37") : object "kube-system"/"original-pull-secret" not registered
Sep 18 16:49:06.729560 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:06.729273    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/056bb4ff-01e7-45b4-b5d0-e15f0779692b-metrics-certs podName:056bb4ff-01e7-45b4-b5d0-e15f0779692b nodeName:}" failed. No retries permitted until 2026-09-18 16:49:22.729265725 +0000 UTC m=+35.786555234 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/056bb4ff-01e7-45b4-b5d0-e15f0779692b-metrics-certs") pod "network-metrics-daemon-xggf7" (UID: "056bb4ff-01e7-45b4-b5d0-e15f0779692b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:49:06.830465 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:06.830426    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqvc2\" (UniqueName: \"kubernetes.io/projected/b91105d9-1858-489c-8b13-8086e49a730c-kube-api-access-vqvc2\") pod \"network-check-target-9jp46\" (UID: \"b91105d9-1858-489c-8b13-8086e49a730c\") " pod="openshift-network-diagnostics/network-check-target-9jp46"
Sep 18 16:49:06.830649 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:06.830632    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 16:49:06.830691 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:06.830661    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 16:49:06.830691 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:06.830674    2577 projected.go:196] Error preparing data for projected volume kube-api-access-vqvc2 for pod openshift-network-diagnostics/network-check-target-9jp46: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:49:06.830756 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:06.830736    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b91105d9-1858-489c-8b13-8086e49a730c-kube-api-access-vqvc2 podName:b91105d9-1858-489c-8b13-8086e49a730c nodeName:}" failed. No retries permitted until 2026-09-18 16:49:22.830717406 +0000 UTC m=+35.888007016 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqvc2" (UniqueName: "kubernetes.io/projected/b91105d9-1858-489c-8b13-8086e49a730c-kube-api-access-vqvc2") pod "network-check-target-9jp46" (UID: "b91105d9-1858-489c-8b13-8086e49a730c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:49:07.116754 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:07.116723    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrq7r"
Sep 18 16:49:07.116923 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:07.116739    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xggf7"
Sep 18 16:49:07.116923 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:07.116849    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9jp46"
Sep 18 16:49:07.116923 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:07.116861    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrq7r" podUID="b7774138-6ff0-4571-8f2e-4a8020126c37"
Sep 18 16:49:07.117081 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:07.116942    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xggf7" podUID="056bb4ff-01e7-45b4-b5d0-e15f0779692b"
Sep 18 16:49:07.117081 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:07.117029    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9jp46" podUID="b91105d9-1858-489c-8b13-8086e49a730c"
Sep 18 16:49:09.117942 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:09.117909    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xggf7"
Sep 18 16:49:09.118296 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:09.117955    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrq7r"
Sep 18 16:49:09.118296 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:09.118034    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xggf7" podUID="056bb4ff-01e7-45b4-b5d0-e15f0779692b"
Sep 18 16:49:09.118296 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:09.118063    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrq7r" podUID="b7774138-6ff0-4571-8f2e-4a8020126c37"
Sep 18 16:49:09.118296 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:09.118100    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9jp46"
Sep 18 16:49:09.118296 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:09.118160    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9jp46" podUID="b91105d9-1858-489c-8b13-8086e49a730c"
Sep 18 16:49:10.204712 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:10.204486    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qtj2k" event={"ID":"6f5452b4-e748-4bf0-a74d-6f0bf1cb2736","Type":"ContainerStarted","Data":"16f31a5115042e13eaabc52bf858f197618c6b915110c9c9f8c9d6185e8712d6"}
Sep 18 16:49:10.206242 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:10.206211    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mrfpx" event={"ID":"b2091824-1069-4f53-8ed7-963ad1fb6076","Type":"ContainerStarted","Data":"33b1893d1c16346ec37d0b8bae2601c3ab429582c42c933d9b413a2d02eeb656"}
Sep 18 16:49:10.207894 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:10.207872    2577 generic.go:356] "Generic (PLEG): container finished" podID="e45baf5d-f62f-40d2-b368-51925ce7d95c" containerID="22cf5f2d870b33540e17eb150d1c2fdad50b855680fd3da1fb93ab59a13076c1" exitCode=0
Sep 18 16:49:10.208004 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:10.207967    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lj92" event={"ID":"e45baf5d-f62f-40d2-b368-51925ce7d95c","Type":"ContainerDied","Data":"22cf5f2d870b33540e17eb150d1c2fdad50b855680fd3da1fb93ab59a13076c1"}
Sep 18 16:49:10.211239 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:10.211221    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktklw_3c1064f0-18a0-4c28-8fb9-a320535dcbbf/ovn-acl-logging/0.log"
Sep 18 16:49:10.211742 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:10.211646    2577 generic.go:356] "Generic (PLEG): container finished" podID="3c1064f0-18a0-4c28-8fb9-a320535dcbbf" containerID="61fca0a484526a4fc8d07fc4ef0769f1cc2cddaeba9aa92e625efe8809b1704e" exitCode=1
Sep 18 16:49:10.211742 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:10.211679    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktklw" event={"ID":"3c1064f0-18a0-4c28-8fb9-a320535dcbbf","Type":"ContainerStarted","Data":"6f8da5c0d5c8d426f757c13efcb1c6dcf6267c77b1b221c720f6e7c8c180a9a0"}
Sep 18 16:49:10.211910 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:10.211756    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktklw" event={"ID":"3c1064f0-18a0-4c28-8fb9-a320535dcbbf","Type":"ContainerStarted","Data":"91635a3b9699004c55a7ba3dc488e92367b2e7955d81a315174838bfe6f75cc8"}
Sep 18 16:49:10.211910 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:10.211806    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktklw" event={"ID":"3c1064f0-18a0-4c28-8fb9-a320535dcbbf","Type":"ContainerStarted","Data":"774ef2c55c0eddaaf19e67e8aa93a271b3f1c979fc4a3d43bd8a4cd232b69366"}
Sep 18 16:49:10.211910 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:10.211851    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktklw" event={"ID":"3c1064f0-18a0-4c28-8fb9-a320535dcbbf","Type":"ContainerStarted","Data":"2ed3fa219b440002d8463cb54c3e46b9d53e8d345005eee21cfcc50c8b41c2b5"}
Sep 18 16:49:10.211910 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:10.211903    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktklw" event={"ID":"3c1064f0-18a0-4c28-8fb9-a320535dcbbf","Type":"ContainerDied","Data":"61fca0a484526a4fc8d07fc4ef0769f1cc2cddaeba9aa92e625efe8809b1704e"}
Sep 18 16:49:10.212065 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:10.211950    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktklw" event={"ID":"3c1064f0-18a0-4c28-8fb9-a320535dcbbf","Type":"ContainerStarted","Data":"8661568f229ab08592e9d1cdf0934204fc9accdd5a910180cd826d6277bfa4f7"}
Sep 18 16:49:10.213524 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:10.213498    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v7rt9" event={"ID":"cb0bea49-0666-42ee-9d96-221eee1b5aa8","Type":"ContainerStarted","Data":"8c8f9232514d86f2b2a6da19790b90d250f8bba593f7e653d2d90bf9c4cf3f4c"}
Sep 18 16:49:10.215184 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:10.215161    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l2bv5" event={"ID":"1534a00e-3417-441a-9df8-29be1ac81b77","Type":"ContainerStarted","Data":"efc577582f4322fcd3511a1ccee13ffe90b016b19da8e1cb74ea45395580c906"}
Sep 18 16:49:10.217033 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:10.217008    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tnt8f" event={"ID":"6f5060ba-247c-476d-b367-df9921e3e446","Type":"ContainerStarted","Data":"da334554890148d763db597c4c092247cf90cf6112bb86e8ab3c025b612d1f2f"}
Sep 18 16:49:10.230634 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:10.230564    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mrfpx" podStartSLOduration=4.055956345 podStartE2EDuration="21.230543158s" totalImagesPullingTime="17.174586813s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:10.230084677 +0000 UTC m=+23.287374208" watchObservedRunningTime="2026-09-18 16:49:10.230543158 +0000 UTC m=+23.287832680"
Sep 18 16:49:10.230895 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:10.230795    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-41.ec2.internal" podStartSLOduration=20.230786536 podStartE2EDuration="20.230786536s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:48:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:48:54.18420362 +0000 UTC m=+7.241493149" watchObservedRunningTime="2026-09-18 16:49:10.230786536 +0000 UTC m=+23.288076064"
Sep 18 16:49:10.252998 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:10.252949    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-v7rt9" podStartSLOduration=4.161666263 podStartE2EDuration="21.252900394s" totalImagesPullingTime="17.091234131s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:10.252817812 +0000 UTC m=+23.310107339" watchObservedRunningTime="2026-09-18 16:49:10.252900394 +0000 UTC m=+23.310189923"
Sep 18 16:49:10.277357 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:10.277107    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tnt8f" podStartSLOduration=4.144490994 podStartE2EDuration="21.277087772s" totalImagesPullingTime="17.132596778s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:10.276984805 +0000 UTC m=+23.334274332" watchObservedRunningTime="2026-09-18 16:49:10.277087772 +0000 UTC m=+23.334377301"
Sep 18 16:49:10.778415 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:10.778392    2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 18 16:49:11.078251 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:11.078019    2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T16:49:10.778409672Z","UUID":"a6434a16-8aa0-4091-a855-b7bd70f53841","Handler":null,"Name":"","Endpoint":""}
Sep 18 16:49:11.079745 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:11.079722    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 18 16:49:11.079855 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:11.079762    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 18 16:49:11.116951 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:11.116926    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9jp46"
Sep 18 16:49:11.117095 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:11.116955    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xggf7"
Sep 18 16:49:11.117095 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:11.116926    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrq7r"
Sep 18 16:49:11.117095 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:11.117024    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9jp46" podUID="b91105d9-1858-489c-8b13-8086e49a730c"
Sep 18 16:49:11.117187 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:11.117117    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrq7r" podUID="b7774138-6ff0-4571-8f2e-4a8020126c37"
Sep 18 16:49:11.117218 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:11.117196    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xggf7" podUID="056bb4ff-01e7-45b4-b5d0-e15f0779692b"
Sep 18 16:49:11.222250 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:11.222211    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qtj2k" event={"ID":"6f5452b4-e748-4bf0-a74d-6f0bf1cb2736","Type":"ContainerStarted","Data":"94e0936a267fed53a3a1402af4a22ee873645b8b39e51b2343b62ba97df18c1a"}
Sep 18 16:49:11.224141 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:11.224098    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-95vmn" event={"ID":"ced56977-5e12-472f-af6d-f0a44d85db88","Type":"ContainerStarted","Data":"b4f729ae31a9b7b50cfe11140c0b3d9e267437f948ec276ed41f3bbe402070ac"}
Sep 18 16:49:11.239965 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:11.239915    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-l2bv5" podStartSLOduration=5.147341238 podStartE2EDuration="22.23989782s" totalImagesPullingTime="17.092556582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:10.331826209 +0000 UTC m=+23.389115737" watchObservedRunningTime="2026-09-18 16:49:11.23989782 +0000 UTC m=+24.297187348"
Sep 18 16:49:11.240106 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:11.240052    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-95vmn" podStartSLOduration=5.1018624 podStartE2EDuration="22.240047168s" totalImagesPullingTime="17.138184768s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:11.239455078 +0000 UTC m=+24.296744606" watchObservedRunningTime="2026-09-18 16:49:11.240047168 +0000 UTC m=+24.297336695"
Sep 18 16:49:12.228772 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:12.228729    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qtj2k" event={"ID":"6f5452b4-e748-4bf0-a74d-6f0bf1cb2736","Type":"ContainerStarted","Data":"6c20da63c887d8715c8d737c3bf24a1c9695a01145a908ecc8732e615282380b"}
Sep 18 16:49:12.246307 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:12.246264    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qtj2k" podStartSLOduration=3.750387486 podStartE2EDuration="23.246248348s" totalImagesPullingTime="19.495860862s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:48:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:12.24570788 +0000 UTC m=+25.302997408" watchObservedRunningTime="2026-09-18 16:49:12.246248348 +0000 UTC m=+25.303537920"
Sep 18 16:49:13.116429 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:13.116393    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrq7r"
Sep 18 16:49:13.116614 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:13.116396    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9jp46"
Sep 18 16:49:13.116614 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:13.116526    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrq7r" podUID="b7774138-6ff0-4571-8f2e-4a8020126c37"
Sep 18 16:49:13.116614 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:13.116394    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xggf7"
Sep 18 16:49:13.116782 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:13.116645    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9jp46" podUID="b91105d9-1858-489c-8b13-8086e49a730c"
Sep 18 16:49:13.116782 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:13.116724    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xggf7" podUID="056bb4ff-01e7-45b4-b5d0-e15f0779692b"
Sep 18 16:49:13.235247 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:13.235217    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktklw_3c1064f0-18a0-4c28-8fb9-a320535dcbbf/ovn-acl-logging/0.log"
Sep 18 16:49:13.235717 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:13.235689    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktklw" event={"ID":"3c1064f0-18a0-4c28-8fb9-a320535dcbbf","Type":"ContainerStarted","Data":"736f745ffc78353a82e949b9f50fa11498dc2373ee3a106f6608ee4d928405bc"}
Sep 18 16:49:15.109391 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:15.109209    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-l2bv5"
Sep 18 16:49:15.110153 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:15.109989    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-l2bv5"
Sep 18 16:49:15.116772 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:15.116747    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xggf7"
Sep 18 16:49:15.116887 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:15.116752    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9jp46"
Sep 18 16:49:15.116887 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:15.116836    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xggf7" podUID="056bb4ff-01e7-45b4-b5d0-e15f0779692b"
Sep 18 16:49:15.117004 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:15.116755    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrq7r"
Sep 18 16:49:15.117004 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:15.116924    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9jp46" podUID="b91105d9-1858-489c-8b13-8086e49a730c"
Sep 18 16:49:15.117061 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:15.116999    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrq7r" podUID="b7774138-6ff0-4571-8f2e-4a8020126c37"
Sep 18 16:49:15.241502 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:15.241468    2577 generic.go:356] "Generic (PLEG): container finished" podID="e45baf5d-f62f-40d2-b368-51925ce7d95c" containerID="1c9e4478df62f419a45bf11ab2a37b0b2e934739880d1cffbdaac708f28f4ae4" exitCode=0
Sep 18 16:49:15.241696 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:15.241554    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lj92" event={"ID":"e45baf5d-f62f-40d2-b368-51925ce7d95c","Type":"ContainerDied","Data":"1c9e4478df62f419a45bf11ab2a37b0b2e934739880d1cffbdaac708f28f4ae4"}
Sep 18 16:49:15.245369 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:15.245349    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktklw_3c1064f0-18a0-4c28-8fb9-a320535dcbbf/ovn-acl-logging/0.log"
Sep 18 16:49:15.245777 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:15.245758    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktklw" event={"ID":"3c1064f0-18a0-4c28-8fb9-a320535dcbbf","Type":"ContainerStarted","Data":"cee5f46391f3e74de31f05b7b70fff30d8a11c3477ea799d5f6471a2799e5a97"}
Sep 18 16:49:15.246092 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:15.246071    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-l2bv5"
Sep 18 16:49:15.246297 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:15.246283    2577 scope.go:117] "RemoveContainer" containerID="61fca0a484526a4fc8d07fc4ef0769f1cc2cddaeba9aa92e625efe8809b1704e"
Sep 18 16:49:15.246357 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:15.246336    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-l2bv5"
Sep 18 16:49:16.251817 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:16.251786    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktklw_3c1064f0-18a0-4c28-8fb9-a320535dcbbf/ovn-acl-logging/0.log"
Sep 18 16:49:16.252321 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:16.252205    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktklw" event={"ID":"3c1064f0-18a0-4c28-8fb9-a320535dcbbf","Type":"ContainerStarted","Data":"1d98dc1e70f69c862a83aceaecc8cdf68ca9710bff64285482f397b8b08ebda1"}
Sep 18 16:49:16.252377 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:16.252323    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:49:16.252422 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:16.252381    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:49:16.252581 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:16.252559    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:49:16.271695 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:16.271671    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:49:16.271830 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:16.271767    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:49:16.276416 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:16.276374    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ktklw" podStartSLOduration=10.126069119 podStartE2EDuration="27.276360445s" totalImagesPullingTime="17.150291326s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:16.274983804 +0000 UTC m=+29.332273332" watchObservedRunningTime="2026-09-18 16:49:16.276360445 +0000 UTC m=+29.333649973"
Sep 18 16:49:16.297462 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:16.297051    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wrq7r"]
Sep 18 16:49:16.297462 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:16.297179    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrq7r"
Sep 18 16:49:16.297462 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:16.297295    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrq7r" podUID="b7774138-6ff0-4571-8f2e-4a8020126c37"
Sep 18 16:49:16.297816 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:16.297790    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9jp46"]
Sep 18 16:49:16.297929 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:16.297886    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9jp46"
Sep 18 16:49:16.297992 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:16.297975    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9jp46" podUID="b91105d9-1858-489c-8b13-8086e49a730c"
Sep 18 16:49:16.298365 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:16.298348    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xggf7"]
Sep 18 16:49:16.298437 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:16.298426    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xggf7"
Sep 18 16:49:16.298525 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:16.298510    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xggf7" podUID="056bb4ff-01e7-45b4-b5d0-e15f0779692b"
Sep 18 16:49:17.256297 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:17.256265    2577 generic.go:356] "Generic (PLEG): container finished" podID="e45baf5d-f62f-40d2-b368-51925ce7d95c" containerID="5d9a161e0ac100c6ac9ab5e234c44255b5a070a555fe260f2ae35820053ce852" exitCode=0
Sep 18 16:49:17.256695 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:17.256345    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lj92" event={"ID":"e45baf5d-f62f-40d2-b368-51925ce7d95c","Type":"ContainerDied","Data":"5d9a161e0ac100c6ac9ab5e234c44255b5a070a555fe260f2ae35820053ce852"}
Sep 18 16:49:18.116185 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:18.116141    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9jp46"
Sep 18 16:49:18.116185 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:18.116168    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrq7r"
Sep 18 16:49:18.116185 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:18.116141    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xggf7"
Sep 18 16:49:18.116431 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:18.116264    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrq7r" podUID="b7774138-6ff0-4571-8f2e-4a8020126c37"
Sep 18 16:49:18.116431 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:18.116317    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xggf7" podUID="056bb4ff-01e7-45b4-b5d0-e15f0779692b"
Sep 18 16:49:18.116431 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:18.116384    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9jp46" podUID="b91105d9-1858-489c-8b13-8086e49a730c"
Sep 18 16:49:19.262583 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:19.262545    2577 generic.go:356] "Generic (PLEG): container finished" podID="e45baf5d-f62f-40d2-b368-51925ce7d95c" containerID="bb1d4ddbd759aa67a3dd4ebfab61f53b543f72031951ca2ae8d4f3aa3957609d" exitCode=0
Sep 18 16:49:19.262583 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:19.262560    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lj92" event={"ID":"e45baf5d-f62f-40d2-b368-51925ce7d95c","Type":"ContainerDied","Data":"bb1d4ddbd759aa67a3dd4ebfab61f53b543f72031951ca2ae8d4f3aa3957609d"}
Sep 18 16:49:20.116459 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:20.116422    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xggf7"
Sep 18 16:49:20.116669 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:20.116438    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9jp46"
Sep 18 16:49:20.116669 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:20.116570    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xggf7" podUID="056bb4ff-01e7-45b4-b5d0-e15f0779692b"
Sep 18 16:49:20.116669 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:20.116438    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrq7r"
Sep 18 16:49:20.116669 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:20.116644    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9jp46" podUID="b91105d9-1858-489c-8b13-8086e49a730c"
Sep 18 16:49:20.116894 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:20.116702    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrq7r" podUID="b7774138-6ff0-4571-8f2e-4a8020126c37"
Sep 18 16:49:22.116977 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.116931    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xggf7"
Sep 18 16:49:22.117468 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.116931    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9jp46"
Sep 18 16:49:22.117468 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:22.117074    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xggf7" podUID="056bb4ff-01e7-45b4-b5d0-e15f0779692b"
Sep 18 16:49:22.117468 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:22.117184    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9jp46" podUID="b91105d9-1858-489c-8b13-8086e49a730c"
Sep 18 16:49:22.117468 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.116931    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrq7r"
Sep 18 16:49:22.117468 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:22.117298    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrq7r" podUID="b7774138-6ff0-4571-8f2e-4a8020126c37"
Sep 18 16:49:22.121809 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.121785    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-41.ec2.internal" event="NodeReady"
Sep 18 16:49:22.121914 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.121898    2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 18 16:49:22.179400 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.179358    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-mk2d9"]
Sep 18 16:49:22.205332 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.205301    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6888775986-fl24h"]
Sep 18 16:49:22.205557 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.205515    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-mk2d9"
Sep 18 16:49:22.208015 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.207991    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 18 16:49:22.208130 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.208058    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 18 16:49:22.208192 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.208141    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-nsvdj\""
Sep 18 16:49:22.208550 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.208365    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 18 16:49:22.208550 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.208424    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 18 16:49:22.213838 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.213818    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 18 16:49:22.219662 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.219570    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-x9bk4"]
Sep 18 16:49:22.219662 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.219659    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:49:22.222652 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.222635    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-b5tkf\""
Sep 18 16:49:22.222763 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.222635    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 18 16:49:22.223018 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.222999    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 18 16:49:22.223090 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.223034    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 18 16:49:22.240189 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.240001    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 18 16:49:22.243420 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.243390    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-czc2k"]
Sep 18 16:49:22.243560 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.243518    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-x9bk4"
Sep 18 16:49:22.245818 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.245800    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 18 16:49:22.245929 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.245800    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 18 16:49:22.245929 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.245800    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-xvqxk\""
Sep 18 16:49:22.258415 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.258392    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-mk2d9"]
Sep 18 16:49:22.258561 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.258433    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-x7gwl"]
Sep 18 16:49:22.258741 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.258720    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-czc2k"
Sep 18 16:49:22.261134 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.261114    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 18 16:49:22.261134 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.261133    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 18 16:49:22.261298 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.261114    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-tts48\""
Sep 18 16:49:22.266740 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.266721    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-t4p6q"]
Sep 18 16:49:22.266863 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.266848    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-x7gwl"
Sep 18 16:49:22.269438 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.269312    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 18 16:49:22.269438 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.269327    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 18 16:49:22.269438 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.269336    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 18 16:49:22.269438 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.269381    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-w4nmw\""
Sep 18 16:49:22.282939 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.282875    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87vfw"]
Sep 18 16:49:22.283040 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.283003    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-t4p6q"
Sep 18 16:49:22.285336 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.285314    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 18 16:49:22.285941 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.285872    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 18 16:49:22.286047 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.285940    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 18 16:49:22.286047 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.285998    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 18 16:49:22.286140 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.286078    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-78djb\""
Sep 18 16:49:22.292155 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.292118    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 18 16:49:22.295040 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.295022    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-qnb85"]
Sep 18 16:49:22.295152 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.295134    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87vfw"
Sep 18 16:49:22.297191 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.297172    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 18 16:49:22.297353 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.297326    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 18 16:49:22.297458 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.297376    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 18 16:49:22.297458 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.297402    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-m2wks\""
Sep 18 16:49:22.297600 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.297583    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 18 16:49:22.306374 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.306354    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6888775986-fl24h"]
Sep 18 16:49:22.306473 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.306383    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-gxdnl"]
Sep 18 16:49:22.306473 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.306455    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qnb85"
Sep 18 16:49:22.308457 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.308441    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 18 16:49:22.308726 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.308701    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 18 16:49:22.308861 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.308806    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-nrjcz\""
Sep 18 16:49:22.309118 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.309050    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 18 16:49:22.309245 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.309225    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 18 16:49:22.318697 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.318670    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-x9bk4"]
Sep 18 16:49:22.318807 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.318706    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-x7gwl"]
Sep 18 16:49:22.318807 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.318735    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-t4p6q"]
Sep 18 16:49:22.318807 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.318755    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-czc2k"]
Sep 18 16:49:22.318807 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.318773    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-gxdnl"]
Sep 18 16:49:22.318807 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.318790    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-qnb85"]
Sep 18 16:49:22.319034 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.318811    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87vfw"]
Sep 18 16:49:22.319034 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.318821    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-gxdnl"
Sep 18 16:49:22.319034 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.318843    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ttxjb"]
Sep 18 16:49:22.320984 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.320963    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 18 16:49:22.321076 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.320998    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 18 16:49:22.321076 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.321035    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-48d6r\""
Sep 18 16:49:22.331210 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.331189    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ttxjb"]
Sep 18 16:49:22.331323 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.331298    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ttxjb"
Sep 18 16:49:22.333553 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.333325    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 18 16:49:22.333553 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.333369    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 18 16:49:22.333553 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.333470    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 18 16:49:22.333767 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.333738    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 18 16:49:22.333878 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.333841    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4lvzz\""
Sep 18 16:49:22.343239 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.343218    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52kjh\" (UniqueName: \"kubernetes.io/projected/e5bb8736-917b-4bb1-bf19-f6b88a528de8-kube-api-access-52kjh\") pod \"insights-operator-6f9c644dd9-mk2d9\" (UID: \"e5bb8736-917b-4bb1-bf19-f6b88a528de8\") " pod="openshift-insights/insights-operator-6f9c644dd9-mk2d9"
Sep 18 16:49:22.343327 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.343253    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2200d387-c1d6-477d-ab65-eb96dc6b3259-image-registry-private-configuration\") pod \"image-registry-6888775986-fl24h\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") " pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:49:22.343327 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.343285    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4mps\" (UniqueName: \"kubernetes.io/projected/bcd40bb5-3d11-4d73-9b14-0372247d9bc7-kube-api-access-j4mps\") pod \"volume-data-source-validator-5c4db8bdf9-czc2k\" (UID: \"bcd40bb5-3d11-4d73-9b14-0372247d9bc7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-czc2k"
Sep 18 16:49:22.343431 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.343347    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2200d387-c1d6-477d-ab65-eb96dc6b3259-trusted-ca\") pod \"image-registry-6888775986-fl24h\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") " pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:49:22.343431 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.343391    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5bb8736-917b-4bb1-bf19-f6b88a528de8-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-mk2d9\" (UID: \"e5bb8736-917b-4bb1-bf19-f6b88a528de8\") " pod="openshift-insights/insights-operator-6f9c644dd9-mk2d9"
Sep 18 16:49:22.343431 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.343411    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgwt6\" (UniqueName: \"kubernetes.io/projected/2200d387-c1d6-477d-ab65-eb96dc6b3259-kube-api-access-cgwt6\") pod \"image-registry-6888775986-fl24h\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") " pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:49:22.343431 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.343431    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e5bb8736-917b-4bb1-bf19-f6b88a528de8-snapshots\") pod \"insights-operator-6f9c644dd9-mk2d9\" (UID: \"e5bb8736-917b-4bb1-bf19-f6b88a528de8\") " pod="openshift-insights/insights-operator-6f9c644dd9-mk2d9"
Sep 18 16:49:22.343638 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.343450    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2200d387-c1d6-477d-ab65-eb96dc6b3259-ca-trust-extracted\") pod \"image-registry-6888775986-fl24h\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") " pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:49:22.343638 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.343516    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2200d387-c1d6-477d-ab65-eb96dc6b3259-registry-certificates\") pod \"image-registry-6888775986-fl24h\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") " pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:49:22.343638 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.343565    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5d212c2-ba22-4283-8333-ac5f88635268-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-x7gwl\" (UID: \"c5d212c2-ba22-4283-8333-ac5f88635268\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-x7gwl"
Sep 18 16:49:22.343638 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.343591    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr86s\" (UniqueName: \"kubernetes.io/projected/c5d212c2-ba22-4283-8333-ac5f88635268-kube-api-access-lr86s\") pod \"cluster-samples-operator-685d7d68b5-x7gwl\" (UID: \"c5d212c2-ba22-4283-8333-ac5f88635268\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-x7gwl"
Sep 18 16:49:22.343638 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.343615    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5bb8736-917b-4bb1-bf19-f6b88a528de8-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-mk2d9\" (UID: \"e5bb8736-917b-4bb1-bf19-f6b88a528de8\") " pod="openshift-insights/insights-operator-6f9c644dd9-mk2d9"
Sep 18 16:49:22.343638 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.343638    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5bb8736-917b-4bb1-bf19-f6b88a528de8-serving-cert\") pod \"insights-operator-6f9c644dd9-mk2d9\" (UID: \"e5bb8736-917b-4bb1-bf19-f6b88a528de8\") " pod="openshift-insights/insights-operator-6f9c644dd9-mk2d9"
Sep 18 16:49:22.343886 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.343679    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2200d387-c1d6-477d-ab65-eb96dc6b3259-bound-sa-token\") pod \"image-registry-6888775986-fl24h\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") " pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:49:22.343886 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.343701    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-x9bk4\" (UID: \"5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-x9bk4"
Sep 18 16:49:22.343886 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.343738    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5bb8736-917b-4bb1-bf19-f6b88a528de8-tmp\") pod \"insights-operator-6f9c644dd9-mk2d9\" (UID: \"e5bb8736-917b-4bb1-bf19-f6b88a528de8\") " pod="openshift-insights/insights-operator-6f9c644dd9-mk2d9"
Sep 18 16:49:22.343886 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.343759    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2200d387-c1d6-477d-ab65-eb96dc6b3259-registry-tls\") pod \"image-registry-6888775986-fl24h\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") " pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:49:22.343886 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.343782    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-x9bk4\" (UID: \"5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-x9bk4"
Sep 18 16:49:22.343886 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.343823    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2200d387-c1d6-477d-ab65-eb96dc6b3259-installation-pull-secrets\") pod \"image-registry-6888775986-fl24h\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") " pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:49:22.424369 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.424330    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2bv5_1534a00e-3417-441a-9df8-29be1ac81b77/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:22.445019 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.444991    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/60bae8ea-9599-47f8-b066-df7c46c011b3-config\") pod \"console-operator-fd4bb46c-t4p6q\" (UID: \"60bae8ea-9599-47f8-b066-df7c46c011b3\") " pod="openshift-console-operator/console-operator-fd4bb46c-t4p6q"
Sep 18 16:49:22.445170 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.445026    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/941c1b4b-8d2b-4c14-b741-f00e2032d493-config\") pod \"service-ca-operator-57cdc4b768-qnb85\" (UID: \"941c1b4b-8d2b-4c14-b741-f00e2032d493\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qnb85"
Sep 18 16:49:22.445170 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.445055    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fc84d1c-d436-4b1a-9557-182688c69eff-tmp-dir\") pod \"dns-default-ttxjb\" (UID: \"9fc84d1c-d436-4b1a-9557-182688c69eff\") " pod="openshift-dns/dns-default-ttxjb"
Sep 18 16:49:22.445170 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.445109    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr86s\" (UniqueName: \"kubernetes.io/projected/c5d212c2-ba22-4283-8333-ac5f88635268-kube-api-access-lr86s\") pod \"cluster-samples-operator-685d7d68b5-x7gwl\" (UID: \"c5d212c2-ba22-4283-8333-ac5f88635268\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-x7gwl"
Sep 18 16:49:22.445326 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.445179    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-x9bk4\" (UID: \"5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-x9bk4"
Sep 18 16:49:22.445326 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.445218    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/60bae8ea-9599-47f8-b066-df7c46c011b3-serving-cert\") pod \"console-operator-fd4bb46c-t4p6q\" (UID: \"60bae8ea-9599-47f8-b066-df7c46c011b3\") " pod="openshift-console-operator/console-operator-fd4bb46c-t4p6q"
Sep 18 16:49:22.445424 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.445338    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/941c1b4b-8d2b-4c14-b741-f00e2032d493-serving-cert\") pod \"service-ca-operator-57cdc4b768-qnb85\" (UID: \"941c1b4b-8d2b-4c14-b741-f00e2032d493\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qnb85"
Sep 18 16:49:22.445424 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.445378    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-x9bk4\" (UID: \"5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-x9bk4"
Sep 18 16:49:22.445562 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.445433    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2200d387-c1d6-477d-ab65-eb96dc6b3259-image-registry-private-configuration\") pod \"image-registry-6888775986-fl24h\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") " pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:49:22.445562 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.445460    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4mps\" (UniqueName: \"kubernetes.io/projected/bcd40bb5-3d11-4d73-9b14-0372247d9bc7-kube-api-access-j4mps\") pod \"volume-data-source-validator-5c4db8bdf9-czc2k\" (UID: \"bcd40bb5-3d11-4d73-9b14-0372247d9bc7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-czc2k"
Sep 18 16:49:22.445562 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.445490    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fc84d1c-d436-4b1a-9557-182688c69eff-metrics-tls\") pod \"dns-default-ttxjb\" (UID: \"9fc84d1c-d436-4b1a-9557-182688c69eff\") " pod="openshift-dns/dns-default-ttxjb"
Sep 18 16:49:22.445562 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:22.445498    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 18 16:49:22.445562 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.445526    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8z68\" (UniqueName: \"kubernetes.io/projected/cd56277f-5047-4f0a-9025-9f5e98acb703-kube-api-access-p8z68\") pod \"network-check-source-7cbc45fddc-gxdnl\" (UID: \"cd56277f-5047-4f0a-9025-9f5e98acb703\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-gxdnl"
Sep 18 16:49:22.445801 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.445574    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5bb8736-917b-4bb1-bf19-f6b88a528de8-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-mk2d9\" (UID: \"e5bb8736-917b-4bb1-bf19-f6b88a528de8\") " pod="openshift-insights/insights-operator-6f9c644dd9-mk2d9"
Sep 18 16:49:22.445801 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:22.445594    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965-networking-console-plugin-cert podName:5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:22.945574146 +0000 UTC m=+36.002863655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-x9bk4" (UID: "5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965") : secret "networking-console-plugin-cert" not found
Sep 18 16:49:22.445801 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.445629    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm9b7\" (UniqueName: \"kubernetes.io/projected/941c1b4b-8d2b-4c14-b741-f00e2032d493-kube-api-access-lm9b7\") pod \"service-ca-operator-57cdc4b768-qnb85\" (UID: \"941c1b4b-8d2b-4c14-b741-f00e2032d493\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qnb85"
Sep 18 16:49:22.445801 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.445665    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e5bb8736-917b-4bb1-bf19-f6b88a528de8-snapshots\") pod \"insights-operator-6f9c644dd9-mk2d9\" (UID: \"e5bb8736-917b-4bb1-bf19-f6b88a528de8\") " pod="openshift-insights/insights-operator-6f9c644dd9-mk2d9"
Sep 18 16:49:22.445801 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.445692    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2200d387-c1d6-477d-ab65-eb96dc6b3259-ca-trust-extracted\") pod \"image-registry-6888775986-fl24h\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") " pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:49:22.446047 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.445870    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bf32dd38-8c07-4cb1-bae7-d8f2613669e0-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-87vfw\" (UID: \"bf32dd38-8c07-4cb1-bae7-d8f2613669e0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87vfw"
Sep 18 16:49:22.446047 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.445902    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bf32dd38-8c07-4cb1-bae7-d8f2613669e0-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-87vfw\" (UID: \"bf32dd38-8c07-4cb1-bae7-d8f2613669e0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87vfw"
Sep 18 16:49:22.446047 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.445934    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-x9bk4\" (UID: \"5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-x9bk4"
Sep 18 16:49:22.446047 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.445937    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5d212c2-ba22-4283-8333-ac5f88635268-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-x7gwl\" (UID: \"c5d212c2-ba22-4283-8333-ac5f88635268\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-x7gwl"
Sep 18 16:49:22.446047 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.445993    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5bb8736-917b-4bb1-bf19-f6b88a528de8-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-mk2d9\" (UID: \"e5bb8736-917b-4bb1-bf19-f6b88a528de8\") " pod="openshift-insights/insights-operator-6f9c644dd9-mk2d9"
Sep 18 16:49:22.446047 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:22.446003    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 18 16:49:22.446047 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.446020    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5bb8736-917b-4bb1-bf19-f6b88a528de8-serving-cert\") pod \"insights-operator-6f9c644dd9-mk2d9\" (UID: \"e5bb8736-917b-4bb1-bf19-f6b88a528de8\") " pod="openshift-insights/insights-operator-6f9c644dd9-mk2d9"
Sep 18 16:49:22.446047 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.446046    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2200d387-c1d6-477d-ab65-eb96dc6b3259-bound-sa-token\") pod \"image-registry-6888775986-fl24h\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") " pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:49:22.446443 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:22.446062    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5d212c2-ba22-4283-8333-ac5f88635268-samples-operator-tls podName:c5d212c2-ba22-4283-8333-ac5f88635268 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:22.946046827 +0000 UTC m=+36.003336341 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c5d212c2-ba22-4283-8333-ac5f88635268-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-x7gwl" (UID: "c5d212c2-ba22-4283-8333-ac5f88635268") : secret "samples-operator-tls" not found
Sep 18 16:49:22.446443 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.446068    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2200d387-c1d6-477d-ab65-eb96dc6b3259-ca-trust-extracted\") pod \"image-registry-6888775986-fl24h\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") " pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:49:22.446443 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.446101    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5bb8736-917b-4bb1-bf19-f6b88a528de8-tmp\") pod \"insights-operator-6f9c644dd9-mk2d9\" (UID: \"e5bb8736-917b-4bb1-bf19-f6b88a528de8\") " pod="openshift-insights/insights-operator-6f9c644dd9-mk2d9"
Sep 18 16:49:22.446443 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.446129    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2200d387-c1d6-477d-ab65-eb96dc6b3259-registry-tls\") pod \"image-registry-6888775986-fl24h\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") " pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:49:22.446443 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.446159    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2200d387-c1d6-477d-ab65-eb96dc6b3259-installation-pull-secrets\") pod \"image-registry-6888775986-fl24h\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") " pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:49:22.446443 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.446186    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5rhk\" (UniqueName: \"kubernetes.io/projected/60bae8ea-9599-47f8-b066-df7c46c011b3-kube-api-access-t5rhk\") pod \"console-operator-fd4bb46c-t4p6q\" (UID: \"60bae8ea-9599-47f8-b066-df7c46c011b3\") " pod="openshift-console-operator/console-operator-fd4bb46c-t4p6q"
Sep 18 16:49:22.446443 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.446197    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5bb8736-917b-4bb1-bf19-f6b88a528de8-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-mk2d9\" (UID: \"e5bb8736-917b-4bb1-bf19-f6b88a528de8\") " pod="openshift-insights/insights-operator-6f9c644dd9-mk2d9"
Sep 18 16:49:22.446443 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.446213    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9fc84d1c-d436-4b1a-9557-182688c69eff-config-volume\") pod \"dns-default-ttxjb\" (UID: \"9fc84d1c-d436-4b1a-9557-182688c69eff\") " pod="openshift-dns/dns-default-ttxjb"
Sep 18 16:49:22.446443 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.446274    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52kjh\" (UniqueName: \"kubernetes.io/projected/e5bb8736-917b-4bb1-bf19-f6b88a528de8-kube-api-access-52kjh\") pod \"insights-operator-6f9c644dd9-mk2d9\" (UID: \"e5bb8736-917b-4bb1-bf19-f6b88a528de8\") " pod="openshift-insights/insights-operator-6f9c644dd9-mk2d9"
Sep 18 16:49:22.446443 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.446311    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khdd5\" (UniqueName: \"kubernetes.io/projected/bf32dd38-8c07-4cb1-bae7-d8f2613669e0-kube-api-access-khdd5\") pod \"kube-storage-version-migrator-operator-55889f7b47-87vfw\" (UID: \"bf32dd38-8c07-4cb1-bae7-d8f2613669e0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87vfw"
Sep 18 16:49:22.446443 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.446360    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2200d387-c1d6-477d-ab65-eb96dc6b3259-trusted-ca\") pod \"image-registry-6888775986-fl24h\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") " pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:49:22.446443 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.446389    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/60bae8ea-9599-47f8-b066-df7c46c011b3-trusted-ca\") pod \"console-operator-fd4bb46c-t4p6q\" (UID: \"60bae8ea-9599-47f8-b066-df7c46c011b3\") " pod="openshift-console-operator/console-operator-fd4bb46c-t4p6q"
Sep 18 16:49:22.446443 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.446414    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgwt6\" (UniqueName: \"kubernetes.io/projected/2200d387-c1d6-477d-ab65-eb96dc6b3259-kube-api-access-cgwt6\") pod \"image-registry-6888775986-fl24h\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") " pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:49:22.446443 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.446437    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd8tb\" (UniqueName: \"kubernetes.io/projected/9fc84d1c-d436-4b1a-9557-182688c69eff-kube-api-access-vd8tb\") pod \"dns-default-ttxjb\" (UID: \"9fc84d1c-d436-4b1a-9557-182688c69eff\") " pod="openshift-dns/dns-default-ttxjb"
Sep 18 16:49:22.447124 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.446460    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2200d387-c1d6-477d-ab65-eb96dc6b3259-registry-certificates\") pod \"image-registry-6888775986-fl24h\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") " pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:49:22.447124 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.446591    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e5bb8736-917b-4bb1-bf19-f6b88a528de8-snapshots\") pod \"insights-operator-6f9c644dd9-mk2d9\" (UID: \"e5bb8736-917b-4bb1-bf19-f6b88a528de8\") " pod="openshift-insights/insights-operator-6f9c644dd9-mk2d9"
Sep 18 16:49:22.447124 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:22.446695    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 16:49:22.447124 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:22.446707    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6888775986-fl24h: secret "image-registry-tls" not found
Sep 18 16:49:22.447124 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:22.446754    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2200d387-c1d6-477d-ab65-eb96dc6b3259-registry-tls podName:2200d387-c1d6-477d-ab65-eb96dc6b3259 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:22.946740859 +0000 UTC m=+36.004030365 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2200d387-c1d6-477d-ab65-eb96dc6b3259-registry-tls") pod "image-registry-6888775986-fl24h" (UID: "2200d387-c1d6-477d-ab65-eb96dc6b3259") : secret "image-registry-tls" not found
Sep 18 16:49:22.447124 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.447000    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5bb8736-917b-4bb1-bf19-f6b88a528de8-tmp\") pod \"insights-operator-6f9c644dd9-mk2d9\" (UID: \"e5bb8736-917b-4bb1-bf19-f6b88a528de8\") " pod="openshift-insights/insights-operator-6f9c644dd9-mk2d9"
Sep 18 16:49:22.447124 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.447013    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2200d387-c1d6-477d-ab65-eb96dc6b3259-registry-certificates\") pod \"image-registry-6888775986-fl24h\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") " pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:49:22.447124 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.447064    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5bb8736-917b-4bb1-bf19-f6b88a528de8-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-mk2d9\" (UID: \"e5bb8736-917b-4bb1-bf19-f6b88a528de8\") " pod="openshift-insights/insights-operator-6f9c644dd9-mk2d9"
Sep 18 16:49:22.447547 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.447508    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2200d387-c1d6-477d-ab65-eb96dc6b3259-trusted-ca\") pod \"image-registry-6888775986-fl24h\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") " pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:49:22.450512 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.450485    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5bb8736-917b-4bb1-bf19-f6b88a528de8-serving-cert\") pod \"insights-operator-6f9c644dd9-mk2d9\" (UID: \"e5bb8736-917b-4bb1-bf19-f6b88a528de8\") " pod="openshift-insights/insights-operator-6f9c644dd9-mk2d9"
Sep 18 16:49:22.450512 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.450500    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2200d387-c1d6-477d-ab65-eb96dc6b3259-installation-pull-secrets\") pod \"image-registry-6888775986-fl24h\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") " pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:49:22.450704 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.450557    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2200d387-c1d6-477d-ab65-eb96dc6b3259-image-registry-private-configuration\") pod \"image-registry-6888775986-fl24h\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") " pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:49:22.456374 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.456323    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr86s\" (UniqueName: \"kubernetes.io/projected/c5d212c2-ba22-4283-8333-ac5f88635268-kube-api-access-lr86s\") pod \"cluster-samples-operator-685d7d68b5-x7gwl\" (UID: \"c5d212c2-ba22-4283-8333-ac5f88635268\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-x7gwl"
Sep 18 16:49:22.457252 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.457225    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4mps\" (UniqueName: \"kubernetes.io/projected/bcd40bb5-3d11-4d73-9b14-0372247d9bc7-kube-api-access-j4mps\") pod \"volume-data-source-validator-5c4db8bdf9-czc2k\" (UID: \"bcd40bb5-3d11-4d73-9b14-0372247d9bc7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-czc2k"
Sep 18 16:49:22.457443 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.457422    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2200d387-c1d6-477d-ab65-eb96dc6b3259-bound-sa-token\") pod \"image-registry-6888775986-fl24h\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") " pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:49:22.466022 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.465998    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52kjh\" (UniqueName: \"kubernetes.io/projected/e5bb8736-917b-4bb1-bf19-f6b88a528de8-kube-api-access-52kjh\") pod \"insights-operator-6f9c644dd9-mk2d9\" (UID: \"e5bb8736-917b-4bb1-bf19-f6b88a528de8\") " pod="openshift-insights/insights-operator-6f9c644dd9-mk2d9"
Sep 18 16:49:22.466139 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.466048    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgwt6\" (UniqueName: \"kubernetes.io/projected/2200d387-c1d6-477d-ab65-eb96dc6b3259-kube-api-access-cgwt6\") pod \"image-registry-6888775986-fl24h\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") " pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:49:22.515731 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.515693    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-mk2d9"
Sep 18 16:49:22.529740 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.529702    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2bv5_1534a00e-3417-441a-9df8-29be1ac81b77/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:22.547224 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.547042    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khdd5\" (UniqueName: \"kubernetes.io/projected/bf32dd38-8c07-4cb1-bae7-d8f2613669e0-kube-api-access-khdd5\") pod \"kube-storage-version-migrator-operator-55889f7b47-87vfw\" (UID: \"bf32dd38-8c07-4cb1-bae7-d8f2613669e0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87vfw"
Sep 18 16:49:22.547358 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.547249    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/60bae8ea-9599-47f8-b066-df7c46c011b3-trusted-ca\") pod \"console-operator-fd4bb46c-t4p6q\" (UID: \"60bae8ea-9599-47f8-b066-df7c46c011b3\") " pod="openshift-console-operator/console-operator-fd4bb46c-t4p6q"
Sep 18 16:49:22.547358 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.547285    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vd8tb\" (UniqueName: \"kubernetes.io/projected/9fc84d1c-d436-4b1a-9557-182688c69eff-kube-api-access-vd8tb\") pod \"dns-default-ttxjb\" (UID: \"9fc84d1c-d436-4b1a-9557-182688c69eff\") " pod="openshift-dns/dns-default-ttxjb"
Sep 18 16:49:22.547358 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.547309    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/60bae8ea-9599-47f8-b066-df7c46c011b3-config\") pod \"console-operator-fd4bb46c-t4p6q\" (UID: \"60bae8ea-9599-47f8-b066-df7c46c011b3\") " pod="openshift-console-operator/console-operator-fd4bb46c-t4p6q"
Sep 18 16:49:22.547358 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.547333    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/941c1b4b-8d2b-4c14-b741-f00e2032d493-config\") pod \"service-ca-operator-57cdc4b768-qnb85\" (UID: \"941c1b4b-8d2b-4c14-b741-f00e2032d493\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qnb85"
Sep 18 16:49:22.547572 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.547360    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fc84d1c-d436-4b1a-9557-182688c69eff-tmp-dir\") pod \"dns-default-ttxjb\" (UID: \"9fc84d1c-d436-4b1a-9557-182688c69eff\") " pod="openshift-dns/dns-default-ttxjb"
Sep 18 16:49:22.547572 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.547390    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/60bae8ea-9599-47f8-b066-df7c46c011b3-serving-cert\") pod \"console-operator-fd4bb46c-t4p6q\" (UID: \"60bae8ea-9599-47f8-b066-df7c46c011b3\") " pod="openshift-console-operator/console-operator-fd4bb46c-t4p6q"
Sep 18 16:49:22.547572 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.547417    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/941c1b4b-8d2b-4c14-b741-f00e2032d493-serving-cert\") pod \"service-ca-operator-57cdc4b768-qnb85\" (UID: \"941c1b4b-8d2b-4c14-b741-f00e2032d493\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qnb85"
Sep 18 16:49:22.547572 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.547483    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fc84d1c-d436-4b1a-9557-182688c69eff-metrics-tls\") pod \"dns-default-ttxjb\" (UID: \"9fc84d1c-d436-4b1a-9557-182688c69eff\") " pod="openshift-dns/dns-default-ttxjb"
Sep 18 16:49:22.547572 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.547511    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8z68\" (UniqueName: \"kubernetes.io/projected/cd56277f-5047-4f0a-9025-9f5e98acb703-kube-api-access-p8z68\") pod \"network-check-source-7cbc45fddc-gxdnl\" (UID: \"cd56277f-5047-4f0a-9025-9f5e98acb703\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-gxdnl"
Sep 18 16:49:22.547572 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.547559    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm9b7\" (UniqueName: \"kubernetes.io/projected/941c1b4b-8d2b-4c14-b741-f00e2032d493-kube-api-access-lm9b7\") pod \"service-ca-operator-57cdc4b768-qnb85\" (UID: \"941c1b4b-8d2b-4c14-b741-f00e2032d493\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qnb85"
Sep 18 16:49:22.547940 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.547923    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fc84d1c-d436-4b1a-9557-182688c69eff-tmp-dir\") pod \"dns-default-ttxjb\" (UID: \"9fc84d1c-d436-4b1a-9557-182688c69eff\") " pod="openshift-dns/dns-default-ttxjb"
Sep 18 16:49:22.548298 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.548025    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/941c1b4b-8d2b-4c14-b741-f00e2032d493-config\") pod \"service-ca-operator-57cdc4b768-qnb85\" (UID: \"941c1b4b-8d2b-4c14-b741-f00e2032d493\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qnb85"
Sep 18 16:49:22.548298 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.548110    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bf32dd38-8c07-4cb1-bae7-d8f2613669e0-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-87vfw\" (UID: \"bf32dd38-8c07-4cb1-bae7-d8f2613669e0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87vfw"
Sep 18 16:49:22.548298 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:22.548137    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 16:49:22.548298 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.548148    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bf32dd38-8c07-4cb1-bae7-d8f2613669e0-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-87vfw\" (UID: \"bf32dd38-8c07-4cb1-bae7-d8f2613669e0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87vfw"
Sep 18 16:49:22.548298 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:22.548194    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fc84d1c-d436-4b1a-9557-182688c69eff-metrics-tls podName:9fc84d1c-d436-4b1a-9557-182688c69eff nodeName:}" failed. No retries permitted until 2026-09-18 16:49:23.048177534 +0000 UTC m=+36.105467054 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fc84d1c-d436-4b1a-9557-182688c69eff-metrics-tls") pod "dns-default-ttxjb" (UID: "9fc84d1c-d436-4b1a-9557-182688c69eff") : secret "dns-default-metrics-tls" not found
Sep 18 16:49:22.548298 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.548224    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/60bae8ea-9599-47f8-b066-df7c46c011b3-config\") pod \"console-operator-fd4bb46c-t4p6q\" (UID: \"60bae8ea-9599-47f8-b066-df7c46c011b3\") " pod="openshift-console-operator/console-operator-fd4bb46c-t4p6q"
Sep 18 16:49:22.548298 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.548244    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5rhk\" (UniqueName: \"kubernetes.io/projected/60bae8ea-9599-47f8-b066-df7c46c011b3-kube-api-access-t5rhk\") pod \"console-operator-fd4bb46c-t4p6q\" (UID: \"60bae8ea-9599-47f8-b066-df7c46c011b3\") " pod="openshift-console-operator/console-operator-fd4bb46c-t4p6q"
Sep 18 16:49:22.548298 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.548247    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/60bae8ea-9599-47f8-b066-df7c46c011b3-trusted-ca\") pod \"console-operator-fd4bb46c-t4p6q\" (UID: \"60bae8ea-9599-47f8-b066-df7c46c011b3\") " pod="openshift-console-operator/console-operator-fd4bb46c-t4p6q"
Sep 18 16:49:22.548298 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.548271    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9fc84d1c-d436-4b1a-9557-182688c69eff-config-volume\") pod \"dns-default-ttxjb\" (UID: \"9fc84d1c-d436-4b1a-9557-182688c69eff\") " pod="openshift-dns/dns-default-ttxjb"
Sep 18 16:49:22.548827 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.548804    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9fc84d1c-d436-4b1a-9557-182688c69eff-config-volume\") pod \"dns-default-ttxjb\" (UID: \"9fc84d1c-d436-4b1a-9557-182688c69eff\") " pod="openshift-dns/dns-default-ttxjb"
Sep 18 16:49:22.548940 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.548846    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bf32dd38-8c07-4cb1-bae7-d8f2613669e0-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-87vfw\" (UID: \"bf32dd38-8c07-4cb1-bae7-d8f2613669e0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87vfw"
Sep 18 16:49:22.550644 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.550607    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/941c1b4b-8d2b-4c14-b741-f00e2032d493-serving-cert\") pod \"service-ca-operator-57cdc4b768-qnb85\" (UID: \"941c1b4b-8d2b-4c14-b741-f00e2032d493\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qnb85"
Sep 18 16:49:22.550758 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.550742    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/60bae8ea-9599-47f8-b066-df7c46c011b3-serving-cert\") pod \"console-operator-fd4bb46c-t4p6q\" (UID: \"60bae8ea-9599-47f8-b066-df7c46c011b3\") " pod="openshift-console-operator/console-operator-fd4bb46c-t4p6q"
Sep 18 16:49:22.551237 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.551205    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bf32dd38-8c07-4cb1-bae7-d8f2613669e0-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-87vfw\" (UID: \"bf32dd38-8c07-4cb1-bae7-d8f2613669e0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87vfw"
Sep 18 16:49:22.555989 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.555965    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd8tb\" (UniqueName: \"kubernetes.io/projected/9fc84d1c-d436-4b1a-9557-182688c69eff-kube-api-access-vd8tb\") pod \"dns-default-ttxjb\" (UID: \"9fc84d1c-d436-4b1a-9557-182688c69eff\") " pod="openshift-dns/dns-default-ttxjb"
Sep 18 16:49:22.557403 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.557384    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8z68\" (UniqueName: \"kubernetes.io/projected/cd56277f-5047-4f0a-9025-9f5e98acb703-kube-api-access-p8z68\") pod \"network-check-source-7cbc45fddc-gxdnl\" (UID: \"cd56277f-5047-4f0a-9025-9f5e98acb703\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-gxdnl"
Sep 18 16:49:22.557617 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.557503    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5rhk\" (UniqueName: \"kubernetes.io/projected/60bae8ea-9599-47f8-b066-df7c46c011b3-kube-api-access-t5rhk\") pod \"console-operator-fd4bb46c-t4p6q\" (UID: \"60bae8ea-9599-47f8-b066-df7c46c011b3\") " pod="openshift-console-operator/console-operator-fd4bb46c-t4p6q"
Sep 18 16:49:22.557760 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.557626    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khdd5\" (UniqueName: \"kubernetes.io/projected/bf32dd38-8c07-4cb1-bae7-d8f2613669e0-kube-api-access-khdd5\") pod \"kube-storage-version-migrator-operator-55889f7b47-87vfw\" (UID: \"bf32dd38-8c07-4cb1-bae7-d8f2613669e0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87vfw"
Sep 18 16:49:22.558357 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.558335    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm9b7\" (UniqueName: \"kubernetes.io/projected/941c1b4b-8d2b-4c14-b741-f00e2032d493-kube-api-access-lm9b7\") pod \"service-ca-operator-57cdc4b768-qnb85\" (UID: \"941c1b4b-8d2b-4c14-b741-f00e2032d493\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qnb85"
Sep 18 16:49:22.568320 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.568282    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-czc2k"
Sep 18 16:49:22.593636 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.593617    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-t4p6q"
Sep 18 16:49:22.604767 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.604745    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87vfw"
Sep 18 16:49:22.616797 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.616771    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qnb85"
Sep 18 16:49:22.627540 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.627509    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-gxdnl"
Sep 18 16:49:22.750240 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.750202    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7774138-6ff0-4571-8f2e-4a8020126c37-original-pull-secret\") pod \"global-pull-secret-syncer-wrq7r\" (UID: \"b7774138-6ff0-4571-8f2e-4a8020126c37\") " pod="kube-system/global-pull-secret-syncer-wrq7r"
Sep 18 16:49:22.750436 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.750286    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/056bb4ff-01e7-45b4-b5d0-e15f0779692b-metrics-certs\") pod \"network-metrics-daemon-xggf7\" (UID: \"056bb4ff-01e7-45b4-b5d0-e15f0779692b\") " pod="openshift-multus/network-metrics-daemon-xggf7"
Sep 18 16:49:22.750436 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:22.750330    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 16:49:22.750436 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:22.750405    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7774138-6ff0-4571-8f2e-4a8020126c37-original-pull-secret podName:b7774138-6ff0-4571-8f2e-4a8020126c37 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:54.750389379 +0000 UTC m=+67.807678900 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7774138-6ff0-4571-8f2e-4a8020126c37-original-pull-secret") pod "global-pull-secret-syncer-wrq7r" (UID: "b7774138-6ff0-4571-8f2e-4a8020126c37") : object "kube-system"/"original-pull-secret" not registered
Sep 18 16:49:22.750627 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:22.750446    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:49:22.750627 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:22.750499    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/056bb4ff-01e7-45b4-b5d0-e15f0779692b-metrics-certs podName:056bb4ff-01e7-45b4-b5d0-e15f0779692b nodeName:}" failed. No retries permitted until 2026-09-18 16:49:54.750484309 +0000 UTC m=+67.807773826 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/056bb4ff-01e7-45b4-b5d0-e15f0779692b-metrics-certs") pod "network-metrics-daemon-xggf7" (UID: "056bb4ff-01e7-45b4-b5d0-e15f0779692b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:49:22.764485 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.764457    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-5rc4b"]
Sep 18 16:49:22.782019 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.781990    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5rc4b"
Sep 18 16:49:22.784370 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.784312    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jxt4w\""
Sep 18 16:49:22.822322 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.822293    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2bv5_1534a00e-3417-441a-9df8-29be1ac81b77/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:22.851453 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.851417    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqvc2\" (UniqueName: \"kubernetes.io/projected/b91105d9-1858-489c-8b13-8086e49a730c-kube-api-access-vqvc2\") pod \"network-check-target-9jp46\" (UID: \"b91105d9-1858-489c-8b13-8086e49a730c\") " pod="openshift-network-diagnostics/network-check-target-9jp46"
Sep 18 16:49:22.854775 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.854748    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqvc2\" (UniqueName: \"kubernetes.io/projected/b91105d9-1858-489c-8b13-8086e49a730c-kube-api-access-vqvc2\") pod \"network-check-target-9jp46\" (UID: \"b91105d9-1858-489c-8b13-8086e49a730c\") " pod="openshift-network-diagnostics/network-check-target-9jp46"
Sep 18 16:49:22.932280 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.932242    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2bv5_1534a00e-3417-441a-9df8-29be1ac81b77/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:22.952307 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.952278    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/95f739d8-990d-4aa8-a1e3-ed8cefd56bd2-hosts-file\") pod \"node-resolver-5rc4b\" (UID: \"95f739d8-990d-4aa8-a1e3-ed8cefd56bd2\") " pod="openshift-dns/node-resolver-5rc4b"
Sep 18 16:49:22.952467 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.952320    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-x9bk4\" (UID: \"5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-x9bk4"
Sep 18 16:49:22.952467 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.952399    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95f739d8-990d-4aa8-a1e3-ed8cefd56bd2-tmp-dir\") pod \"node-resolver-5rc4b\" (UID: \"95f739d8-990d-4aa8-a1e3-ed8cefd56bd2\") " pod="openshift-dns/node-resolver-5rc4b"
Sep 18 16:49:22.952467 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.952458    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5d212c2-ba22-4283-8333-ac5f88635268-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-x7gwl\" (UID: \"c5d212c2-ba22-4283-8333-ac5f88635268\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-x7gwl"
Sep 18 16:49:22.952467 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:22.952458    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 18 16:49:22.952698 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.952480    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77rxb\" (UniqueName: \"kubernetes.io/projected/95f739d8-990d-4aa8-a1e3-ed8cefd56bd2-kube-api-access-77rxb\") pod \"node-resolver-5rc4b\" (UID: \"95f739d8-990d-4aa8-a1e3-ed8cefd56bd2\") " pod="openshift-dns/node-resolver-5rc4b"
Sep 18 16:49:22.952698 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:22.952516    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965-networking-console-plugin-cert podName:5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:23.952501189 +0000 UTC m=+37.009790711 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-x9bk4" (UID: "5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965") : secret "networking-console-plugin-cert" not found
Sep 18 16:49:22.952698 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:22.952554    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2200d387-c1d6-477d-ab65-eb96dc6b3259-registry-tls\") pod \"image-registry-6888775986-fl24h\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") " pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:49:22.952698 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:22.952582    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 18 16:49:22.952698 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:22.952630    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 16:49:22.952698 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:22.952646    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5d212c2-ba22-4283-8333-ac5f88635268-samples-operator-tls podName:c5d212c2-ba22-4283-8333-ac5f88635268 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:23.952629487 +0000 UTC m=+37.009919009 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c5d212c2-ba22-4283-8333-ac5f88635268-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-x7gwl" (UID: "c5d212c2-ba22-4283-8333-ac5f88635268") : secret "samples-operator-tls" not found
Sep 18 16:49:22.952698 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:22.952648    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6888775986-fl24h: secret "image-registry-tls" not found
Sep 18 16:49:22.952698 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:22.952700    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2200d387-c1d6-477d-ab65-eb96dc6b3259-registry-tls podName:2200d387-c1d6-477d-ab65-eb96dc6b3259 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:23.952683021 +0000 UTC m=+37.009972541 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2200d387-c1d6-477d-ab65-eb96dc6b3259-registry-tls") pod "image-registry-6888775986-fl24h" (UID: "2200d387-c1d6-477d-ab65-eb96dc6b3259") : secret "image-registry-tls" not found
Sep 18 16:49:23.053910 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:23.053816    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/95f739d8-990d-4aa8-a1e3-ed8cefd56bd2-hosts-file\") pod \"node-resolver-5rc4b\" (UID: \"95f739d8-990d-4aa8-a1e3-ed8cefd56bd2\") " pod="openshift-dns/node-resolver-5rc4b"
Sep 18 16:49:23.054068 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:23.053968    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/95f739d8-990d-4aa8-a1e3-ed8cefd56bd2-hosts-file\") pod \"node-resolver-5rc4b\" (UID: \"95f739d8-990d-4aa8-a1e3-ed8cefd56bd2\") " pod="openshift-dns/node-resolver-5rc4b"
Sep 18 16:49:23.054068 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:23.053980    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fc84d1c-d436-4b1a-9557-182688c69eff-metrics-tls\") pod \"dns-default-ttxjb\" (UID: \"9fc84d1c-d436-4b1a-9557-182688c69eff\") " pod="openshift-dns/dns-default-ttxjb"
Sep 18 16:49:23.054068 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:23.054042    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95f739d8-990d-4aa8-a1e3-ed8cefd56bd2-tmp-dir\") pod \"node-resolver-5rc4b\" (UID: \"95f739d8-990d-4aa8-a1e3-ed8cefd56bd2\") " pod="openshift-dns/node-resolver-5rc4b"
Sep 18 16:49:23.054227 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:23.054084    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 16:49:23.054227 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:23.054098    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77rxb\" (UniqueName: \"kubernetes.io/projected/95f739d8-990d-4aa8-a1e3-ed8cefd56bd2-kube-api-access-77rxb\") pod \"node-resolver-5rc4b\" (UID: \"95f739d8-990d-4aa8-a1e3-ed8cefd56bd2\") " pod="openshift-dns/node-resolver-5rc4b"
Sep 18 16:49:23.054227 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:23.054144    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fc84d1c-d436-4b1a-9557-182688c69eff-metrics-tls podName:9fc84d1c-d436-4b1a-9557-182688c69eff nodeName:}" failed. No retries permitted until 2026-09-18 16:49:24.054126496 +0000 UTC m=+37.111416023 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fc84d1c-d436-4b1a-9557-182688c69eff-metrics-tls") pod "dns-default-ttxjb" (UID: "9fc84d1c-d436-4b1a-9557-182688c69eff") : secret "dns-default-metrics-tls" not found
Sep 18 16:49:23.054487 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:23.054455    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95f739d8-990d-4aa8-a1e3-ed8cefd56bd2-tmp-dir\") pod \"node-resolver-5rc4b\" (UID: \"95f739d8-990d-4aa8-a1e3-ed8cefd56bd2\") " pod="openshift-dns/node-resolver-5rc4b"
Sep 18 16:49:23.063339 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:23.063312    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77rxb\" (UniqueName: \"kubernetes.io/projected/95f739d8-990d-4aa8-a1e3-ed8cefd56bd2-kube-api-access-77rxb\") pod \"node-resolver-5rc4b\" (UID: \"95f739d8-990d-4aa8-a1e3-ed8cefd56bd2\") " pod="openshift-dns/node-resolver-5rc4b"
Sep 18 16:49:23.093547 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:23.093492    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5rc4b"
Sep 18 16:49:23.653775 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:23.653594    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2bv5_1534a00e-3417-441a-9df8-29be1ac81b77/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:23.886451 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:23.886375    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-mk2d9"]
Sep 18 16:49:23.888247 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:23.887812    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87vfw"]
Sep 18 16:49:23.889090 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:23.888921    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-gxdnl"]
Sep 18 16:49:23.889420 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:49:23.889385    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5bb8736_917b_4bb1_bf19_f6b88a528de8.slice/crio-89bd0a93d15b0c83e1d5f82445394a259d29dc4824148519549350de7460330d WatchSource:0}: Error finding container 89bd0a93d15b0c83e1d5f82445394a259d29dc4824148519549350de7460330d: Status 404 returned error can't find the container with id 89bd0a93d15b0c83e1d5f82445394a259d29dc4824148519549350de7460330d
Sep 18 16:49:23.890073 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:23.890021    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-qnb85"]
Sep 18 16:49:23.891003 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:23.890974    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-czc2k"]
Sep 18 16:49:23.892416 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:49:23.892393    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf32dd38_8c07_4cb1_bae7_d8f2613669e0.slice/crio-80c72cc686a441335e135bd3a7e40607ef6232b7c1debc1b8b7ddbde124dba49 WatchSource:0}: Error finding container 80c72cc686a441335e135bd3a7e40607ef6232b7c1debc1b8b7ddbde124dba49: Status 404 returned error can't find the container with id 80c72cc686a441335e135bd3a7e40607ef6232b7c1debc1b8b7ddbde124dba49
Sep 18 16:49:23.892962 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:49:23.892938    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod941c1b4b_8d2b_4c14_b741_f00e2032d493.slice/crio-9f00c37520b6c90d3aa03a38b05f71e5ca778263ede90a6806a239a4a96ec9a4 WatchSource:0}: Error finding container 9f00c37520b6c90d3aa03a38b05f71e5ca778263ede90a6806a239a4a96ec9a4: Status 404 returned error can't find the container with id 9f00c37520b6c90d3aa03a38b05f71e5ca778263ede90a6806a239a4a96ec9a4
Sep 18 16:49:23.893760 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:49:23.893737    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd56277f_5047_4f0a_9025_9f5e98acb703.slice/crio-9d34471ab1557ab9ff81c4f6600a198c7680718f4bd2e9772d76115dceac32bf WatchSource:0}: Error finding container 9d34471ab1557ab9ff81c4f6600a198c7680718f4bd2e9772d76115dceac32bf: Status 404 returned error can't find the container with id 9d34471ab1557ab9ff81c4f6600a198c7680718f4bd2e9772d76115dceac32bf
Sep 18 16:49:23.894237 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:49:23.894219    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcd40bb5_3d11_4d73_9b14_0372247d9bc7.slice/crio-c3569156a8cd50afa8511f59de481bde0d48211ba0cb82b40b791649c9445f01 WatchSource:0}: Error finding container c3569156a8cd50afa8511f59de481bde0d48211ba0cb82b40b791649c9445f01: Status 404 returned error can't find the container with id c3569156a8cd50afa8511f59de481bde0d48211ba0cb82b40b791649c9445f01
Sep 18 16:49:23.901001 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:23.900981    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-t4p6q"]
Sep 18 16:49:23.903857 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:49:23.903837    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60bae8ea_9599_47f8_b066_df7c46c011b3.slice/crio-236446b29a4c20d8fead9964a5c257c2fbc43a583b8b87b05c6e0aa4942fbeb6 WatchSource:0}: Error finding container 236446b29a4c20d8fead9964a5c257c2fbc43a583b8b87b05c6e0aa4942fbeb6: Status 404 returned error can't find the container with id 236446b29a4c20d8fead9964a5c257c2fbc43a583b8b87b05c6e0aa4942fbeb6
Sep 18 16:49:23.964661 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:23.964632    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-x9bk4\" (UID: \"5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-x9bk4"
Sep 18 16:49:23.964798 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:23.964775    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5d212c2-ba22-4283-8333-ac5f88635268-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-x7gwl\" (UID: \"c5d212c2-ba22-4283-8333-ac5f88635268\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-x7gwl"
Sep 18 16:49:23.964833 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:23.964816    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2200d387-c1d6-477d-ab65-eb96dc6b3259-registry-tls\") pod \"image-registry-6888775986-fl24h\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") " pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:49:23.964902 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:23.964814    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 18 16:49:23.964946 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:23.964927    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 18 16:49:23.964977 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:23.964955    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 16:49:23.964977 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:23.964970    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6888775986-fl24h: secret "image-registry-tls" not found
Sep 18 16:49:23.965039 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:23.964961    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965-networking-console-plugin-cert podName:5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:25.964945812 +0000 UTC m=+39.022235318 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-x9bk4" (UID: "5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965") : secret "networking-console-plugin-cert" not found
Sep 18 16:49:23.965039 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:23.965020    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5d212c2-ba22-4283-8333-ac5f88635268-samples-operator-tls podName:c5d212c2-ba22-4283-8333-ac5f88635268 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:25.965005286 +0000 UTC m=+39.022294794 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c5d212c2-ba22-4283-8333-ac5f88635268-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-x7gwl" (UID: "c5d212c2-ba22-4283-8333-ac5f88635268") : secret "samples-operator-tls" not found
Sep 18 16:49:23.965039 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:23.965030    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2200d387-c1d6-477d-ab65-eb96dc6b3259-registry-tls podName:2200d387-c1d6-477d-ab65-eb96dc6b3259 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:25.965024663 +0000 UTC m=+39.022314169 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2200d387-c1d6-477d-ab65-eb96dc6b3259-registry-tls") pod "image-registry-6888775986-fl24h" (UID: "2200d387-c1d6-477d-ab65-eb96dc6b3259") : secret "image-registry-tls" not found
Sep 18 16:49:24.065664 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:24.065639    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fc84d1c-d436-4b1a-9557-182688c69eff-metrics-tls\") pod \"dns-default-ttxjb\" (UID: \"9fc84d1c-d436-4b1a-9557-182688c69eff\") " pod="openshift-dns/dns-default-ttxjb"
Sep 18 16:49:24.065816 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:24.065799    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 16:49:24.065872 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:24.065862    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fc84d1c-d436-4b1a-9557-182688c69eff-metrics-tls podName:9fc84d1c-d436-4b1a-9557-182688c69eff nodeName:}" failed. No retries permitted until 2026-09-18 16:49:26.065846496 +0000 UTC m=+39.123136007 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fc84d1c-d436-4b1a-9557-182688c69eff-metrics-tls") pod "dns-default-ttxjb" (UID: "9fc84d1c-d436-4b1a-9557-182688c69eff") : secret "dns-default-metrics-tls" not found
Sep 18 16:49:24.116322 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:24.116288    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xggf7"
Sep 18 16:49:24.116465 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:24.116319    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9jp46"
Sep 18 16:49:24.116465 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:24.116337    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrq7r"
Sep 18 16:49:24.120817 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:24.118929    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 18 16:49:24.120817 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:24.119310    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rqwhk\""
Sep 18 16:49:24.120817 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:24.119353    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7dj2b\""
Sep 18 16:49:24.120817 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:24.119752    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 18 16:49:24.135006 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:24.134988    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9jp46"
Sep 18 16:49:24.275214 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:24.275183    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87vfw" event={"ID":"bf32dd38-8c07-4cb1-bae7-d8f2613669e0","Type":"ContainerStarted","Data":"80c72cc686a441335e135bd3a7e40607ef6232b7c1debc1b8b7ddbde124dba49"}
Sep 18 16:49:24.276618 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:24.276595    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5rc4b" event={"ID":"95f739d8-990d-4aa8-a1e3-ed8cefd56bd2","Type":"ContainerStarted","Data":"334a98d14adabbfafafff68eb67a577140ffc00b8daa36bd2ec27901d972a445"}
Sep 18 16:49:24.276722 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:24.276643    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5rc4b" event={"ID":"95f739d8-990d-4aa8-a1e3-ed8cefd56bd2","Type":"ContainerStarted","Data":"53d5d5c7dd9461dd1f8dd3b65852dfe9620307ba6375994f6d70dde893d0b4ce"}
Sep 18 16:49:24.277786 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:24.277761    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-mk2d9" event={"ID":"e5bb8736-917b-4bb1-bf19-f6b88a528de8","Type":"ContainerStarted","Data":"89bd0a93d15b0c83e1d5f82445394a259d29dc4824148519549350de7460330d"}
Sep 18 16:49:24.278840 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:24.278821    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-gxdnl" event={"ID":"cd56277f-5047-4f0a-9025-9f5e98acb703","Type":"ContainerStarted","Data":"9d34471ab1557ab9ff81c4f6600a198c7680718f4bd2e9772d76115dceac32bf"}
Sep 18 16:49:24.281523 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:24.281497    2577 generic.go:356] "Generic (PLEG): container finished" podID="e45baf5d-f62f-40d2-b368-51925ce7d95c" containerID="a9208ef84010f93918e62ec17fb2cf51dd7810d4c75d82cc33e59706c5ea1b69" exitCode=0
Sep 18 16:49:24.281635 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:24.281591    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lj92" event={"ID":"e45baf5d-f62f-40d2-b368-51925ce7d95c","Type":"ContainerDied","Data":"a9208ef84010f93918e62ec17fb2cf51dd7810d4c75d82cc33e59706c5ea1b69"}
Sep 18 16:49:24.282747 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:24.282727    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-t4p6q" event={"ID":"60bae8ea-9599-47f8-b066-df7c46c011b3","Type":"ContainerStarted","Data":"236446b29a4c20d8fead9964a5c257c2fbc43a583b8b87b05c6e0aa4942fbeb6"}
Sep 18 16:49:24.283838 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:24.283807    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-czc2k" event={"ID":"bcd40bb5-3d11-4d73-9b14-0372247d9bc7","Type":"ContainerStarted","Data":"c3569156a8cd50afa8511f59de481bde0d48211ba0cb82b40b791649c9445f01"}
Sep 18 16:49:24.284851 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:24.284831    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qnb85" event={"ID":"941c1b4b-8d2b-4c14-b741-f00e2032d493","Type":"ContainerStarted","Data":"9f00c37520b6c90d3aa03a38b05f71e5ca778263ede90a6806a239a4a96ec9a4"}
Sep 18 16:49:24.290482 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:24.290445    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5rc4b" podStartSLOduration=2.290433192 podStartE2EDuration="2.290433192s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:49:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:24.289706909 +0000 UTC m=+37.346996437" watchObservedRunningTime="2026-09-18 16:49:24.290433192 +0000 UTC m=+37.347722721"
Sep 18 16:49:24.410796 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:24.410692    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9jp46"]
Sep 18 16:49:24.413164 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:49:24.413138    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb91105d9_1858_489c_8b13_8086e49a730c.slice/crio-2e4bfdc24a31a7f4953961d030095951dcca32dbb3546a49e1f46cfd3e12b162 WatchSource:0}: Error finding container 2e4bfdc24a31a7f4953961d030095951dcca32dbb3546a49e1f46cfd3e12b162: Status 404 returned error can't find the container with id 2e4bfdc24a31a7f4953961d030095951dcca32dbb3546a49e1f46cfd3e12b162
Sep 18 16:49:24.542273 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:24.542209    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2bv5_1534a00e-3417-441a-9df8-29be1ac81b77/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:24.940502 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:24.940452    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2bv5_1534a00e-3417-441a-9df8-29be1ac81b77/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:25.041772 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:25.041709    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2bv5_1534a00e-3417-441a-9df8-29be1ac81b77/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:25.253834 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:25.253589    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2bv5_1534a00e-3417-441a-9df8-29be1ac81b77/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:25.299753 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:25.299716    2577 generic.go:356] "Generic (PLEG): container finished" podID="e45baf5d-f62f-40d2-b368-51925ce7d95c" containerID="7a568aff526560e7e7f79afe54871c457c65931ca25116628a224be742f91667" exitCode=0
Sep 18 16:49:25.299929 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:25.299817    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lj92" event={"ID":"e45baf5d-f62f-40d2-b368-51925ce7d95c","Type":"ContainerDied","Data":"7a568aff526560e7e7f79afe54871c457c65931ca25116628a224be742f91667"}
Sep 18 16:49:25.307555 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:25.307513    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9jp46" event={"ID":"b91105d9-1858-489c-8b13-8086e49a730c","Type":"ContainerStarted","Data":"2e4bfdc24a31a7f4953961d030095951dcca32dbb3546a49e1f46cfd3e12b162"}
Sep 18 16:49:25.985417 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:25.985315    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5d212c2-ba22-4283-8333-ac5f88635268-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-x7gwl\" (UID: \"c5d212c2-ba22-4283-8333-ac5f88635268\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-x7gwl"
Sep 18 16:49:25.985417 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:25.985373    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2200d387-c1d6-477d-ab65-eb96dc6b3259-registry-tls\") pod \"image-registry-6888775986-fl24h\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") " pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:49:25.985923 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:25.985440    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-x9bk4\" (UID: \"5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-x9bk4"
Sep 18 16:49:25.985923 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:25.985636    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 18 16:49:25.985923 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:25.985705    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965-networking-console-plugin-cert podName:5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:29.985684401 +0000 UTC m=+43.042973930 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-x9bk4" (UID: "5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965") : secret "networking-console-plugin-cert" not found
Sep 18 16:49:25.985923 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:25.985772    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 18 16:49:25.985923 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:25.985805    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5d212c2-ba22-4283-8333-ac5f88635268-samples-operator-tls podName:c5d212c2-ba22-4283-8333-ac5f88635268 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:29.985794364 +0000 UTC m=+43.043083883 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c5d212c2-ba22-4283-8333-ac5f88635268-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-x7gwl" (UID: "c5d212c2-ba22-4283-8333-ac5f88635268") : secret "samples-operator-tls" not found
Sep 18 16:49:25.985923 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:25.985867    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 16:49:25.985923 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:25.985879    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6888775986-fl24h: secret "image-registry-tls" not found
Sep 18 16:49:25.985923 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:25.985911    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2200d387-c1d6-477d-ab65-eb96dc6b3259-registry-tls podName:2200d387-c1d6-477d-ab65-eb96dc6b3259 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:29.985900125 +0000 UTC m=+43.043189644 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2200d387-c1d6-477d-ab65-eb96dc6b3259-registry-tls") pod "image-registry-6888775986-fl24h" (UID: "2200d387-c1d6-477d-ab65-eb96dc6b3259") : secret "image-registry-tls" not found
Sep 18 16:49:25.993026 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:25.992865    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2bv5_1534a00e-3417-441a-9df8-29be1ac81b77/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:26.086159 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:26.086121    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fc84d1c-d436-4b1a-9557-182688c69eff-metrics-tls\") pod \"dns-default-ttxjb\" (UID: \"9fc84d1c-d436-4b1a-9557-182688c69eff\") " pod="openshift-dns/dns-default-ttxjb"
Sep 18 16:49:26.086364 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:26.086348    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 16:49:26.086430 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:26.086418    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fc84d1c-d436-4b1a-9557-182688c69eff-metrics-tls podName:9fc84d1c-d436-4b1a-9557-182688c69eff nodeName:}" failed. No retries permitted until 2026-09-18 16:49:30.086399179 +0000 UTC m=+43.143688700 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fc84d1c-d436-4b1a-9557-182688c69eff-metrics-tls") pod "dns-default-ttxjb" (UID: "9fc84d1c-d436-4b1a-9557-182688c69eff") : secret "dns-default-metrics-tls" not found
Sep 18 16:49:26.315737 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:26.315616    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lj92" event={"ID":"e45baf5d-f62f-40d2-b368-51925ce7d95c","Type":"ContainerStarted","Data":"189e2f482e7e9e2d8569a87f836ad55940ea23c75ee4ad45ffadf4951e946886"}
Sep 18 16:49:26.317965 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:26.317936    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-czc2k" event={"ID":"bcd40bb5-3d11-4d73-9b14-0372247d9bc7","Type":"ContainerStarted","Data":"51916a1af2f063afe0687fa6b72d134cefd6730077840bd17d4873287af14638"}
Sep 18 16:49:26.333632 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:26.333573    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5lj92" podStartSLOduration=9.453944557 podStartE2EDuration="37.333554988s" totalImagesPullingTime="27.879610431s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:48:49 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:26.33263603 +0000 UTC m=+39.389925559" watchObservedRunningTime="2026-09-18 16:49:26.333554988 +0000 UTC m=+39.390844519"
Sep 18 16:49:26.346007 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:26.345946    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-czc2k" podStartSLOduration=16.485563417 podStartE2EDuration="18.345928881s" totalImagesPullingTime="1.860365464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:49:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:26.345404905 +0000 UTC m=+39.402694427" watchObservedRunningTime="2026-09-18 16:49:26.345928881 +0000 UTC m=+39.403218410"
Sep 18 16:49:26.462798 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:26.462753    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2bv5_1534a00e-3417-441a-9df8-29be1ac81b77/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:26.562663 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:26.562620    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2bv5_1534a00e-3417-441a-9df8-29be1ac81b77/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:26.707910 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:26.707280    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2bv5_1534a00e-3417-441a-9df8-29be1ac81b77/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:26.812416 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:26.812235    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2bv5_1534a00e-3417-441a-9df8-29be1ac81b77/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:27.349876 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:27.349835    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2bv5_1534a00e-3417-441a-9df8-29be1ac81b77/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:28.092939 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:28.092899    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2bv5_1534a00e-3417-441a-9df8-29be1ac81b77/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:28.864228 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:28.864186    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2bv5_1534a00e-3417-441a-9df8-29be1ac81b77/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:29.674067 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:29.674034    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2bv5_1534a00e-3417-441a-9df8-29be1ac81b77/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:30.025111 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:30.025066    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5d212c2-ba22-4283-8333-ac5f88635268-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-x7gwl\" (UID: \"c5d212c2-ba22-4283-8333-ac5f88635268\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-x7gwl"
Sep 18 16:49:30.025574 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:30.025127    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2200d387-c1d6-477d-ab65-eb96dc6b3259-registry-tls\") pod \"image-registry-6888775986-fl24h\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") " pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:49:30.025574 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:30.025196    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-x9bk4\" (UID: \"5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-x9bk4"
Sep 18 16:49:30.025574 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:30.025241    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 18 16:49:30.025574 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:30.025316    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5d212c2-ba22-4283-8333-ac5f88635268-samples-operator-tls podName:c5d212c2-ba22-4283-8333-ac5f88635268 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:38.025295206 +0000 UTC m=+51.082584712 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c5d212c2-ba22-4283-8333-ac5f88635268-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-x7gwl" (UID: "c5d212c2-ba22-4283-8333-ac5f88635268") : secret "samples-operator-tls" not found
Sep 18 16:49:30.025574 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:30.025320    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 18 16:49:30.025574 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:30.025359    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 16:49:30.025574 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:30.025380    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965-networking-console-plugin-cert podName:5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:38.025364667 +0000 UTC m=+51.082654178 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-x9bk4" (UID: "5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965") : secret "networking-console-plugin-cert" not found
Sep 18 16:49:30.025574 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:30.025380    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6888775986-fl24h: secret "image-registry-tls" not found
Sep 18 16:49:30.025574 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:30.025452    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2200d387-c1d6-477d-ab65-eb96dc6b3259-registry-tls podName:2200d387-c1d6-477d-ab65-eb96dc6b3259 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:38.02543688 +0000 UTC m=+51.082726400 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2200d387-c1d6-477d-ab65-eb96dc6b3259-registry-tls") pod "image-registry-6888775986-fl24h" (UID: "2200d387-c1d6-477d-ab65-eb96dc6b3259") : secret "image-registry-tls" not found
Sep 18 16:49:30.126592 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:30.126558    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fc84d1c-d436-4b1a-9557-182688c69eff-metrics-tls\") pod \"dns-default-ttxjb\" (UID: \"9fc84d1c-d436-4b1a-9557-182688c69eff\") " pod="openshift-dns/dns-default-ttxjb"
Sep 18 16:49:30.126727 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:30.126630    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 16:49:30.126727 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:30.126695    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fc84d1c-d436-4b1a-9557-182688c69eff-metrics-tls podName:9fc84d1c-d436-4b1a-9557-182688c69eff nodeName:}" failed. No retries permitted until 2026-09-18 16:49:38.126676615 +0000 UTC m=+51.183966124 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fc84d1c-d436-4b1a-9557-182688c69eff-metrics-tls") pod "dns-default-ttxjb" (UID: "9fc84d1c-d436-4b1a-9557-182688c69eff") : secret "dns-default-metrics-tls" not found
Sep 18 16:49:30.332592 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:30.332490    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87vfw" event={"ID":"bf32dd38-8c07-4cb1-bae7-d8f2613669e0","Type":"ContainerStarted","Data":"92f18a518069969a31e6368c1eaba9a535206f1d21ec701406aba33d001b760d"}
Sep 18 16:49:30.334553 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:30.334347    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-mk2d9" event={"ID":"e5bb8736-917b-4bb1-bf19-f6b88a528de8","Type":"ContainerStarted","Data":"73245b1eaf70b62fa86ee15284539d7e591d6fa7f920ee7c02b8cc677113d269"}
Sep 18 16:49:30.336701 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:30.336676    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-gxdnl" event={"ID":"cd56277f-5047-4f0a-9025-9f5e98acb703","Type":"ContainerStarted","Data":"3c3ac7336d140aa48ec66c8d5b1faad0be6eb9c3521fa9f5a476e5f650362d66"}
Sep 18 16:49:30.338547 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:30.338509    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-t4p6q_60bae8ea-9599-47f8-b066-df7c46c011b3/console-operator/0.log"
Sep 18 16:49:30.338642 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:30.338563    2577 generic.go:356] "Generic (PLEG): container finished" podID="60bae8ea-9599-47f8-b066-df7c46c011b3" containerID="527db3e247a74dc141804b990f680755f17614d8490ea77fbf8be493299719a5" exitCode=255
Sep 18 16:49:30.338791 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:30.338770    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-t4p6q" event={"ID":"60bae8ea-9599-47f8-b066-df7c46c011b3","Type":"ContainerDied","Data":"527db3e247a74dc141804b990f680755f17614d8490ea77fbf8be493299719a5"}
Sep 18 16:49:30.338905 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:30.338846    2577 scope.go:117] "RemoveContainer" containerID="527db3e247a74dc141804b990f680755f17614d8490ea77fbf8be493299719a5"
Sep 18 16:49:30.342659 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:30.342621    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qnb85" event={"ID":"941c1b4b-8d2b-4c14-b741-f00e2032d493","Type":"ContainerStarted","Data":"6cf2779677a9e10ab000f60aeee10b2446e336f75474f68c54a1abdbb65cb60b"}
Sep 18 16:49:30.344365 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:30.344340    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9jp46" event={"ID":"b91105d9-1858-489c-8b13-8086e49a730c","Type":"ContainerStarted","Data":"dbc7f858269a0fb64bfd7be94586cb54427da1fab544f68f648ca37c3a5a9d84"}
Sep 18 16:49:30.344472 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:30.344411    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9jp46"
Sep 18 16:49:30.348897 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:30.348858    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87vfw" podStartSLOduration=14.817113404 podStartE2EDuration="20.348846593s" totalImagesPullingTime="5.531733189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:49:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:30.347996878 +0000 UTC m=+43.405286407" watchObservedRunningTime="2026-09-18 16:49:30.348846593 +0000 UTC m=+43.406136114"
Sep 18 16:49:30.361917 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:30.360825    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9jp46" podStartSLOduration=35.977695268 podStartE2EDuration="41.360808163s" totalImagesPullingTime="5.383112895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:30.360175858 +0000 UTC m=+43.417465385" watchObservedRunningTime="2026-09-18 16:49:30.360808163 +0000 UTC m=+43.418097693"
Sep 18 16:49:30.374437 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:30.374391    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qnb85" podStartSLOduration=14.834888408 podStartE2EDuration="20.374373s" totalImagesPullingTime="5.539484592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:49:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:30.373654936 +0000 UTC m=+43.430944456" watchObservedRunningTime="2026-09-18 16:49:30.374373 +0000 UTC m=+43.431662529"
Sep 18 16:49:30.416582 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:30.416521    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-6f9c644dd9-mk2d9" podStartSLOduration=31.87409049 podStartE2EDuration="37.41650113s" totalImagesPullingTime="5.54241064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:48:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:30.416485945 +0000 UTC m=+43.473775486" watchObservedRunningTime="2026-09-18 16:49:30.41650113 +0000 UTC m=+43.473790659"
Sep 18 16:49:30.417993 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:30.417951    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-gxdnl" podStartSLOduration=29.316835355 podStartE2EDuration="35.417938627s" totalImagesPullingTime="6.101103272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:48:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:30.399222678 +0000 UTC m=+43.456512207" watchObservedRunningTime="2026-09-18 16:49:30.417938627 +0000 UTC m=+43.475228154"
Sep 18 16:49:30.448959 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:30.448860    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2bv5_1534a00e-3417-441a-9df8-29be1ac81b77/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:30.833851 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:30.833824    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-b2dcg"]
Sep 18 16:49:30.834551 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:30.834476    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2bv5_1534a00e-3417-441a-9df8-29be1ac81b77/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:30.836103 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:30.836088    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-b2dcg"
Sep 18 16:49:30.838320 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:30.838299    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 18 16:49:30.838554 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:30.838523    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-xtb5r\""
Sep 18 16:49:30.838622 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:30.838608    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 18 16:49:30.846646 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:30.846624    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-b2dcg"]
Sep 18 16:49:30.926092 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:30.926059    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2bv5_1534a00e-3417-441a-9df8-29be1ac81b77/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:30.934250 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:30.934225    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97tl2\" (UniqueName: \"kubernetes.io/projected/4383ecc4-e1ec-49ab-9fef-cfd5fc19e88a-kube-api-access-97tl2\") pod \"migrator-76794cbd6c-b2dcg\" (UID: \"4383ecc4-e1ec-49ab-9fef-cfd5fc19e88a\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-b2dcg"
Sep 18 16:49:31.028190 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:31.028149    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2bv5_1534a00e-3417-441a-9df8-29be1ac81b77/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:31.035335 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:31.035295    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97tl2\" (UniqueName: \"kubernetes.io/projected/4383ecc4-e1ec-49ab-9fef-cfd5fc19e88a-kube-api-access-97tl2\") pod \"migrator-76794cbd6c-b2dcg\" (UID: \"4383ecc4-e1ec-49ab-9fef-cfd5fc19e88a\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-b2dcg"
Sep 18 16:49:31.046492 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:31.046459    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97tl2\" (UniqueName: \"kubernetes.io/projected/4383ecc4-e1ec-49ab-9fef-cfd5fc19e88a-kube-api-access-97tl2\") pod \"migrator-76794cbd6c-b2dcg\" (UID: \"4383ecc4-e1ec-49ab-9fef-cfd5fc19e88a\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-b2dcg"
Sep 18 16:49:31.129190 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:31.129157    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2bv5_1534a00e-3417-441a-9df8-29be1ac81b77/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:31.146298 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:31.146258    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-b2dcg"
Sep 18 16:49:31.350397 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:31.350370    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-t4p6q_60bae8ea-9599-47f8-b066-df7c46c011b3/console-operator/1.log"
Sep 18 16:49:31.350783 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:31.350770    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-t4p6q_60bae8ea-9599-47f8-b066-df7c46c011b3/console-operator/0.log"
Sep 18 16:49:31.350848 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:31.350802    2577 generic.go:356] "Generic (PLEG): container finished" podID="60bae8ea-9599-47f8-b066-df7c46c011b3" containerID="abc3b068c547c1796f09fd4828cb18eb1bb05a47be2ace13ceeae30c8ca291ac" exitCode=255
Sep 18 16:49:31.350933 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:31.350908    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-t4p6q" event={"ID":"60bae8ea-9599-47f8-b066-df7c46c011b3","Type":"ContainerDied","Data":"abc3b068c547c1796f09fd4828cb18eb1bb05a47be2ace13ceeae30c8ca291ac"}
Sep 18 16:49:31.350984 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:31.350969    2577 scope.go:117] "RemoveContainer" containerID="527db3e247a74dc141804b990f680755f17614d8490ea77fbf8be493299719a5"
Sep 18 16:49:31.351269 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:31.351231    2577 scope.go:117] "RemoveContainer" containerID="abc3b068c547c1796f09fd4828cb18eb1bb05a47be2ace13ceeae30c8ca291ac"
Sep 18 16:49:31.351416 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:31.351393    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-t4p6q_openshift-console-operator(60bae8ea-9599-47f8-b066-df7c46c011b3)\"" pod="openshift-console-operator/console-operator-fd4bb46c-t4p6q" podUID="60bae8ea-9599-47f8-b066-df7c46c011b3"
Sep 18 16:49:31.417655 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:31.417579    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-b2dcg"]
Sep 18 16:49:31.421111 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:49:31.421076    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4383ecc4_e1ec_49ab_9fef_cfd5fc19e88a.slice/crio-b676033fc2df04df72ffa18dfb49fee44a5a8754c2277972aba03dea368b91d1 WatchSource:0}: Error finding container b676033fc2df04df72ffa18dfb49fee44a5a8754c2277972aba03dea368b91d1: Status 404 returned error can't find the container with id b676033fc2df04df72ffa18dfb49fee44a5a8754c2277972aba03dea368b91d1
Sep 18 16:49:31.471895 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:31.471860    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2bv5_1534a00e-3417-441a-9df8-29be1ac81b77/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:31.574499 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:31.574460    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2bv5_1534a00e-3417-441a-9df8-29be1ac81b77/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:31.671629 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:31.671517    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2bv5_1534a00e-3417-441a-9df8-29be1ac81b77/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:31.899167 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:31.899131    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2bv5_1534a00e-3417-441a-9df8-29be1ac81b77/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:32.033625 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:32.033543    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ghtv5"]
Sep 18 16:49:32.036036 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:32.036013    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ghtv5"
Sep 18 16:49:32.042219 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:32.042174    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 18 16:49:32.042786 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:32.042194    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 18 16:49:32.042786 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:32.042252    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8qvq5\""
Sep 18 16:49:32.092858 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:32.092827    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2bv5_1534a00e-3417-441a-9df8-29be1ac81b77/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:32.107817 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:32.107782    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ghtv5"]
Sep 18 16:49:32.144638 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:32.144599    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr8v9\" (UniqueName: \"kubernetes.io/projected/770f3c28-b304-40a6-a804-5bbe9e49bab3-kube-api-access-sr8v9\") pod \"insights-runtime-extractor-ghtv5\" (UID: \"770f3c28-b304-40a6-a804-5bbe9e49bab3\") " pod="openshift-insights/insights-runtime-extractor-ghtv5"
Sep 18 16:49:32.144814 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:32.144767    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/770f3c28-b304-40a6-a804-5bbe9e49bab3-data-volume\") pod \"insights-runtime-extractor-ghtv5\" (UID: \"770f3c28-b304-40a6-a804-5bbe9e49bab3\") " pod="openshift-insights/insights-runtime-extractor-ghtv5"
Sep 18 16:49:32.144932 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:32.144814    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/770f3c28-b304-40a6-a804-5bbe9e49bab3-crio-socket\") pod \"insights-runtime-extractor-ghtv5\" (UID: \"770f3c28-b304-40a6-a804-5bbe9e49bab3\") " pod="openshift-insights/insights-runtime-extractor-ghtv5"
Sep 18 16:49:32.144932 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:32.144856    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/770f3c28-b304-40a6-a804-5bbe9e49bab3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ghtv5\" (UID: \"770f3c28-b304-40a6-a804-5bbe9e49bab3\") " pod="openshift-insights/insights-runtime-extractor-ghtv5"
Sep 18 16:49:32.144932 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:32.144886    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/770f3c28-b304-40a6-a804-5bbe9e49bab3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ghtv5\" (UID: \"770f3c28-b304-40a6-a804-5bbe9e49bab3\") " pod="openshift-insights/insights-runtime-extractor-ghtv5"
Sep 18 16:49:32.245448 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:32.245412    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/770f3c28-b304-40a6-a804-5bbe9e49bab3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ghtv5\" (UID: \"770f3c28-b304-40a6-a804-5bbe9e49bab3\") " pod="openshift-insights/insights-runtime-extractor-ghtv5"
Sep 18 16:49:32.245806 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:32.245487    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sr8v9\" (UniqueName: \"kubernetes.io/projected/770f3c28-b304-40a6-a804-5bbe9e49bab3-kube-api-access-sr8v9\") pod \"insights-runtime-extractor-ghtv5\" (UID: \"770f3c28-b304-40a6-a804-5bbe9e49bab3\") " pod="openshift-insights/insights-runtime-extractor-ghtv5"
Sep 18 16:49:32.245806 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:32.245604    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/770f3c28-b304-40a6-a804-5bbe9e49bab3-data-volume\") pod \"insights-runtime-extractor-ghtv5\" (UID: \"770f3c28-b304-40a6-a804-5bbe9e49bab3\") " pod="openshift-insights/insights-runtime-extractor-ghtv5"
Sep 18 16:49:32.245806 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:32.245646    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/770f3c28-b304-40a6-a804-5bbe9e49bab3-crio-socket\") pod \"insights-runtime-extractor-ghtv5\" (UID: \"770f3c28-b304-40a6-a804-5bbe9e49bab3\") " pod="openshift-insights/insights-runtime-extractor-ghtv5"
Sep 18 16:49:32.245806 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:32.245609    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 16:49:32.245806 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:32.245764    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/770f3c28-b304-40a6-a804-5bbe9e49bab3-insights-runtime-extractor-tls podName:770f3c28-b304-40a6-a804-5bbe9e49bab3 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:32.74574347 +0000 UTC m=+45.803032980 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/770f3c28-b304-40a6-a804-5bbe9e49bab3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ghtv5" (UID: "770f3c28-b304-40a6-a804-5bbe9e49bab3") : secret "insights-runtime-extractor-tls" not found
Sep 18 16:49:32.245806 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:32.245684    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/770f3c28-b304-40a6-a804-5bbe9e49bab3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ghtv5\" (UID: \"770f3c28-b304-40a6-a804-5bbe9e49bab3\") " pod="openshift-insights/insights-runtime-extractor-ghtv5"
Sep 18 16:49:32.245806 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:32.245785    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/770f3c28-b304-40a6-a804-5bbe9e49bab3-crio-socket\") pod \"insights-runtime-extractor-ghtv5\" (UID: \"770f3c28-b304-40a6-a804-5bbe9e49bab3\") " pod="openshift-insights/insights-runtime-extractor-ghtv5"
Sep 18 16:49:32.246300 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:32.245852    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 16:49:32.246300 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:32.245940    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/770f3c28-b304-40a6-a804-5bbe9e49bab3-kube-rbac-proxy-cm podName:770f3c28-b304-40a6-a804-5bbe9e49bab3 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:32.745915083 +0000 UTC m=+45.803204609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/770f3c28-b304-40a6-a804-5bbe9e49bab3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ghtv5" (UID: "770f3c28-b304-40a6-a804-5bbe9e49bab3") : configmap "kube-rbac-proxy" not found
Sep 18 16:49:32.246300 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:32.245979    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/770f3c28-b304-40a6-a804-5bbe9e49bab3-data-volume\") pod \"insights-runtime-extractor-ghtv5\" (UID: \"770f3c28-b304-40a6-a804-5bbe9e49bab3\") " pod="openshift-insights/insights-runtime-extractor-ghtv5"
Sep 18 16:49:32.257054 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:32.257030    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr8v9\" (UniqueName: \"kubernetes.io/projected/770f3c28-b304-40a6-a804-5bbe9e49bab3-kube-api-access-sr8v9\") pod \"insights-runtime-extractor-ghtv5\" (UID: \"770f3c28-b304-40a6-a804-5bbe9e49bab3\") " pod="openshift-insights/insights-runtime-extractor-ghtv5"
Sep 18 16:49:32.356851 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:32.356820    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-t4p6q_60bae8ea-9599-47f8-b066-df7c46c011b3/console-operator/1.log"
Sep 18 16:49:32.357221 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:32.357194    2577 scope.go:117] "RemoveContainer" containerID="abc3b068c547c1796f09fd4828cb18eb1bb05a47be2ace13ceeae30c8ca291ac"
Sep 18 16:49:32.357394 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:32.357370    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-t4p6q_openshift-console-operator(60bae8ea-9599-47f8-b066-df7c46c011b3)\"" pod="openshift-console-operator/console-operator-fd4bb46c-t4p6q" podUID="60bae8ea-9599-47f8-b066-df7c46c011b3"
Sep 18 16:49:32.358380 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:32.358354    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-b2dcg" event={"ID":"4383ecc4-e1ec-49ab-9fef-cfd5fc19e88a","Type":"ContainerStarted","Data":"b676033fc2df04df72ffa18dfb49fee44a5a8754c2277972aba03dea368b91d1"}
Sep 18 16:49:32.369771 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:32.369752    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5rc4b_95f739d8-990d-4aa8-a1e3-ed8cefd56bd2/dns-node-resolver/0.log"
Sep 18 16:49:32.594304 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:32.594279    2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-fd4bb46c-t4p6q"
Sep 18 16:49:32.594410 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:32.594334    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-t4p6q"
Sep 18 16:49:32.626857 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:32.626828    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2bv5_1534a00e-3417-441a-9df8-29be1ac81b77/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:32.750887 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:32.750855    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/770f3c28-b304-40a6-a804-5bbe9e49bab3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ghtv5\" (UID: \"770f3c28-b304-40a6-a804-5bbe9e49bab3\") " pod="openshift-insights/insights-runtime-extractor-ghtv5"
Sep 18 16:49:32.751056 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:32.750900    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/770f3c28-b304-40a6-a804-5bbe9e49bab3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ghtv5\" (UID: \"770f3c28-b304-40a6-a804-5bbe9e49bab3\") " pod="openshift-insights/insights-runtime-extractor-ghtv5"
Sep 18 16:49:32.751056 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:32.750989    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 16:49:32.751176 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:32.751058    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/770f3c28-b304-40a6-a804-5bbe9e49bab3-kube-rbac-proxy-cm podName:770f3c28-b304-40a6-a804-5bbe9e49bab3 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:33.751041393 +0000 UTC m=+46.808330899 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/770f3c28-b304-40a6-a804-5bbe9e49bab3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ghtv5" (UID: "770f3c28-b304-40a6-a804-5bbe9e49bab3") : configmap "kube-rbac-proxy" not found
Sep 18 16:49:32.751176 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:32.751056    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 16:49:32.751176 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:32.751085    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/770f3c28-b304-40a6-a804-5bbe9e49bab3-insights-runtime-extractor-tls podName:770f3c28-b304-40a6-a804-5bbe9e49bab3 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:33.751078697 +0000 UTC m=+46.808368203 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/770f3c28-b304-40a6-a804-5bbe9e49bab3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ghtv5" (UID: "770f3c28-b304-40a6-a804-5bbe9e49bab3") : secret "insights-runtime-extractor-tls" not found
Sep 18 16:49:33.363778 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:33.363735    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-b2dcg" event={"ID":"4383ecc4-e1ec-49ab-9fef-cfd5fc19e88a","Type":"ContainerStarted","Data":"fcdef64c7c75046efdcdc25ca5480853bd426c01c10893a06443f8e8d5b4812f"}
Sep 18 16:49:33.364263 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:33.363802    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-b2dcg" event={"ID":"4383ecc4-e1ec-49ab-9fef-cfd5fc19e88a","Type":"ContainerStarted","Data":"2d889e418683fddb62f6e5f52af5e8c73427d62f3627abf12046dfe10098d185"}
Sep 18 16:49:33.364263 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:33.364084    2577 scope.go:117] "RemoveContainer" containerID="abc3b068c547c1796f09fd4828cb18eb1bb05a47be2ace13ceeae30c8ca291ac"
Sep 18 16:49:33.364362 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:33.364261    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-t4p6q_openshift-console-operator(60bae8ea-9599-47f8-b066-df7c46c011b3)\"" pod="openshift-console-operator/console-operator-fd4bb46c-t4p6q" podUID="60bae8ea-9599-47f8-b066-df7c46c011b3"
Sep 18 16:49:33.383707 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:33.383655    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-b2dcg" podStartSLOduration=2.247958776 podStartE2EDuration="3.383636447s" totalImagesPullingTime="1.135677671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:49:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:33.382576492 +0000 UTC m=+46.439866020" watchObservedRunningTime="2026-09-18 16:49:33.383636447 +0000 UTC m=+46.440925977"
Sep 18 16:49:33.435383 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:33.435349    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-mngmw"]
Sep 18 16:49:33.437465 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:33.437437    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-mngmw"
Sep 18 16:49:33.439787 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:33.439761    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 18 16:49:33.439787 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:33.439767    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 18 16:49:33.440082 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:33.439815    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-5jplg\""
Sep 18 16:49:33.440082 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:33.439835    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 18 16:49:33.440082 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:33.439815    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 18 16:49:33.448412 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:33.448389    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-mngmw"]
Sep 18 16:49:33.557303 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:33.557270    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-879rq\" (UniqueName: \"kubernetes.io/projected/f4e17d0d-c4c0-4681-b2ad-cd345d1f6b97-kube-api-access-879rq\") pod \"service-ca-55f6fc7b86-mngmw\" (UID: \"f4e17d0d-c4c0-4681-b2ad-cd345d1f6b97\") " pod="openshift-service-ca/service-ca-55f6fc7b86-mngmw"
Sep 18 16:49:33.557476 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:33.557321    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f4e17d0d-c4c0-4681-b2ad-cd345d1f6b97-signing-key\") pod \"service-ca-55f6fc7b86-mngmw\" (UID: \"f4e17d0d-c4c0-4681-b2ad-cd345d1f6b97\") " pod="openshift-service-ca/service-ca-55f6fc7b86-mngmw"
Sep 18 16:49:33.557476 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:33.557445    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f4e17d0d-c4c0-4681-b2ad-cd345d1f6b97-signing-cabundle\") pod \"service-ca-55f6fc7b86-mngmw\" (UID: \"f4e17d0d-c4c0-4681-b2ad-cd345d1f6b97\") " pod="openshift-service-ca/service-ca-55f6fc7b86-mngmw"
Sep 18 16:49:33.658599 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:33.658507    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-879rq\" (UniqueName: \"kubernetes.io/projected/f4e17d0d-c4c0-4681-b2ad-cd345d1f6b97-kube-api-access-879rq\") pod \"service-ca-55f6fc7b86-mngmw\" (UID: \"f4e17d0d-c4c0-4681-b2ad-cd345d1f6b97\") " pod="openshift-service-ca/service-ca-55f6fc7b86-mngmw"
Sep 18 16:49:33.658599 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:33.658570    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f4e17d0d-c4c0-4681-b2ad-cd345d1f6b97-signing-key\") pod \"service-ca-55f6fc7b86-mngmw\" (UID: \"f4e17d0d-c4c0-4681-b2ad-cd345d1f6b97\") " pod="openshift-service-ca/service-ca-55f6fc7b86-mngmw"
Sep 18 16:49:33.658831 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:33.658618    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f4e17d0d-c4c0-4681-b2ad-cd345d1f6b97-signing-cabundle\") pod \"service-ca-55f6fc7b86-mngmw\" (UID: \"f4e17d0d-c4c0-4681-b2ad-cd345d1f6b97\") " pod="openshift-service-ca/service-ca-55f6fc7b86-mngmw"
Sep 18 16:49:33.659244 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:33.659226    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f4e17d0d-c4c0-4681-b2ad-cd345d1f6b97-signing-cabundle\") pod \"service-ca-55f6fc7b86-mngmw\" (UID: \"f4e17d0d-c4c0-4681-b2ad-cd345d1f6b97\") " pod="openshift-service-ca/service-ca-55f6fc7b86-mngmw"
Sep 18 16:49:33.661026 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:33.661003    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f4e17d0d-c4c0-4681-b2ad-cd345d1f6b97-signing-key\") pod \"service-ca-55f6fc7b86-mngmw\" (UID: \"f4e17d0d-c4c0-4681-b2ad-cd345d1f6b97\") " pod="openshift-service-ca/service-ca-55f6fc7b86-mngmw"
Sep 18 16:49:33.667491 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:33.667470    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-879rq\" (UniqueName: \"kubernetes.io/projected/f4e17d0d-c4c0-4681-b2ad-cd345d1f6b97-kube-api-access-879rq\") pod \"service-ca-55f6fc7b86-mngmw\" (UID: \"f4e17d0d-c4c0-4681-b2ad-cd345d1f6b97\") " pod="openshift-service-ca/service-ca-55f6fc7b86-mngmw"
Sep 18 16:49:33.745917 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:33.745881    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-mngmw"
Sep 18 16:49:33.759196 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:33.759170    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/770f3c28-b304-40a6-a804-5bbe9e49bab3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ghtv5\" (UID: \"770f3c28-b304-40a6-a804-5bbe9e49bab3\") " pod="openshift-insights/insights-runtime-extractor-ghtv5"
Sep 18 16:49:33.759305 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:33.759204    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/770f3c28-b304-40a6-a804-5bbe9e49bab3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ghtv5\" (UID: \"770f3c28-b304-40a6-a804-5bbe9e49bab3\") " pod="openshift-insights/insights-runtime-extractor-ghtv5"
Sep 18 16:49:33.759349 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:33.759301    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 16:49:33.759394 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:33.759381    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/770f3c28-b304-40a6-a804-5bbe9e49bab3-kube-rbac-proxy-cm podName:770f3c28-b304-40a6-a804-5bbe9e49bab3 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:35.759360861 +0000 UTC m=+48.816650387 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/770f3c28-b304-40a6-a804-5bbe9e49bab3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ghtv5" (UID: "770f3c28-b304-40a6-a804-5bbe9e49bab3") : configmap "kube-rbac-proxy" not found
Sep 18 16:49:33.759448 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:33.759414    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 16:49:33.759495 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:33.759477    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/770f3c28-b304-40a6-a804-5bbe9e49bab3-insights-runtime-extractor-tls podName:770f3c28-b304-40a6-a804-5bbe9e49bab3 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:35.759457798 +0000 UTC m=+48.816747331 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/770f3c28-b304-40a6-a804-5bbe9e49bab3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ghtv5" (UID: "770f3c28-b304-40a6-a804-5bbe9e49bab3") : secret "insights-runtime-extractor-tls" not found
Sep 18 16:49:33.766798 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:33.766774    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v7rt9_cb0bea49-0666-42ee-9d96-221eee1b5aa8/node-ca/0.log"
Sep 18 16:49:33.968266 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:33.968175    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-b2dcg_4383ecc4-e1ec-49ab-9fef-cfd5fc19e88a/migrator/0.log"
Sep 18 16:49:34.016518 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:34.016483    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-mngmw"]
Sep 18 16:49:34.019692 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:49:34.019668    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4e17d0d_c4c0_4681_b2ad_cd345d1f6b97.slice/crio-108e97b6e88b54bf0726f218d890b01d09157c18671b9b9767b239e2fc8f5438 WatchSource:0}: Error finding container 108e97b6e88b54bf0726f218d890b01d09157c18671b9b9767b239e2fc8f5438: Status 404 returned error can't find the container with id 108e97b6e88b54bf0726f218d890b01d09157c18671b9b9767b239e2fc8f5438
Sep 18 16:49:34.166119 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:34.166091    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-b2dcg_4383ecc4-e1ec-49ab-9fef-cfd5fc19e88a/graceful-termination/0.log"
Sep 18 16:49:34.368109 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:34.368070    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-mngmw" event={"ID":"f4e17d0d-c4c0-4681-b2ad-cd345d1f6b97","Type":"ContainerStarted","Data":"f9f0d24fb1278516f83275dad66413acc042bed5e7174606662b8649d07d1cd0"}
Sep 18 16:49:34.368576 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:34.368125    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-mngmw" event={"ID":"f4e17d0d-c4c0-4681-b2ad-cd345d1f6b97","Type":"ContainerStarted","Data":"108e97b6e88b54bf0726f218d890b01d09157c18671b9b9767b239e2fc8f5438"}
Sep 18 16:49:34.377058 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:34.377033    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-87vfw_bf32dd38-8c07-4cb1-bae7-d8f2613669e0/kube-storage-version-migrator-operator/0.log"
Sep 18 16:49:34.393389 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:34.393336    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-55f6fc7b86-mngmw" podStartSLOduration=1.393318413 podStartE2EDuration="1.393318413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:49:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:34.391946386 +0000 UTC m=+47.449235915" watchObservedRunningTime="2026-09-18 16:49:34.393318413 +0000 UTC m=+47.450607943"
Sep 18 16:49:35.775771 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:35.775726    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/770f3c28-b304-40a6-a804-5bbe9e49bab3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ghtv5\" (UID: \"770f3c28-b304-40a6-a804-5bbe9e49bab3\") " pod="openshift-insights/insights-runtime-extractor-ghtv5"
Sep 18 16:49:35.775771 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:35.775777    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/770f3c28-b304-40a6-a804-5bbe9e49bab3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ghtv5\" (UID: \"770f3c28-b304-40a6-a804-5bbe9e49bab3\") " pod="openshift-insights/insights-runtime-extractor-ghtv5"
Sep 18 16:49:35.776251 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:35.775811    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 16:49:35.776251 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:35.775879    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/770f3c28-b304-40a6-a804-5bbe9e49bab3-kube-rbac-proxy-cm podName:770f3c28-b304-40a6-a804-5bbe9e49bab3 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:39.775861689 +0000 UTC m=+52.833151201 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/770f3c28-b304-40a6-a804-5bbe9e49bab3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ghtv5" (UID: "770f3c28-b304-40a6-a804-5bbe9e49bab3") : configmap "kube-rbac-proxy" not found
Sep 18 16:49:35.776251 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:35.775892    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 16:49:35.776251 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:35.775926    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/770f3c28-b304-40a6-a804-5bbe9e49bab3-insights-runtime-extractor-tls podName:770f3c28-b304-40a6-a804-5bbe9e49bab3 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:39.775915851 +0000 UTC m=+52.833205360 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/770f3c28-b304-40a6-a804-5bbe9e49bab3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ghtv5" (UID: "770f3c28-b304-40a6-a804-5bbe9e49bab3") : secret "insights-runtime-extractor-tls" not found
Sep 18 16:49:38.095681 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:38.095646    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-x9bk4\" (UID: \"5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-x9bk4"
Sep 18 16:49:38.096041 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:38.095718    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5d212c2-ba22-4283-8333-ac5f88635268-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-x7gwl\" (UID: \"c5d212c2-ba22-4283-8333-ac5f88635268\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-x7gwl"
Sep 18 16:49:38.096041 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:38.095744    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2200d387-c1d6-477d-ab65-eb96dc6b3259-registry-tls\") pod \"image-registry-6888775986-fl24h\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") " pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:49:38.096041 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:38.095795    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 18 16:49:38.096041 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:38.095846    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 16:49:38.096041 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:38.095855    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6888775986-fl24h: secret "image-registry-tls" not found
Sep 18 16:49:38.096041 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:38.095868    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965-networking-console-plugin-cert podName:5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:54.095852739 +0000 UTC m=+67.153142265 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-x9bk4" (UID: "5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965") : secret "networking-console-plugin-cert" not found
Sep 18 16:49:38.096041 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:38.095891    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2200d387-c1d6-477d-ab65-eb96dc6b3259-registry-tls podName:2200d387-c1d6-477d-ab65-eb96dc6b3259 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:54.095881456 +0000 UTC m=+67.153170962 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2200d387-c1d6-477d-ab65-eb96dc6b3259-registry-tls") pod "image-registry-6888775986-fl24h" (UID: "2200d387-c1d6-477d-ab65-eb96dc6b3259") : secret "image-registry-tls" not found
Sep 18 16:49:38.098259 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:38.098226    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5d212c2-ba22-4283-8333-ac5f88635268-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-x7gwl\" (UID: \"c5d212c2-ba22-4283-8333-ac5f88635268\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-x7gwl"
Sep 18 16:49:38.176399 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:38.176364    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-x7gwl"
Sep 18 16:49:38.196880 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:38.196853    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fc84d1c-d436-4b1a-9557-182688c69eff-metrics-tls\") pod \"dns-default-ttxjb\" (UID: \"9fc84d1c-d436-4b1a-9557-182688c69eff\") " pod="openshift-dns/dns-default-ttxjb"
Sep 18 16:49:38.197013 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:38.196998    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 16:49:38.197072 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:38.197062    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fc84d1c-d436-4b1a-9557-182688c69eff-metrics-tls podName:9fc84d1c-d436-4b1a-9557-182688c69eff nodeName:}" failed. No retries permitted until 2026-09-18 16:49:54.197045792 +0000 UTC m=+67.254335300 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fc84d1c-d436-4b1a-9557-182688c69eff-metrics-tls") pod "dns-default-ttxjb" (UID: "9fc84d1c-d436-4b1a-9557-182688c69eff") : secret "dns-default-metrics-tls" not found
Sep 18 16:49:38.474875 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:38.474842    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-x7gwl"]
Sep 18 16:49:39.388090 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:39.388046    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-x7gwl" event={"ID":"c5d212c2-ba22-4283-8333-ac5f88635268","Type":"ContainerStarted","Data":"bec032a67b99fbb91b37d9ae393ce5ab3f4b9e6f3fe45b596239b414385cf937"}
Sep 18 16:49:39.810996 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:39.810913    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/770f3c28-b304-40a6-a804-5bbe9e49bab3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ghtv5\" (UID: \"770f3c28-b304-40a6-a804-5bbe9e49bab3\") " pod="openshift-insights/insights-runtime-extractor-ghtv5"
Sep 18 16:49:39.811162 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:39.811026    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/770f3c28-b304-40a6-a804-5bbe9e49bab3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ghtv5\" (UID: \"770f3c28-b304-40a6-a804-5bbe9e49bab3\") " pod="openshift-insights/insights-runtime-extractor-ghtv5"
Sep 18 16:49:39.811162 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:39.811093    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 16:49:39.811270 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:49:39.811187    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/770f3c28-b304-40a6-a804-5bbe9e49bab3-insights-runtime-extractor-tls podName:770f3c28-b304-40a6-a804-5bbe9e49bab3 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:47.81116516 +0000 UTC m=+60.868454668 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/770f3c28-b304-40a6-a804-5bbe9e49bab3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ghtv5" (UID: "770f3c28-b304-40a6-a804-5bbe9e49bab3") : secret "insights-runtime-extractor-tls" not found
Sep 18 16:49:39.811462 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:39.811443    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/770f3c28-b304-40a6-a804-5bbe9e49bab3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ghtv5\" (UID: \"770f3c28-b304-40a6-a804-5bbe9e49bab3\") " pod="openshift-insights/insights-runtime-extractor-ghtv5"
Sep 18 16:49:41.395548 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:41.395489    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-x7gwl" event={"ID":"c5d212c2-ba22-4283-8333-ac5f88635268","Type":"ContainerStarted","Data":"0159c8302051beacc04ff5edff3d868827a93248f2f5f1d76066607343e80f09"}
Sep 18 16:49:41.396006 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:41.395575    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-x7gwl" event={"ID":"c5d212c2-ba22-4283-8333-ac5f88635268","Type":"ContainerStarted","Data":"103c6b8340032a02f0850aca87433b3d2c72e2c67c70e25e428f7d72699710a1"}
Sep 18 16:49:41.431962 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:41.431903    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-x7gwl" podStartSLOduration=32.315070302 podStartE2EDuration="34.431885009s" totalImagesPullingTime="2.116814707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:49:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:41.430774339 +0000 UTC m=+54.488063867" watchObservedRunningTime="2026-09-18 16:49:41.431885009 +0000 UTC m=+54.489174537"
Sep 18 16:49:45.116435 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:45.116401    2577 scope.go:117] "RemoveContainer" containerID="abc3b068c547c1796f09fd4828cb18eb1bb05a47be2ace13ceeae30c8ca291ac"
Sep 18 16:49:45.413102 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:45.413030    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-t4p6q_60bae8ea-9599-47f8-b066-df7c46c011b3/console-operator/1.log"
Sep 18 16:49:45.413250 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:45.413108    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-t4p6q" event={"ID":"60bae8ea-9599-47f8-b066-df7c46c011b3","Type":"ContainerStarted","Data":"d09d8b06badba649d38d2ba5fef5bb05560bd5fd858243d99e61a5491d687f30"}
Sep 18 16:49:45.413405 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:45.413382    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-t4p6q"
Sep 18 16:49:45.432254 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:45.432206    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-fd4bb46c-t4p6q" podStartSLOduration=30.903576785 podStartE2EDuration="36.432190745s" totalImagesPullingTime="5.52861396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:49:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:45.431574241 +0000 UTC m=+58.488863770" watchObservedRunningTime="2026-09-18 16:49:45.432190745 +0000 UTC m=+58.489480327"
Sep 18 16:49:46.010031 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:46.009995    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-fd4bb46c-t4p6q"
Sep 18 16:49:47.878250 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:47.878218    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/770f3c28-b304-40a6-a804-5bbe9e49bab3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ghtv5\" (UID: \"770f3c28-b304-40a6-a804-5bbe9e49bab3\") " pod="openshift-insights/insights-runtime-extractor-ghtv5"
Sep 18 16:49:47.880480 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:47.880454    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/770f3c28-b304-40a6-a804-5bbe9e49bab3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ghtv5\" (UID: \"770f3c28-b304-40a6-a804-5bbe9e49bab3\") " pod="openshift-insights/insights-runtime-extractor-ghtv5"
Sep 18 16:49:47.947625 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:47.947592    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ghtv5"
Sep 18 16:49:48.254491 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:48.253560    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ghtv5"]
Sep 18 16:49:48.258464 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:49:48.258438    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod770f3c28_b304_40a6_a804_5bbe9e49bab3.slice/crio-48b84d6ec193211e862b7d1f41c541089eda9db76aa09ab237de8c0da105c3aa WatchSource:0}: Error finding container 48b84d6ec193211e862b7d1f41c541089eda9db76aa09ab237de8c0da105c3aa: Status 404 returned error can't find the container with id 48b84d6ec193211e862b7d1f41c541089eda9db76aa09ab237de8c0da105c3aa
Sep 18 16:49:48.284971 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:48.284948    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ktklw"
Sep 18 16:49:48.424623 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:48.424579    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ghtv5" event={"ID":"770f3c28-b304-40a6-a804-5bbe9e49bab3","Type":"ContainerStarted","Data":"361fd335ae720b61b9f1bb3e4ddc09d0d53d996c6343bceaeab1b05f4d62811d"}
Sep 18 16:49:48.424791 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:48.424642    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ghtv5" event={"ID":"770f3c28-b304-40a6-a804-5bbe9e49bab3","Type":"ContainerStarted","Data":"48b84d6ec193211e862b7d1f41c541089eda9db76aa09ab237de8c0da105c3aa"}
Sep 18 16:49:50.433671 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:50.433630    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ghtv5" event={"ID":"770f3c28-b304-40a6-a804-5bbe9e49bab3","Type":"ContainerStarted","Data":"1cb6ac70735899a8b2b44cd5ef3d450dc8c4d691c49436d201afbb6833fda433"}
Sep 18 16:49:51.438470 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:51.438415    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ghtv5" event={"ID":"770f3c28-b304-40a6-a804-5bbe9e49bab3","Type":"ContainerStarted","Data":"eb252dd085c2c44fa6f669d44090f6f8bf53f92f347ca3d6a684a58eb71f35f5"}
Sep 18 16:49:51.456146 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:51.456100    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ghtv5" podStartSLOduration=17.632300913 podStartE2EDuration="20.456084573s" totalImagesPullingTime="2.82378366s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:49:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:51.455178382 +0000 UTC m=+64.512467909" watchObservedRunningTime="2026-09-18 16:49:51.456084573 +0000 UTC m=+64.513374128"
Sep 18 16:49:54.129727 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:54.129690    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-x9bk4\" (UID: \"5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-x9bk4"
Sep 18 16:49:54.130191 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:54.129861    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2200d387-c1d6-477d-ab65-eb96dc6b3259-registry-tls\") pod \"image-registry-6888775986-fl24h\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") " pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:49:54.132117 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:54.132099    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-x9bk4\" (UID: \"5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-x9bk4"
Sep 18 16:49:54.132188 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:54.132167    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2200d387-c1d6-477d-ab65-eb96dc6b3259-registry-tls\") pod \"image-registry-6888775986-fl24h\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") " pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:49:54.230596 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:54.230522    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fc84d1c-d436-4b1a-9557-182688c69eff-metrics-tls\") pod \"dns-default-ttxjb\" (UID: \"9fc84d1c-d436-4b1a-9557-182688c69eff\") " pod="openshift-dns/dns-default-ttxjb"
Sep 18 16:49:54.232774 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:54.232751    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fc84d1c-d436-4b1a-9557-182688c69eff-metrics-tls\") pod \"dns-default-ttxjb\" (UID: \"9fc84d1c-d436-4b1a-9557-182688c69eff\") " pod="openshift-dns/dns-default-ttxjb"
Sep 18 16:49:54.342657 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:54.342627    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-b5tkf\""
Sep 18 16:49:54.351274 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:54.351257    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:49:54.354231 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:54.354215    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-xvqxk\""
Sep 18 16:49:54.362818 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:54.362797    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-x9bk4"
Sep 18 16:49:54.443784 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:54.443763    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4lvzz\""
Sep 18 16:49:54.452116 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:54.452091    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ttxjb"
Sep 18 16:49:54.626477 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:54.626447    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6888775986-fl24h"]
Sep 18 16:49:54.629871 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:49:54.629842    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2200d387_c1d6_477d_ab65_eb96dc6b3259.slice/crio-fa705b7e7bb7c12676f6fed43bd6f3e26085f3d0a0fb46816a18b0824a9647e5 WatchSource:0}: Error finding container fa705b7e7bb7c12676f6fed43bd6f3e26085f3d0a0fb46816a18b0824a9647e5: Status 404 returned error can't find the container with id fa705b7e7bb7c12676f6fed43bd6f3e26085f3d0a0fb46816a18b0824a9647e5
Sep 18 16:49:54.639234 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:54.639206    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-x9bk4"]
Sep 18 16:49:54.641881 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:49:54.641852    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bd1c70f_d4b2_4d0c_8ac4_2d10df8b4965.slice/crio-8f211a8652bf5665c142b31526ba0246cf94b2163ce9ad9eb6abf5d044072872 WatchSource:0}: Error finding container 8f211a8652bf5665c142b31526ba0246cf94b2163ce9ad9eb6abf5d044072872: Status 404 returned error can't find the container with id 8f211a8652bf5665c142b31526ba0246cf94b2163ce9ad9eb6abf5d044072872
Sep 18 16:49:54.719121 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:54.718989    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ttxjb"]
Sep 18 16:49:54.721483 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:49:54.721461    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fc84d1c_d436_4b1a_9557_182688c69eff.slice/crio-0ea988c9f4d4ed9f4efad5d73c4a274cf8cec42fe8378d458706ca6b9960b4c3 WatchSource:0}: Error finding container 0ea988c9f4d4ed9f4efad5d73c4a274cf8cec42fe8378d458706ca6b9960b4c3: Status 404 returned error can't find the container with id 0ea988c9f4d4ed9f4efad5d73c4a274cf8cec42fe8378d458706ca6b9960b4c3
Sep 18 16:49:54.835266 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:54.835228    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/056bb4ff-01e7-45b4-b5d0-e15f0779692b-metrics-certs\") pod \"network-metrics-daemon-xggf7\" (UID: \"056bb4ff-01e7-45b4-b5d0-e15f0779692b\") " pod="openshift-multus/network-metrics-daemon-xggf7"
Sep 18 16:49:54.835419 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:54.835298    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7774138-6ff0-4571-8f2e-4a8020126c37-original-pull-secret\") pod \"global-pull-secret-syncer-wrq7r\" (UID: \"b7774138-6ff0-4571-8f2e-4a8020126c37\") " pod="kube-system/global-pull-secret-syncer-wrq7r"
Sep 18 16:49:54.837660 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:54.837640    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 18 16:49:54.837759 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:54.837642    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 18 16:49:54.848598 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:54.848573    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/056bb4ff-01e7-45b4-b5d0-e15f0779692b-metrics-certs\") pod \"network-metrics-daemon-xggf7\" (UID: \"056bb4ff-01e7-45b4-b5d0-e15f0779692b\") " pod="openshift-multus/network-metrics-daemon-xggf7"
Sep 18 16:49:54.848697 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:54.848638    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7774138-6ff0-4571-8f2e-4a8020126c37-original-pull-secret\") pod \"global-pull-secret-syncer-wrq7r\" (UID: \"b7774138-6ff0-4571-8f2e-4a8020126c37\") " pod="kube-system/global-pull-secret-syncer-wrq7r"
Sep 18 16:49:55.032145 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:55.032066    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rqwhk\""
Sep 18 16:49:55.040980 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:55.040954    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xggf7"
Sep 18 16:49:55.040980 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:55.040972    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrq7r"
Sep 18 16:49:55.320627 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:55.320435    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xggf7"]
Sep 18 16:49:55.322197 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:55.322162    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wrq7r"]
Sep 18 16:49:55.325705 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:49:55.325663    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod056bb4ff_01e7_45b4_b5d0_e15f0779692b.slice/crio-3bbaa914d5125a935ba350bb1bab17075f6f7034fe23362fe7d87c452851dd16 WatchSource:0}: Error finding container 3bbaa914d5125a935ba350bb1bab17075f6f7034fe23362fe7d87c452851dd16: Status 404 returned error can't find the container with id 3bbaa914d5125a935ba350bb1bab17075f6f7034fe23362fe7d87c452851dd16
Sep 18 16:49:55.326585 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:49:55.326556    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7774138_6ff0_4571_8f2e_4a8020126c37.slice/crio-451fc3d63bafb54abe8ffa8951429c3c0225d98c528caa1d9ca6b897d8f43c3d WatchSource:0}: Error finding container 451fc3d63bafb54abe8ffa8951429c3c0225d98c528caa1d9ca6b897d8f43c3d: Status 404 returned error can't find the container with id 451fc3d63bafb54abe8ffa8951429c3c0225d98c528caa1d9ca6b897d8f43c3d
Sep 18 16:49:55.453581 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:55.453469    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wrq7r" event={"ID":"b7774138-6ff0-4571-8f2e-4a8020126c37","Type":"ContainerStarted","Data":"451fc3d63bafb54abe8ffa8951429c3c0225d98c528caa1d9ca6b897d8f43c3d"}
Sep 18 16:49:55.455244 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:55.455203    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-x9bk4" event={"ID":"5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965","Type":"ContainerStarted","Data":"8f211a8652bf5665c142b31526ba0246cf94b2163ce9ad9eb6abf5d044072872"}
Sep 18 16:49:55.457351 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:55.457314    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6888775986-fl24h" event={"ID":"2200d387-c1d6-477d-ab65-eb96dc6b3259","Type":"ContainerStarted","Data":"402807b01118db2701ce4f591ce38118bdd40e91c048a630ee93382035d51d20"}
Sep 18 16:49:55.457462 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:55.457373    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6888775986-fl24h" event={"ID":"2200d387-c1d6-477d-ab65-eb96dc6b3259","Type":"ContainerStarted","Data":"fa705b7e7bb7c12676f6fed43bd6f3e26085f3d0a0fb46816a18b0824a9647e5"}
Sep 18 16:49:55.457565 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:55.457460    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:49:55.459241 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:55.459191    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xggf7" event={"ID":"056bb4ff-01e7-45b4-b5d0-e15f0779692b","Type":"ContainerStarted","Data":"3bbaa914d5125a935ba350bb1bab17075f6f7034fe23362fe7d87c452851dd16"}
Sep 18 16:49:55.460973 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:55.460946    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ttxjb" event={"ID":"9fc84d1c-d436-4b1a-9557-182688c69eff","Type":"ContainerStarted","Data":"0ea988c9f4d4ed9f4efad5d73c4a274cf8cec42fe8378d458706ca6b9960b4c3"}
Sep 18 16:49:55.478516 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:55.478293    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6888775986-fl24h" podStartSLOduration=66.478271969 podStartE2EDuration="1m6.478271969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:48:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:55.477886561 +0000 UTC m=+68.535176093" watchObservedRunningTime="2026-09-18 16:49:55.478271969 +0000 UTC m=+68.535561498"
Sep 18 16:49:56.467660 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:56.467589    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-x9bk4" event={"ID":"5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965","Type":"ContainerStarted","Data":"0a7c0519a4730865ac6f67426bd4aa1635acb94227f3b61826090386014569fe"}
Sep 18 16:49:56.486395 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:56.486311    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6446c8d75d-x9bk4" podStartSLOduration=55.391515306 podStartE2EDuration="56.486289257s" totalImagesPullingTime="1.094773951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:49:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:56.485077807 +0000 UTC m=+69.542367335" watchObservedRunningTime="2026-09-18 16:49:56.486289257 +0000 UTC m=+69.543578786"
Sep 18 16:49:57.475611 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:57.475572    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xggf7" event={"ID":"056bb4ff-01e7-45b4-b5d0-e15f0779692b","Type":"ContainerStarted","Data":"88a44e0532c373886c22d902e58a7c74d65ea051cfa7b2850ab959cacd494b2e"}
Sep 18 16:49:57.476057 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:57.475641    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xggf7" event={"ID":"056bb4ff-01e7-45b4-b5d0-e15f0779692b","Type":"ContainerStarted","Data":"4cd1d8e0a1b0ea220b0cd5ca6cc137d81bb5f7e4a3e07a4ff889aac32af268bd"}
Sep 18 16:49:57.477623 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:57.477588    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ttxjb" event={"ID":"9fc84d1c-d436-4b1a-9557-182688c69eff","Type":"ContainerStarted","Data":"76d2411536f4c0b7837bb228016775bfc6c664ccf034e0786731d6d0f012100f"}
Sep 18 16:49:57.477758 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:57.477644    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ttxjb" event={"ID":"9fc84d1c-d436-4b1a-9557-182688c69eff","Type":"ContainerStarted","Data":"34c7056ee78d5b15aeaeadbe3dd9eac8a764966368c5ab3f1feea50cf0b925a0"}
Sep 18 16:49:57.493818 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:57.493769    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xggf7" podStartSLOduration=67.135236179 podStartE2EDuration="1m8.493749086s" totalImagesPullingTime="1.358512907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:57.492334076 +0000 UTC m=+70.549623603" watchObservedRunningTime="2026-09-18 16:49:57.493749086 +0000 UTC m=+70.551038615"
Sep 18 16:49:57.511701 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:57.511649    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ttxjb" podStartSLOduration=33.548048893 podStartE2EDuration="35.511631165s" totalImagesPullingTime="1.963582272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:49:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:57.510231839 +0000 UTC m=+70.567521368" watchObservedRunningTime="2026-09-18 16:49:57.511631165 +0000 UTC m=+70.568920695"
Sep 18 16:49:58.482566 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:58.482518    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ttxjb"
Sep 18 16:49:59.487161 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:59.487055    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wrq7r" event={"ID":"b7774138-6ff0-4571-8f2e-4a8020126c37","Type":"ContainerStarted","Data":"380195ff9f50edb8b3325a91149492000e60e7922f6bfc9695ca17d470f46a0e"}
Sep 18 16:49:59.502275 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:49:59.502226    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wrq7r" podStartSLOduration=66.700469458 podStartE2EDuration="1m10.502212923s" totalImagesPullingTime="3.801743465s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:59.501248422 +0000 UTC m=+72.558537951" watchObservedRunningTime="2026-09-18 16:49:59.502212923 +0000 UTC m=+72.559502451"
Sep 18 16:50:01.354700 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:50:01.354593    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9jp46"
Sep 18 16:50:08.489633 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:50:08.489599    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ttxjb"
Sep 18 16:50:14.355431 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:50:14.355394    2577 patch_prober.go:28] interesting pod/image-registry-6888775986-fl24h container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 18 16:50:14.355817 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:50:14.355451    2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6888775986-fl24h" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:50:16.472381 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:50:16.472336    2577 patch_prober.go:28] interesting pod/image-registry-6888775986-fl24h container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 18 16:50:16.472790 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:50:16.472393    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6888775986-fl24h" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:50:24.356006 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:50:24.355967    2577 patch_prober.go:28] interesting pod/image-registry-6888775986-fl24h container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 18 16:50:24.356375 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:50:24.356022    2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6888775986-fl24h" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:50:26.472393 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:50:26.472355    2577 patch_prober.go:28] interesting pod/image-registry-6888775986-fl24h container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 18 16:50:26.472855 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:50:26.472418    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6888775986-fl24h" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:50:34.356806 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:50:34.356770    2577 patch_prober.go:28] interesting pod/image-registry-6888775986-fl24h container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 18 16:50:34.357251 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:50:34.356824    2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6888775986-fl24h" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:50:34.357251 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:50:34.356867    2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:50:34.357351 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:50:34.357261    2577 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"402807b01118db2701ce4f591ce38118bdd40e91c048a630ee93382035d51d20"} pod="openshift-image-registry/image-registry-6888775986-fl24h" containerMessage="Container registry failed liveness probe, will be restarted"
Sep 18 16:50:34.360875 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:50:34.360846    2577 patch_prober.go:28] interesting pod/image-registry-6888775986-fl24h container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 18 16:50:34.361000 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:50:34.360895    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6888775986-fl24h" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:50:40.629602 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:50:40.629569    2577 generic.go:356] "Generic (PLEG): container finished" podID="e5bb8736-917b-4bb1-bf19-f6b88a528de8" containerID="73245b1eaf70b62fa86ee15284539d7e591d6fa7f920ee7c02b8cc677113d269" exitCode=0
Sep 18 16:50:40.630127 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:50:40.629648    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-mk2d9" event={"ID":"e5bb8736-917b-4bb1-bf19-f6b88a528de8","Type":"ContainerDied","Data":"73245b1eaf70b62fa86ee15284539d7e591d6fa7f920ee7c02b8cc677113d269"}
Sep 18 16:50:40.630127 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:50:40.630072    2577 scope.go:117] "RemoveContainer" containerID="73245b1eaf70b62fa86ee15284539d7e591d6fa7f920ee7c02b8cc677113d269"
Sep 18 16:50:41.635065 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:50:41.635032    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-mk2d9" event={"ID":"e5bb8736-917b-4bb1-bf19-f6b88a528de8","Type":"ContainerStarted","Data":"7eac0e1b454c963343d478b7035dd543de1d50c2cc2bb5e79ce278cab98a1e48"}
Sep 18 16:50:42.001060 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:50:42.000984    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6446c8d75d-x9bk4_5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965/networking-console-plugin/0.log"
Sep 18 16:50:42.200330 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:50:42.200303    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-t4p6q_60bae8ea-9599-47f8-b066-df7c46c011b3/console-operator/1.log"
Sep 18 16:50:42.403101 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:50:42.403071    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-t4p6q_60bae8ea-9599-47f8-b066-df7c46c011b3/console-operator/2.log"
Sep 18 16:50:42.607163 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:50:42.607135    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ttxjb_9fc84d1c-d436-4b1a-9557-182688c69eff/dns/0.log"
Sep 18 16:50:42.800750 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:50:42.800673    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ttxjb_9fc84d1c-d436-4b1a-9557-182688c69eff/kube-rbac-proxy/0.log"
Sep 18 16:50:43.000283 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:50:43.000260    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5rc4b_95f739d8-990d-4aa8-a1e3-ed8cefd56bd2/dns-node-resolver/0.log"
Sep 18 16:50:43.600655 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:50:43.600628    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6888775986-fl24h_2200d387-c1d6-477d-ab65-eb96dc6b3259/registry/0.log"
Sep 18 16:50:44.361246 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:50:44.361213    2577 patch_prober.go:28] interesting pod/image-registry-6888775986-fl24h container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 18 16:50:44.361655 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:50:44.361264    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6888775986-fl24h" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:50:44.400659 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:50:44.400633    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v7rt9_cb0bea49-0666-42ee-9d96-221eee1b5aa8/node-ca/0.log"
Sep 18 16:50:54.361052 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:50:54.361019    2577 patch_prober.go:28] interesting pod/image-registry-6888775986-fl24h container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 18 16:50:54.361425 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:50:54.361082    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6888775986-fl24h" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:50:59.375802 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:50:59.375758    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6888775986-fl24h" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry" containerID="cri-o://402807b01118db2701ce4f591ce38118bdd40e91c048a630ee93382035d51d20" gracePeriod=30
Sep 18 16:50:59.405753 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:50:59.405724    2577 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2200d387_c1d6_477d_ab65_eb96dc6b3259.slice/crio-conmon-402807b01118db2701ce4f591ce38118bdd40e91c048a630ee93382035d51d20.scope\": RecentStats: unable to find data in memory cache]"
Sep 18 16:50:59.698069 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:50:59.697988    2577 generic.go:356] "Generic (PLEG): container finished" podID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerID="402807b01118db2701ce4f591ce38118bdd40e91c048a630ee93382035d51d20" exitCode=0
Sep 18 16:50:59.698069 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:50:59.698051    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6888775986-fl24h" event={"ID":"2200d387-c1d6-477d-ab65-eb96dc6b3259","Type":"ContainerDied","Data":"402807b01118db2701ce4f591ce38118bdd40e91c048a630ee93382035d51d20"}
Sep 18 16:50:59.698247 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:50:59.698097    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6888775986-fl24h" event={"ID":"2200d387-c1d6-477d-ab65-eb96dc6b3259","Type":"ContainerStarted","Data":"aca7831e62b12d9507408bd93d52e94d47fdc014259d25bc3e94bf13dd172173"}
Sep 18 16:50:59.698283 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:50:59.698263    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:51:00.703062 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:51:00.702973    2577 generic.go:356] "Generic (PLEG): container finished" podID="941c1b4b-8d2b-4c14-b741-f00e2032d493" containerID="6cf2779677a9e10ab000f60aeee10b2446e336f75474f68c54a1abdbb65cb60b" exitCode=0
Sep 18 16:51:00.703062 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:51:00.703049    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qnb85" event={"ID":"941c1b4b-8d2b-4c14-b741-f00e2032d493","Type":"ContainerDied","Data":"6cf2779677a9e10ab000f60aeee10b2446e336f75474f68c54a1abdbb65cb60b"}
Sep 18 16:51:00.703493 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:51:00.703459    2577 scope.go:117] "RemoveContainer" containerID="6cf2779677a9e10ab000f60aeee10b2446e336f75474f68c54a1abdbb65cb60b"
Sep 18 16:51:00.704814 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:51:00.704696    2577 generic.go:356] "Generic (PLEG): container finished" podID="bf32dd38-8c07-4cb1-bae7-d8f2613669e0" containerID="92f18a518069969a31e6368c1eaba9a535206f1d21ec701406aba33d001b760d" exitCode=0
Sep 18 16:51:00.704814 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:51:00.704776    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87vfw" event={"ID":"bf32dd38-8c07-4cb1-bae7-d8f2613669e0","Type":"ContainerDied","Data":"92f18a518069969a31e6368c1eaba9a535206f1d21ec701406aba33d001b760d"}
Sep 18 16:51:00.705143 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:51:00.705129    2577 scope.go:117] "RemoveContainer" containerID="92f18a518069969a31e6368c1eaba9a535206f1d21ec701406aba33d001b760d"
Sep 18 16:51:01.709981 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:51:01.709942    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qnb85" event={"ID":"941c1b4b-8d2b-4c14-b741-f00e2032d493","Type":"ContainerStarted","Data":"45f4424cb241d656249c1c29a1df93158200c3209289d4cb8cfee4890ce32a15"}
Sep 18 16:51:01.711685 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:51:01.711665    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87vfw" event={"ID":"bf32dd38-8c07-4cb1-bae7-d8f2613669e0","Type":"ContainerStarted","Data":"5fbddc60a484a397095ccca0ccd4ebdc95527772de66e023553d0fd2cc65cb57"}
Sep 18 16:51:14.355878 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:51:14.355837    2577 patch_prober.go:28] interesting pod/image-registry-6888775986-fl24h container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 18 16:51:14.356432 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:51:14.355906    2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6888775986-fl24h" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:51:20.709284 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:51:20.709244    2577 patch_prober.go:28] interesting pod/image-registry-6888775986-fl24h container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 18 16:51:20.709672 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:51:20.709300    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6888775986-fl24h" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:51:24.356136 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:51:24.356097    2577 patch_prober.go:28] interesting pod/image-registry-6888775986-fl24h container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 18 16:51:24.356510 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:51:24.356152    2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6888775986-fl24h" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:51:30.709681 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:51:30.709601    2577 patch_prober.go:28] interesting pod/image-registry-6888775986-fl24h container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 18 16:51:30.709681 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:51:30.709658    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6888775986-fl24h" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:51:34.355192 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:51:34.355158    2577 patch_prober.go:28] interesting pod/image-registry-6888775986-fl24h container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 18 16:51:34.355574 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:51:34.355215    2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6888775986-fl24h" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:51:34.355574 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:51:34.355256    2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:51:34.355798 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:51:34.355762    2577 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"aca7831e62b12d9507408bd93d52e94d47fdc014259d25bc3e94bf13dd172173"} pod="openshift-image-registry/image-registry-6888775986-fl24h" containerMessage="Container registry failed liveness probe, will be restarted"
Sep 18 16:51:34.359392 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:51:34.359369    2577 patch_prober.go:28] interesting pod/image-registry-6888775986-fl24h container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 18 16:51:34.359514 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:51:34.359407    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6888775986-fl24h" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:51:44.359635 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:51:44.359595    2577 patch_prober.go:28] interesting pod/image-registry-6888775986-fl24h container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 18 16:51:44.360021 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:51:44.359656    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6888775986-fl24h" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:51:54.359578 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:51:54.359524    2577 patch_prober.go:28] interesting pod/image-registry-6888775986-fl24h container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 18 16:51:54.360013 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:51:54.359601    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6888775986-fl24h" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:51:59.373798 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:51:59.373752    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6888775986-fl24h" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry" containerID="cri-o://aca7831e62b12d9507408bd93d52e94d47fdc014259d25bc3e94bf13dd172173" gracePeriod=30
Sep 18 16:51:59.919023 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:51:59.918990    2577 generic.go:356] "Generic (PLEG): container finished" podID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerID="aca7831e62b12d9507408bd93d52e94d47fdc014259d25bc3e94bf13dd172173" exitCode=0
Sep 18 16:51:59.919195 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:51:59.919037    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6888775986-fl24h" event={"ID":"2200d387-c1d6-477d-ab65-eb96dc6b3259","Type":"ContainerDied","Data":"aca7831e62b12d9507408bd93d52e94d47fdc014259d25bc3e94bf13dd172173"}
Sep 18 16:51:59.919195 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:51:59.919088    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6888775986-fl24h" event={"ID":"2200d387-c1d6-477d-ab65-eb96dc6b3259","Type":"ContainerStarted","Data":"aaa0bf43c92965d2aa3c90a41b84906b6dd7d3ef0e9a7445ac0620db0dfc9ddf"}
Sep 18 16:51:59.919195 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:51:59.919117    2577 scope.go:117] "RemoveContainer" containerID="402807b01118db2701ce4f591ce38118bdd40e91c048a630ee93382035d51d20"
Sep 18 16:51:59.919340 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:51:59.919246    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:52:14.356122 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:52:14.356086    2577 patch_prober.go:28] interesting pod/image-registry-6888775986-fl24h container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 18 16:52:14.356495 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:52:14.356137    2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6888775986-fl24h" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:52:20.928455 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:52:20.928415    2577 patch_prober.go:28] interesting pod/image-registry-6888775986-fl24h container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 18 16:52:20.928882 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:52:20.928489    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6888775986-fl24h" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:52:24.355685 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:52:24.355650    2577 patch_prober.go:28] interesting pod/image-registry-6888775986-fl24h container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 18 16:52:24.356118 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:52:24.355707    2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6888775986-fl24h" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:52:30.928772 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:52:30.928736    2577 patch_prober.go:28] interesting pod/image-registry-6888775986-fl24h container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 18 16:52:30.929185 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:52:30.928805    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6888775986-fl24h" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:52:34.355974 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:52:34.355941    2577 patch_prober.go:28] interesting pod/image-registry-6888775986-fl24h container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 18 16:52:34.356370 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:52:34.355995    2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6888775986-fl24h" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:52:34.356370 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:52:34.356035    2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:52:34.356624 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:52:34.356601    2577 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"aaa0bf43c92965d2aa3c90a41b84906b6dd7d3ef0e9a7445ac0620db0dfc9ddf"} pod="openshift-image-registry/image-registry-6888775986-fl24h" containerMessage="Container registry failed liveness probe, will be restarted"
Sep 18 16:52:34.360027 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:52:34.360000    2577 patch_prober.go:28] interesting pod/image-registry-6888775986-fl24h container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 18 16:52:34.360123 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:52:34.360051    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6888775986-fl24h" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:52:44.360968 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:52:44.360930    2577 patch_prober.go:28] interesting pod/image-registry-6888775986-fl24h container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 18 16:52:44.361334 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:52:44.360992    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6888775986-fl24h" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:52:54.360820 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:52:54.360783    2577 patch_prober.go:28] interesting pod/image-registry-6888775986-fl24h container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 18 16:52:54.361233 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:52:54.360844    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6888775986-fl24h" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:52:59.374856 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:52:59.374811    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6888775986-fl24h" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry" containerID="cri-o://aaa0bf43c92965d2aa3c90a41b84906b6dd7d3ef0e9a7445ac0620db0dfc9ddf" gracePeriod=30
Sep 18 16:53:00.133018 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:00.132986    2577 generic.go:356] "Generic (PLEG): container finished" podID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerID="aaa0bf43c92965d2aa3c90a41b84906b6dd7d3ef0e9a7445ac0620db0dfc9ddf" exitCode=0
Sep 18 16:53:00.133192 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:00.133059    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6888775986-fl24h" event={"ID":"2200d387-c1d6-477d-ab65-eb96dc6b3259","Type":"ContainerDied","Data":"aaa0bf43c92965d2aa3c90a41b84906b6dd7d3ef0e9a7445ac0620db0dfc9ddf"}
Sep 18 16:53:00.133192 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:00.133110    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6888775986-fl24h" event={"ID":"2200d387-c1d6-477d-ab65-eb96dc6b3259","Type":"ContainerStarted","Data":"91911ff0e1e71cad414b942d7cad83fa7fb1c833cd1a42629c77be5446c9775a"}
Sep 18 16:53:00.133192 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:00.133133    2577 scope.go:117] "RemoveContainer" containerID="aca7831e62b12d9507408bd93d52e94d47fdc014259d25bc3e94bf13dd172173"
Sep 18 16:53:00.133319 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:00.133243    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:53:14.355601 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:14.355567    2577 patch_prober.go:28] interesting pod/image-registry-6888775986-fl24h container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 18 16:53:14.355963 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:14.355618    2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6888775986-fl24h" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:53:21.147425 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:21.147391    2577 patch_prober.go:28] interesting pod/image-registry-6888775986-fl24h container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 18 16:53:21.147901 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:21.147454    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6888775986-fl24h" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:53:24.355348 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:24.355310    2577 patch_prober.go:28] interesting pod/image-registry-6888775986-fl24h container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 18 16:53:24.355756 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:24.355380    2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6888775986-fl24h" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:53:31.147961 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:31.147917    2577 patch_prober.go:28] interesting pod/image-registry-6888775986-fl24h container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 18 16:53:31.148398 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:31.147972    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6888775986-fl24h" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:53:34.355872 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:34.355833    2577 patch_prober.go:28] interesting pod/image-registry-6888775986-fl24h container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 18 16:53:34.356241 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:34.355894    2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6888775986-fl24h" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:53:34.356241 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:34.355932    2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:53:34.356443 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:34.356419    2577 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"91911ff0e1e71cad414b942d7cad83fa7fb1c833cd1a42629c77be5446c9775a"} pod="openshift-image-registry/image-registry-6888775986-fl24h" containerMessage="Container registry failed liveness probe, will be restarted"
Sep 18 16:53:34.359948 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:34.359918    2577 patch_prober.go:28] interesting pod/image-registry-6888775986-fl24h container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 18 16:53:34.360041 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:34.359979    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6888775986-fl24h" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:53:42.973503 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:42.973469    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4w84l"]
Sep 18 16:53:42.976704 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:42.976685    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4w84l"
Sep 18 16:53:42.980276 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:42.980253    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 18 16:53:42.980405 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:42.980348    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 18 16:53:42.981123 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:42.981104    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 18 16:53:42.981251 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:42.981133    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-w6l9x\""
Sep 18 16:53:42.981251 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:42.981142    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 18 16:53:42.991381 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:42.991355    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4w84l"]
Sep 18 16:53:43.057760 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:43.057726    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4bc850b-a864-4436-a183-799c111bb01f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-4w84l\" (UID: \"f4bc850b-a864-4436-a183-799c111bb01f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4w84l"
Sep 18 16:53:43.057960 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:43.057777    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hqnp\" (UniqueName: \"kubernetes.io/projected/f4bc850b-a864-4436-a183-799c111bb01f-kube-api-access-9hqnp\") pod \"cluster-monitoring-operator-847b8bd8d7-4w84l\" (UID: \"f4bc850b-a864-4436-a183-799c111bb01f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4w84l"
Sep 18 16:53:43.057960 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:43.057876    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f4bc850b-a864-4436-a183-799c111bb01f-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-4w84l\" (UID: \"f4bc850b-a864-4436-a183-799c111bb01f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4w84l"
Sep 18 16:53:43.135832 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:43.135798    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6594f4c75-dq25h"]
Sep 18 16:53:43.138803 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:43.138786    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-dq25h"
Sep 18 16:53:43.140820 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:43.140799    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 18 16:53:43.140953 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:43.140833    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 18 16:53:43.140953 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:43.140844    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-k5q9t\""
Sep 18 16:53:43.151486 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:43.151465    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-dq25h"]
Sep 18 16:53:43.158382 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:43.158359    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hqnp\" (UniqueName: \"kubernetes.io/projected/f4bc850b-a864-4436-a183-799c111bb01f-kube-api-access-9hqnp\") pod \"cluster-monitoring-operator-847b8bd8d7-4w84l\" (UID: \"f4bc850b-a864-4436-a183-799c111bb01f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4w84l"
Sep 18 16:53:43.158515 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:43.158401    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f4bc850b-a864-4436-a183-799c111bb01f-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-4w84l\" (UID: \"f4bc850b-a864-4436-a183-799c111bb01f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4w84l"
Sep 18 16:53:43.158515 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:43.158426    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4bc850b-a864-4436-a183-799c111bb01f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-4w84l\" (UID: \"f4bc850b-a864-4436-a183-799c111bb01f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4w84l"
Sep 18 16:53:43.159014 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:43.158996    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f4bc850b-a864-4436-a183-799c111bb01f-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-4w84l\" (UID: \"f4bc850b-a864-4436-a183-799c111bb01f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4w84l"
Sep 18 16:53:43.160786 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:43.160770    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4bc850b-a864-4436-a183-799c111bb01f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-4w84l\" (UID: \"f4bc850b-a864-4436-a183-799c111bb01f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4w84l"
Sep 18 16:53:43.174901 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:43.174874    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hqnp\" (UniqueName: \"kubernetes.io/projected/f4bc850b-a864-4436-a183-799c111bb01f-kube-api-access-9hqnp\") pod \"cluster-monitoring-operator-847b8bd8d7-4w84l\" (UID: \"f4bc850b-a864-4436-a183-799c111bb01f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4w84l"
Sep 18 16:53:43.259194 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:43.259106    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2t2v\" (UniqueName: \"kubernetes.io/projected/4f028e9f-c895-4f71-870a-0d2ff7102024-kube-api-access-k2t2v\") pod \"downloads-6594f4c75-dq25h\" (UID: \"4f028e9f-c895-4f71-870a-0d2ff7102024\") " pod="openshift-console/downloads-6594f4c75-dq25h"
Sep 18 16:53:43.286243 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:43.286206    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4w84l"
Sep 18 16:53:43.360216 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:43.360177    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2t2v\" (UniqueName: \"kubernetes.io/projected/4f028e9f-c895-4f71-870a-0d2ff7102024-kube-api-access-k2t2v\") pod \"downloads-6594f4c75-dq25h\" (UID: \"4f028e9f-c895-4f71-870a-0d2ff7102024\") " pod="openshift-console/downloads-6594f4c75-dq25h"
Sep 18 16:53:43.377575 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:43.377522    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2t2v\" (UniqueName: \"kubernetes.io/projected/4f028e9f-c895-4f71-870a-0d2ff7102024-kube-api-access-k2t2v\") pod \"downloads-6594f4c75-dq25h\" (UID: \"4f028e9f-c895-4f71-870a-0d2ff7102024\") " pod="openshift-console/downloads-6594f4c75-dq25h"
Sep 18 16:53:43.448339 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:43.448289    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-dq25h"
Sep 18 16:53:43.571922 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:43.571845    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4w84l"]
Sep 18 16:53:43.574948 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:53:43.574918    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4bc850b_a864_4436_a183_799c111bb01f.slice/crio-dd1a00d6e149096433923a602fd72352a1aa2576ac79847caac196ad7b9819d6 WatchSource:0}: Error finding container dd1a00d6e149096433923a602fd72352a1aa2576ac79847caac196ad7b9819d6: Status 404 returned error can't find the container with id dd1a00d6e149096433923a602fd72352a1aa2576ac79847caac196ad7b9819d6
Sep 18 16:53:43.735204 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:43.735169    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-dq25h"]
Sep 18 16:53:43.739197 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:53:43.739167    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f028e9f_c895_4f71_870a_0d2ff7102024.slice/crio-f11b954362233ce639847ae0e57abe7171097c3e8ebc7035e896a08bad4b12e5 WatchSource:0}: Error finding container f11b954362233ce639847ae0e57abe7171097c3e8ebc7035e896a08bad4b12e5: Status 404 returned error can't find the container with id f11b954362233ce639847ae0e57abe7171097c3e8ebc7035e896a08bad4b12e5
Sep 18 16:53:44.297978 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:44.297940    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-dq25h" event={"ID":"4f028e9f-c895-4f71-870a-0d2ff7102024","Type":"ContainerStarted","Data":"f11b954362233ce639847ae0e57abe7171097c3e8ebc7035e896a08bad4b12e5"}
Sep 18 16:53:44.299246 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:44.299208    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4w84l" event={"ID":"f4bc850b-a864-4436-a183-799c111bb01f","Type":"ContainerStarted","Data":"dd1a00d6e149096433923a602fd72352a1aa2576ac79847caac196ad7b9819d6"}
Sep 18 16:53:44.362140 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:44.362092    2577 patch_prober.go:28] interesting pod/image-registry-6888775986-fl24h container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 18 16:53:44.362330 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:44.362173    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6888775986-fl24h" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:53:46.203977 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:46.203943    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9pqbj"]
Sep 18 16:53:46.207511 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:46.207488    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9pqbj"
Sep 18 16:53:46.209817 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:46.209724    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 18 16:53:46.209817 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:46.209737    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-kj8p5\""
Sep 18 16:53:46.218775 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:46.218064    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9pqbj"]
Sep 18 16:53:46.309444 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:46.309401    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4w84l" event={"ID":"f4bc850b-a864-4436-a183-799c111bb01f","Type":"ContainerStarted","Data":"100e1d3bc0ae0dd789f3fcaed367887e8d639e7431ec54917e55783dc5de6869"}
Sep 18 16:53:46.328421 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:46.328356    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4w84l" podStartSLOduration=2.278366654 podStartE2EDuration="4.328336215s" totalImagesPullingTime="2.049969561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:53:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:53:46.327974676 +0000 UTC m=+299.385264206" watchObservedRunningTime="2026-09-18 16:53:46.328336215 +0000 UTC m=+299.385625744"
Sep 18 16:53:46.386293 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:46.386250    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8d069742-d2b5-475e-8240-eddb4ae53bbe-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-9pqbj\" (UID: \"8d069742-d2b5-475e-8240-eddb4ae53bbe\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9pqbj"
Sep 18 16:53:46.487441 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:46.487342    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8d069742-d2b5-475e-8240-eddb4ae53bbe-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-9pqbj\" (UID: \"8d069742-d2b5-475e-8240-eddb4ae53bbe\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9pqbj"
Sep 18 16:53:46.490345 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:46.490320    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8d069742-d2b5-475e-8240-eddb4ae53bbe-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-9pqbj\" (UID: \"8d069742-d2b5-475e-8240-eddb4ae53bbe\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9pqbj"
Sep 18 16:53:46.522013 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:46.521969    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9pqbj"
Sep 18 16:53:46.802796 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:46.802768    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9pqbj"]
Sep 18 16:53:46.805966 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:53:46.805935    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d069742_d2b5_475e_8240_eddb4ae53bbe.slice/crio-7bb8e6f4bc6260c6beaf2987234e119cb3aacb787d1017905c1a40f36b050753 WatchSource:0}: Error finding container 7bb8e6f4bc6260c6beaf2987234e119cb3aacb787d1017905c1a40f36b050753: Status 404 returned error can't find the container with id 7bb8e6f4bc6260c6beaf2987234e119cb3aacb787d1017905c1a40f36b050753
Sep 18 16:53:47.315303 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:47.315264    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9pqbj" event={"ID":"8d069742-d2b5-475e-8240-eddb4ae53bbe","Type":"ContainerStarted","Data":"7bb8e6f4bc6260c6beaf2987234e119cb3aacb787d1017905c1a40f36b050753"}
Sep 18 16:53:48.321037 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:48.320996    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9pqbj" event={"ID":"8d069742-d2b5-475e-8240-eddb4ae53bbe","Type":"ContainerStarted","Data":"212db84ceec9f1b09867029331dc84ebb4358375070aac391712934e8f23028b"}
Sep 18 16:53:48.321490 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:48.321219    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9pqbj"
Sep 18 16:53:48.326652 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:48.326624    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9pqbj"
Sep 18 16:53:48.337805 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:48.337746    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9pqbj" podStartSLOduration=1.315817513 podStartE2EDuration="2.337728961s" totalImagesPullingTime="1.021911448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:53:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:53:48.336176108 +0000 UTC m=+301.393465630" watchObservedRunningTime="2026-09-18 16:53:48.337728961 +0000 UTC m=+301.395018489"
Sep 18 16:53:48.996485 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:48.996451    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-t4p6q_60bae8ea-9599-47f8-b066-df7c46c011b3/console-operator/1.log"
Sep 18 16:53:48.998905 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:48.998883    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-t4p6q_60bae8ea-9599-47f8-b066-df7c46c011b3/console-operator/1.log"
Sep 18 16:53:49.003520 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:49.003495    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktklw_3c1064f0-18a0-4c28-8fb9-a320535dcbbf/ovn-acl-logging/0.log"
Sep 18 16:53:49.006438 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:49.006421    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktklw_3c1064f0-18a0-4c28-8fb9-a320535dcbbf/ovn-acl-logging/0.log"
Sep 18 16:53:49.011113 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:49.011095    2577 kubelet.go:1648] "Image garbage collection succeeded"
Sep 18 16:53:49.317893 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:49.317813    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-59n4l"]
Sep 18 16:53:49.321329 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:49.321307    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-59n4l"
Sep 18 16:53:49.323711 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:49.323686    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 18 16:53:49.324192 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:49.324159    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vvdd4\""
Sep 18 16:53:49.324441 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:49.324425    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 18 16:53:49.324577 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:49.324557    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 18 16:53:49.330742 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:49.330305    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-59n4l"]
Sep 18 16:53:49.411615 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:49.411583    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dabee8c-f83f-45cc-8e91-042849088339-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-59n4l\" (UID: \"7dabee8c-f83f-45cc-8e91-042849088339\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-59n4l"
Sep 18 16:53:49.411805 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:49.411623    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7dabee8c-f83f-45cc-8e91-042849088339-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-59n4l\" (UID: \"7dabee8c-f83f-45cc-8e91-042849088339\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-59n4l"
Sep 18 16:53:49.411805 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:49.411708    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7dabee8c-f83f-45cc-8e91-042849088339-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-59n4l\" (UID: \"7dabee8c-f83f-45cc-8e91-042849088339\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-59n4l"
Sep 18 16:53:49.411805 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:49.411794    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrzgk\" (UniqueName: \"kubernetes.io/projected/7dabee8c-f83f-45cc-8e91-042849088339-kube-api-access-zrzgk\") pod \"prometheus-operator-7bd5d56d6-59n4l\" (UID: \"7dabee8c-f83f-45cc-8e91-042849088339\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-59n4l"
Sep 18 16:53:49.512456 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:49.512422    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrzgk\" (UniqueName: \"kubernetes.io/projected/7dabee8c-f83f-45cc-8e91-042849088339-kube-api-access-zrzgk\") pod \"prometheus-operator-7bd5d56d6-59n4l\" (UID: \"7dabee8c-f83f-45cc-8e91-042849088339\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-59n4l"
Sep 18 16:53:49.512675 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:49.512480    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dabee8c-f83f-45cc-8e91-042849088339-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-59n4l\" (UID: \"7dabee8c-f83f-45cc-8e91-042849088339\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-59n4l"
Sep 18 16:53:49.512675 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:49.512506    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7dabee8c-f83f-45cc-8e91-042849088339-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-59n4l\" (UID: \"7dabee8c-f83f-45cc-8e91-042849088339\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-59n4l"
Sep 18 16:53:49.512675 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:49.512580    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7dabee8c-f83f-45cc-8e91-042849088339-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-59n4l\" (UID: \"7dabee8c-f83f-45cc-8e91-042849088339\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-59n4l"
Sep 18 16:53:49.513351 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:49.513324    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dabee8c-f83f-45cc-8e91-042849088339-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-59n4l\" (UID: \"7dabee8c-f83f-45cc-8e91-042849088339\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-59n4l"
Sep 18 16:53:49.515457 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:49.515431    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7dabee8c-f83f-45cc-8e91-042849088339-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-59n4l\" (UID: \"7dabee8c-f83f-45cc-8e91-042849088339\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-59n4l"
Sep 18 16:53:49.515584 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:49.515499    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7dabee8c-f83f-45cc-8e91-042849088339-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-59n4l\" (UID: \"7dabee8c-f83f-45cc-8e91-042849088339\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-59n4l"
Sep 18 16:53:49.521553 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:49.521520    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrzgk\" (UniqueName: \"kubernetes.io/projected/7dabee8c-f83f-45cc-8e91-042849088339-kube-api-access-zrzgk\") pod \"prometheus-operator-7bd5d56d6-59n4l\" (UID: \"7dabee8c-f83f-45cc-8e91-042849088339\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-59n4l"
Sep 18 16:53:49.633997 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:49.633963    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-59n4l"
Sep 18 16:53:49.913326 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:49.913224    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-59n4l"]
Sep 18 16:53:49.916428 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:53:49.916396    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dabee8c_f83f_45cc_8e91_042849088339.slice/crio-ab6c092986080193209ecae302bdb4919862150055c6b243b348c51d4949a8a2 WatchSource:0}: Error finding container ab6c092986080193209ecae302bdb4919862150055c6b243b348c51d4949a8a2: Status 404 returned error can't find the container with id ab6c092986080193209ecae302bdb4919862150055c6b243b348c51d4949a8a2
Sep 18 16:53:50.331339 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:50.331255    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-59n4l" event={"ID":"7dabee8c-f83f-45cc-8e91-042849088339","Type":"ContainerStarted","Data":"ab6c092986080193209ecae302bdb4919862150055c6b243b348c51d4949a8a2"}
Sep 18 16:53:51.337996 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:51.337952    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-59n4l" event={"ID":"7dabee8c-f83f-45cc-8e91-042849088339","Type":"ContainerStarted","Data":"4abb1e0c15f6f0937e3537c547460689b6eb84e01dc5c0bd1bce0d65b48d5ae1"}
Sep 18 16:53:51.338453 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:51.338018    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-59n4l" event={"ID":"7dabee8c-f83f-45cc-8e91-042849088339","Type":"ContainerStarted","Data":"614e36301cdba872cfa9d5b25a17de828cf4c858f316c550431902faaa4a84c4"}
Sep 18 16:53:51.357718 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:51.357661    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-59n4l" podStartSLOduration=1.140895801 podStartE2EDuration="2.357643014s" totalImagesPullingTime="1.216747213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:53:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:53:51.355788157 +0000 UTC m=+304.413077687" watchObservedRunningTime="2026-09-18 16:53:51.357643014 +0000 UTC m=+304.414932542"
Sep 18 16:53:53.892253 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:53.892219    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-sk6jr"]
Sep 18 16:53:53.897451 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:53.897427    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6tl5z"]
Sep 18 16:53:53.897608 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:53.897570    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-sk6jr"
Sep 18 16:53:53.900077 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:53.900047    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 18 16:53:53.900287 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:53.900267    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-7jf2t\""
Sep 18 16:53:53.900825 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:53.900523    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 18 16:53:53.901141 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:53.901119    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6tl5z"
Sep 18 16:53:53.903319 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:53.903300    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 18 16:53:53.903319 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:53.903312    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 18 16:53:53.903814 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:53.903791    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 18 16:53:53.904243 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:53.904075    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kslbc\""
Sep 18 16:53:53.912106 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:53.912083    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-sk6jr"]
Sep 18 16:53:53.930086 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:53.930061    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-86pwd"]
Sep 18 16:53:53.938281 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:53.938253    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-86pwd"
Sep 18 16:53:53.941732 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:53.941705    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 18 16:53:53.942007 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:53.941990    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-gznsw\""
Sep 18 16:53:53.942215 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:53.942197    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 18 16:53:53.942464 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:53.942442    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 18 16:53:53.949802 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:53.949776    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-86pwd"]
Sep 18 16:53:54.053119 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.053074    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tprnx\" (UniqueName: \"kubernetes.io/projected/0cb31f04-f48e-4dda-9147-915c238fc857-kube-api-access-tprnx\") pod \"kube-state-metrics-84c885658c-86pwd\" (UID: \"0cb31f04-f48e-4dda-9147-915c238fc857\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-86pwd"
Sep 18 16:53:54.053305 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.053167    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0cb31f04-f48e-4dda-9147-915c238fc857-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-86pwd\" (UID: \"0cb31f04-f48e-4dda-9147-915c238fc857\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-86pwd"
Sep 18 16:53:54.053305 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.053208    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxjds\" (UniqueName: \"kubernetes.io/projected/67895b79-4bdd-45ed-82e9-e9921052c81e-kube-api-access-xxjds\") pod \"openshift-state-metrics-86c5bc79d6-sk6jr\" (UID: \"67895b79-4bdd-45ed-82e9-e9921052c81e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-sk6jr"
Sep 18 16:53:54.053305 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.053225    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/57cef12e-d07e-4c77-9de9-895b066092e1-node-exporter-tls\") pod \"node-exporter-6tl5z\" (UID: \"57cef12e-d07e-4c77-9de9-895b066092e1\") " pod="openshift-monitoring/node-exporter-6tl5z"
Sep 18 16:53:54.053305 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.053243    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/57cef12e-d07e-4c77-9de9-895b066092e1-node-exporter-accelerators-collector-config\") pod \"node-exporter-6tl5z\" (UID: \"57cef12e-d07e-4c77-9de9-895b066092e1\") " pod="openshift-monitoring/node-exporter-6tl5z"
Sep 18 16:53:54.053305 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.053272    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/57cef12e-d07e-4c77-9de9-895b066092e1-root\") pod \"node-exporter-6tl5z\" (UID: \"57cef12e-d07e-4c77-9de9-895b066092e1\") " pod="openshift-monitoring/node-exporter-6tl5z"
Sep 18 16:53:54.053584 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.053318    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/57cef12e-d07e-4c77-9de9-895b066092e1-node-exporter-textfile\") pod \"node-exporter-6tl5z\" (UID: \"57cef12e-d07e-4c77-9de9-895b066092e1\") " pod="openshift-monitoring/node-exporter-6tl5z"
Sep 18 16:53:54.053584 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.053341    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cb31f04-f48e-4dda-9147-915c238fc857-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-86pwd\" (UID: \"0cb31f04-f48e-4dda-9147-915c238fc857\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-86pwd"
Sep 18 16:53:54.053584 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.053360    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57cef12e-d07e-4c77-9de9-895b066092e1-sys\") pod \"node-exporter-6tl5z\" (UID: \"57cef12e-d07e-4c77-9de9-895b066092e1\") " pod="openshift-monitoring/node-exporter-6tl5z"
Sep 18 16:53:54.053584 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.053385    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cb31f04-f48e-4dda-9147-915c238fc857-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-86pwd\" (UID: \"0cb31f04-f48e-4dda-9147-915c238fc857\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-86pwd"
Sep 18 16:53:54.053584 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.053425    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0cb31f04-f48e-4dda-9147-915c238fc857-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-86pwd\" (UID: \"0cb31f04-f48e-4dda-9147-915c238fc857\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-86pwd"
Sep 18 16:53:54.053584 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.053475    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67895b79-4bdd-45ed-82e9-e9921052c81e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-sk6jr\" (UID: \"67895b79-4bdd-45ed-82e9-e9921052c81e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-sk6jr"
Sep 18 16:53:54.053584 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.053504    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67895b79-4bdd-45ed-82e9-e9921052c81e-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-sk6jr\" (UID: \"67895b79-4bdd-45ed-82e9-e9921052c81e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-sk6jr"
Sep 18 16:53:54.053584 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.053549    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0cb31f04-f48e-4dda-9147-915c238fc857-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-86pwd\" (UID: \"0cb31f04-f48e-4dda-9147-915c238fc857\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-86pwd"
Sep 18 16:53:54.053584 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.053585    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57cef12e-d07e-4c77-9de9-895b066092e1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6tl5z\" (UID: \"57cef12e-d07e-4c77-9de9-895b066092e1\") " pod="openshift-monitoring/node-exporter-6tl5z"
Sep 18 16:53:54.054014 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.053608    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57cef12e-d07e-4c77-9de9-895b066092e1-metrics-client-ca\") pod \"node-exporter-6tl5z\" (UID: \"57cef12e-d07e-4c77-9de9-895b066092e1\") " pod="openshift-monitoring/node-exporter-6tl5z"
Sep 18 16:53:54.054014 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.053637    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/67895b79-4bdd-45ed-82e9-e9921052c81e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-sk6jr\" (UID: \"67895b79-4bdd-45ed-82e9-e9921052c81e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-sk6jr"
Sep 18 16:53:54.054014 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.053666    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/57cef12e-d07e-4c77-9de9-895b066092e1-node-exporter-wtmp\") pod \"node-exporter-6tl5z\" (UID: \"57cef12e-d07e-4c77-9de9-895b066092e1\") " pod="openshift-monitoring/node-exporter-6tl5z"
Sep 18 16:53:54.054014 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.053692    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txglz\" (UniqueName: \"kubernetes.io/projected/57cef12e-d07e-4c77-9de9-895b066092e1-kube-api-access-txglz\") pod \"node-exporter-6tl5z\" (UID: \"57cef12e-d07e-4c77-9de9-895b066092e1\") " pod="openshift-monitoring/node-exporter-6tl5z"
Sep 18 16:53:54.154771 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.154678    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67895b79-4bdd-45ed-82e9-e9921052c81e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-sk6jr\" (UID: \"67895b79-4bdd-45ed-82e9-e9921052c81e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-sk6jr"
Sep 18 16:53:54.154771 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.154732    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67895b79-4bdd-45ed-82e9-e9921052c81e-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-sk6jr\" (UID: \"67895b79-4bdd-45ed-82e9-e9921052c81e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-sk6jr"
Sep 18 16:53:54.154771 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.154760    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0cb31f04-f48e-4dda-9147-915c238fc857-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-86pwd\" (UID: \"0cb31f04-f48e-4dda-9147-915c238fc857\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-86pwd"
Sep 18 16:53:54.155577 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.155280    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57cef12e-d07e-4c77-9de9-895b066092e1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6tl5z\" (UID: \"57cef12e-d07e-4c77-9de9-895b066092e1\") " pod="openshift-monitoring/node-exporter-6tl5z"
Sep 18 16:53:54.155577 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.155324    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57cef12e-d07e-4c77-9de9-895b066092e1-metrics-client-ca\") pod \"node-exporter-6tl5z\" (UID: \"57cef12e-d07e-4c77-9de9-895b066092e1\") " pod="openshift-monitoring/node-exporter-6tl5z"
Sep 18 16:53:54.160210 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.155936    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57cef12e-d07e-4c77-9de9-895b066092e1-metrics-client-ca\") pod \"node-exporter-6tl5z\" (UID: \"57cef12e-d07e-4c77-9de9-895b066092e1\") " pod="openshift-monitoring/node-exporter-6tl5z"
Sep 18 16:53:54.160210 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.155990    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/67895b79-4bdd-45ed-82e9-e9921052c81e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-sk6jr\" (UID: \"67895b79-4bdd-45ed-82e9-e9921052c81e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-sk6jr"
Sep 18 16:53:54.160210 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.156025    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/57cef12e-d07e-4c77-9de9-895b066092e1-node-exporter-wtmp\") pod \"node-exporter-6tl5z\" (UID: \"57cef12e-d07e-4c77-9de9-895b066092e1\") " pod="openshift-monitoring/node-exporter-6tl5z"
Sep 18 16:53:54.160210 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.156051    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txglz\" (UniqueName: \"kubernetes.io/projected/57cef12e-d07e-4c77-9de9-895b066092e1-kube-api-access-txglz\") pod \"node-exporter-6tl5z\" (UID: \"57cef12e-d07e-4c77-9de9-895b066092e1\") " pod="openshift-monitoring/node-exporter-6tl5z"
Sep 18 16:53:54.160210 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.156057    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67895b79-4bdd-45ed-82e9-e9921052c81e-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-sk6jr\" (UID: \"67895b79-4bdd-45ed-82e9-e9921052c81e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-sk6jr"
Sep 18 16:53:54.160210 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.156086    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tprnx\" (UniqueName: \"kubernetes.io/projected/0cb31f04-f48e-4dda-9147-915c238fc857-kube-api-access-tprnx\") pod \"kube-state-metrics-84c885658c-86pwd\" (UID: \"0cb31f04-f48e-4dda-9147-915c238fc857\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-86pwd"
Sep 18 16:53:54.160210 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.156121    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0cb31f04-f48e-4dda-9147-915c238fc857-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-86pwd\" (UID: \"0cb31f04-f48e-4dda-9147-915c238fc857\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-86pwd"
Sep 18 16:53:54.160210 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.156164    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxjds\" (UniqueName: \"kubernetes.io/projected/67895b79-4bdd-45ed-82e9-e9921052c81e-kube-api-access-xxjds\") pod \"openshift-state-metrics-86c5bc79d6-sk6jr\" (UID: \"67895b79-4bdd-45ed-82e9-e9921052c81e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-sk6jr"
Sep 18 16:53:54.160210 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.156186    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/57cef12e-d07e-4c77-9de9-895b066092e1-node-exporter-tls\") pod \"node-exporter-6tl5z\" (UID: \"57cef12e-d07e-4c77-9de9-895b066092e1\") " pod="openshift-monitoring/node-exporter-6tl5z"
Sep 18 16:53:54.160210 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.156210    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/57cef12e-d07e-4c77-9de9-895b066092e1-node-exporter-wtmp\") pod \"node-exporter-6tl5z\" (UID: \"57cef12e-d07e-4c77-9de9-895b066092e1\") " pod="openshift-monitoring/node-exporter-6tl5z"
Sep 18 16:53:54.160210 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.156211    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/57cef12e-d07e-4c77-9de9-895b066092e1-node-exporter-accelerators-collector-config\") pod \"node-exporter-6tl5z\" (UID: \"57cef12e-d07e-4c77-9de9-895b066092e1\") " pod="openshift-monitoring/node-exporter-6tl5z"
Sep 18 16:53:54.160210 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.156264    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/57cef12e-d07e-4c77-9de9-895b066092e1-root\") pod \"node-exporter-6tl5z\" (UID: \"57cef12e-d07e-4c77-9de9-895b066092e1\") " pod="openshift-monitoring/node-exporter-6tl5z"
Sep 18 16:53:54.160210 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.156299    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/57cef12e-d07e-4c77-9de9-895b066092e1-node-exporter-textfile\") pod \"node-exporter-6tl5z\" (UID: \"57cef12e-d07e-4c77-9de9-895b066092e1\") " pod="openshift-monitoring/node-exporter-6tl5z"
Sep 18 16:53:54.160210 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.156338    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cb31f04-f48e-4dda-9147-915c238fc857-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-86pwd\" (UID: \"0cb31f04-f48e-4dda-9147-915c238fc857\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-86pwd"
Sep 18 16:53:54.160210 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.156374    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57cef12e-d07e-4c77-9de9-895b066092e1-sys\") pod \"node-exporter-6tl5z\" (UID: \"57cef12e-d07e-4c77-9de9-895b066092e1\") " pod="openshift-monitoring/node-exporter-6tl5z"
Sep 18 16:53:54.160210 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.156401    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cb31f04-f48e-4dda-9147-915c238fc857-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-86pwd\" (UID: \"0cb31f04-f48e-4dda-9147-915c238fc857\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-86pwd"
Sep 18 16:53:54.161092 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.156431    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0cb31f04-f48e-4dda-9147-915c238fc857-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-86pwd\" (UID: \"0cb31f04-f48e-4dda-9147-915c238fc857\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-86pwd"
Sep 18 16:53:54.161092 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.156625    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/57cef12e-d07e-4c77-9de9-895b066092e1-node-exporter-accelerators-collector-config\") pod \"node-exporter-6tl5z\" (UID: \"57cef12e-d07e-4c77-9de9-895b066092e1\") " pod="openshift-monitoring/node-exporter-6tl5z"
Sep 18 16:53:54.161092 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.156813    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0cb31f04-f48e-4dda-9147-915c238fc857-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-86pwd\" (UID: \"0cb31f04-f48e-4dda-9147-915c238fc857\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-86pwd"
Sep 18 16:53:54.161092 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:53:54.156903    2577 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 18 16:53:54.161092 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:53:54.156988    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67895b79-4bdd-45ed-82e9-e9921052c81e-openshift-state-metrics-tls podName:67895b79-4bdd-45ed-82e9-e9921052c81e nodeName:}" failed. No retries permitted until 2026-09-18 16:53:54.65696808 +0000 UTC m=+307.714257606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/67895b79-4bdd-45ed-82e9-e9921052c81e-openshift-state-metrics-tls") pod "openshift-state-metrics-86c5bc79d6-sk6jr" (UID: "67895b79-4bdd-45ed-82e9-e9921052c81e") : secret "openshift-state-metrics-tls" not found
Sep 18 16:53:54.161092 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.157133    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/57cef12e-d07e-4c77-9de9-895b066092e1-root\") pod \"node-exporter-6tl5z\" (UID: \"57cef12e-d07e-4c77-9de9-895b066092e1\") " pod="openshift-monitoring/node-exporter-6tl5z"
Sep 18 16:53:54.161092 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.157414    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/57cef12e-d07e-4c77-9de9-895b066092e1-node-exporter-textfile\") pod \"node-exporter-6tl5z\" (UID: \"57cef12e-d07e-4c77-9de9-895b066092e1\") " pod="openshift-monitoring/node-exporter-6tl5z"
Sep 18 16:53:54.161092 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:53:54.157492    2577 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 18 16:53:54.161092 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:53:54.157558    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cb31f04-f48e-4dda-9147-915c238fc857-kube-state-metrics-tls podName:0cb31f04-f48e-4dda-9147-915c238fc857 nodeName:}" failed. No retries permitted until 2026-09-18 16:53:54.657520824 +0000 UTC m=+307.714810329 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/0cb31f04-f48e-4dda-9147-915c238fc857-kube-state-metrics-tls") pod "kube-state-metrics-84c885658c-86pwd" (UID: "0cb31f04-f48e-4dda-9147-915c238fc857") : secret "kube-state-metrics-tls" not found
Sep 18 16:53:54.161092 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.157609    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57cef12e-d07e-4c77-9de9-895b066092e1-sys\") pod \"node-exporter-6tl5z\" (UID: \"57cef12e-d07e-4c77-9de9-895b066092e1\") " pod="openshift-monitoring/node-exporter-6tl5z"
Sep 18 16:53:54.161092 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:53:54.157726    2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 18 16:53:54.161092 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:53:54.157781    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57cef12e-d07e-4c77-9de9-895b066092e1-node-exporter-tls podName:57cef12e-d07e-4c77-9de9-895b066092e1 nodeName:}" failed. No retries permitted until 2026-09-18 16:53:54.657767506 +0000 UTC m=+307.715057017 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/57cef12e-d07e-4c77-9de9-895b066092e1-node-exporter-tls") pod "node-exporter-6tl5z" (UID: "57cef12e-d07e-4c77-9de9-895b066092e1") : secret "node-exporter-tls" not found
Sep 18 16:53:54.161092 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.158795    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57cef12e-d07e-4c77-9de9-895b066092e1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6tl5z\" (UID: \"57cef12e-d07e-4c77-9de9-895b066092e1\") " pod="openshift-monitoring/node-exporter-6tl5z"
Sep 18 16:53:54.161092 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.158976    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67895b79-4bdd-45ed-82e9-e9921052c81e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-sk6jr\" (UID: \"67895b79-4bdd-45ed-82e9-e9921052c81e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-sk6jr"
Sep 18 16:53:54.161092 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.160732    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0cb31f04-f48e-4dda-9147-915c238fc857-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-86pwd\" (UID: \"0cb31f04-f48e-4dda-9147-915c238fc857\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-86pwd"
Sep 18 16:53:54.162433 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.162394    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0cb31f04-f48e-4dda-9147-915c238fc857-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-86pwd\" (UID: \"0cb31f04-f48e-4dda-9147-915c238fc857\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-86pwd"
Sep 18 16:53:54.162517 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.162475    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cb31f04-f48e-4dda-9147-915c238fc857-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-86pwd\" (UID: \"0cb31f04-f48e-4dda-9147-915c238fc857\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-86pwd"
Sep 18 16:53:54.175251 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.175224    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxjds\" (UniqueName: \"kubernetes.io/projected/67895b79-4bdd-45ed-82e9-e9921052c81e-kube-api-access-xxjds\") pod \"openshift-state-metrics-86c5bc79d6-sk6jr\" (UID: \"67895b79-4bdd-45ed-82e9-e9921052c81e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-sk6jr"
Sep 18 16:53:54.175371 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.175303    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txglz\" (UniqueName: \"kubernetes.io/projected/57cef12e-d07e-4c77-9de9-895b066092e1-kube-api-access-txglz\") pod \"node-exporter-6tl5z\" (UID: \"57cef12e-d07e-4c77-9de9-895b066092e1\") " pod="openshift-monitoring/node-exporter-6tl5z"
Sep 18 16:53:54.176247 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.176209    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tprnx\" (UniqueName: \"kubernetes.io/projected/0cb31f04-f48e-4dda-9147-915c238fc857-kube-api-access-tprnx\") pod \"kube-state-metrics-84c885658c-86pwd\" (UID: \"0cb31f04-f48e-4dda-9147-915c238fc857\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-86pwd"
Sep 18 16:53:54.361571 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.361515    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:53:54.660481 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.660431    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/67895b79-4bdd-45ed-82e9-e9921052c81e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-sk6jr\" (UID: \"67895b79-4bdd-45ed-82e9-e9921052c81e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-sk6jr"
Sep 18 16:53:54.660697 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.660501    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/57cef12e-d07e-4c77-9de9-895b066092e1-node-exporter-tls\") pod \"node-exporter-6tl5z\" (UID: \"57cef12e-d07e-4c77-9de9-895b066092e1\") " pod="openshift-monitoring/node-exporter-6tl5z"
Sep 18 16:53:54.660697 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.660563    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cb31f04-f48e-4dda-9147-915c238fc857-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-86pwd\" (UID: \"0cb31f04-f48e-4dda-9147-915c238fc857\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-86pwd"
Sep 18 16:53:54.663281 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.663255    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/57cef12e-d07e-4c77-9de9-895b066092e1-node-exporter-tls\") pod \"node-exporter-6tl5z\" (UID: \"57cef12e-d07e-4c77-9de9-895b066092e1\") " pod="openshift-monitoring/node-exporter-6tl5z"
Sep 18 16:53:54.663431 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.663407    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cb31f04-f48e-4dda-9147-915c238fc857-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-86pwd\" (UID: \"0cb31f04-f48e-4dda-9147-915c238fc857\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-86pwd"
Sep 18 16:53:54.663509 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.663428    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/67895b79-4bdd-45ed-82e9-e9921052c81e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-sk6jr\" (UID: \"67895b79-4bdd-45ed-82e9-e9921052c81e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-sk6jr"
Sep 18 16:53:54.813952 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.813868    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-sk6jr"
Sep 18 16:53:54.819299 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.819274    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6tl5z"
Sep 18 16:53:54.852820 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:54.852790    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-86pwd"
Sep 18 16:53:58.485935 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.485897    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-bcw4j"]
Sep 18 16:53:58.489885 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.489858    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-bcw4j"
Sep 18 16:53:58.492115 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.492090    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-42zgp\""
Sep 18 16:53:58.492253 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.492091    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 18 16:53:58.497268 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.497213    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-bcw4j"]
Sep 18 16:53:58.568671 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.568623    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6b74996fcf-fzjx5"]
Sep 18 16:53:58.572333 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.572305    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6b74996fcf-fzjx5"
Sep 18 16:53:58.574797 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.574769    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 18 16:53:58.575141 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.575115    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-vtkht\""
Sep 18 16:53:58.575141 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.575115    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 18 16:53:58.575560 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.575423    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 18 16:53:58.575560 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.575455    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-95n4nv51bvcsf\""
Sep 18 16:53:58.575560 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.575509    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 18 16:53:58.584051 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.584025    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6b74996fcf-fzjx5"]
Sep 18 16:53:58.589604 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.589509    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f4074d69-35a8-4ded-9721-ec5ce7994c0d-secret-metrics-server-client-certs\") pod \"metrics-server-6b74996fcf-fzjx5\" (UID: \"f4074d69-35a8-4ded-9721-ec5ce7994c0d\") " pod="openshift-monitoring/metrics-server-6b74996fcf-fzjx5"
Sep 18 16:53:58.589604 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.589569    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4074d69-35a8-4ded-9721-ec5ce7994c0d-client-ca-bundle\") pod \"metrics-server-6b74996fcf-fzjx5\" (UID: \"f4074d69-35a8-4ded-9721-ec5ce7994c0d\") " pod="openshift-monitoring/metrics-server-6b74996fcf-fzjx5"
Sep 18 16:53:58.589767 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.589631    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p74sq\" (UniqueName: \"kubernetes.io/projected/f4074d69-35a8-4ded-9721-ec5ce7994c0d-kube-api-access-p74sq\") pod \"metrics-server-6b74996fcf-fzjx5\" (UID: \"f4074d69-35a8-4ded-9721-ec5ce7994c0d\") " pod="openshift-monitoring/metrics-server-6b74996fcf-fzjx5"
Sep 18 16:53:58.589767 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.589702    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rxwx\" (UniqueName: \"kubernetes.io/projected/0668115e-a46e-4f74-806b-445fe858939a-kube-api-access-9rxwx\") pod \"monitoring-plugin-5984459ff8-bcw4j\" (UID: \"0668115e-a46e-4f74-806b-445fe858939a\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-bcw4j"
Sep 18 16:53:58.589767 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.589736    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f4074d69-35a8-4ded-9721-ec5ce7994c0d-audit-log\") pod \"metrics-server-6b74996fcf-fzjx5\" (UID: \"f4074d69-35a8-4ded-9721-ec5ce7994c0d\") " pod="openshift-monitoring/metrics-server-6b74996fcf-fzjx5"
Sep 18 16:53:58.589767 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.589761    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f4074d69-35a8-4ded-9721-ec5ce7994c0d-metrics-server-audit-profiles\") pod \"metrics-server-6b74996fcf-fzjx5\" (UID: \"f4074d69-35a8-4ded-9721-ec5ce7994c0d\") " pod="openshift-monitoring/metrics-server-6b74996fcf-fzjx5"
Sep 18 16:53:58.589953 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.589788    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f4074d69-35a8-4ded-9721-ec5ce7994c0d-secret-metrics-server-tls\") pod \"metrics-server-6b74996fcf-fzjx5\" (UID: \"f4074d69-35a8-4ded-9721-ec5ce7994c0d\") " pod="openshift-monitoring/metrics-server-6b74996fcf-fzjx5"
Sep 18 16:53:58.589953 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.589873    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0668115e-a46e-4f74-806b-445fe858939a-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-bcw4j\" (UID: \"0668115e-a46e-4f74-806b-445fe858939a\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-bcw4j"
Sep 18 16:53:58.589953 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.589910    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4074d69-35a8-4ded-9721-ec5ce7994c0d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6b74996fcf-fzjx5\" (UID: \"f4074d69-35a8-4ded-9721-ec5ce7994c0d\") " pod="openshift-monitoring/metrics-server-6b74996fcf-fzjx5"
Sep 18 16:53:58.690684 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.690642    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f4074d69-35a8-4ded-9721-ec5ce7994c0d-secret-metrics-server-client-certs\") pod \"metrics-server-6b74996fcf-fzjx5\" (UID: \"f4074d69-35a8-4ded-9721-ec5ce7994c0d\") " pod="openshift-monitoring/metrics-server-6b74996fcf-fzjx5"
Sep 18 16:53:58.690684 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.690690    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4074d69-35a8-4ded-9721-ec5ce7994c0d-client-ca-bundle\") pod \"metrics-server-6b74996fcf-fzjx5\" (UID: \"f4074d69-35a8-4ded-9721-ec5ce7994c0d\") " pod="openshift-monitoring/metrics-server-6b74996fcf-fzjx5"
Sep 18 16:53:58.690985 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.690950    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p74sq\" (UniqueName: \"kubernetes.io/projected/f4074d69-35a8-4ded-9721-ec5ce7994c0d-kube-api-access-p74sq\") pod \"metrics-server-6b74996fcf-fzjx5\" (UID: \"f4074d69-35a8-4ded-9721-ec5ce7994c0d\") " pod="openshift-monitoring/metrics-server-6b74996fcf-fzjx5"
Sep 18 16:53:58.691105 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.691018    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rxwx\" (UniqueName: \"kubernetes.io/projected/0668115e-a46e-4f74-806b-445fe858939a-kube-api-access-9rxwx\") pod \"monitoring-plugin-5984459ff8-bcw4j\" (UID: \"0668115e-a46e-4f74-806b-445fe858939a\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-bcw4j"
Sep 18 16:53:58.691105 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.691047    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f4074d69-35a8-4ded-9721-ec5ce7994c0d-audit-log\") pod \"metrics-server-6b74996fcf-fzjx5\" (UID: \"f4074d69-35a8-4ded-9721-ec5ce7994c0d\") " pod="openshift-monitoring/metrics-server-6b74996fcf-fzjx5"
Sep 18 16:53:58.691105 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.691063    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f4074d69-35a8-4ded-9721-ec5ce7994c0d-metrics-server-audit-profiles\") pod \"metrics-server-6b74996fcf-fzjx5\" (UID: \"f4074d69-35a8-4ded-9721-ec5ce7994c0d\") " pod="openshift-monitoring/metrics-server-6b74996fcf-fzjx5"
Sep 18 16:53:58.691105 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.691087    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f4074d69-35a8-4ded-9721-ec5ce7994c0d-secret-metrics-server-tls\") pod \"metrics-server-6b74996fcf-fzjx5\" (UID: \"f4074d69-35a8-4ded-9721-ec5ce7994c0d\") " pod="openshift-monitoring/metrics-server-6b74996fcf-fzjx5"
Sep 18 16:53:58.691312 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.691139    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0668115e-a46e-4f74-806b-445fe858939a-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-bcw4j\" (UID: \"0668115e-a46e-4f74-806b-445fe858939a\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-bcw4j"
Sep 18 16:53:58.691312 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.691166    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4074d69-35a8-4ded-9721-ec5ce7994c0d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6b74996fcf-fzjx5\" (UID: \"f4074d69-35a8-4ded-9721-ec5ce7994c0d\") " pod="openshift-monitoring/metrics-server-6b74996fcf-fzjx5"
Sep 18 16:53:58.691888 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.691838    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f4074d69-35a8-4ded-9721-ec5ce7994c0d-audit-log\") pod \"metrics-server-6b74996fcf-fzjx5\" (UID: \"f4074d69-35a8-4ded-9721-ec5ce7994c0d\") " pod="openshift-monitoring/metrics-server-6b74996fcf-fzjx5"
Sep 18 16:53:58.691992 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.691934    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4074d69-35a8-4ded-9721-ec5ce7994c0d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6b74996fcf-fzjx5\" (UID: \"f4074d69-35a8-4ded-9721-ec5ce7994c0d\") " pod="openshift-monitoring/metrics-server-6b74996fcf-fzjx5"
Sep 18 16:53:58.692351 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.692331    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f4074d69-35a8-4ded-9721-ec5ce7994c0d-metrics-server-audit-profiles\") pod \"metrics-server-6b74996fcf-fzjx5\" (UID: \"f4074d69-35a8-4ded-9721-ec5ce7994c0d\") " pod="openshift-monitoring/metrics-server-6b74996fcf-fzjx5"
Sep 18 16:53:58.693882 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.693856    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4074d69-35a8-4ded-9721-ec5ce7994c0d-client-ca-bundle\") pod \"metrics-server-6b74996fcf-fzjx5\" (UID: \"f4074d69-35a8-4ded-9721-ec5ce7994c0d\") " pod="openshift-monitoring/metrics-server-6b74996fcf-fzjx5"
Sep 18 16:53:58.693981 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.693942    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f4074d69-35a8-4ded-9721-ec5ce7994c0d-secret-metrics-server-client-certs\") pod \"metrics-server-6b74996fcf-fzjx5\" (UID: \"f4074d69-35a8-4ded-9721-ec5ce7994c0d\") " pod="openshift-monitoring/metrics-server-6b74996fcf-fzjx5"
Sep 18 16:53:58.694700 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.694678    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0668115e-a46e-4f74-806b-445fe858939a-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-bcw4j\" (UID: \"0668115e-a46e-4f74-806b-445fe858939a\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-bcw4j"
Sep 18 16:53:58.694773 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.694678    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f4074d69-35a8-4ded-9721-ec5ce7994c0d-secret-metrics-server-tls\") pod \"metrics-server-6b74996fcf-fzjx5\" (UID: \"f4074d69-35a8-4ded-9721-ec5ce7994c0d\") " pod="openshift-monitoring/metrics-server-6b74996fcf-fzjx5"
Sep 18 16:53:58.700951 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.700930    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p74sq\" (UniqueName: \"kubernetes.io/projected/f4074d69-35a8-4ded-9721-ec5ce7994c0d-kube-api-access-p74sq\") pod \"metrics-server-6b74996fcf-fzjx5\" (UID: \"f4074d69-35a8-4ded-9721-ec5ce7994c0d\") " pod="openshift-monitoring/metrics-server-6b74996fcf-fzjx5"
Sep 18 16:53:58.701109 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.701071    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rxwx\" (UniqueName: \"kubernetes.io/projected/0668115e-a46e-4f74-806b-445fe858939a-kube-api-access-9rxwx\") pod \"monitoring-plugin-5984459ff8-bcw4j\" (UID: \"0668115e-a46e-4f74-806b-445fe858939a\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-bcw4j"
Sep 18 16:53:58.804148 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.804059    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-bcw4j"
Sep 18 16:53:58.889025 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:58.888988    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6b74996fcf-fzjx5"
Sep 18 16:53:59.115630 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:59.115593    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6b8658d9bc-44d9c"]
Sep 18 16:53:59.122169 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:59.122139    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6b8658d9bc-44d9c"
Sep 18 16:53:59.124324 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:59.124301    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 18 16:53:59.124451 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:59.124427    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 18 16:53:59.124451 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:59.124441    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 18 16:53:59.124735 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:59.124716    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 18 16:53:59.124868 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:59.124815    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 18 16:53:59.125381 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:59.125360    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-mt4jm\""
Sep 18 16:53:59.129377 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:59.129357    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 18 16:53:59.141154 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:59.141133    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6b8658d9bc-44d9c"]
Sep 18 16:53:59.196320 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:59.196275    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8f9134ad-d07d-4c88-977b-c04e0c51bc21-telemeter-client-tls\") pod \"telemeter-client-6b8658d9bc-44d9c\" (UID: \"8f9134ad-d07d-4c88-977b-c04e0c51bc21\") " pod="openshift-monitoring/telemeter-client-6b8658d9bc-44d9c"
Sep 18 16:53:59.196320 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:59.196318    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scb9q\" (UniqueName: \"kubernetes.io/projected/8f9134ad-d07d-4c88-977b-c04e0c51bc21-kube-api-access-scb9q\") pod \"telemeter-client-6b8658d9bc-44d9c\" (UID: \"8f9134ad-d07d-4c88-977b-c04e0c51bc21\") " pod="openshift-monitoring/telemeter-client-6b8658d9bc-44d9c"
Sep 18 16:53:59.196521 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:59.196376    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f9134ad-d07d-4c88-977b-c04e0c51bc21-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6b8658d9bc-44d9c\" (UID: \"8f9134ad-d07d-4c88-977b-c04e0c51bc21\") " pod="openshift-monitoring/telemeter-client-6b8658d9bc-44d9c"
Sep 18 16:53:59.196521 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:59.196511    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8f9134ad-d07d-4c88-977b-c04e0c51bc21-federate-client-tls\") pod \"telemeter-client-6b8658d9bc-44d9c\" (UID: \"8f9134ad-d07d-4c88-977b-c04e0c51bc21\") " pod="openshift-monitoring/telemeter-client-6b8658d9bc-44d9c"
Sep 18 16:53:59.196636 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:59.196567    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f9134ad-d07d-4c88-977b-c04e0c51bc21-metrics-client-ca\") pod \"telemeter-client-6b8658d9bc-44d9c\" (UID: \"8f9134ad-d07d-4c88-977b-c04e0c51bc21\") " pod="openshift-monitoring/telemeter-client-6b8658d9bc-44d9c"
Sep 18 16:53:59.196636 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:59.196591    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f9134ad-d07d-4c88-977b-c04e0c51bc21-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6b8658d9bc-44d9c\" (UID: \"8f9134ad-d07d-4c88-977b-c04e0c51bc21\") " pod="openshift-monitoring/telemeter-client-6b8658d9bc-44d9c"
Sep 18 16:53:59.196636 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:59.196609    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f9134ad-d07d-4c88-977b-c04e0c51bc21-serving-certs-ca-bundle\") pod \"telemeter-client-6b8658d9bc-44d9c\" (UID: \"8f9134ad-d07d-4c88-977b-c04e0c51bc21\") " pod="openshift-monitoring/telemeter-client-6b8658d9bc-44d9c"
Sep 18 16:53:59.196636 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:59.196632    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8f9134ad-d07d-4c88-977b-c04e0c51bc21-secret-telemeter-client\") pod \"telemeter-client-6b8658d9bc-44d9c\" (UID: \"8f9134ad-d07d-4c88-977b-c04e0c51bc21\") " pod="openshift-monitoring/telemeter-client-6b8658d9bc-44d9c"
Sep 18 16:53:59.297784 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:59.297745    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8f9134ad-d07d-4c88-977b-c04e0c51bc21-federate-client-tls\") pod \"telemeter-client-6b8658d9bc-44d9c\" (UID: \"8f9134ad-d07d-4c88-977b-c04e0c51bc21\") " pod="openshift-monitoring/telemeter-client-6b8658d9bc-44d9c"
Sep 18 16:53:59.297972 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:59.297796    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f9134ad-d07d-4c88-977b-c04e0c51bc21-metrics-client-ca\") pod \"telemeter-client-6b8658d9bc-44d9c\" (UID: \"8f9134ad-d07d-4c88-977b-c04e0c51bc21\") " pod="openshift-monitoring/telemeter-client-6b8658d9bc-44d9c"
Sep 18 16:53:59.297972 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:59.297824    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f9134ad-d07d-4c88-977b-c04e0c51bc21-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6b8658d9bc-44d9c\" (UID: \"8f9134ad-d07d-4c88-977b-c04e0c51bc21\") " pod="openshift-monitoring/telemeter-client-6b8658d9bc-44d9c"
Sep 18 16:53:59.297972 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:59.297850    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f9134ad-d07d-4c88-977b-c04e0c51bc21-serving-certs-ca-bundle\") pod \"telemeter-client-6b8658d9bc-44d9c\" (UID: \"8f9134ad-d07d-4c88-977b-c04e0c51bc21\") " pod="openshift-monitoring/telemeter-client-6b8658d9bc-44d9c"
Sep 18 16:53:59.297972 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:59.297879    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8f9134ad-d07d-4c88-977b-c04e0c51bc21-secret-telemeter-client\") pod \"telemeter-client-6b8658d9bc-44d9c\" (UID: \"8f9134ad-d07d-4c88-977b-c04e0c51bc21\") " pod="openshift-monitoring/telemeter-client-6b8658d9bc-44d9c"
Sep 18 16:53:59.297972 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:59.297921    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8f9134ad-d07d-4c88-977b-c04e0c51bc21-telemeter-client-tls\") pod \"telemeter-client-6b8658d9bc-44d9c\" (UID: \"8f9134ad-d07d-4c88-977b-c04e0c51bc21\") " pod="openshift-monitoring/telemeter-client-6b8658d9bc-44d9c"
Sep 18 16:53:59.297972 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:59.297942    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scb9q\" (UniqueName: \"kubernetes.io/projected/8f9134ad-d07d-4c88-977b-c04e0c51bc21-kube-api-access-scb9q\") pod \"telemeter-client-6b8658d9bc-44d9c\" (UID: \"8f9134ad-d07d-4c88-977b-c04e0c51bc21\") " pod="openshift-monitoring/telemeter-client-6b8658d9bc-44d9c"
Sep 18 16:53:59.297972 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:59.297972    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f9134ad-d07d-4c88-977b-c04e0c51bc21-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6b8658d9bc-44d9c\" (UID: \"8f9134ad-d07d-4c88-977b-c04e0c51bc21\") " pod="openshift-monitoring/telemeter-client-6b8658d9bc-44d9c"
Sep 18 16:53:59.298716 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:59.298688    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f9134ad-d07d-4c88-977b-c04e0c51bc21-serving-certs-ca-bundle\") pod \"telemeter-client-6b8658d9bc-44d9c\" (UID: \"8f9134ad-d07d-4c88-977b-c04e0c51bc21\") " pod="openshift-monitoring/telemeter-client-6b8658d9bc-44d9c"
Sep 18 16:53:59.298968 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:59.298943    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f9134ad-d07d-4c88-977b-c04e0c51bc21-metrics-client-ca\") pod \"telemeter-client-6b8658d9bc-44d9c\" (UID: \"8f9134ad-d07d-4c88-977b-c04e0c51bc21\") " pod="openshift-monitoring/telemeter-client-6b8658d9bc-44d9c"
Sep 18 16:53:59.299047 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:59.298976    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f9134ad-d07d-4c88-977b-c04e0c51bc21-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6b8658d9bc-44d9c\" (UID: \"8f9134ad-d07d-4c88-977b-c04e0c51bc21\") " pod="openshift-monitoring/telemeter-client-6b8658d9bc-44d9c"
Sep 18 16:53:59.300704 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:59.300674    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f9134ad-d07d-4c88-977b-c04e0c51bc21-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6b8658d9bc-44d9c\" (UID: \"8f9134ad-d07d-4c88-977b-c04e0c51bc21\") " pod="openshift-monitoring/telemeter-client-6b8658d9bc-44d9c"
Sep 18 16:53:59.300924 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:59.300906    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8f9134ad-d07d-4c88-977b-c04e0c51bc21-federate-client-tls\") pod \"telemeter-client-6b8658d9bc-44d9c\" (UID: \"8f9134ad-d07d-4c88-977b-c04e0c51bc21\") " pod="openshift-monitoring/telemeter-client-6b8658d9bc-44d9c"
Sep 18 16:53:59.301004 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:59.300965    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8f9134ad-d07d-4c88-977b-c04e0c51bc21-telemeter-client-tls\") pod \"telemeter-client-6b8658d9bc-44d9c\" (UID: \"8f9134ad-d07d-4c88-977b-c04e0c51bc21\") " pod="openshift-monitoring/telemeter-client-6b8658d9bc-44d9c"
Sep 18 16:53:59.301063 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:59.301041    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8f9134ad-d07d-4c88-977b-c04e0c51bc21-secret-telemeter-client\") pod \"telemeter-client-6b8658d9bc-44d9c\" (UID: \"8f9134ad-d07d-4c88-977b-c04e0c51bc21\") " pod="openshift-monitoring/telemeter-client-6b8658d9bc-44d9c"
Sep 18 16:53:59.307992 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:59.307953    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scb9q\" (UniqueName: \"kubernetes.io/projected/8f9134ad-d07d-4c88-977b-c04e0c51bc21-kube-api-access-scb9q\") pod \"telemeter-client-6b8658d9bc-44d9c\" (UID: \"8f9134ad-d07d-4c88-977b-c04e0c51bc21\") " pod="openshift-monitoring/telemeter-client-6b8658d9bc-44d9c"
Sep 18 16:53:59.374610 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:59.374507    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6888775986-fl24h" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry" containerID="cri-o://91911ff0e1e71cad414b942d7cad83fa7fb1c833cd1a42629c77be5446c9775a" gracePeriod=30
Sep 18 16:53:59.434573 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:53:59.434516    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6b8658d9bc-44d9c"
Sep 18 16:54:00.117136 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:54:00.117038    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57cef12e_d07e_4c77_9de9_895b066092e1.slice/crio-be950d15a19d96ce85020c3010cce027bf18ace5fe740720a1cce614b263f511 WatchSource:0}: Error finding container be950d15a19d96ce85020c3010cce027bf18ace5fe740720a1cce614b263f511: Status 404 returned error can't find the container with id be950d15a19d96ce85020c3010cce027bf18ace5fe740720a1cce614b263f511
Sep 18 16:54:00.133583 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:00.130694    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 16:54:00.360259 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:00.360232    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6b8658d9bc-44d9c"]
Sep 18 16:54:00.362696 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:54:00.362664    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f9134ad_d07d_4c88_977b_c04e0c51bc21.slice/crio-135c79c4f1eb383ccaf8bad8f922d51fec7a5f6af5fa5d66bf4a942c985b4d75 WatchSource:0}: Error finding container 135c79c4f1eb383ccaf8bad8f922d51fec7a5f6af5fa5d66bf4a942c985b4d75: Status 404 returned error can't find the container with id 135c79c4f1eb383ccaf8bad8f922d51fec7a5f6af5fa5d66bf4a942c985b4d75
Sep 18 16:54:00.385052 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:00.385007    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6tl5z" event={"ID":"57cef12e-d07e-4c77-9de9-895b066092e1","Type":"ContainerStarted","Data":"be950d15a19d96ce85020c3010cce027bf18ace5fe740720a1cce614b263f511"}
Sep 18 16:54:00.387258 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:00.387227    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-dq25h" event={"ID":"4f028e9f-c895-4f71-870a-0d2ff7102024","Type":"ContainerStarted","Data":"7a364dc505ed38e4a71ec64f047e63132a7b8030c1d3b0c62ebbfb9af6082f57"}
Sep 18 16:54:00.387431 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:00.387414    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6594f4c75-dq25h"
Sep 18 16:54:00.389096 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:00.389072    2577 patch_prober.go:28] interesting pod/downloads-6594f4c75-dq25h container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.20:8080/\": dial tcp 10.132.0.20:8080: connect: connection refused" start-of-body=
Sep 18 16:54:00.389272 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:00.389247    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-6594f4c75-dq25h" podUID="4f028e9f-c895-4f71-870a-0d2ff7102024" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.20:8080/\": dial tcp 10.132.0.20:8080: connect: connection refused"
Sep 18 16:54:00.390277 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:00.390233    2577 generic.go:356] "Generic (PLEG): container finished" podID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerID="91911ff0e1e71cad414b942d7cad83fa7fb1c833cd1a42629c77be5446c9775a" exitCode=0
Sep 18 16:54:00.390380 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:00.390322    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6888775986-fl24h" event={"ID":"2200d387-c1d6-477d-ab65-eb96dc6b3259","Type":"ContainerDied","Data":"91911ff0e1e71cad414b942d7cad83fa7fb1c833cd1a42629c77be5446c9775a"}
Sep 18 16:54:00.390380 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:00.390369    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6888775986-fl24h" event={"ID":"2200d387-c1d6-477d-ab65-eb96dc6b3259","Type":"ContainerStarted","Data":"1a3d9a4e8e4f334f95ee0c54568c528e21742bf5aa1a1684f0278bfd257eef3a"}
Sep 18 16:54:00.390497 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:00.390424    2577 scope.go:117] "RemoveContainer" containerID="aaa0bf43c92965d2aa3c90a41b84906b6dd7d3ef0e9a7445ac0620db0dfc9ddf"
Sep 18 16:54:00.390573 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:00.390425    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:54:00.392083 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:00.391971    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b8658d9bc-44d9c" event={"ID":"8f9134ad-d07d-4c88-977b-c04e0c51bc21","Type":"ContainerStarted","Data":"135c79c4f1eb383ccaf8bad8f922d51fec7a5f6af5fa5d66bf4a942c985b4d75"}
Sep 18 16:54:00.416345 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:00.416319    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-sk6jr"]
Sep 18 16:54:00.419146 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:00.419119    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-bcw4j"]
Sep 18 16:54:00.421173 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:54:00.421147    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67895b79_4bdd_45ed_82e9_e9921052c81e.slice/crio-bc6f017cecd19a751cc472e75555b5ce51494c26849e61c8350e49a78d00cc82 WatchSource:0}: Error finding container bc6f017cecd19a751cc472e75555b5ce51494c26849e61c8350e49a78d00cc82: Status 404 returned error can't find the container with id bc6f017cecd19a751cc472e75555b5ce51494c26849e61c8350e49a78d00cc82
Sep 18 16:54:00.422203 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:54:00.422181    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0668115e_a46e_4f74_806b_445fe858939a.slice/crio-f90f724cd362c1e73cd3eeedc8249f8bc174d631d52888061c0417808d716f42 WatchSource:0}: Error finding container f90f724cd362c1e73cd3eeedc8249f8bc174d631d52888061c0417808d716f42: Status 404 returned error can't find the container with id f90f724cd362c1e73cd3eeedc8249f8bc174d631d52888061c0417808d716f42
Sep 18 16:54:00.436702 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:00.436650    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6594f4c75-dq25h" podStartSLOduration=0.980574891 podStartE2EDuration="17.436631673s" totalImagesPullingTime="16.456056782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:53:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:54:00.434807047 +0000 UTC m=+313.492096572" watchObservedRunningTime="2026-09-18 16:54:00.436631673 +0000 UTC m=+313.493921204"
Sep 18 16:54:00.441422 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:00.441357    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6b74996fcf-fzjx5"]
Sep 18 16:54:00.442446 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:00.441978    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-86pwd"]
Sep 18 16:54:01.404386 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:01.404273    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-86pwd" event={"ID":"0cb31f04-f48e-4dda-9147-915c238fc857","Type":"ContainerStarted","Data":"a1d2c8eab67222712ed9d6a2acc3894b18eb196421ae01f40d05761a5d6d8dfe"}
Sep 18 16:54:01.408355 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:01.408271    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6b74996fcf-fzjx5" event={"ID":"f4074d69-35a8-4ded-9721-ec5ce7994c0d","Type":"ContainerStarted","Data":"a403f37efaae0dfc36f4bcd55e4e1d1eb8d16db71c7980d2afb8b258bde80155"}
Sep 18 16:54:01.410582 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:01.410488    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-bcw4j" event={"ID":"0668115e-a46e-4f74-806b-445fe858939a","Type":"ContainerStarted","Data":"f90f724cd362c1e73cd3eeedc8249f8bc174d631d52888061c0417808d716f42"}
Sep 18 16:54:01.417428 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:01.417194    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6tl5z" event={"ID":"57cef12e-d07e-4c77-9de9-895b066092e1","Type":"ContainerStarted","Data":"3093cf7ef10723281721e6bfbed21a429071130a81477861f736f0c3a5177f2a"}
Sep 18 16:54:01.423714 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:01.423562    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-sk6jr" event={"ID":"67895b79-4bdd-45ed-82e9-e9921052c81e","Type":"ContainerStarted","Data":"00c770aa81ef1c90a2b8a3ce02a885589ce23fa92481bd0d8e8a1db0d234bcfc"}
Sep 18 16:54:01.423714 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:01.423614    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-sk6jr" event={"ID":"67895b79-4bdd-45ed-82e9-e9921052c81e","Type":"ContainerStarted","Data":"4470f44454934afe32a7b6849cc1182f9f4b955df9e36fd7ceb8c0358f9cd0b7"}
Sep 18 16:54:01.423714 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:01.423647    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-sk6jr" event={"ID":"67895b79-4bdd-45ed-82e9-e9921052c81e","Type":"ContainerStarted","Data":"bc6f017cecd19a751cc472e75555b5ce51494c26849e61c8350e49a78d00cc82"}
Sep 18 16:54:01.465738 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:01.465705    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6594f4c75-dq25h"
Sep 18 16:54:02.462295 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:02.460903    2577 generic.go:356] "Generic (PLEG): container finished" podID="57cef12e-d07e-4c77-9de9-895b066092e1" containerID="3093cf7ef10723281721e6bfbed21a429071130a81477861f736f0c3a5177f2a" exitCode=0
Sep 18 16:54:02.462295 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:02.462201    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6tl5z" event={"ID":"57cef12e-d07e-4c77-9de9-895b066092e1","Type":"ContainerDied","Data":"3093cf7ef10723281721e6bfbed21a429071130a81477861f736f0c3a5177f2a"}
Sep 18 16:54:02.462295 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:02.462252    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6tl5z" event={"ID":"57cef12e-d07e-4c77-9de9-895b066092e1","Type":"ContainerStarted","Data":"da0e1b829911241a9c9cfd7d390e065dfb43689a3238a87ef274d3256aea4c12"}
Sep 18 16:54:02.463129 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:02.462996    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6tl5z" event={"ID":"57cef12e-d07e-4c77-9de9-895b066092e1","Type":"ContainerStarted","Data":"1aaca4243818e04b02bb387b21862f2363e9ff33ebb0e77bbf1628bacd06711f"}
Sep 18 16:54:02.485429 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:02.485380    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6tl5z" podStartSLOduration=8.322596915 podStartE2EDuration="9.485355494s" totalImagesPullingTime="1.044072804s" totalInitContainerRuntime="118.685775ms" isStatefulPod=true podCreationTimestamp="2026-09-18 16:53:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:54:02.484110644 +0000 UTC m=+315.541400175" watchObservedRunningTime="2026-09-18 16:54:02.485355494 +0000 UTC m=+315.542645023"
Sep 18 16:54:06.485716 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:06.485614    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b8658d9bc-44d9c" event={"ID":"8f9134ad-d07d-4c88-977b-c04e0c51bc21","Type":"ContainerStarted","Data":"63d6caf79b5d56eb37c33976465e1c3d645f800cf69f66ec51c49220da908c3f"}
Sep 18 16:54:06.489198 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:06.489064    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-86pwd" event={"ID":"0cb31f04-f48e-4dda-9147-915c238fc857","Type":"ContainerStarted","Data":"c842a99a2af37373e5487e27b33a15b50b952b56807bcea328d2d2b6fa49f42a"}
Sep 18 16:54:06.489198 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:06.489126    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-86pwd" event={"ID":"0cb31f04-f48e-4dda-9147-915c238fc857","Type":"ContainerStarted","Data":"2596cb119adf72d10d7dfb9b0ca322cd9ed48d91edc6a7f2039b713743137d86"}
Sep 18 16:54:06.489198 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:06.489157    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-86pwd" event={"ID":"0cb31f04-f48e-4dda-9147-915c238fc857","Type":"ContainerStarted","Data":"d3ef776b680f89def197a40406948de4a15fe1f4ef3306ffe9207850b7b2435e"}
Sep 18 16:54:06.492288 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:06.491799    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6b74996fcf-fzjx5" event={"ID":"f4074d69-35a8-4ded-9721-ec5ce7994c0d","Type":"ContainerStarted","Data":"37a73301490a10c1b0e5e6ac933f3420ee4b69f534e7e6330c74c51ede70ef06"}
Sep 18 16:54:06.497091 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:06.494907    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-bcw4j" event={"ID":"0668115e-a46e-4f74-806b-445fe858939a","Type":"ContainerStarted","Data":"ea1cd31bf7ef9a9c4fd20fbabdf777a663a83b06b347e227b09cce4754c289fd"}
Sep 18 16:54:06.497091 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:06.495678    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-bcw4j"
Sep 18 16:54:06.502644 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:06.502594    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-bcw4j"
Sep 18 16:54:06.504070 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:06.504042    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-sk6jr" event={"ID":"67895b79-4bdd-45ed-82e9-e9921052c81e","Type":"ContainerStarted","Data":"2cca172de104cd9464bbdc108b375ba442c9aa8c4bb18c390f3a73356b82581b"}
Sep 18 16:54:06.516416 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:06.516364    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-84c885658c-86pwd" podStartSLOduration=8.336972137 podStartE2EDuration="13.516344095s" totalImagesPullingTime="5.179371958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:53:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:54:06.514947784 +0000 UTC m=+319.572237314" watchObservedRunningTime="2026-09-18 16:54:06.516344095 +0000 UTC m=+319.573633625"
Sep 18 16:54:06.534788 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:06.534733    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6b74996fcf-fzjx5" podStartSLOduration=3.349329243 podStartE2EDuration="8.53471843s" totalImagesPullingTime="5.185389187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:53:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:54:06.533868384 +0000 UTC m=+319.591157949" watchObservedRunningTime="2026-09-18 16:54:06.53471843 +0000 UTC m=+319.592007960"
Sep 18 16:54:06.580106 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:06.579185    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-bcw4j" podStartSLOduration=3.374182907 podStartE2EDuration="8.579167671s" totalImagesPullingTime="5.204984764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:53:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:54:06.550694688 +0000 UTC m=+319.607984217" watchObservedRunningTime="2026-09-18 16:54:06.579167671 +0000 UTC m=+319.636457202"
Sep 18 16:54:06.580106 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:06.579491    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-sk6jr" podStartSLOduration=8.550986981 podStartE2EDuration="13.579485022s" totalImagesPullingTime="5.028498041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:53:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:54:06.576644658 +0000 UTC m=+319.633934187" watchObservedRunningTime="2026-09-18 16:54:06.579485022 +0000 UTC m=+319.636774551"
Sep 18 16:54:08.520086 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:08.520040    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b8658d9bc-44d9c" event={"ID":"8f9134ad-d07d-4c88-977b-c04e0c51bc21","Type":"ContainerStarted","Data":"0944f1e7e8a543b843fde833edd727b75cccd3f6bbb1ca72ed1d89d0b3d0014a"}
Sep 18 16:54:08.520629 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:08.520116    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b8658d9bc-44d9c" event={"ID":"8f9134ad-d07d-4c88-977b-c04e0c51bc21","Type":"ContainerStarted","Data":"9e73f32e958fa4b785de1f64d5259eb588fae4e9c155d0e53165bec46a0e7c87"}
Sep 18 16:54:08.548135 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:08.548076    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6b8658d9bc-44d9c" podStartSLOduration=2.437239011 podStartE2EDuration="9.548054899s" totalImagesPullingTime="7.110815888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:53:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:54:08.545686104 +0000 UTC m=+321.602975637" watchObservedRunningTime="2026-09-18 16:54:08.548054899 +0000 UTC m=+321.605344428"
Sep 18 16:54:18.889881 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:18.889843    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6b74996fcf-fzjx5"
Sep 18 16:54:18.890357 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:18.889939    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6b74996fcf-fzjx5"
Sep 18 16:54:21.448489 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:21.448461    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:54:28.567821 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:28.567786    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6888775986-fl24h"]
Sep 18 16:54:38.895465 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:38.895386    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6b74996fcf-fzjx5"
Sep 18 16:54:38.899132 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:38.899110    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6b74996fcf-fzjx5"
Sep 18 16:54:53.587022 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:53.586957    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6888775986-fl24h" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry" containerID="cri-o://1a3d9a4e8e4f334f95ee0c54568c528e21742bf5aa1a1684f0278bfd257eef3a" gracePeriod=30
Sep 18 16:54:53.716358 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:53.716324    2577 generic.go:356] "Generic (PLEG): container finished" podID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerID="1a3d9a4e8e4f334f95ee0c54568c528e21742bf5aa1a1684f0278bfd257eef3a" exitCode=0
Sep 18 16:54:53.716525 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:53.716392    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6888775986-fl24h" event={"ID":"2200d387-c1d6-477d-ab65-eb96dc6b3259","Type":"ContainerDied","Data":"1a3d9a4e8e4f334f95ee0c54568c528e21742bf5aa1a1684f0278bfd257eef3a"}
Sep 18 16:54:53.716525 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:53.716449    2577 scope.go:117] "RemoveContainer" containerID="91911ff0e1e71cad414b942d7cad83fa7fb1c833cd1a42629c77be5446c9775a"
Sep 18 16:54:53.833075 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:53.833048    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:54:53.878824 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:53.878794    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2200d387-c1d6-477d-ab65-eb96dc6b3259-trusted-ca\") pod \"2200d387-c1d6-477d-ab65-eb96dc6b3259\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") "
Sep 18 16:54:53.878824 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:53.878824    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2200d387-c1d6-477d-ab65-eb96dc6b3259-registry-tls\") pod \"2200d387-c1d6-477d-ab65-eb96dc6b3259\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") "
Sep 18 16:54:53.879019 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:53.878846    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2200d387-c1d6-477d-ab65-eb96dc6b3259-installation-pull-secrets\") pod \"2200d387-c1d6-477d-ab65-eb96dc6b3259\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") "
Sep 18 16:54:53.879019 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:53.878908    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cgwt6\" (UniqueName: \"kubernetes.io/projected/2200d387-c1d6-477d-ab65-eb96dc6b3259-kube-api-access-cgwt6\") pod \"2200d387-c1d6-477d-ab65-eb96dc6b3259\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") "
Sep 18 16:54:53.879019 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:53.878977    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2200d387-c1d6-477d-ab65-eb96dc6b3259-image-registry-private-configuration\") pod \"2200d387-c1d6-477d-ab65-eb96dc6b3259\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") "
Sep 18 16:54:53.879019 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:53.879002    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2200d387-c1d6-477d-ab65-eb96dc6b3259-bound-sa-token\") pod \"2200d387-c1d6-477d-ab65-eb96dc6b3259\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") "
Sep 18 16:54:53.879214 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:53.879136    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2200d387-c1d6-477d-ab65-eb96dc6b3259-ca-trust-extracted\") pod \"2200d387-c1d6-477d-ab65-eb96dc6b3259\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") "
Sep 18 16:54:53.879214 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:53.879208    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2200d387-c1d6-477d-ab65-eb96dc6b3259-registry-certificates\") pod \"2200d387-c1d6-477d-ab65-eb96dc6b3259\" (UID: \"2200d387-c1d6-477d-ab65-eb96dc6b3259\") "
Sep 18 16:54:53.880105 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:53.879820    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2200d387-c1d6-477d-ab65-eb96dc6b3259-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2200d387-c1d6-477d-ab65-eb96dc6b3259" (UID: "2200d387-c1d6-477d-ab65-eb96dc6b3259"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 16:54:53.880105 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:53.880074    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2200d387-c1d6-477d-ab65-eb96dc6b3259-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2200d387-c1d6-477d-ab65-eb96dc6b3259" (UID: "2200d387-c1d6-477d-ab65-eb96dc6b3259"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 16:54:53.881914 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:53.881887    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2200d387-c1d6-477d-ab65-eb96dc6b3259-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2200d387-c1d6-477d-ab65-eb96dc6b3259" (UID: "2200d387-c1d6-477d-ab65-eb96dc6b3259"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 16:54:53.882029 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:53.881942    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2200d387-c1d6-477d-ab65-eb96dc6b3259-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2200d387-c1d6-477d-ab65-eb96dc6b3259" (UID: "2200d387-c1d6-477d-ab65-eb96dc6b3259"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 16:54:53.882029 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:53.881966    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2200d387-c1d6-477d-ab65-eb96dc6b3259-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2200d387-c1d6-477d-ab65-eb96dc6b3259" (UID: "2200d387-c1d6-477d-ab65-eb96dc6b3259"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 16:54:53.882148 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:53.882050    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2200d387-c1d6-477d-ab65-eb96dc6b3259-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2200d387-c1d6-477d-ab65-eb96dc6b3259" (UID: "2200d387-c1d6-477d-ab65-eb96dc6b3259"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 16:54:53.882286 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:53.882264    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2200d387-c1d6-477d-ab65-eb96dc6b3259-kube-api-access-cgwt6" (OuterVolumeSpecName: "kube-api-access-cgwt6") pod "2200d387-c1d6-477d-ab65-eb96dc6b3259" (UID: "2200d387-c1d6-477d-ab65-eb96dc6b3259"). InnerVolumeSpecName "kube-api-access-cgwt6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 16:54:53.888950 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:53.888917    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2200d387-c1d6-477d-ab65-eb96dc6b3259-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2200d387-c1d6-477d-ab65-eb96dc6b3259" (UID: "2200d387-c1d6-477d-ab65-eb96dc6b3259"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 16:54:53.980674 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:53.980640    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2200d387-c1d6-477d-ab65-eb96dc6b3259-trusted-ca\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 16:54:53.980674 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:53.980668    2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2200d387-c1d6-477d-ab65-eb96dc6b3259-registry-tls\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 16:54:53.980674 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:53.980677    2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2200d387-c1d6-477d-ab65-eb96dc6b3259-installation-pull-secrets\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 16:54:53.980899 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:53.980685    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cgwt6\" (UniqueName: \"kubernetes.io/projected/2200d387-c1d6-477d-ab65-eb96dc6b3259-kube-api-access-cgwt6\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 16:54:53.980899 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:53.980695    2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2200d387-c1d6-477d-ab65-eb96dc6b3259-image-registry-private-configuration\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 16:54:53.980899 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:53.980704    2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2200d387-c1d6-477d-ab65-eb96dc6b3259-bound-sa-token\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 16:54:53.980899 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:53.980712    2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2200d387-c1d6-477d-ab65-eb96dc6b3259-ca-trust-extracted\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 16:54:53.980899 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:53.980720    2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2200d387-c1d6-477d-ab65-eb96dc6b3259-registry-certificates\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 16:54:54.721445 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:54.721413    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6888775986-fl24h"
Sep 18 16:54:54.721445 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:54.721436    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6888775986-fl24h" event={"ID":"2200d387-c1d6-477d-ab65-eb96dc6b3259","Type":"ContainerDied","Data":"fa705b7e7bb7c12676f6fed43bd6f3e26085f3d0a0fb46816a18b0824a9647e5"}
Sep 18 16:54:54.721974 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:54.721484    2577 scope.go:117] "RemoveContainer" containerID="1a3d9a4e8e4f334f95ee0c54568c528e21742bf5aa1a1684f0278bfd257eef3a"
Sep 18 16:54:54.748706 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:54.748680    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6888775986-fl24h"]
Sep 18 16:54:54.756861 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:54.756838    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6888775986-fl24h"]
Sep 18 16:54:55.121310 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:54:55.121280    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" path="/var/lib/kubelet/pods/2200d387-c1d6-477d-ab65-eb96dc6b3259/volumes"
Sep 18 16:55:45.452102 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:55:45.452069    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pkl4j"]
Sep 18 16:55:45.452510 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:55:45.452395    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry"
Sep 18 16:55:45.452510 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:55:45.452406    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry"
Sep 18 16:55:45.452510 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:55:45.452417    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry"
Sep 18 16:55:45.452510 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:55:45.452422    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry"
Sep 18 16:55:45.452510 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:55:45.452435    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry"
Sep 18 16:55:45.452510 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:55:45.452441    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry"
Sep 18 16:55:45.452510 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:55:45.452453    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry"
Sep 18 16:55:45.452510 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:55:45.452460    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry"
Sep 18 16:55:45.452788 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:55:45.452554    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry"
Sep 18 16:55:45.452788 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:55:45.452567    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry"
Sep 18 16:55:45.452788 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:55:45.452578    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry"
Sep 18 16:55:45.454645 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:55:45.454624    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pkl4j"
Sep 18 16:55:45.468715 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:55:45.468693    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bjwms\""
Sep 18 16:55:45.468715 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:55:45.468710    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 18 16:55:45.469392 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:55:45.469373    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 18 16:55:45.469435 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:55:45.469410    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 18 16:55:45.503425 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:55:45.503392    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pkl4j"]
Sep 18 16:55:45.513253 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:55:45.513226    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b20e181a-e088-448d-8ee1-d052e787955e-cert\") pod \"ingress-canary-pkl4j\" (UID: \"b20e181a-e088-448d-8ee1-d052e787955e\") " pod="openshift-ingress-canary/ingress-canary-pkl4j"
Sep 18 16:55:45.513397 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:55:45.513332    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m74fd\" (UniqueName: \"kubernetes.io/projected/b20e181a-e088-448d-8ee1-d052e787955e-kube-api-access-m74fd\") pod \"ingress-canary-pkl4j\" (UID: \"b20e181a-e088-448d-8ee1-d052e787955e\") " pod="openshift-ingress-canary/ingress-canary-pkl4j"
Sep 18 16:55:45.614744 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:55:45.614712    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m74fd\" (UniqueName: \"kubernetes.io/projected/b20e181a-e088-448d-8ee1-d052e787955e-kube-api-access-m74fd\") pod \"ingress-canary-pkl4j\" (UID: \"b20e181a-e088-448d-8ee1-d052e787955e\") " pod="openshift-ingress-canary/ingress-canary-pkl4j"
Sep 18 16:55:45.614919 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:55:45.614765    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b20e181a-e088-448d-8ee1-d052e787955e-cert\") pod \"ingress-canary-pkl4j\" (UID: \"b20e181a-e088-448d-8ee1-d052e787955e\") " pod="openshift-ingress-canary/ingress-canary-pkl4j"
Sep 18 16:55:45.614974 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:55:45.614921    2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Sep 18 16:55:45.615013 ip-10-0-132-41 kubenswrapper[2577]: E0918 16:55:45.614993    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b20e181a-e088-448d-8ee1-d052e787955e-cert podName:b20e181a-e088-448d-8ee1-d052e787955e nodeName:}" failed. No retries permitted until 2026-09-18 16:55:46.114977475 +0000 UTC m=+419.172266981 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b20e181a-e088-448d-8ee1-d052e787955e-cert") pod "ingress-canary-pkl4j" (UID: "b20e181a-e088-448d-8ee1-d052e787955e") : secret "canary-serving-cert" not found
Sep 18 16:55:45.648055 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:55:45.648027    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m74fd\" (UniqueName: \"kubernetes.io/projected/b20e181a-e088-448d-8ee1-d052e787955e-kube-api-access-m74fd\") pod \"ingress-canary-pkl4j\" (UID: \"b20e181a-e088-448d-8ee1-d052e787955e\") " pod="openshift-ingress-canary/ingress-canary-pkl4j"
Sep 18 16:55:46.119071 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:55:46.119045    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b20e181a-e088-448d-8ee1-d052e787955e-cert\") pod \"ingress-canary-pkl4j\" (UID: \"b20e181a-e088-448d-8ee1-d052e787955e\") " pod="openshift-ingress-canary/ingress-canary-pkl4j"
Sep 18 16:55:46.121548 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:55:46.121510    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b20e181a-e088-448d-8ee1-d052e787955e-cert\") pod \"ingress-canary-pkl4j\" (UID: \"b20e181a-e088-448d-8ee1-d052e787955e\") " pod="openshift-ingress-canary/ingress-canary-pkl4j"
Sep 18 16:55:46.363520 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:55:46.363485    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pkl4j"
Sep 18 16:55:46.649932 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:55:46.649906    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pkl4j"]
Sep 18 16:55:46.652363 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:55:46.652333    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb20e181a_e088_448d_8ee1_d052e787955e.slice/crio-33f3fd5018ad3204667a562ecc12d989bdd3c9921ced1f442acfe48f780ad076 WatchSource:0}: Error finding container 33f3fd5018ad3204667a562ecc12d989bdd3c9921ced1f442acfe48f780ad076: Status 404 returned error can't find the container with id 33f3fd5018ad3204667a562ecc12d989bdd3c9921ced1f442acfe48f780ad076
Sep 18 16:55:46.957138 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:55:46.957052    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pkl4j" event={"ID":"b20e181a-e088-448d-8ee1-d052e787955e","Type":"ContainerStarted","Data":"33f3fd5018ad3204667a562ecc12d989bdd3c9921ced1f442acfe48f780ad076"}
Sep 18 16:55:48.967941 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:55:48.967853    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pkl4j" event={"ID":"b20e181a-e088-448d-8ee1-d052e787955e","Type":"ContainerStarted","Data":"4c032911201c456870b4c8f9095640c68b4d61e5ae64d5d013969822f38c1460"}
Sep 18 16:55:48.986641 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:55:48.986591    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pkl4j" podStartSLOduration=1.9825662689999999 podStartE2EDuration="3.986575458s" totalImagesPullingTime="2.004009189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:55:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:55:48.985277997 +0000 UTC m=+422.042567524" watchObservedRunningTime="2026-09-18 16:55:48.986575458 +0000 UTC m=+422.043864991"
Sep 18 16:58:49.029662 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:49.029622    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-t4p6q_60bae8ea-9599-47f8-b066-df7c46c011b3/console-operator/1.log"
Sep 18 16:58:49.030155 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:49.029784    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-t4p6q_60bae8ea-9599-47f8-b066-df7c46c011b3/console-operator/1.log"
Sep 18 16:58:49.035655 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:49.035629    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktklw_3c1064f0-18a0-4c28-8fb9-a320535dcbbf/ovn-acl-logging/0.log"
Sep 18 16:58:49.035766 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:49.035699    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktklw_3c1064f0-18a0-4c28-8fb9-a320535dcbbf/ovn-acl-logging/0.log"
Sep 18 16:58:58.053947 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.053912    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 16:58:58.056763 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.054482    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry"
Sep 18 16:58:58.056763 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.054505    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry"
Sep 18 16:58:58.056763 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.054611    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry"
Sep 18 16:58:58.056763 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.054623    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2200d387-c1d6-477d-ab65-eb96dc6b3259" containerName="registry"
Sep 18 16:58:58.058823 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.058799    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.061090 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.061069    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 18 16:58:58.061211 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.061153    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 18 16:58:58.061211 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.061181    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-pvzh5\""
Sep 18 16:58:58.061354 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.061278    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 18 16:58:58.061496 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.061473    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 18 16:58:58.061754 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.061734    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 18 16:58:58.061845 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.061820    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 18 16:58:58.062050 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.062032    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 18 16:58:58.062192 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.062116    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 18 16:58:58.066478 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.066461    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 18 16:58:58.078486 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.078459    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 16:58:58.213698 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.213659    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9h2g\" (UniqueName: \"kubernetes.io/projected/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-kube-api-access-l9h2g\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.213698 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.213698    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.213930 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.213726    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.213930 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.213746    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.213930 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.213795    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.213930 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.213852    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.213930 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.213888    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.213930 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.213925    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.214164 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.213947    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-config-volume\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.214164 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.213970    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.214164 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.213987    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-web-config\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.214164 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.214009    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-config-out\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.214164 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.214024    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.315025 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.314927    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9h2g\" (UniqueName: \"kubernetes.io/projected/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-kube-api-access-l9h2g\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.315025 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.314978    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.315223 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.315089    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.315223 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.315129    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.315223 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.315152    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.315223 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.315215    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.315425 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.315264    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.315425 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.315300    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.315425 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.315338    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-config-volume\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.315425 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.315391    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.315737 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.315443    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-web-config\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.315737 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.315486    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-config-out\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.315737 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.315511    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.316142 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.316119    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.316420 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.316401    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.316498 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.316418    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.318192 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.318167    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.318301 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.318214    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.318301 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.318234    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-config-volume\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.318630 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.318610    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.318915 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.318889    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.319003 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.318953    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.319065 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.319022    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.319128 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.319109    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-config-out\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.320315 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.320296    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-web-config\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.324968 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.324949    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9h2g\" (UniqueName: \"kubernetes.io/projected/43e18a4a-10e4-4204-b0d9-42b8f0e802a2-kube-api-access-l9h2g\") pod \"alertmanager-main-0\" (UID: \"43e18a4a-10e4-4204-b0d9-42b8f0e802a2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.369956 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.369927    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 18 16:58:58.650876 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.650840    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 16:58:58.653059 ip-10-0-132-41 kubenswrapper[2577]: W0918 16:58:58.653028    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43e18a4a_10e4_4204_b0d9_42b8f0e802a2.slice/crio-ad31a675fa3eb31dd1924c2748436174dab249799bc7ec144e99da4c6b89d67d WatchSource:0}: Error finding container ad31a675fa3eb31dd1924c2748436174dab249799bc7ec144e99da4c6b89d67d: Status 404 returned error can't find the container with id ad31a675fa3eb31dd1924c2748436174dab249799bc7ec144e99da4c6b89d67d
Sep 18 16:58:58.798740 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.798709    2577 generic.go:356] "Generic (PLEG): container finished" podID="43e18a4a-10e4-4204-b0d9-42b8f0e802a2" containerID="6c1e3587404f3db41d97aba59164e2726cbc5207ea6d61846bd9c95600cb4eec" exitCode=0
Sep 18 16:58:58.798910 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.798793    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"43e18a4a-10e4-4204-b0d9-42b8f0e802a2","Type":"ContainerDied","Data":"6c1e3587404f3db41d97aba59164e2726cbc5207ea6d61846bd9c95600cb4eec"}
Sep 18 16:58:58.798910 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:58:58.798863    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"43e18a4a-10e4-4204-b0d9-42b8f0e802a2","Type":"ContainerStarted","Data":"ad31a675fa3eb31dd1924c2748436174dab249799bc7ec144e99da4c6b89d67d"}
Sep 18 16:59:00.492767 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:59:00.492745    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 16:59:00.813105 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:59:00.813019    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"43e18a4a-10e4-4204-b0d9-42b8f0e802a2","Type":"ContainerStarted","Data":"3440a80ea7db5cea6892fd34a306d1206e728f5d1c9d5f1bc975c6bf31ddcdb7"}
Sep 18 16:59:00.813105 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:59:00.813097    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"43e18a4a-10e4-4204-b0d9-42b8f0e802a2","Type":"ContainerStarted","Data":"c1e1c87ed543e358531e59dbd9c33b20f87ee365b0a8dda4738ccf3d1c7eaf5e"}
Sep 18 16:59:00.813292 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:59:00.813127    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"43e18a4a-10e4-4204-b0d9-42b8f0e802a2","Type":"ContainerStarted","Data":"c3755956e9b73264868f4eac49371664aafe19ad9e0a2fc3928cd8cb5e1cccc2"}
Sep 18 16:59:00.813292 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:59:00.813160    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"43e18a4a-10e4-4204-b0d9-42b8f0e802a2","Type":"ContainerStarted","Data":"61f56e1f41f8b4014672d3008ca3860c3677bc7dee826329ab27e803a18f70df"}
Sep 18 16:59:00.813292 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:59:00.813186    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"43e18a4a-10e4-4204-b0d9-42b8f0e802a2","Type":"ContainerStarted","Data":"a2e435176e9495f3bc3a19be1dfc2d6570b161ae0d9bc457babe85fe0447d6c6"}
Sep 18 16:59:01.820800 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:59:01.820763    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"43e18a4a-10e4-4204-b0d9-42b8f0e802a2","Type":"ContainerStarted","Data":"e975a60cf223e5c789100f86b7a4a5fa6e71122b3f12fd3efbaf01d267f8dad6"}
Sep 18 16:59:01.865483 ip-10-0-132-41 kubenswrapper[2577]: I0918 16:59:01.865431    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.8425109370000001 podStartE2EDuration="3.865415064s" totalImagesPullingTime="2.00777566s" totalInitContainerRuntime="15.128467ms" isStatefulPod=false podCreationTimestamp="2026-09-18 16:58:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:59:01.862457765 +0000 UTC m=+614.919747296" watchObservedRunningTime="2026-09-18 16:59:01.865415064 +0000 UTC m=+614.922704591"
Sep 18 17:03:28.075945 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:28.075911    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-5c47bdc49c-bmdrf"]
Sep 18 17:03:28.079236 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:28.079214    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-5c47bdc49c-bmdrf"
Sep 18 17:03:28.083178 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:03:28.083146    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kserve-controller-manager-dockercfg-dsxp5\" is forbidden: User \"system:node:ip-10-0-132-41.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"kserve\": no relationship found between node 'ip-10-0-132-41.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-dsxp5\"" type="*v1.Secret"
Sep 18 17:03:28.083295 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:03:28.083185    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-132-41.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kserve\": no relationship found between node 'ip-10-0-132-41.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Sep 18 17:03:28.083295 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:03:28.083185    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kserve-controller-manager-5c47bdc49c-bmdrf\" is forbidden: User \"system:node:ip-10-0-132-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kserve\": no relationship found between node 'ip-10-0-132-41.ec2.internal' and this object" podUID="08593f06-2e09-4439-af17-aa63cce48397" pod="kserve/kserve-controller-manager-5c47bdc49c-bmdrf"
Sep 18 17:03:28.083295 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:03:28.083203    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-132-41.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kserve\": no relationship found between node 'ip-10-0-132-41.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Sep 18 17:03:28.083295 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:03:28.083227    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kserve-webhook-server-cert\" is forbidden: User \"system:node:ip-10-0-132-41.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"kserve\": no relationship found between node 'ip-10-0-132-41.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" type="*v1.Secret"
Sep 18 17:03:28.102669 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:28.102641    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-5c47bdc49c-bmdrf"]
Sep 18 17:03:28.133336 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:28.133306    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-zgckq"]
Sep 18 17:03:28.136809 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:28.136791    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-zgckq"
Sep 18 17:03:28.139254 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:28.139225    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4x9l\" (UniqueName: \"kubernetes.io/projected/08593f06-2e09-4439-af17-aa63cce48397-kube-api-access-b4x9l\") pod \"kserve-controller-manager-5c47bdc49c-bmdrf\" (UID: \"08593f06-2e09-4439-af17-aa63cce48397\") " pod="kserve/kserve-controller-manager-5c47bdc49c-bmdrf"
Sep 18 17:03:28.139377 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:28.139355    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08593f06-2e09-4439-af17-aa63cce48397-cert\") pod \"kserve-controller-manager-5c47bdc49c-bmdrf\" (UID: \"08593f06-2e09-4439-af17-aa63cce48397\") " pod="kserve/kserve-controller-manager-5c47bdc49c-bmdrf"
Sep 18 17:03:28.144780 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:28.144762    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Sep 18 17:03:28.144877 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:28.144801    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-fkg7n\""
Sep 18 17:03:28.151613 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:28.151590    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-zgckq"]
Sep 18 17:03:28.241235 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:28.241085    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/783f10a3-dbfa-4132-95f4-fefc06c21594-data\") pod \"seaweedfs-64568bcd49-zgckq\" (UID: \"783f10a3-dbfa-4132-95f4-fefc06c21594\") " pod="kserve/seaweedfs-64568bcd49-zgckq"
Sep 18 17:03:28.241427 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:28.241267    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08593f06-2e09-4439-af17-aa63cce48397-cert\") pod \"kserve-controller-manager-5c47bdc49c-bmdrf\" (UID: \"08593f06-2e09-4439-af17-aa63cce48397\") " pod="kserve/kserve-controller-manager-5c47bdc49c-bmdrf"
Sep 18 17:03:28.241427 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:28.241324    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcgkc\" (UniqueName: \"kubernetes.io/projected/783f10a3-dbfa-4132-95f4-fefc06c21594-kube-api-access-xcgkc\") pod \"seaweedfs-64568bcd49-zgckq\" (UID: \"783f10a3-dbfa-4132-95f4-fefc06c21594\") " pod="kserve/seaweedfs-64568bcd49-zgckq"
Sep 18 17:03:28.241427 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:28.241379    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4x9l\" (UniqueName: \"kubernetes.io/projected/08593f06-2e09-4439-af17-aa63cce48397-kube-api-access-b4x9l\") pod \"kserve-controller-manager-5c47bdc49c-bmdrf\" (UID: \"08593f06-2e09-4439-af17-aa63cce48397\") " pod="kserve/kserve-controller-manager-5c47bdc49c-bmdrf"
Sep 18 17:03:28.342934 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:28.342844    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/783f10a3-dbfa-4132-95f4-fefc06c21594-data\") pod \"seaweedfs-64568bcd49-zgckq\" (UID: \"783f10a3-dbfa-4132-95f4-fefc06c21594\") " pod="kserve/seaweedfs-64568bcd49-zgckq"
Sep 18 17:03:28.342934 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:28.342896    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcgkc\" (UniqueName: \"kubernetes.io/projected/783f10a3-dbfa-4132-95f4-fefc06c21594-kube-api-access-xcgkc\") pod \"seaweedfs-64568bcd49-zgckq\" (UID: \"783f10a3-dbfa-4132-95f4-fefc06c21594\") " pod="kserve/seaweedfs-64568bcd49-zgckq"
Sep 18 17:03:28.343259 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:28.343239    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/783f10a3-dbfa-4132-95f4-fefc06c21594-data\") pod \"seaweedfs-64568bcd49-zgckq\" (UID: \"783f10a3-dbfa-4132-95f4-fefc06c21594\") " pod="kserve/seaweedfs-64568bcd49-zgckq"
Sep 18 17:03:28.899910 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:28.899877    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-dsxp5\""
Sep 18 17:03:28.961158 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:28.961128    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Sep 18 17:03:29.242847 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:03:29.242751    2577 secret.go:189] Couldn't get secret kserve/kserve-webhook-server-cert: failed to sync secret cache: timed out waiting for the condition
Sep 18 17:03:29.242847 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:03:29.242839    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08593f06-2e09-4439-af17-aa63cce48397-cert podName:08593f06-2e09-4439-af17-aa63cce48397 nodeName:}" failed. No retries permitted until 2026-09-18 17:03:29.742821023 +0000 UTC m=+882.800110529 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/08593f06-2e09-4439-af17-aa63cce48397-cert") pod "kserve-controller-manager-5c47bdc49c-bmdrf" (UID: "08593f06-2e09-4439-af17-aa63cce48397") : failed to sync secret cache: timed out waiting for the condition
Sep 18 17:03:29.246895 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:29.246863    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\""
Sep 18 17:03:29.251322 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:03:29.251305    2577 projected.go:291] Couldn't get configMap kserve/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition
Sep 18 17:03:29.251397 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:03:29.251336    2577 projected.go:196] Error preparing data for projected volume kube-api-access-b4x9l for pod kserve/kserve-controller-manager-5c47bdc49c-bmdrf: failed to sync configmap cache: timed out waiting for the condition
Sep 18 17:03:29.251397 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:03:29.251387    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/08593f06-2e09-4439-af17-aa63cce48397-kube-api-access-b4x9l podName:08593f06-2e09-4439-af17-aa63cce48397 nodeName:}" failed. No retries permitted until 2026-09-18 17:03:29.75137453 +0000 UTC m=+882.808664037 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-b4x9l" (UniqueName: "kubernetes.io/projected/08593f06-2e09-4439-af17-aa63cce48397-kube-api-access-b4x9l") pod "kserve-controller-manager-5c47bdc49c-bmdrf" (UID: "08593f06-2e09-4439-af17-aa63cce48397") : failed to sync configmap cache: timed out waiting for the condition
Sep 18 17:03:29.351400 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:03:29.351364    2577 projected.go:291] Couldn't get configMap kserve/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition
Sep 18 17:03:29.351400 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:03:29.351404    2577 projected.go:196] Error preparing data for projected volume kube-api-access-xcgkc for pod kserve/seaweedfs-64568bcd49-zgckq: failed to sync configmap cache: timed out waiting for the condition
Sep 18 17:03:29.351720 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:03:29.351468    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/783f10a3-dbfa-4132-95f4-fefc06c21594-kube-api-access-xcgkc podName:783f10a3-dbfa-4132-95f4-fefc06c21594 nodeName:}" failed. No retries permitted until 2026-09-18 17:03:29.851453195 +0000 UTC m=+882.908742702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xcgkc" (UniqueName: "kubernetes.io/projected/783f10a3-dbfa-4132-95f4-fefc06c21594-kube-api-access-xcgkc") pod "seaweedfs-64568bcd49-zgckq" (UID: "783f10a3-dbfa-4132-95f4-fefc06c21594") : failed to sync configmap cache: timed out waiting for the condition
Sep 18 17:03:29.522242 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:29.522166    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Sep 18 17:03:29.756042 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:29.755994    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08593f06-2e09-4439-af17-aa63cce48397-cert\") pod \"kserve-controller-manager-5c47bdc49c-bmdrf\" (UID: \"08593f06-2e09-4439-af17-aa63cce48397\") " pod="kserve/kserve-controller-manager-5c47bdc49c-bmdrf"
Sep 18 17:03:29.756230 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:29.756076    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4x9l\" (UniqueName: \"kubernetes.io/projected/08593f06-2e09-4439-af17-aa63cce48397-kube-api-access-b4x9l\") pod \"kserve-controller-manager-5c47bdc49c-bmdrf\" (UID: \"08593f06-2e09-4439-af17-aa63cce48397\") " pod="kserve/kserve-controller-manager-5c47bdc49c-bmdrf"
Sep 18 17:03:29.758524 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:29.758490    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08593f06-2e09-4439-af17-aa63cce48397-cert\") pod \"kserve-controller-manager-5c47bdc49c-bmdrf\" (UID: \"08593f06-2e09-4439-af17-aa63cce48397\") " pod="kserve/kserve-controller-manager-5c47bdc49c-bmdrf"
Sep 18 17:03:29.758670 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:29.758647    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4x9l\" (UniqueName: \"kubernetes.io/projected/08593f06-2e09-4439-af17-aa63cce48397-kube-api-access-b4x9l\") pod \"kserve-controller-manager-5c47bdc49c-bmdrf\" (UID: \"08593f06-2e09-4439-af17-aa63cce48397\") " pod="kserve/kserve-controller-manager-5c47bdc49c-bmdrf"
Sep 18 17:03:29.857443 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:29.857410    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcgkc\" (UniqueName: \"kubernetes.io/projected/783f10a3-dbfa-4132-95f4-fefc06c21594-kube-api-access-xcgkc\") pod \"seaweedfs-64568bcd49-zgckq\" (UID: \"783f10a3-dbfa-4132-95f4-fefc06c21594\") " pod="kserve/seaweedfs-64568bcd49-zgckq"
Sep 18 17:03:29.859923 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:29.859899    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcgkc\" (UniqueName: \"kubernetes.io/projected/783f10a3-dbfa-4132-95f4-fefc06c21594-kube-api-access-xcgkc\") pod \"seaweedfs-64568bcd49-zgckq\" (UID: \"783f10a3-dbfa-4132-95f4-fefc06c21594\") " pod="kserve/seaweedfs-64568bcd49-zgckq"
Sep 18 17:03:29.914980 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:29.914947    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-5c47bdc49c-bmdrf"
Sep 18 17:03:29.946408 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:29.946365    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-zgckq"
Sep 18 17:03:30.186568 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:30.186517    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-5c47bdc49c-bmdrf"]
Sep 18 17:03:30.188757 ip-10-0-132-41 kubenswrapper[2577]: W0918 17:03:30.188733    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08593f06_2e09_4439_af17_aa63cce48397.slice/crio-71a1d2644f6c7c3f506c7eac566d20b4e7bb28ccd254dfa84fc3d29a7288fcb3 WatchSource:0}: Error finding container 71a1d2644f6c7c3f506c7eac566d20b4e7bb28ccd254dfa84fc3d29a7288fcb3: Status 404 returned error can't find the container with id 71a1d2644f6c7c3f506c7eac566d20b4e7bb28ccd254dfa84fc3d29a7288fcb3
Sep 18 17:03:30.226446 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:30.226421    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-zgckq"]
Sep 18 17:03:30.229067 ip-10-0-132-41 kubenswrapper[2577]: W0918 17:03:30.229040    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod783f10a3_dbfa_4132_95f4_fefc06c21594.slice/crio-7f69566b4580d7808e03b496a5b132d9253655065d51fe3f0e1582bcecc32e08 WatchSource:0}: Error finding container 7f69566b4580d7808e03b496a5b132d9253655065d51fe3f0e1582bcecc32e08: Status 404 returned error can't find the container with id 7f69566b4580d7808e03b496a5b132d9253655065d51fe3f0e1582bcecc32e08
Sep 18 17:03:31.046699 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:31.046622    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-zgckq" event={"ID":"783f10a3-dbfa-4132-95f4-fefc06c21594","Type":"ContainerStarted","Data":"7f69566b4580d7808e03b496a5b132d9253655065d51fe3f0e1582bcecc32e08"}
Sep 18 17:03:31.050298 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:31.050207    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-5c47bdc49c-bmdrf" event={"ID":"08593f06-2e09-4439-af17-aa63cce48397","Type":"ContainerStarted","Data":"71a1d2644f6c7c3f506c7eac566d20b4e7bb28ccd254dfa84fc3d29a7288fcb3"}
Sep 18 17:03:34.067675 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:34.067642    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-zgckq" event={"ID":"783f10a3-dbfa-4132-95f4-fefc06c21594","Type":"ContainerStarted","Data":"af6f420cffdf7fc43aebd639f2190971605288f80e494937ba2b64a38d2d5a82"}
Sep 18 17:03:34.068147 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:34.067755    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-zgckq"
Sep 18 17:03:34.069348 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:34.069323    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-5c47bdc49c-bmdrf" event={"ID":"08593f06-2e09-4439-af17-aa63cce48397","Type":"ContainerStarted","Data":"c21381621e90c748ddb9470e01867daec50580f4abeb95085e714138eec916f7"}
Sep 18 17:03:34.069480 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:34.069380    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-5c47bdc49c-bmdrf"
Sep 18 17:03:34.087183 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:34.087120    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-zgckq" podStartSLOduration=2.347662892 podStartE2EDuration="6.087099858s" totalImagesPullingTime="3.739436966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:03:34.085745251 +0000 UTC m=+887.143034780" watchObservedRunningTime="2026-09-18 17:03:34.087099858 +0000 UTC m=+887.144389387"
Sep 18 17:03:34.104135 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:34.104088    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-5c47bdc49c-bmdrf" podStartSLOduration=2.416822611 podStartE2EDuration="6.104072493s" totalImagesPullingTime="3.687249882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:03:34.102105238 +0000 UTC m=+887.159394765" watchObservedRunningTime="2026-09-18 17:03:34.104072493 +0000 UTC m=+887.161362021"
Sep 18 17:03:40.075476 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:40.075444    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-zgckq"
Sep 18 17:03:49.076355 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:49.076323    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-t4p6q_60bae8ea-9599-47f8-b066-df7c46c011b3/console-operator/1.log"
Sep 18 17:03:49.076844 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:49.076822    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-t4p6q_60bae8ea-9599-47f8-b066-df7c46c011b3/console-operator/1.log"
Sep 18 17:03:49.083692 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:49.083670    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktklw_3c1064f0-18a0-4c28-8fb9-a320535dcbbf/ovn-acl-logging/0.log"
Sep 18 17:03:49.083692 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:03:49.083689    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktklw_3c1064f0-18a0-4c28-8fb9-a320535dcbbf/ovn-acl-logging/0.log"
Sep 18 17:04:05.078821 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:05.078784    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-5c47bdc49c-bmdrf"
Sep 18 17:04:11.642311 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:11.642272    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-5c47bdc49c-bmdrf"]
Sep 18 17:04:11.642753 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:11.642474    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/kserve-controller-manager-5c47bdc49c-bmdrf" podUID="08593f06-2e09-4439-af17-aa63cce48397" containerName="manager" containerID="cri-o://c21381621e90c748ddb9470e01867daec50580f4abeb95085e714138eec916f7" gracePeriod=10
Sep 18 17:04:11.688545 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:11.688498    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-5c47bdc49c-6q6nz"]
Sep 18 17:04:11.691428 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:11.691410    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-5c47bdc49c-6q6nz"
Sep 18 17:04:11.702763 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:11.702737    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-5c47bdc49c-6q6nz"]
Sep 18 17:04:11.729657 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:11.729626    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1229258a-a5c8-4531-b801-8fcd53cdb578-cert\") pod \"kserve-controller-manager-5c47bdc49c-6q6nz\" (UID: \"1229258a-a5c8-4531-b801-8fcd53cdb578\") " pod="kserve/kserve-controller-manager-5c47bdc49c-6q6nz"
Sep 18 17:04:11.729657 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:11.729661    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6crg\" (UniqueName: \"kubernetes.io/projected/1229258a-a5c8-4531-b801-8fcd53cdb578-kube-api-access-s6crg\") pod \"kserve-controller-manager-5c47bdc49c-6q6nz\" (UID: \"1229258a-a5c8-4531-b801-8fcd53cdb578\") " pod="kserve/kserve-controller-manager-5c47bdc49c-6q6nz"
Sep 18 17:04:11.830210 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:11.830178    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1229258a-a5c8-4531-b801-8fcd53cdb578-cert\") pod \"kserve-controller-manager-5c47bdc49c-6q6nz\" (UID: \"1229258a-a5c8-4531-b801-8fcd53cdb578\") " pod="kserve/kserve-controller-manager-5c47bdc49c-6q6nz"
Sep 18 17:04:11.830384 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:11.830217    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6crg\" (UniqueName: \"kubernetes.io/projected/1229258a-a5c8-4531-b801-8fcd53cdb578-kube-api-access-s6crg\") pod \"kserve-controller-manager-5c47bdc49c-6q6nz\" (UID: \"1229258a-a5c8-4531-b801-8fcd53cdb578\") " pod="kserve/kserve-controller-manager-5c47bdc49c-6q6nz"
Sep 18 17:04:11.832729 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:11.832696    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1229258a-a5c8-4531-b801-8fcd53cdb578-cert\") pod \"kserve-controller-manager-5c47bdc49c-6q6nz\" (UID: \"1229258a-a5c8-4531-b801-8fcd53cdb578\") " pod="kserve/kserve-controller-manager-5c47bdc49c-6q6nz"
Sep 18 17:04:11.838828 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:11.838803    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6crg\" (UniqueName: \"kubernetes.io/projected/1229258a-a5c8-4531-b801-8fcd53cdb578-kube-api-access-s6crg\") pod \"kserve-controller-manager-5c47bdc49c-6q6nz\" (UID: \"1229258a-a5c8-4531-b801-8fcd53cdb578\") " pod="kserve/kserve-controller-manager-5c47bdc49c-6q6nz"
Sep 18 17:04:11.889781 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:11.889754    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-5c47bdc49c-bmdrf"
Sep 18 17:04:11.931485 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:11.931407    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08593f06-2e09-4439-af17-aa63cce48397-cert\") pod \"08593f06-2e09-4439-af17-aa63cce48397\" (UID: \"08593f06-2e09-4439-af17-aa63cce48397\") "
Sep 18 17:04:11.931485 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:11.931455    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4x9l\" (UniqueName: \"kubernetes.io/projected/08593f06-2e09-4439-af17-aa63cce48397-kube-api-access-b4x9l\") pod \"08593f06-2e09-4439-af17-aa63cce48397\" (UID: \"08593f06-2e09-4439-af17-aa63cce48397\") "
Sep 18 17:04:11.933676 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:11.933650    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08593f06-2e09-4439-af17-aa63cce48397-cert" (OuterVolumeSpecName: "cert") pod "08593f06-2e09-4439-af17-aa63cce48397" (UID: "08593f06-2e09-4439-af17-aa63cce48397"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:04:11.933786 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:11.933709    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08593f06-2e09-4439-af17-aa63cce48397-kube-api-access-b4x9l" (OuterVolumeSpecName: "kube-api-access-b4x9l") pod "08593f06-2e09-4439-af17-aa63cce48397" (UID: "08593f06-2e09-4439-af17-aa63cce48397"). InnerVolumeSpecName "kube-api-access-b4x9l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:04:12.019626 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:12.019589    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-5c47bdc49c-6q6nz"
Sep 18 17:04:12.032757 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:12.032737    2577 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08593f06-2e09-4439-af17-aa63cce48397-cert\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:04:12.032835 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:12.032760    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4x9l\" (UniqueName: \"kubernetes.io/projected/08593f06-2e09-4439-af17-aa63cce48397-kube-api-access-b4x9l\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:04:12.247014 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:12.246924    2577 generic.go:356] "Generic (PLEG): container finished" podID="08593f06-2e09-4439-af17-aa63cce48397" containerID="c21381621e90c748ddb9470e01867daec50580f4abeb95085e714138eec916f7" exitCode=0
Sep 18 17:04:12.247014 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:12.246979    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-5c47bdc49c-bmdrf"
Sep 18 17:04:12.247189 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:12.247011    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-5c47bdc49c-bmdrf" event={"ID":"08593f06-2e09-4439-af17-aa63cce48397","Type":"ContainerDied","Data":"c21381621e90c748ddb9470e01867daec50580f4abeb95085e714138eec916f7"}
Sep 18 17:04:12.247189 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:12.247068    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-5c47bdc49c-bmdrf" event={"ID":"08593f06-2e09-4439-af17-aa63cce48397","Type":"ContainerDied","Data":"71a1d2644f6c7c3f506c7eac566d20b4e7bb28ccd254dfa84fc3d29a7288fcb3"}
Sep 18 17:04:12.247189 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:12.247092    2577 scope.go:117] "RemoveContainer" containerID="c21381621e90c748ddb9470e01867daec50580f4abeb95085e714138eec916f7"
Sep 18 17:04:12.256097 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:12.256080    2577 scope.go:117] "RemoveContainer" containerID="c21381621e90c748ddb9470e01867daec50580f4abeb95085e714138eec916f7"
Sep 18 17:04:12.256377 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:04:12.256358    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c21381621e90c748ddb9470e01867daec50580f4abeb95085e714138eec916f7\": container with ID starting with c21381621e90c748ddb9470e01867daec50580f4abeb95085e714138eec916f7 not found: ID does not exist" containerID="c21381621e90c748ddb9470e01867daec50580f4abeb95085e714138eec916f7"
Sep 18 17:04:12.256451 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:12.256383    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c21381621e90c748ddb9470e01867daec50580f4abeb95085e714138eec916f7"} err="failed to get container status \"c21381621e90c748ddb9470e01867daec50580f4abeb95085e714138eec916f7\": rpc error: code = NotFound desc = could not find container \"c21381621e90c748ddb9470e01867daec50580f4abeb95085e714138eec916f7\": container with ID starting with c21381621e90c748ddb9470e01867daec50580f4abeb95085e714138eec916f7 not found: ID does not exist"
Sep 18 17:04:12.270008 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:12.269981    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-5c47bdc49c-bmdrf"]
Sep 18 17:04:12.273802 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:12.273780    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-5c47bdc49c-bmdrf"]
Sep 18 17:04:12.289707 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:12.289685    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-5c47bdc49c-6q6nz"]
Sep 18 17:04:12.292487 ip-10-0-132-41 kubenswrapper[2577]: W0918 17:04:12.292462    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1229258a_a5c8_4531_b801_8fcd53cdb578.slice/crio-aeec318f00cc5db8f36985afabb9eeb4f2e84e3c5df061ca9c925f5547192677 WatchSource:0}: Error finding container aeec318f00cc5db8f36985afabb9eeb4f2e84e3c5df061ca9c925f5547192677: Status 404 returned error can't find the container with id aeec318f00cc5db8f36985afabb9eeb4f2e84e3c5df061ca9c925f5547192677
Sep 18 17:04:12.293877 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:12.293860    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 17:04:13.123351 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:13.123314    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08593f06-2e09-4439-af17-aa63cce48397" path="/var/lib/kubelet/pods/08593f06-2e09-4439-af17-aa63cce48397/volumes"
Sep 18 17:04:13.254475 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:13.254442    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-5c47bdc49c-6q6nz" event={"ID":"1229258a-a5c8-4531-b801-8fcd53cdb578","Type":"ContainerStarted","Data":"e01d80348eda61a0dbfd17c9adfb66245ff611ec3a9374478b8d7665a332625f"}
Sep 18 17:04:13.254689 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:13.254493    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-5c47bdc49c-6q6nz" event={"ID":"1229258a-a5c8-4531-b801-8fcd53cdb578","Type":"ContainerStarted","Data":"aeec318f00cc5db8f36985afabb9eeb4f2e84e3c5df061ca9c925f5547192677"}
Sep 18 17:04:13.254689 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:13.254586    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-5c47bdc49c-6q6nz"
Sep 18 17:04:13.271849 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:13.271798    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-5c47bdc49c-6q6nz" podStartSLOduration=1.970473468 podStartE2EDuration="2.271781265s" totalImagesPullingTime="301.307797ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:04:13.270560689 +0000 UTC m=+926.327850230" watchObservedRunningTime="2026-09-18 17:04:13.271781265 +0000 UTC m=+926.329070834"
Sep 18 17:04:44.262567 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:44.262521    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-5c47bdc49c-6q6nz"
Sep 18 17:04:45.548362 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:45.548327    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-7b954ffc95-kwdkh"]
Sep 18 17:04:45.548954 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:45.548928    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08593f06-2e09-4439-af17-aa63cce48397" containerName="manager"
Sep 18 17:04:45.549043 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:45.548956    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="08593f06-2e09-4439-af17-aa63cce48397" containerName="manager"
Sep 18 17:04:45.549099 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:45.549060    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="08593f06-2e09-4439-af17-aa63cce48397" containerName="manager"
Sep 18 17:04:45.551238 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:45.551214    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-kwdkh"
Sep 18 17:04:45.556464 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:45.556429    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\""
Sep 18 17:04:45.556809 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:45.556784    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-t64cw\""
Sep 18 17:04:45.578049 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:45.578003    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-kwdkh"]
Sep 18 17:04:45.728837 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:45.728805    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26a3f8bb-ddd8-4599-be7f-f4bf0f6b0148-tls-certs\") pod \"model-serving-api-7b954ffc95-kwdkh\" (UID: \"26a3f8bb-ddd8-4599-be7f-f4bf0f6b0148\") " pod="kserve/model-serving-api-7b954ffc95-kwdkh"
Sep 18 17:04:45.729005 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:45.728845    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnlsq\" (UniqueName: \"kubernetes.io/projected/26a3f8bb-ddd8-4599-be7f-f4bf0f6b0148-kube-api-access-dnlsq\") pod \"model-serving-api-7b954ffc95-kwdkh\" (UID: \"26a3f8bb-ddd8-4599-be7f-f4bf0f6b0148\") " pod="kserve/model-serving-api-7b954ffc95-kwdkh"
Sep 18 17:04:45.829757 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:45.829677    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26a3f8bb-ddd8-4599-be7f-f4bf0f6b0148-tls-certs\") pod \"model-serving-api-7b954ffc95-kwdkh\" (UID: \"26a3f8bb-ddd8-4599-be7f-f4bf0f6b0148\") " pod="kserve/model-serving-api-7b954ffc95-kwdkh"
Sep 18 17:04:45.829757 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:45.829720    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnlsq\" (UniqueName: \"kubernetes.io/projected/26a3f8bb-ddd8-4599-be7f-f4bf0f6b0148-kube-api-access-dnlsq\") pod \"model-serving-api-7b954ffc95-kwdkh\" (UID: \"26a3f8bb-ddd8-4599-be7f-f4bf0f6b0148\") " pod="kserve/model-serving-api-7b954ffc95-kwdkh"
Sep 18 17:04:45.832273 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:45.832242    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26a3f8bb-ddd8-4599-be7f-f4bf0f6b0148-tls-certs\") pod \"model-serving-api-7b954ffc95-kwdkh\" (UID: \"26a3f8bb-ddd8-4599-be7f-f4bf0f6b0148\") " pod="kserve/model-serving-api-7b954ffc95-kwdkh"
Sep 18 17:04:45.840471 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:45.840440    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnlsq\" (UniqueName: \"kubernetes.io/projected/26a3f8bb-ddd8-4599-be7f-f4bf0f6b0148-kube-api-access-dnlsq\") pod \"model-serving-api-7b954ffc95-kwdkh\" (UID: \"26a3f8bb-ddd8-4599-be7f-f4bf0f6b0148\") " pod="kserve/model-serving-api-7b954ffc95-kwdkh"
Sep 18 17:04:45.865352 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:45.865319    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-kwdkh"
Sep 18 17:04:46.153197 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:46.153154    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-kwdkh"]
Sep 18 17:04:46.154747 ip-10-0-132-41 kubenswrapper[2577]: W0918 17:04:46.154713    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26a3f8bb_ddd8_4599_be7f_f4bf0f6b0148.slice/crio-8e6cee972ffba38a4c71ba459c327a60ea461b4019f4653c00b3db3e42acdcd6 WatchSource:0}: Error finding container 8e6cee972ffba38a4c71ba459c327a60ea461b4019f4653c00b3db3e42acdcd6: Status 404 returned error can't find the container with id 8e6cee972ffba38a4c71ba459c327a60ea461b4019f4653c00b3db3e42acdcd6
Sep 18 17:04:46.419071 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:46.418979    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-kwdkh" event={"ID":"26a3f8bb-ddd8-4599-be7f-f4bf0f6b0148","Type":"ContainerStarted","Data":"8e6cee972ffba38a4c71ba459c327a60ea461b4019f4653c00b3db3e42acdcd6"}
Sep 18 17:04:49.437194 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:49.437151    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-kwdkh" event={"ID":"26a3f8bb-ddd8-4599-be7f-f4bf0f6b0148","Type":"ContainerStarted","Data":"49acd2a1770dcaa279783d2d69958a0b2cd1ae475eaa66f860d8580d89e53034"}
Sep 18 17:04:49.437701 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:49.437287    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-7b954ffc95-kwdkh"
Sep 18 17:04:49.463133 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:04:49.463080    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-7b954ffc95-kwdkh" podStartSLOduration=2.127354315 podStartE2EDuration="4.463064036s" totalImagesPullingTime="2.335709721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:04:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:04:49.461111916 +0000 UTC m=+962.518401442" watchObservedRunningTime="2026-09-18 17:04:49.463064036 +0000 UTC m=+962.520353564"
Sep 18 17:05:00.446504 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:05:00.446423    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-7b954ffc95-kwdkh"
Sep 18 17:06:32.694252 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.694166    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6"]
Sep 18 17:06:32.697769 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.697746    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6"
Sep 18 17:06:32.700309 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.700285    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Sep 18 17:06:32.700424 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.700316    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\""
Sep 18 17:06:32.700424 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.700316    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Sep 18 17:06:32.700675 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.700656    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Sep 18 17:06:32.700758 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.700677    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-97cfm\""
Sep 18 17:06:32.700758 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.700684    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 18 17:06:32.700758 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.700737    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-predictor-serving-cert\""
Sep 18 17:06:32.711852 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.711826    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6"]
Sep 18 17:06:32.757103 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.757070    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4d8p\" (UniqueName: \"kubernetes.io/projected/2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1-kube-api-access-z4d8p\") pod \"isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6\" (UID: \"2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6"
Sep 18 17:06:32.757267 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.757123    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6\" (UID: \"2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6"
Sep 18 17:06:32.757267 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.757152    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6\" (UID: \"2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6"
Sep 18 17:06:32.757267 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.757177    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6\" (UID: \"2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6"
Sep 18 17:06:32.757267 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.757222    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6\" (UID: \"2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6"
Sep 18 17:06:32.824505 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.824469    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h"]
Sep 18 17:06:32.827674 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.827650    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h"
Sep 18 17:06:32.831584 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.831556    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-a4cbd-kube-rbac-proxy-sar-config\""
Sep 18 17:06:32.831852 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.831836    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-a4cbd-predictor-serving-cert\""
Sep 18 17:06:32.858372 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.858345    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6\" (UID: \"2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6"
Sep 18 17:06:32.858564 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.858389    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6\" (UID: \"2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6"
Sep 18 17:06:32.858564 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.858445    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4d8p\" (UniqueName: \"kubernetes.io/projected/2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1-kube-api-access-z4d8p\") pod \"isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6\" (UID: \"2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6"
Sep 18 17:06:32.858564 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.858464    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6g8d\" (UniqueName: \"kubernetes.io/projected/118cb984-b1e6-4cc5-aa53-755b241ff683-kube-api-access-r6g8d\") pod \"success-200-isvc-a4cbd-predictor-68d958b656-ld56h\" (UID: \"118cb984-b1e6-4cc5-aa53-755b241ff683\") " pod="kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h"
Sep 18 17:06:32.858564 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.858489    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/118cb984-b1e6-4cc5-aa53-755b241ff683-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-a4cbd-predictor-68d958b656-ld56h\" (UID: \"118cb984-b1e6-4cc5-aa53-755b241ff683\") " pod="kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h"
Sep 18 17:06:32.858778 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.858564    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6\" (UID: \"2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6"
Sep 18 17:06:32.858778 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.858614    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/118cb984-b1e6-4cc5-aa53-755b241ff683-proxy-tls\") pod \"success-200-isvc-a4cbd-predictor-68d958b656-ld56h\" (UID: \"118cb984-b1e6-4cc5-aa53-755b241ff683\") " pod="kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h"
Sep 18 17:06:32.858778 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.858648    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6\" (UID: \"2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6"
Sep 18 17:06:32.858968 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.858785    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6\" (UID: \"2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6"
Sep 18 17:06:32.859260 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.859238    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6\" (UID: \"2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6"
Sep 18 17:06:32.859341 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.859325    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6\" (UID: \"2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6"
Sep 18 17:06:32.861022 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.861006    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6\" (UID: \"2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6"
Sep 18 17:06:32.874358 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.874323    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4d8p\" (UniqueName: \"kubernetes.io/projected/2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1-kube-api-access-z4d8p\") pod \"isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6\" (UID: \"2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6"
Sep 18 17:06:32.886658 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.886622    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h"]
Sep 18 17:06:32.960063 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.959968    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6g8d\" (UniqueName: \"kubernetes.io/projected/118cb984-b1e6-4cc5-aa53-755b241ff683-kube-api-access-r6g8d\") pod \"success-200-isvc-a4cbd-predictor-68d958b656-ld56h\" (UID: \"118cb984-b1e6-4cc5-aa53-755b241ff683\") " pod="kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h"
Sep 18 17:06:32.960063 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.960026    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/118cb984-b1e6-4cc5-aa53-755b241ff683-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-a4cbd-predictor-68d958b656-ld56h\" (UID: \"118cb984-b1e6-4cc5-aa53-755b241ff683\") " pod="kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h"
Sep 18 17:06:32.960290 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.960081    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/118cb984-b1e6-4cc5-aa53-755b241ff683-proxy-tls\") pod \"success-200-isvc-a4cbd-predictor-68d958b656-ld56h\" (UID: \"118cb984-b1e6-4cc5-aa53-755b241ff683\") " pod="kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h"
Sep 18 17:06:32.960290 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:06:32.960189    2577 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-serving-cert: secret "success-200-isvc-a4cbd-predictor-serving-cert" not found
Sep 18 17:06:32.960290 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:06:32.960254    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/118cb984-b1e6-4cc5-aa53-755b241ff683-proxy-tls podName:118cb984-b1e6-4cc5-aa53-755b241ff683 nodeName:}" failed. No retries permitted until 2026-09-18 17:06:33.460235794 +0000 UTC m=+1066.517525316 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/118cb984-b1e6-4cc5-aa53-755b241ff683-proxy-tls") pod "success-200-isvc-a4cbd-predictor-68d958b656-ld56h" (UID: "118cb984-b1e6-4cc5-aa53-755b241ff683") : secret "success-200-isvc-a4cbd-predictor-serving-cert" not found
Sep 18 17:06:32.960783 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.960762    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/118cb984-b1e6-4cc5-aa53-755b241ff683-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-a4cbd-predictor-68d958b656-ld56h\" (UID: \"118cb984-b1e6-4cc5-aa53-755b241ff683\") " pod="kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h"
Sep 18 17:06:32.974952 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:32.974920    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6g8d\" (UniqueName: \"kubernetes.io/projected/118cb984-b1e6-4cc5-aa53-755b241ff683-kube-api-access-r6g8d\") pod \"success-200-isvc-a4cbd-predictor-68d958b656-ld56h\" (UID: \"118cb984-b1e6-4cc5-aa53-755b241ff683\") " pod="kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h"
Sep 18 17:06:33.008776 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:33.008742    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6"
Sep 18 17:06:33.295428 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:33.295360    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6"]
Sep 18 17:06:33.298949 ip-10-0-132-41 kubenswrapper[2577]: W0918 17:06:33.298916    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c3fccdf_e8bb_4978_bdfc_b39b5b4a01a1.slice/crio-5ba08c212734e0829ff2b3a3ef6de248806012b989a2c0db5570b2c7f53122ca WatchSource:0}: Error finding container 5ba08c212734e0829ff2b3a3ef6de248806012b989a2c0db5570b2c7f53122ca: Status 404 returned error can't find the container with id 5ba08c212734e0829ff2b3a3ef6de248806012b989a2c0db5570b2c7f53122ca
Sep 18 17:06:33.466166 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:33.466128    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/118cb984-b1e6-4cc5-aa53-755b241ff683-proxy-tls\") pod \"success-200-isvc-a4cbd-predictor-68d958b656-ld56h\" (UID: \"118cb984-b1e6-4cc5-aa53-755b241ff683\") " pod="kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h"
Sep 18 17:06:33.466359 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:06:33.466280    2577 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-serving-cert: secret "success-200-isvc-a4cbd-predictor-serving-cert" not found
Sep 18 17:06:33.466359 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:06:33.466352    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/118cb984-b1e6-4cc5-aa53-755b241ff683-proxy-tls podName:118cb984-b1e6-4cc5-aa53-755b241ff683 nodeName:}" failed. No retries permitted until 2026-09-18 17:06:34.466334446 +0000 UTC m=+1067.523623953 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/118cb984-b1e6-4cc5-aa53-755b241ff683-proxy-tls") pod "success-200-isvc-a4cbd-predictor-68d958b656-ld56h" (UID: "118cb984-b1e6-4cc5-aa53-755b241ff683") : secret "success-200-isvc-a4cbd-predictor-serving-cert" not found
Sep 18 17:06:33.942849 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:33.942804    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6" event={"ID":"2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1","Type":"ContainerStarted","Data":"5ba08c212734e0829ff2b3a3ef6de248806012b989a2c0db5570b2c7f53122ca"}
Sep 18 17:06:34.476242 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:34.476198    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/118cb984-b1e6-4cc5-aa53-755b241ff683-proxy-tls\") pod \"success-200-isvc-a4cbd-predictor-68d958b656-ld56h\" (UID: \"118cb984-b1e6-4cc5-aa53-755b241ff683\") " pod="kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h"
Sep 18 17:06:34.479309 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:34.479283    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/118cb984-b1e6-4cc5-aa53-755b241ff683-proxy-tls\") pod \"success-200-isvc-a4cbd-predictor-68d958b656-ld56h\" (UID: \"118cb984-b1e6-4cc5-aa53-755b241ff683\") " pod="kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h"
Sep 18 17:06:34.638574 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:34.638520    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h"
Sep 18 17:06:34.924987 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:34.924960    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h"]
Sep 18 17:06:34.927583 ip-10-0-132-41 kubenswrapper[2577]: W0918 17:06:34.927556    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod118cb984_b1e6_4cc5_aa53_755b241ff683.slice/crio-04601ec854fc0b4694879233050f7ef6b263da4e141c21bd4b7ba37f209a7de9 WatchSource:0}: Error finding container 04601ec854fc0b4694879233050f7ef6b263da4e141c21bd4b7ba37f209a7de9: Status 404 returned error can't find the container with id 04601ec854fc0b4694879233050f7ef6b263da4e141c21bd4b7ba37f209a7de9
Sep 18 17:06:34.948147 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:34.948111    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h" event={"ID":"118cb984-b1e6-4cc5-aa53-755b241ff683","Type":"ContainerStarted","Data":"04601ec854fc0b4694879233050f7ef6b263da4e141c21bd4b7ba37f209a7de9"}
Sep 18 17:06:36.968850 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:36.968762    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6" event={"ID":"2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1","Type":"ContainerStarted","Data":"0e2fa3fa8ef6f62311c8545025a6fc975db1be10dede3b91b5e1149d6a0e142b"}
Sep 18 17:06:42.002005 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:42.001969    2577 generic.go:356] "Generic (PLEG): container finished" podID="2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1" containerID="0e2fa3fa8ef6f62311c8545025a6fc975db1be10dede3b91b5e1149d6a0e142b" exitCode=0
Sep 18 17:06:42.002363 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:42.002015    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6" event={"ID":"2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1","Type":"ContainerDied","Data":"0e2fa3fa8ef6f62311c8545025a6fc975db1be10dede3b91b5e1149d6a0e142b"}
Sep 18 17:06:54.078818 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:54.078719    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6" event={"ID":"2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1","Type":"ContainerStarted","Data":"0650d37f936f0e48e03814a6e78d27222078c138ef21f87d2b9fd341bc7738c0"}
Sep 18 17:06:54.080270 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:54.080246    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h" event={"ID":"118cb984-b1e6-4cc5-aa53-755b241ff683","Type":"ContainerStarted","Data":"3a9a84d845f1af4c7e45d6b1a9f00d3ddecd4d455a09a01f057bce7c72565941"}
Sep 18 17:06:57.105840 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:57.105799    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6" event={"ID":"2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1","Type":"ContainerStarted","Data":"73c4ba83dc1073b1887c358cf708ff6d08f371ddbb52f1a79d2a08f59ac267f5"}
Sep 18 17:06:57.106454 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:57.105883    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6"
Sep 18 17:06:57.106454 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:57.105919    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6"
Sep 18 17:06:57.107278 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:57.107082    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6" podUID="2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused"
Sep 18 17:06:57.108604 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:57.108577    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h" event={"ID":"118cb984-b1e6-4cc5-aa53-755b241ff683","Type":"ContainerStarted","Data":"6895d8a219ae6dbdf27342507c829cd8e998e28f6c6d2e77b8aab4c47b89df9a"}
Sep 18 17:06:57.108862 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:57.108838    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h"
Sep 18 17:06:57.109103 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:57.108901    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h"
Sep 18 17:06:57.109842 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:57.109817    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h" podUID="118cb984-b1e6-4cc5-aa53-755b241ff683" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Sep 18 17:06:57.132115 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:57.132060    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6" podStartSLOduration=3.515927276 podStartE2EDuration="25.1320448s" totalImagesPullingTime="17.538576189s" totalInitContainerRuntime="4.077541335s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:06:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:06:57.130190627 +0000 UTC m=+1090.187480197" watchObservedRunningTime="2026-09-18 17:06:57.1320448 +0000 UTC m=+1090.189334394"
Sep 18 17:06:57.151942 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:57.151885    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h" podStartSLOduration=3.877286205 podStartE2EDuration="25.151869085s" totalImagesPullingTime="21.27458288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:06:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:06:57.149936623 +0000 UTC m=+1090.207226163" watchObservedRunningTime="2026-09-18 17:06:57.151869085 +0000 UTC m=+1090.209158612"
Sep 18 17:06:58.113837 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:58.113796    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6" podUID="2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused"
Sep 18 17:06:58.114247 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:06:58.113797    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h" podUID="118cb984-b1e6-4cc5-aa53-755b241ff683" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Sep 18 17:07:03.122833 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:07:03.122801    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6"
Sep 18 17:07:03.123270 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:07:03.122893    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h"
Sep 18 17:07:03.123456 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:07:03.123432    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h" podUID="118cb984-b1e6-4cc5-aa53-755b241ff683" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Sep 18 17:07:03.123706 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:07:03.123682    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6" podUID="2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused"
Sep 18 17:07:13.124434 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:07:13.124400    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6" podUID="2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused"
Sep 18 17:07:13.124831 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:07:13.124400    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h" podUID="118cb984-b1e6-4cc5-aa53-755b241ff683" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Sep 18 17:07:23.124022 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:07:23.123978    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6" podUID="2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused"
Sep 18 17:07:23.124404 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:07:23.123978    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h" podUID="118cb984-b1e6-4cc5-aa53-755b241ff683" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Sep 18 17:07:33.124345 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:07:33.124308    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6" podUID="2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused"
Sep 18 17:07:33.124839 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:07:33.124311    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h" podUID="118cb984-b1e6-4cc5-aa53-755b241ff683" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Sep 18 17:07:43.123985 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:07:43.123940    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6" podUID="2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused"
Sep 18 17:07:43.123985 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:07:43.123959    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h" podUID="118cb984-b1e6-4cc5-aa53-755b241ff683" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Sep 18 17:07:53.123791 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:07:53.123745    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6" podUID="2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused"
Sep 18 17:07:53.124477 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:07:53.124458    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h"
Sep 18 17:08:03.124069 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:03.123982    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6" podUID="2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused"
Sep 18 17:08:12.638929 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:12.638893    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-a4cbd-58b99b6759-jv64t"]
Sep 18 17:08:12.642752 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:12.642730    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-a4cbd-58b99b6759-jv64t"
Sep 18 17:08:12.645953 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:12.645929    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-a4cbd-serving-cert\""
Sep 18 17:08:12.646181 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:12.646167    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-a4cbd-kube-rbac-proxy-sar-config\""
Sep 18 17:08:12.653250 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:12.653227    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-a4cbd-58b99b6759-jv64t"]
Sep 18 17:08:12.694716 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:12.694682    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a288cb1a-6b37-45ae-bcd1-221c0c86a113-proxy-tls\") pod \"switch-graph-a4cbd-58b99b6759-jv64t\" (UID: \"a288cb1a-6b37-45ae-bcd1-221c0c86a113\") " pod="kserve-ci-e2e-test/switch-graph-a4cbd-58b99b6759-jv64t"
Sep 18 17:08:12.694871 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:12.694745    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a288cb1a-6b37-45ae-bcd1-221c0c86a113-openshift-service-ca-bundle\") pod \"switch-graph-a4cbd-58b99b6759-jv64t\" (UID: \"a288cb1a-6b37-45ae-bcd1-221c0c86a113\") " pod="kserve-ci-e2e-test/switch-graph-a4cbd-58b99b6759-jv64t"
Sep 18 17:08:12.795967 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:12.795936    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a288cb1a-6b37-45ae-bcd1-221c0c86a113-openshift-service-ca-bundle\") pod \"switch-graph-a4cbd-58b99b6759-jv64t\" (UID: \"a288cb1a-6b37-45ae-bcd1-221c0c86a113\") " pod="kserve-ci-e2e-test/switch-graph-a4cbd-58b99b6759-jv64t"
Sep 18 17:08:12.796162 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:12.796012    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a288cb1a-6b37-45ae-bcd1-221c0c86a113-proxy-tls\") pod \"switch-graph-a4cbd-58b99b6759-jv64t\" (UID: \"a288cb1a-6b37-45ae-bcd1-221c0c86a113\") " pod="kserve-ci-e2e-test/switch-graph-a4cbd-58b99b6759-jv64t"
Sep 18 17:08:12.796628 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:12.796609    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a288cb1a-6b37-45ae-bcd1-221c0c86a113-openshift-service-ca-bundle\") pod \"switch-graph-a4cbd-58b99b6759-jv64t\" (UID: \"a288cb1a-6b37-45ae-bcd1-221c0c86a113\") " pod="kserve-ci-e2e-test/switch-graph-a4cbd-58b99b6759-jv64t"
Sep 18 17:08:12.798574 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:12.798554    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a288cb1a-6b37-45ae-bcd1-221c0c86a113-proxy-tls\") pod \"switch-graph-a4cbd-58b99b6759-jv64t\" (UID: \"a288cb1a-6b37-45ae-bcd1-221c0c86a113\") " pod="kserve-ci-e2e-test/switch-graph-a4cbd-58b99b6759-jv64t"
Sep 18 17:08:12.953809 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:12.953717    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-a4cbd-58b99b6759-jv64t"
Sep 18 17:08:13.124462 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:13.124433    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6"
Sep 18 17:08:13.231194 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:13.231105    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-a4cbd-58b99b6759-jv64t"]
Sep 18 17:08:13.234789 ip-10-0-132-41 kubenswrapper[2577]: W0918 17:08:13.234749    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda288cb1a_6b37_45ae_bcd1_221c0c86a113.slice/crio-a808da9c3c18a94081ca49c595baf231ccec07be8f1eee873a414f6361805ba8 WatchSource:0}: Error finding container a808da9c3c18a94081ca49c595baf231ccec07be8f1eee873a414f6361805ba8: Status 404 returned error can't find the container with id a808da9c3c18a94081ca49c595baf231ccec07be8f1eee873a414f6361805ba8
Sep 18 17:08:13.485079 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:13.484992    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-a4cbd-58b99b6759-jv64t" event={"ID":"a288cb1a-6b37-45ae-bcd1-221c0c86a113","Type":"ContainerStarted","Data":"a808da9c3c18a94081ca49c595baf231ccec07be8f1eee873a414f6361805ba8"}
Sep 18 17:08:15.497978 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:15.497941    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-a4cbd-58b99b6759-jv64t" event={"ID":"a288cb1a-6b37-45ae-bcd1-221c0c86a113","Type":"ContainerStarted","Data":"daeacc9be751f0d78d31a1f3b213bd358ddc7374c3fa3cd491663d0b2ba58288"}
Sep 18 17:08:15.498449 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:15.498108    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-a4cbd-58b99b6759-jv64t"
Sep 18 17:08:15.516300 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:15.516248    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-a4cbd-58b99b6759-jv64t" podStartSLOduration=1.338071993 podStartE2EDuration="3.516232103s" totalImagesPullingTime="2.17816011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:08:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:08:15.514114687 +0000 UTC m=+1168.571404214" watchObservedRunningTime="2026-09-18 17:08:15.516232103 +0000 UTC m=+1168.573521631"
Sep 18 17:08:21.508630 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:21.508601    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-a4cbd-58b99b6759-jv64t"
Sep 18 17:08:23.616296 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:23.616256    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-a4cbd-58b99b6759-jv64t"]
Sep 18 17:08:23.616812 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:23.616453    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-a4cbd-58b99b6759-jv64t" podUID="a288cb1a-6b37-45ae-bcd1-221c0c86a113" containerName="switch-graph-a4cbd" containerID="cri-o://daeacc9be751f0d78d31a1f3b213bd358ddc7374c3fa3cd491663d0b2ba58288" gracePeriod=30
Sep 18 17:08:23.905380 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:23.905289    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h"]
Sep 18 17:08:23.905612 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:23.905576    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h" podUID="118cb984-b1e6-4cc5-aa53-755b241ff683" containerName="kserve-container" containerID="cri-o://3a9a84d845f1af4c7e45d6b1a9f00d3ddecd4d455a09a01f057bce7c72565941" gracePeriod=30
Sep 18 17:08:23.905612 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:23.905593    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h" podUID="118cb984-b1e6-4cc5-aa53-755b241ff683" containerName="kube-rbac-proxy" containerID="cri-o://6895d8a219ae6dbdf27342507c829cd8e998e28f6c6d2e77b8aab4c47b89df9a" gracePeriod=30
Sep 18 17:08:23.979795 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:23.979761    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25"]
Sep 18 17:08:23.985823 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:23.985800    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25"
Sep 18 17:08:23.988377 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:23.988350    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-1ff44-predictor-serving-cert\""
Sep 18 17:08:23.988510 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:23.988372    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-1ff44-kube-rbac-proxy-sar-config\""
Sep 18 17:08:24.009882 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:24.009811    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25"]
Sep 18 17:08:24.100013 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:24.099979    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cf1783d6-7404-4a56-baad-1858de663182-proxy-tls\") pod \"success-200-isvc-1ff44-predictor-54b47c469d-hwr25\" (UID: \"cf1783d6-7404-4a56-baad-1858de663182\") " pod="kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25"
Sep 18 17:08:24.100202 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:24.100030    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cf1783d6-7404-4a56-baad-1858de663182-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-1ff44-predictor-54b47c469d-hwr25\" (UID: \"cf1783d6-7404-4a56-baad-1858de663182\") " pod="kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25"
Sep 18 17:08:24.100202 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:24.100059    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4km6w\" (UniqueName: \"kubernetes.io/projected/cf1783d6-7404-4a56-baad-1858de663182-kube-api-access-4km6w\") pod \"success-200-isvc-1ff44-predictor-54b47c469d-hwr25\" (UID: \"cf1783d6-7404-4a56-baad-1858de663182\") " pod="kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25"
Sep 18 17:08:24.201057 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:24.200963    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cf1783d6-7404-4a56-baad-1858de663182-proxy-tls\") pod \"success-200-isvc-1ff44-predictor-54b47c469d-hwr25\" (UID: \"cf1783d6-7404-4a56-baad-1858de663182\") " pod="kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25"
Sep 18 17:08:24.201294 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:24.201267    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cf1783d6-7404-4a56-baad-1858de663182-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-1ff44-predictor-54b47c469d-hwr25\" (UID: \"cf1783d6-7404-4a56-baad-1858de663182\") " pod="kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25"
Sep 18 17:08:24.201379 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:08:24.201289    2577 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-serving-cert: secret "success-200-isvc-1ff44-predictor-serving-cert" not found
Sep 18 17:08:24.201379 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:24.201312    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4km6w\" (UniqueName: \"kubernetes.io/projected/cf1783d6-7404-4a56-baad-1858de663182-kube-api-access-4km6w\") pod \"success-200-isvc-1ff44-predictor-54b47c469d-hwr25\" (UID: \"cf1783d6-7404-4a56-baad-1858de663182\") " pod="kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25"
Sep 18 17:08:24.201379 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:08:24.201351    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1783d6-7404-4a56-baad-1858de663182-proxy-tls podName:cf1783d6-7404-4a56-baad-1858de663182 nodeName:}" failed. No retries permitted until 2026-09-18 17:08:24.701330751 +0000 UTC m=+1177.758620260 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/cf1783d6-7404-4a56-baad-1858de663182-proxy-tls") pod "success-200-isvc-1ff44-predictor-54b47c469d-hwr25" (UID: "cf1783d6-7404-4a56-baad-1858de663182") : secret "success-200-isvc-1ff44-predictor-serving-cert" not found
Sep 18 17:08:24.201914 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:24.201894    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cf1783d6-7404-4a56-baad-1858de663182-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-1ff44-predictor-54b47c469d-hwr25\" (UID: \"cf1783d6-7404-4a56-baad-1858de663182\") " pod="kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25"
Sep 18 17:08:24.215323 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:24.215297    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4km6w\" (UniqueName: \"kubernetes.io/projected/cf1783d6-7404-4a56-baad-1858de663182-kube-api-access-4km6w\") pod \"success-200-isvc-1ff44-predictor-54b47c469d-hwr25\" (UID: \"cf1783d6-7404-4a56-baad-1858de663182\") " pod="kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25"
Sep 18 17:08:24.544960 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:24.544882    2577 generic.go:356] "Generic (PLEG): container finished" podID="118cb984-b1e6-4cc5-aa53-755b241ff683" containerID="6895d8a219ae6dbdf27342507c829cd8e998e28f6c6d2e77b8aab4c47b89df9a" exitCode=2
Sep 18 17:08:24.544960 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:24.544945    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h" event={"ID":"118cb984-b1e6-4cc5-aa53-755b241ff683","Type":"ContainerDied","Data":"6895d8a219ae6dbdf27342507c829cd8e998e28f6c6d2e77b8aab4c47b89df9a"}
Sep 18 17:08:24.705161 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:24.705121    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cf1783d6-7404-4a56-baad-1858de663182-proxy-tls\") pod \"success-200-isvc-1ff44-predictor-54b47c469d-hwr25\" (UID: \"cf1783d6-7404-4a56-baad-1858de663182\") " pod="kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25"
Sep 18 17:08:24.707642 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:24.707618    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cf1783d6-7404-4a56-baad-1858de663182-proxy-tls\") pod \"success-200-isvc-1ff44-predictor-54b47c469d-hwr25\" (UID: \"cf1783d6-7404-4a56-baad-1858de663182\") " pod="kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25"
Sep 18 17:08:24.899284 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:24.899230    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25"
Sep 18 17:08:25.187787 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:25.187707    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25"]
Sep 18 17:08:25.191135 ip-10-0-132-41 kubenswrapper[2577]: W0918 17:08:25.191105    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf1783d6_7404_4a56_baad_1858de663182.slice/crio-bfcb17a551962311331504bc01e2f1c764b262d9676108fbbecf44ca86388849 WatchSource:0}: Error finding container bfcb17a551962311331504bc01e2f1c764b262d9676108fbbecf44ca86388849: Status 404 returned error can't find the container with id bfcb17a551962311331504bc01e2f1c764b262d9676108fbbecf44ca86388849
Sep 18 17:08:25.552508 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:25.552416    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25" event={"ID":"cf1783d6-7404-4a56-baad-1858de663182","Type":"ContainerStarted","Data":"4b17c75b8bd749400a65e3b57de995fabf700db04f109648499c9f88a74e0c30"}
Sep 18 17:08:25.552508 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:25.552481    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25"
Sep 18 17:08:25.552508 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:25.552501    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25" event={"ID":"cf1783d6-7404-4a56-baad-1858de663182","Type":"ContainerStarted","Data":"452e8b6cf3234af17268c9052ce4b190afce82de8cc7c4174b25833d38fc62ea"}
Sep 18 17:08:25.552750 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:25.552522    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25" event={"ID":"cf1783d6-7404-4a56-baad-1858de663182","Type":"ContainerStarted","Data":"bfcb17a551962311331504bc01e2f1c764b262d9676108fbbecf44ca86388849"}
Sep 18 17:08:25.584965 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:25.584897    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25" podStartSLOduration=2.584871205 podStartE2EDuration="2.584871205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:08:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:08:25.584523491 +0000 UTC m=+1178.641813021" watchObservedRunningTime="2026-09-18 17:08:25.584871205 +0000 UTC m=+1178.642160738"
Sep 18 17:08:26.507502 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:26.507465    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-a4cbd-58b99b6759-jv64t" podUID="a288cb1a-6b37-45ae-bcd1-221c0c86a113" containerName="switch-graph-a4cbd" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:08:26.557839 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:26.557805    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25"
Sep 18 17:08:26.558954 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:26.558926    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25" podUID="cf1783d6-7404-4a56-baad-1858de663182" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused"
Sep 18 17:08:27.564505 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:27.564475    2577 generic.go:356] "Generic (PLEG): container finished" podID="118cb984-b1e6-4cc5-aa53-755b241ff683" containerID="3a9a84d845f1af4c7e45d6b1a9f00d3ddecd4d455a09a01f057bce7c72565941" exitCode=0
Sep 18 17:08:27.564914 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:27.564563    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h" event={"ID":"118cb984-b1e6-4cc5-aa53-755b241ff683","Type":"ContainerDied","Data":"3a9a84d845f1af4c7e45d6b1a9f00d3ddecd4d455a09a01f057bce7c72565941"}
Sep 18 17:08:27.564914 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:27.564880    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25" podUID="cf1783d6-7404-4a56-baad-1858de663182" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused"
Sep 18 17:08:27.854922 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:27.854892    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h"
Sep 18 17:08:27.931007 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:27.930974    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/118cb984-b1e6-4cc5-aa53-755b241ff683-proxy-tls\") pod \"118cb984-b1e6-4cc5-aa53-755b241ff683\" (UID: \"118cb984-b1e6-4cc5-aa53-755b241ff683\") "
Sep 18 17:08:27.931154 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:27.931069    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/118cb984-b1e6-4cc5-aa53-755b241ff683-kube-rbac-proxy-sar-config\") pod \"118cb984-b1e6-4cc5-aa53-755b241ff683\" (UID: \"118cb984-b1e6-4cc5-aa53-755b241ff683\") "
Sep 18 17:08:27.931154 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:27.931139    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6g8d\" (UniqueName: \"kubernetes.io/projected/118cb984-b1e6-4cc5-aa53-755b241ff683-kube-api-access-r6g8d\") pod \"118cb984-b1e6-4cc5-aa53-755b241ff683\" (UID: \"118cb984-b1e6-4cc5-aa53-755b241ff683\") "
Sep 18 17:08:27.931473 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:27.931441    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/118cb984-b1e6-4cc5-aa53-755b241ff683-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "118cb984-b1e6-4cc5-aa53-755b241ff683" (UID: "118cb984-b1e6-4cc5-aa53-755b241ff683"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:08:27.933159 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:27.933134    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/118cb984-b1e6-4cc5-aa53-755b241ff683-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "118cb984-b1e6-4cc5-aa53-755b241ff683" (UID: "118cb984-b1e6-4cc5-aa53-755b241ff683"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:08:27.933276 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:27.933200    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/118cb984-b1e6-4cc5-aa53-755b241ff683-kube-api-access-r6g8d" (OuterVolumeSpecName: "kube-api-access-r6g8d") pod "118cb984-b1e6-4cc5-aa53-755b241ff683" (UID: "118cb984-b1e6-4cc5-aa53-755b241ff683"). InnerVolumeSpecName "kube-api-access-r6g8d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:08:28.032216 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:28.032136    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6g8d\" (UniqueName: \"kubernetes.io/projected/118cb984-b1e6-4cc5-aa53-755b241ff683-kube-api-access-r6g8d\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:08:28.032216 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:28.032163    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/118cb984-b1e6-4cc5-aa53-755b241ff683-proxy-tls\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:08:28.032216 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:28.032174    2577 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/118cb984-b1e6-4cc5-aa53-755b241ff683-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:08:28.570932 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:28.570907    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h"
Sep 18 17:08:28.571307 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:28.570950    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h" event={"ID":"118cb984-b1e6-4cc5-aa53-755b241ff683","Type":"ContainerDied","Data":"04601ec854fc0b4694879233050f7ef6b263da4e141c21bd4b7ba37f209a7de9"}
Sep 18 17:08:28.571307 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:28.571019    2577 scope.go:117] "RemoveContainer" containerID="6895d8a219ae6dbdf27342507c829cd8e998e28f6c6d2e77b8aab4c47b89df9a"
Sep 18 17:08:28.580705 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:28.580686    2577 scope.go:117] "RemoveContainer" containerID="3a9a84d845f1af4c7e45d6b1a9f00d3ddecd4d455a09a01f057bce7c72565941"
Sep 18 17:08:28.607356 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:28.607322    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h"]
Sep 18 17:08:28.611357 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:28.611331    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-a4cbd-predictor-68d958b656-ld56h"]
Sep 18 17:08:29.122747 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:29.122704    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="118cb984-b1e6-4cc5-aa53-755b241ff683" path="/var/lib/kubelet/pods/118cb984-b1e6-4cc5-aa53-755b241ff683/volumes"
Sep 18 17:08:31.507228 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:31.507189    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-a4cbd-58b99b6759-jv64t" podUID="a288cb1a-6b37-45ae-bcd1-221c0c86a113" containerName="switch-graph-a4cbd" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:08:32.569365 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:32.569333    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25"
Sep 18 17:08:32.569784 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:32.569765    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25" podUID="cf1783d6-7404-4a56-baad-1858de663182" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused"
Sep 18 17:08:36.506780 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:36.506737    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-a4cbd-58b99b6759-jv64t" podUID="a288cb1a-6b37-45ae-bcd1-221c0c86a113" containerName="switch-graph-a4cbd" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:08:36.507127 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:36.506883    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-a4cbd-58b99b6759-jv64t"
Sep 18 17:08:41.511293 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:41.511252    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-a4cbd-58b99b6759-jv64t" podUID="a288cb1a-6b37-45ae-bcd1-221c0c86a113" containerName="switch-graph-a4cbd" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:08:42.570315 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:42.570274    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25" podUID="cf1783d6-7404-4a56-baad-1858de663182" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused"
Sep 18 17:08:42.574674 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:42.574650    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-dbc88f5f4-zzlmb"]
Sep 18 17:08:42.575076 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:42.575057    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="118cb984-b1e6-4cc5-aa53-755b241ff683" containerName="kube-rbac-proxy"
Sep 18 17:08:42.575076 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:42.575075    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="118cb984-b1e6-4cc5-aa53-755b241ff683" containerName="kube-rbac-proxy"
Sep 18 17:08:42.575246 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:42.575101    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="118cb984-b1e6-4cc5-aa53-755b241ff683" containerName="kserve-container"
Sep 18 17:08:42.575246 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:42.575110    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="118cb984-b1e6-4cc5-aa53-755b241ff683" containerName="kserve-container"
Sep 18 17:08:42.575246 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:42.575215    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="118cb984-b1e6-4cc5-aa53-755b241ff683" containerName="kube-rbac-proxy"
Sep 18 17:08:42.575246 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:42.575231    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="118cb984-b1e6-4cc5-aa53-755b241ff683" containerName="kserve-container"
Sep 18 17:08:42.578340 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:42.578322    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-dbc88f5f4-zzlmb"
Sep 18 17:08:42.580372 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:42.580352    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-kube-rbac-proxy-sar-config\""
Sep 18 17:08:42.580456 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:42.580352    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-serving-cert\""
Sep 18 17:08:42.588910 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:42.588883    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-dbc88f5f4-zzlmb"]
Sep 18 17:08:42.658369 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:42.658333    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/def449f5-3cc2-4fec-9278-291bebfd2b65-proxy-tls\") pod \"model-chainer-dbc88f5f4-zzlmb\" (UID: \"def449f5-3cc2-4fec-9278-291bebfd2b65\") " pod="kserve-ci-e2e-test/model-chainer-dbc88f5f4-zzlmb"
Sep 18 17:08:42.658614 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:42.658456    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/def449f5-3cc2-4fec-9278-291bebfd2b65-openshift-service-ca-bundle\") pod \"model-chainer-dbc88f5f4-zzlmb\" (UID: \"def449f5-3cc2-4fec-9278-291bebfd2b65\") " pod="kserve-ci-e2e-test/model-chainer-dbc88f5f4-zzlmb"
Sep 18 17:08:42.759767 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:42.759727    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/def449f5-3cc2-4fec-9278-291bebfd2b65-openshift-service-ca-bundle\") pod \"model-chainer-dbc88f5f4-zzlmb\" (UID: \"def449f5-3cc2-4fec-9278-291bebfd2b65\") " pod="kserve-ci-e2e-test/model-chainer-dbc88f5f4-zzlmb"
Sep 18 17:08:42.759930 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:42.759814    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/def449f5-3cc2-4fec-9278-291bebfd2b65-proxy-tls\") pod \"model-chainer-dbc88f5f4-zzlmb\" (UID: \"def449f5-3cc2-4fec-9278-291bebfd2b65\") " pod="kserve-ci-e2e-test/model-chainer-dbc88f5f4-zzlmb"
Sep 18 17:08:42.760001 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:08:42.759976    2577 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-serving-cert: secret "model-chainer-serving-cert" not found
Sep 18 17:08:42.760080 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:08:42.760068    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/def449f5-3cc2-4fec-9278-291bebfd2b65-proxy-tls podName:def449f5-3cc2-4fec-9278-291bebfd2b65 nodeName:}" failed. No retries permitted until 2026-09-18 17:08:43.260043449 +0000 UTC m=+1196.317332961 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/def449f5-3cc2-4fec-9278-291bebfd2b65-proxy-tls") pod "model-chainer-dbc88f5f4-zzlmb" (UID: "def449f5-3cc2-4fec-9278-291bebfd2b65") : secret "model-chainer-serving-cert" not found
Sep 18 17:08:42.760480 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:42.760463    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/def449f5-3cc2-4fec-9278-291bebfd2b65-openshift-service-ca-bundle\") pod \"model-chainer-dbc88f5f4-zzlmb\" (UID: \"def449f5-3cc2-4fec-9278-291bebfd2b65\") " pod="kserve-ci-e2e-test/model-chainer-dbc88f5f4-zzlmb"
Sep 18 17:08:43.264289 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:43.264255    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/def449f5-3cc2-4fec-9278-291bebfd2b65-proxy-tls\") pod \"model-chainer-dbc88f5f4-zzlmb\" (UID: \"def449f5-3cc2-4fec-9278-291bebfd2b65\") " pod="kserve-ci-e2e-test/model-chainer-dbc88f5f4-zzlmb"
Sep 18 17:08:43.266719 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:43.266696    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/def449f5-3cc2-4fec-9278-291bebfd2b65-proxy-tls\") pod \"model-chainer-dbc88f5f4-zzlmb\" (UID: \"def449f5-3cc2-4fec-9278-291bebfd2b65\") " pod="kserve-ci-e2e-test/model-chainer-dbc88f5f4-zzlmb"
Sep 18 17:08:43.490267 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:43.490228    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-dbc88f5f4-zzlmb"
Sep 18 17:08:43.762462 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:43.762433    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-dbc88f5f4-zzlmb"]
Sep 18 17:08:43.765190 ip-10-0-132-41 kubenswrapper[2577]: W0918 17:08:43.765157    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddef449f5_3cc2_4fec_9278_291bebfd2b65.slice/crio-2ed5bb8d0f9dd087234a302d4d48303284e63d55efc63f132f37926694ba0355 WatchSource:0}: Error finding container 2ed5bb8d0f9dd087234a302d4d48303284e63d55efc63f132f37926694ba0355: Status 404 returned error can't find the container with id 2ed5bb8d0f9dd087234a302d4d48303284e63d55efc63f132f37926694ba0355
Sep 18 17:08:44.651411 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:44.651373    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-dbc88f5f4-zzlmb" event={"ID":"def449f5-3cc2-4fec-9278-291bebfd2b65","Type":"ContainerStarted","Data":"725d4c6d68ef48946becb0c157f3a85c738f78185a384f494ad092d86ec3cd98"}
Sep 18 17:08:44.651621 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:44.651431    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-dbc88f5f4-zzlmb" event={"ID":"def449f5-3cc2-4fec-9278-291bebfd2b65","Type":"ContainerStarted","Data":"2ed5bb8d0f9dd087234a302d4d48303284e63d55efc63f132f37926694ba0355"}
Sep 18 17:08:44.651621 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:44.651471    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-dbc88f5f4-zzlmb"
Sep 18 17:08:44.671620 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:44.671498    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-dbc88f5f4-zzlmb" podStartSLOduration=2.671482577 podStartE2EDuration="2.671482577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:08:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:08:44.668986852 +0000 UTC m=+1197.726276392" watchObservedRunningTime="2026-09-18 17:08:44.671482577 +0000 UTC m=+1197.728772104"
Sep 18 17:08:46.506985 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:46.506951    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-a4cbd-58b99b6759-jv64t" podUID="a288cb1a-6b37-45ae-bcd1-221c0c86a113" containerName="switch-graph-a4cbd" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:08:49.112376 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:49.112349    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-t4p6q_60bae8ea-9599-47f8-b066-df7c46c011b3/console-operator/1.log"
Sep 18 17:08:49.112820 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:49.112433    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-t4p6q_60bae8ea-9599-47f8-b066-df7c46c011b3/console-operator/1.log"
Sep 18 17:08:49.117732 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:49.117712    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktklw_3c1064f0-18a0-4c28-8fb9-a320535dcbbf/ovn-acl-logging/0.log"
Sep 18 17:08:49.117878 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:49.117718    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktklw_3c1064f0-18a0-4c28-8fb9-a320535dcbbf/ovn-acl-logging/0.log"
Sep 18 17:08:50.661626 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:50.661594    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-dbc88f5f4-zzlmb"
Sep 18 17:08:51.506699 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:51.506663    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-a4cbd-58b99b6759-jv64t" podUID="a288cb1a-6b37-45ae-bcd1-221c0c86a113" containerName="switch-graph-a4cbd" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:08:52.570772 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:52.570725    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25" podUID="cf1783d6-7404-4a56-baad-1858de663182" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused"
Sep 18 17:08:53.696132 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:53.696092    2577 generic.go:356] "Generic (PLEG): container finished" podID="a288cb1a-6b37-45ae-bcd1-221c0c86a113" containerID="daeacc9be751f0d78d31a1f3b213bd358ddc7374c3fa3cd491663d0b2ba58288" exitCode=0
Sep 18 17:08:53.696489 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:53.696162    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-a4cbd-58b99b6759-jv64t" event={"ID":"a288cb1a-6b37-45ae-bcd1-221c0c86a113","Type":"ContainerDied","Data":"daeacc9be751f0d78d31a1f3b213bd358ddc7374c3fa3cd491663d0b2ba58288"}
Sep 18 17:08:54.073780 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:54.073711    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-dbc88f5f4-zzlmb"]
Sep 18 17:08:54.073932 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:54.073909    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-dbc88f5f4-zzlmb" podUID="def449f5-3cc2-4fec-9278-291bebfd2b65" containerName="model-chainer" containerID="cri-o://725d4c6d68ef48946becb0c157f3a85c738f78185a384f494ad092d86ec3cd98" gracePeriod=30
Sep 18 17:08:54.279841 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:54.279807    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-a4cbd-58b99b6759-jv64t"
Sep 18 17:08:54.353808 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:54.353714    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6"]
Sep 18 17:08:54.353992 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:54.353969    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6" podUID="2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1" containerName="kserve-container" containerID="cri-o://0650d37f936f0e48e03814a6e78d27222078c138ef21f87d2b9fd341bc7738c0" gracePeriod=30
Sep 18 17:08:54.354210 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:54.354128    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6" podUID="2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1" containerName="kube-rbac-proxy" containerID="cri-o://73c4ba83dc1073b1887c358cf708ff6d08f371ddbb52f1a79d2a08f59ac267f5" gracePeriod=30
Sep 18 17:08:54.358877 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:54.358846    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a288cb1a-6b37-45ae-bcd1-221c0c86a113-proxy-tls\") pod \"a288cb1a-6b37-45ae-bcd1-221c0c86a113\" (UID: \"a288cb1a-6b37-45ae-bcd1-221c0c86a113\") "
Sep 18 17:08:54.359006 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:54.358952    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a288cb1a-6b37-45ae-bcd1-221c0c86a113-openshift-service-ca-bundle\") pod \"a288cb1a-6b37-45ae-bcd1-221c0c86a113\" (UID: \"a288cb1a-6b37-45ae-bcd1-221c0c86a113\") "
Sep 18 17:08:54.359336 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:54.359307    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a288cb1a-6b37-45ae-bcd1-221c0c86a113-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "a288cb1a-6b37-45ae-bcd1-221c0c86a113" (UID: "a288cb1a-6b37-45ae-bcd1-221c0c86a113"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:08:54.363372 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:54.363339    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a288cb1a-6b37-45ae-bcd1-221c0c86a113-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "a288cb1a-6b37-45ae-bcd1-221c0c86a113" (UID: "a288cb1a-6b37-45ae-bcd1-221c0c86a113"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:08:54.460129 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:54.460092    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a288cb1a-6b37-45ae-bcd1-221c0c86a113-proxy-tls\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:08:54.460129 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:54.460133    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a288cb1a-6b37-45ae-bcd1-221c0c86a113-openshift-service-ca-bundle\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:08:54.531165 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:54.531133    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv"]
Sep 18 17:08:54.531577 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:54.531565    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a288cb1a-6b37-45ae-bcd1-221c0c86a113" containerName="switch-graph-a4cbd"
Sep 18 17:08:54.531630 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:54.531580    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a288cb1a-6b37-45ae-bcd1-221c0c86a113" containerName="switch-graph-a4cbd"
Sep 18 17:08:54.531665 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:54.531643    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a288cb1a-6b37-45ae-bcd1-221c0c86a113" containerName="switch-graph-a4cbd"
Sep 18 17:08:54.534984 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:54.534960    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv"
Sep 18 17:08:54.538882 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:54.538854    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-9846a-predictor-serving-cert\""
Sep 18 17:08:54.538991 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:54.538914    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-9846a-kube-rbac-proxy-sar-config\""
Sep 18 17:08:54.551750 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:54.551724    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv"]
Sep 18 17:08:54.662002 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:54.661954    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f2712b96-4f47-4fb0-9e76-3c9458bf7bc8-proxy-tls\") pod \"success-200-isvc-9846a-predictor-84848664-z4zxv\" (UID: \"f2712b96-4f47-4fb0-9e76-3c9458bf7bc8\") " pod="kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv"
Sep 18 17:08:54.662175 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:54.662073    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f2712b96-4f47-4fb0-9e76-3c9458bf7bc8-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-9846a-predictor-84848664-z4zxv\" (UID: \"f2712b96-4f47-4fb0-9e76-3c9458bf7bc8\") " pod="kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv"
Sep 18 17:08:54.662175 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:54.662109    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss25v\" (UniqueName: \"kubernetes.io/projected/f2712b96-4f47-4fb0-9e76-3c9458bf7bc8-kube-api-access-ss25v\") pod \"success-200-isvc-9846a-predictor-84848664-z4zxv\" (UID: \"f2712b96-4f47-4fb0-9e76-3c9458bf7bc8\") " pod="kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv"
Sep 18 17:08:54.704799 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:54.704763    2577 generic.go:356] "Generic (PLEG): container finished" podID="2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1" containerID="73c4ba83dc1073b1887c358cf708ff6d08f371ddbb52f1a79d2a08f59ac267f5" exitCode=2
Sep 18 17:08:54.705207 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:54.704826    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6" event={"ID":"2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1","Type":"ContainerDied","Data":"73c4ba83dc1073b1887c358cf708ff6d08f371ddbb52f1a79d2a08f59ac267f5"}
Sep 18 17:08:54.706160 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:54.706143    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-a4cbd-58b99b6759-jv64t"
Sep 18 17:08:54.706240 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:54.706167    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-a4cbd-58b99b6759-jv64t" event={"ID":"a288cb1a-6b37-45ae-bcd1-221c0c86a113","Type":"ContainerDied","Data":"a808da9c3c18a94081ca49c595baf231ccec07be8f1eee873a414f6361805ba8"}
Sep 18 17:08:54.706240 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:54.706212    2577 scope.go:117] "RemoveContainer" containerID="daeacc9be751f0d78d31a1f3b213bd358ddc7374c3fa3cd491663d0b2ba58288"
Sep 18 17:08:54.747818 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:54.747785    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-a4cbd-58b99b6759-jv64t"]
Sep 18 17:08:54.752782 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:54.752759    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-a4cbd-58b99b6759-jv64t"]
Sep 18 17:08:54.762976 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:54.762952    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f2712b96-4f47-4fb0-9e76-3c9458bf7bc8-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-9846a-predictor-84848664-z4zxv\" (UID: \"f2712b96-4f47-4fb0-9e76-3c9458bf7bc8\") " pod="kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv"
Sep 18 17:08:54.763122 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:54.762984    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss25v\" (UniqueName: \"kubernetes.io/projected/f2712b96-4f47-4fb0-9e76-3c9458bf7bc8-kube-api-access-ss25v\") pod \"success-200-isvc-9846a-predictor-84848664-z4zxv\" (UID: \"f2712b96-4f47-4fb0-9e76-3c9458bf7bc8\") " pod="kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv"
Sep 18 17:08:54.763122 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:54.763043    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f2712b96-4f47-4fb0-9e76-3c9458bf7bc8-proxy-tls\") pod \"success-200-isvc-9846a-predictor-84848664-z4zxv\" (UID: \"f2712b96-4f47-4fb0-9e76-3c9458bf7bc8\") " pod="kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv"
Sep 18 17:08:54.763687 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:54.763663    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f2712b96-4f47-4fb0-9e76-3c9458bf7bc8-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-9846a-predictor-84848664-z4zxv\" (UID: \"f2712b96-4f47-4fb0-9e76-3c9458bf7bc8\") " pod="kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv"
Sep 18 17:08:54.765472 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:54.765448    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f2712b96-4f47-4fb0-9e76-3c9458bf7bc8-proxy-tls\") pod \"success-200-isvc-9846a-predictor-84848664-z4zxv\" (UID: \"f2712b96-4f47-4fb0-9e76-3c9458bf7bc8\") " pod="kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv"
Sep 18 17:08:54.774795 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:54.774775    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss25v\" (UniqueName: \"kubernetes.io/projected/f2712b96-4f47-4fb0-9e76-3c9458bf7bc8-kube-api-access-ss25v\") pod \"success-200-isvc-9846a-predictor-84848664-z4zxv\" (UID: \"f2712b96-4f47-4fb0-9e76-3c9458bf7bc8\") " pod="kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv"
Sep 18 17:08:54.845180 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:54.845139    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv"
Sep 18 17:08:55.122617 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:55.122585    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a288cb1a-6b37-45ae-bcd1-221c0c86a113" path="/var/lib/kubelet/pods/a288cb1a-6b37-45ae-bcd1-221c0c86a113/volumes"
Sep 18 17:08:55.140040 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:55.140018    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv"]
Sep 18 17:08:55.142275 ip-10-0-132-41 kubenswrapper[2577]: W0918 17:08:55.142243    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2712b96_4f47_4fb0_9e76_3c9458bf7bc8.slice/crio-6a4d79453f7cf9f603ff68cd082d4d9f4649bf9b6f201d31a4b2ecbd9761cd33 WatchSource:0}: Error finding container 6a4d79453f7cf9f603ff68cd082d4d9f4649bf9b6f201d31a4b2ecbd9761cd33: Status 404 returned error can't find the container with id 6a4d79453f7cf9f603ff68cd082d4d9f4649bf9b6f201d31a4b2ecbd9761cd33
Sep 18 17:08:55.660281 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:55.660243    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-dbc88f5f4-zzlmb" podUID="def449f5-3cc2-4fec-9278-291bebfd2b65" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:08:55.716388 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:55.714214    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv" event={"ID":"f2712b96-4f47-4fb0-9e76-3c9458bf7bc8","Type":"ContainerStarted","Data":"41e86ad34d37da48f1ca7d680190c33fcdc6e032d9d0d276d4e3cedc0dcc0059"}
Sep 18 17:08:55.716388 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:55.714620    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv" event={"ID":"f2712b96-4f47-4fb0-9e76-3c9458bf7bc8","Type":"ContainerStarted","Data":"cea6b883241b413dc76f0635d4274b3a8c78e36931a9488ba88636dfe4ca67c8"}
Sep 18 17:08:55.716388 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:55.714815    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv" event={"ID":"f2712b96-4f47-4fb0-9e76-3c9458bf7bc8","Type":"ContainerStarted","Data":"6a4d79453f7cf9f603ff68cd082d4d9f4649bf9b6f201d31a4b2ecbd9761cd33"}
Sep 18 17:08:55.716388 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:55.714867    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv"
Sep 18 17:08:55.716388 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:55.714935    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv"
Sep 18 17:08:55.717188 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:55.717161    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv" podUID="f2712b96-4f47-4fb0-9e76-3c9458bf7bc8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Sep 18 17:08:55.735765 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:55.735709    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv" podStartSLOduration=1.735692647 podStartE2EDuration="1.735692647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:08:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:08:55.734836091 +0000 UTC m=+1208.792125620" watchObservedRunningTime="2026-09-18 17:08:55.735692647 +0000 UTC m=+1208.792982176"
Sep 18 17:08:56.720026 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:56.719990    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv" podUID="f2712b96-4f47-4fb0-9e76-3c9458bf7bc8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Sep 18 17:08:58.114597 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:58.114527    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6" podUID="2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.34:8643/healthz\": dial tcp 10.132.0.34:8643: connect: connection refused"
Sep 18 17:08:59.700675 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:59.700650    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6"
Sep 18 17:08:59.736182 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:59.736088    2577 generic.go:356] "Generic (PLEG): container finished" podID="2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1" containerID="0650d37f936f0e48e03814a6e78d27222078c138ef21f87d2b9fd341bc7738c0" exitCode=0
Sep 18 17:08:59.736182 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:59.736141    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6"
Sep 18 17:08:59.736362 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:59.736175    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6" event={"ID":"2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1","Type":"ContainerDied","Data":"0650d37f936f0e48e03814a6e78d27222078c138ef21f87d2b9fd341bc7738c0"}
Sep 18 17:08:59.736362 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:59.736239    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6" event={"ID":"2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1","Type":"ContainerDied","Data":"5ba08c212734e0829ff2b3a3ef6de248806012b989a2c0db5570b2c7f53122ca"}
Sep 18 17:08:59.736362 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:59.736269    2577 scope.go:117] "RemoveContainer" containerID="73c4ba83dc1073b1887c358cf708ff6d08f371ddbb52f1a79d2a08f59ac267f5"
Sep 18 17:08:59.745110 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:59.745089    2577 scope.go:117] "RemoveContainer" containerID="0650d37f936f0e48e03814a6e78d27222078c138ef21f87d2b9fd341bc7738c0"
Sep 18 17:08:59.753037 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:59.753018    2577 scope.go:117] "RemoveContainer" containerID="0e2fa3fa8ef6f62311c8545025a6fc975db1be10dede3b91b5e1149d6a0e142b"
Sep 18 17:08:59.760979 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:59.760961    2577 scope.go:117] "RemoveContainer" containerID="73c4ba83dc1073b1887c358cf708ff6d08f371ddbb52f1a79d2a08f59ac267f5"
Sep 18 17:08:59.761240 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:08:59.761222    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73c4ba83dc1073b1887c358cf708ff6d08f371ddbb52f1a79d2a08f59ac267f5\": container with ID starting with 73c4ba83dc1073b1887c358cf708ff6d08f371ddbb52f1a79d2a08f59ac267f5 not found: ID does not exist" containerID="73c4ba83dc1073b1887c358cf708ff6d08f371ddbb52f1a79d2a08f59ac267f5"
Sep 18 17:08:59.761314 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:59.761246    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73c4ba83dc1073b1887c358cf708ff6d08f371ddbb52f1a79d2a08f59ac267f5"} err="failed to get container status \"73c4ba83dc1073b1887c358cf708ff6d08f371ddbb52f1a79d2a08f59ac267f5\": rpc error: code = NotFound desc = could not find container \"73c4ba83dc1073b1887c358cf708ff6d08f371ddbb52f1a79d2a08f59ac267f5\": container with ID starting with 73c4ba83dc1073b1887c358cf708ff6d08f371ddbb52f1a79d2a08f59ac267f5 not found: ID does not exist"
Sep 18 17:08:59.761314 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:59.761262    2577 scope.go:117] "RemoveContainer" containerID="0650d37f936f0e48e03814a6e78d27222078c138ef21f87d2b9fd341bc7738c0"
Sep 18 17:08:59.761524 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:08:59.761504    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0650d37f936f0e48e03814a6e78d27222078c138ef21f87d2b9fd341bc7738c0\": container with ID starting with 0650d37f936f0e48e03814a6e78d27222078c138ef21f87d2b9fd341bc7738c0 not found: ID does not exist" containerID="0650d37f936f0e48e03814a6e78d27222078c138ef21f87d2b9fd341bc7738c0"
Sep 18 17:08:59.761590 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:59.761545    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0650d37f936f0e48e03814a6e78d27222078c138ef21f87d2b9fd341bc7738c0"} err="failed to get container status \"0650d37f936f0e48e03814a6e78d27222078c138ef21f87d2b9fd341bc7738c0\": rpc error: code = NotFound desc = could not find container \"0650d37f936f0e48e03814a6e78d27222078c138ef21f87d2b9fd341bc7738c0\": container with ID starting with 0650d37f936f0e48e03814a6e78d27222078c138ef21f87d2b9fd341bc7738c0 not found: ID does not exist"
Sep 18 17:08:59.761590 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:59.761572    2577 scope.go:117] "RemoveContainer" containerID="0e2fa3fa8ef6f62311c8545025a6fc975db1be10dede3b91b5e1149d6a0e142b"
Sep 18 17:08:59.761822 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:08:59.761803    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e2fa3fa8ef6f62311c8545025a6fc975db1be10dede3b91b5e1149d6a0e142b\": container with ID starting with 0e2fa3fa8ef6f62311c8545025a6fc975db1be10dede3b91b5e1149d6a0e142b not found: ID does not exist" containerID="0e2fa3fa8ef6f62311c8545025a6fc975db1be10dede3b91b5e1149d6a0e142b"
Sep 18 17:08:59.761859 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:59.761828    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e2fa3fa8ef6f62311c8545025a6fc975db1be10dede3b91b5e1149d6a0e142b"} err="failed to get container status \"0e2fa3fa8ef6f62311c8545025a6fc975db1be10dede3b91b5e1149d6a0e142b\": rpc error: code = NotFound desc = could not find container \"0e2fa3fa8ef6f62311c8545025a6fc975db1be10dede3b91b5e1149d6a0e142b\": container with ID starting with 0e2fa3fa8ef6f62311c8545025a6fc975db1be10dede3b91b5e1149d6a0e142b not found: ID does not exist"
Sep 18 17:08:59.809091 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:59.809057    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1-proxy-tls\") pod \"2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1\" (UID: \"2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1\") "
Sep 18 17:08:59.809259 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:59.809191    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1-kserve-provision-location\") pod \"2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1\" (UID: \"2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1\") "
Sep 18 17:08:59.809259 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:59.809237    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4d8p\" (UniqueName: \"kubernetes.io/projected/2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1-kube-api-access-z4d8p\") pod \"2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1\" (UID: \"2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1\") "
Sep 18 17:08:59.809366 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:59.809265    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1-kube-rbac-proxy-sar-config\") pod \"2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1\" (UID: \"2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1\") "
Sep 18 17:08:59.809366 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:59.809289    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1-cabundle-cert\") pod \"2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1\" (UID: \"2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1\") "
Sep 18 17:08:59.809657 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:59.809623    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1" (UID: "2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:08:59.809776 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:59.809685    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1" (UID: "2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:08:59.809776 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:59.809720    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1" (UID: "2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:08:59.811348 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:59.811322    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1" (UID: "2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:08:59.811348 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:59.811332    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1-kube-api-access-z4d8p" (OuterVolumeSpecName: "kube-api-access-z4d8p") pod "2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1" (UID: "2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1"). InnerVolumeSpecName "kube-api-access-z4d8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:08:59.910597 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:59.910560    2577 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1-kserve-provision-location\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:08:59.910597 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:59.910592    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4d8p\" (UniqueName: \"kubernetes.io/projected/2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1-kube-api-access-z4d8p\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:08:59.910597 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:59.910606    2577 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:08:59.910805 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:59.910620    2577 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1-cabundle-cert\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:08:59.910805 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:08:59.910633    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1-proxy-tls\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:09:00.060326 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:00.060293    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6"]
Sep 18 17:09:00.066774 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:00.066748    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-4k7z6"]
Sep 18 17:09:00.659959 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:00.659919    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-dbc88f5f4-zzlmb" podUID="def449f5-3cc2-4fec-9278-291bebfd2b65" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:09:01.122517 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:01.122478    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1" path="/var/lib/kubelet/pods/2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1/volumes"
Sep 18 17:09:01.724305 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:01.724277    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv"
Sep 18 17:09:01.724709 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:01.724684    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv" podUID="f2712b96-4f47-4fb0-9e76-3c9458bf7bc8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Sep 18 17:09:02.570030 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:02.569985    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25" podUID="cf1783d6-7404-4a56-baad-1858de663182" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused"
Sep 18 17:09:05.660709 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:05.660669    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-dbc88f5f4-zzlmb" podUID="def449f5-3cc2-4fec-9278-291bebfd2b65" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:09:05.663025 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:05.660801    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-dbc88f5f4-zzlmb"
Sep 18 17:09:10.660255 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:10.660216    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-dbc88f5f4-zzlmb" podUID="def449f5-3cc2-4fec-9278-291bebfd2b65" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:09:11.725169 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:11.725131    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv" podUID="f2712b96-4f47-4fb0-9e76-3c9458bf7bc8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Sep 18 17:09:12.569772 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:12.569729    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25" podUID="cf1783d6-7404-4a56-baad-1858de663182" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused"
Sep 18 17:09:15.659990 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:15.659952    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-dbc88f5f4-zzlmb" podUID="def449f5-3cc2-4fec-9278-291bebfd2b65" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:09:20.660591 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:20.660554    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-dbc88f5f4-zzlmb" podUID="def449f5-3cc2-4fec-9278-291bebfd2b65" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:09:21.725701 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:21.725662    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv" podUID="f2712b96-4f47-4fb0-9e76-3c9458bf7bc8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Sep 18 17:09:22.570666 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:22.570637    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25"
Sep 18 17:09:24.215298 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:24.215270    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-dbc88f5f4-zzlmb"
Sep 18 17:09:24.335866 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:24.335786    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/def449f5-3cc2-4fec-9278-291bebfd2b65-openshift-service-ca-bundle\") pod \"def449f5-3cc2-4fec-9278-291bebfd2b65\" (UID: \"def449f5-3cc2-4fec-9278-291bebfd2b65\") "
Sep 18 17:09:24.335866 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:24.335836    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/def449f5-3cc2-4fec-9278-291bebfd2b65-proxy-tls\") pod \"def449f5-3cc2-4fec-9278-291bebfd2b65\" (UID: \"def449f5-3cc2-4fec-9278-291bebfd2b65\") "
Sep 18 17:09:24.336164 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:24.336140    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/def449f5-3cc2-4fec-9278-291bebfd2b65-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "def449f5-3cc2-4fec-9278-291bebfd2b65" (UID: "def449f5-3cc2-4fec-9278-291bebfd2b65"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:09:24.337807 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:24.337776    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/def449f5-3cc2-4fec-9278-291bebfd2b65-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "def449f5-3cc2-4fec-9278-291bebfd2b65" (UID: "def449f5-3cc2-4fec-9278-291bebfd2b65"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:09:24.436449 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:24.436416    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/def449f5-3cc2-4fec-9278-291bebfd2b65-openshift-service-ca-bundle\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:09:24.436449 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:24.436444    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/def449f5-3cc2-4fec-9278-291bebfd2b65-proxy-tls\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:09:24.862624 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:24.862588    2577 generic.go:356] "Generic (PLEG): container finished" podID="def449f5-3cc2-4fec-9278-291bebfd2b65" containerID="725d4c6d68ef48946becb0c157f3a85c738f78185a384f494ad092d86ec3cd98" exitCode=0
Sep 18 17:09:24.862805 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:24.862632    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-dbc88f5f4-zzlmb"
Sep 18 17:09:24.862805 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:24.862667    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-dbc88f5f4-zzlmb" event={"ID":"def449f5-3cc2-4fec-9278-291bebfd2b65","Type":"ContainerDied","Data":"725d4c6d68ef48946becb0c157f3a85c738f78185a384f494ad092d86ec3cd98"}
Sep 18 17:09:24.862805 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:24.862719    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-dbc88f5f4-zzlmb" event={"ID":"def449f5-3cc2-4fec-9278-291bebfd2b65","Type":"ContainerDied","Data":"2ed5bb8d0f9dd087234a302d4d48303284e63d55efc63f132f37926694ba0355"}
Sep 18 17:09:24.862805 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:24.862747    2577 scope.go:117] "RemoveContainer" containerID="725d4c6d68ef48946becb0c157f3a85c738f78185a384f494ad092d86ec3cd98"
Sep 18 17:09:24.873064 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:24.873040    2577 scope.go:117] "RemoveContainer" containerID="725d4c6d68ef48946becb0c157f3a85c738f78185a384f494ad092d86ec3cd98"
Sep 18 17:09:24.873349 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:09:24.873330    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"725d4c6d68ef48946becb0c157f3a85c738f78185a384f494ad092d86ec3cd98\": container with ID starting with 725d4c6d68ef48946becb0c157f3a85c738f78185a384f494ad092d86ec3cd98 not found: ID does not exist" containerID="725d4c6d68ef48946becb0c157f3a85c738f78185a384f494ad092d86ec3cd98"
Sep 18 17:09:24.873403 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:24.873358    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"725d4c6d68ef48946becb0c157f3a85c738f78185a384f494ad092d86ec3cd98"} err="failed to get container status \"725d4c6d68ef48946becb0c157f3a85c738f78185a384f494ad092d86ec3cd98\": rpc error: code = NotFound desc = could not find container \"725d4c6d68ef48946becb0c157f3a85c738f78185a384f494ad092d86ec3cd98\": container with ID starting with 725d4c6d68ef48946becb0c157f3a85c738f78185a384f494ad092d86ec3cd98 not found: ID does not exist"
Sep 18 17:09:24.891352 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:24.891304    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-dbc88f5f4-zzlmb"]
Sep 18 17:09:24.893544 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:24.893510    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-dbc88f5f4-zzlmb"]
Sep 18 17:09:25.122846 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:25.122766    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="def449f5-3cc2-4fec-9278-291bebfd2b65" path="/var/lib/kubelet/pods/def449f5-3cc2-4fec-9278-291bebfd2b65/volumes"
Sep 18 17:09:31.724977 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:31.724893    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv" podUID="f2712b96-4f47-4fb0-9e76-3c9458bf7bc8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Sep 18 17:09:33.945849 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:33.945812    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-1ff44-6b78b6c5c9-7dx42"]
Sep 18 17:09:33.946357 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:33.946223    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1" containerName="kube-rbac-proxy"
Sep 18 17:09:33.946357 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:33.946235    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1" containerName="kube-rbac-proxy"
Sep 18 17:09:33.946357 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:33.946244    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1" containerName="storage-initializer"
Sep 18 17:09:33.946357 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:33.946250    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1" containerName="storage-initializer"
Sep 18 17:09:33.946357 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:33.946257    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="def449f5-3cc2-4fec-9278-291bebfd2b65" containerName="model-chainer"
Sep 18 17:09:33.946357 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:33.946264    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="def449f5-3cc2-4fec-9278-291bebfd2b65" containerName="model-chainer"
Sep 18 17:09:33.946357 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:33.946281    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1" containerName="kserve-container"
Sep 18 17:09:33.946357 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:33.946287    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1" containerName="kserve-container"
Sep 18 17:09:33.946357 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:33.946351    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1" containerName="kserve-container"
Sep 18 17:09:33.946357 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:33.946364    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c3fccdf-e8bb-4978-bdfc-b39b5b4a01a1" containerName="kube-rbac-proxy"
Sep 18 17:09:33.946922 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:33.946371    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="def449f5-3cc2-4fec-9278-291bebfd2b65" containerName="model-chainer"
Sep 18 17:09:33.950807 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:33.950783    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-1ff44-6b78b6c5c9-7dx42"
Sep 18 17:09:33.957071 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:33.957054    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-1ff44-serving-cert\""
Sep 18 17:09:33.957604 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:33.957589    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-1ff44-kube-rbac-proxy-sar-config\""
Sep 18 17:09:33.964226 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:33.964207    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-1ff44-6b78b6c5c9-7dx42"]
Sep 18 17:09:34.016190 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:34.016160    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/470cfc94-b2b5-4781-99e8-bd1a02cd4cbc-openshift-service-ca-bundle\") pod \"switch-graph-1ff44-6b78b6c5c9-7dx42\" (UID: \"470cfc94-b2b5-4781-99e8-bd1a02cd4cbc\") " pod="kserve-ci-e2e-test/switch-graph-1ff44-6b78b6c5c9-7dx42"
Sep 18 17:09:34.016365 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:34.016230    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/470cfc94-b2b5-4781-99e8-bd1a02cd4cbc-proxy-tls\") pod \"switch-graph-1ff44-6b78b6c5c9-7dx42\" (UID: \"470cfc94-b2b5-4781-99e8-bd1a02cd4cbc\") " pod="kserve-ci-e2e-test/switch-graph-1ff44-6b78b6c5c9-7dx42"
Sep 18 17:09:34.117460 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:34.117427    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/470cfc94-b2b5-4781-99e8-bd1a02cd4cbc-proxy-tls\") pod \"switch-graph-1ff44-6b78b6c5c9-7dx42\" (UID: \"470cfc94-b2b5-4781-99e8-bd1a02cd4cbc\") " pod="kserve-ci-e2e-test/switch-graph-1ff44-6b78b6c5c9-7dx42"
Sep 18 17:09:34.117658 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:34.117504    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/470cfc94-b2b5-4781-99e8-bd1a02cd4cbc-openshift-service-ca-bundle\") pod \"switch-graph-1ff44-6b78b6c5c9-7dx42\" (UID: \"470cfc94-b2b5-4781-99e8-bd1a02cd4cbc\") " pod="kserve-ci-e2e-test/switch-graph-1ff44-6b78b6c5c9-7dx42"
Sep 18 17:09:34.117658 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:09:34.117637    2577 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-1ff44-serving-cert: secret "switch-graph-1ff44-serving-cert" not found
Sep 18 17:09:34.117739 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:09:34.117719    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/470cfc94-b2b5-4781-99e8-bd1a02cd4cbc-proxy-tls podName:470cfc94-b2b5-4781-99e8-bd1a02cd4cbc nodeName:}" failed. No retries permitted until 2026-09-18 17:09:34.617698342 +0000 UTC m=+1247.674987862 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/470cfc94-b2b5-4781-99e8-bd1a02cd4cbc-proxy-tls") pod "switch-graph-1ff44-6b78b6c5c9-7dx42" (UID: "470cfc94-b2b5-4781-99e8-bd1a02cd4cbc") : secret "switch-graph-1ff44-serving-cert" not found
Sep 18 17:09:34.118169 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:34.118141    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/470cfc94-b2b5-4781-99e8-bd1a02cd4cbc-openshift-service-ca-bundle\") pod \"switch-graph-1ff44-6b78b6c5c9-7dx42\" (UID: \"470cfc94-b2b5-4781-99e8-bd1a02cd4cbc\") " pod="kserve-ci-e2e-test/switch-graph-1ff44-6b78b6c5c9-7dx42"
Sep 18 17:09:34.622650 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:34.622613    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/470cfc94-b2b5-4781-99e8-bd1a02cd4cbc-proxy-tls\") pod \"switch-graph-1ff44-6b78b6c5c9-7dx42\" (UID: \"470cfc94-b2b5-4781-99e8-bd1a02cd4cbc\") " pod="kserve-ci-e2e-test/switch-graph-1ff44-6b78b6c5c9-7dx42"
Sep 18 17:09:34.625047 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:34.625022    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/470cfc94-b2b5-4781-99e8-bd1a02cd4cbc-proxy-tls\") pod \"switch-graph-1ff44-6b78b6c5c9-7dx42\" (UID: \"470cfc94-b2b5-4781-99e8-bd1a02cd4cbc\") " pod="kserve-ci-e2e-test/switch-graph-1ff44-6b78b6c5c9-7dx42"
Sep 18 17:09:34.864709 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:34.864677    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-1ff44-6b78b6c5c9-7dx42"
Sep 18 17:09:35.150542 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:35.150449    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-1ff44-6b78b6c5c9-7dx42"]
Sep 18 17:09:35.154078 ip-10-0-132-41 kubenswrapper[2577]: W0918 17:09:35.154048    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod470cfc94_b2b5_4781_99e8_bd1a02cd4cbc.slice/crio-e84b3ce4fa09ac396198c69328b72e7c0620689f9c2d1002fd21fca4ea6acf64 WatchSource:0}: Error finding container e84b3ce4fa09ac396198c69328b72e7c0620689f9c2d1002fd21fca4ea6acf64: Status 404 returned error can't find the container with id e84b3ce4fa09ac396198c69328b72e7c0620689f9c2d1002fd21fca4ea6acf64
Sep 18 17:09:35.922776 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:35.922738    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-1ff44-6b78b6c5c9-7dx42" event={"ID":"470cfc94-b2b5-4781-99e8-bd1a02cd4cbc","Type":"ContainerStarted","Data":"c5e87b17911d056f0d461722a83cf0b5a37c5b79e2277b901af649926a4ab4ab"}
Sep 18 17:09:35.922978 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:35.922820    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-1ff44-6b78b6c5c9-7dx42" event={"ID":"470cfc94-b2b5-4781-99e8-bd1a02cd4cbc","Type":"ContainerStarted","Data":"e84b3ce4fa09ac396198c69328b72e7c0620689f9c2d1002fd21fca4ea6acf64"}
Sep 18 17:09:35.922978 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:35.922943    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-1ff44-6b78b6c5c9-7dx42"
Sep 18 17:09:35.944010 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:35.943957    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-1ff44-6b78b6c5c9-7dx42" podStartSLOduration=2.943943099 podStartE2EDuration="2.943943099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:09:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:09:35.94149804 +0000 UTC m=+1248.998787570" watchObservedRunningTime="2026-09-18 17:09:35.943943099 +0000 UTC m=+1249.001232626"
Sep 18 17:09:41.724845 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:41.724806    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv" podUID="f2712b96-4f47-4fb0-9e76-3c9458bf7bc8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Sep 18 17:09:41.933084 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:41.933055    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-1ff44-6b78b6c5c9-7dx42"
Sep 18 17:09:51.725234 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:09:51.725205    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv"
Sep 18 17:13:49.147003 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:13:49.146969    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-t4p6q_60bae8ea-9599-47f8-b066-df7c46c011b3/console-operator/1.log"
Sep 18 17:13:49.147861 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:13:49.147846    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-t4p6q_60bae8ea-9599-47f8-b066-df7c46c011b3/console-operator/1.log"
Sep 18 17:13:49.152986 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:13:49.152965    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktklw_3c1064f0-18a0-4c28-8fb9-a320535dcbbf/ovn-acl-logging/0.log"
Sep 18 17:13:49.153453 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:13:49.153435    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktklw_3c1064f0-18a0-4c28-8fb9-a320535dcbbf/ovn-acl-logging/0.log"
Sep 18 17:17:49.125072 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:49.125044    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-1ff44-6b78b6c5c9-7dx42"]
Sep 18 17:17:49.127717 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:49.125223    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-1ff44-6b78b6c5c9-7dx42" podUID="470cfc94-b2b5-4781-99e8-bd1a02cd4cbc" containerName="switch-graph-1ff44" containerID="cri-o://c5e87b17911d056f0d461722a83cf0b5a37c5b79e2277b901af649926a4ab4ab" gracePeriod=30
Sep 18 17:17:49.251868 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:49.251834    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25"]
Sep 18 17:17:49.252164 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:49.252122    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25" podUID="cf1783d6-7404-4a56-baad-1858de663182" containerName="kserve-container" containerID="cri-o://452e8b6cf3234af17268c9052ce4b190afce82de8cc7c4174b25833d38fc62ea" gracePeriod=30
Sep 18 17:17:49.252245 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:49.252148    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25" podUID="cf1783d6-7404-4a56-baad-1858de663182" containerName="kube-rbac-proxy" containerID="cri-o://4b17c75b8bd749400a65e3b57de995fabf700db04f109648499c9f88a74e0c30" gracePeriod=30
Sep 18 17:17:49.431620 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:49.431519    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl"]
Sep 18 17:17:49.435442 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:49.435419    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl"
Sep 18 17:17:49.438928 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:49.438907    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-21436-predictor-serving-cert\""
Sep 18 17:17:49.439235 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:49.439219    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-21436-kube-rbac-proxy-sar-config\""
Sep 18 17:17:49.456681 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:49.456648    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl"]
Sep 18 17:17:49.506471 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:49.506437    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b17786bb-e59e-4104-ae4c-65e0e3db8256-proxy-tls\") pod \"success-200-isvc-21436-predictor-c549db5dd-4klsl\" (UID: \"b17786bb-e59e-4104-ae4c-65e0e3db8256\") " pod="kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl"
Sep 18 17:17:49.506642 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:49.506486    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45dp4\" (UniqueName: \"kubernetes.io/projected/b17786bb-e59e-4104-ae4c-65e0e3db8256-kube-api-access-45dp4\") pod \"success-200-isvc-21436-predictor-c549db5dd-4klsl\" (UID: \"b17786bb-e59e-4104-ae4c-65e0e3db8256\") " pod="kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl"
Sep 18 17:17:49.506642 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:49.506619    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b17786bb-e59e-4104-ae4c-65e0e3db8256-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-21436-predictor-c549db5dd-4klsl\" (UID: \"b17786bb-e59e-4104-ae4c-65e0e3db8256\") " pod="kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl"
Sep 18 17:17:49.607928 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:49.607887    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b17786bb-e59e-4104-ae4c-65e0e3db8256-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-21436-predictor-c549db5dd-4klsl\" (UID: \"b17786bb-e59e-4104-ae4c-65e0e3db8256\") " pod="kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl"
Sep 18 17:17:49.607928 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:49.607931    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b17786bb-e59e-4104-ae4c-65e0e3db8256-proxy-tls\") pod \"success-200-isvc-21436-predictor-c549db5dd-4klsl\" (UID: \"b17786bb-e59e-4104-ae4c-65e0e3db8256\") " pod="kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl"
Sep 18 17:17:49.608176 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:49.607958    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45dp4\" (UniqueName: \"kubernetes.io/projected/b17786bb-e59e-4104-ae4c-65e0e3db8256-kube-api-access-45dp4\") pod \"success-200-isvc-21436-predictor-c549db5dd-4klsl\" (UID: \"b17786bb-e59e-4104-ae4c-65e0e3db8256\") " pod="kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl"
Sep 18 17:17:49.608685 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:49.608661    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b17786bb-e59e-4104-ae4c-65e0e3db8256-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-21436-predictor-c549db5dd-4klsl\" (UID: \"b17786bb-e59e-4104-ae4c-65e0e3db8256\") " pod="kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl"
Sep 18 17:17:49.610482 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:49.610460    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b17786bb-e59e-4104-ae4c-65e0e3db8256-proxy-tls\") pod \"success-200-isvc-21436-predictor-c549db5dd-4klsl\" (UID: \"b17786bb-e59e-4104-ae4c-65e0e3db8256\") " pod="kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl"
Sep 18 17:17:49.616773 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:49.616748    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45dp4\" (UniqueName: \"kubernetes.io/projected/b17786bb-e59e-4104-ae4c-65e0e3db8256-kube-api-access-45dp4\") pod \"success-200-isvc-21436-predictor-c549db5dd-4klsl\" (UID: \"b17786bb-e59e-4104-ae4c-65e0e3db8256\") " pod="kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl"
Sep 18 17:17:49.746881 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:49.746793    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl"
Sep 18 17:17:50.025077 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:50.022958    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl"]
Sep 18 17:17:50.029774 ip-10-0-132-41 kubenswrapper[2577]: W0918 17:17:50.028596    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb17786bb_e59e_4104_ae4c_65e0e3db8256.slice/crio-52497bb5f74be3c698aa17d3325ec3e80438b10d67876c7074b3a52f43f6f2fb WatchSource:0}: Error finding container 52497bb5f74be3c698aa17d3325ec3e80438b10d67876c7074b3a52f43f6f2fb: Status 404 returned error can't find the container with id 52497bb5f74be3c698aa17d3325ec3e80438b10d67876c7074b3a52f43f6f2fb
Sep 18 17:17:50.315360 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:50.315260    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl" event={"ID":"b17786bb-e59e-4104-ae4c-65e0e3db8256","Type":"ContainerStarted","Data":"a2ac75e8eb17866244cb667df42814cb363ec1177ac3cabd9b4d0091bca997a4"}
Sep 18 17:17:50.315360 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:50.315325    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl" event={"ID":"b17786bb-e59e-4104-ae4c-65e0e3db8256","Type":"ContainerStarted","Data":"4c7fc3ba40a0717c9357b60d8fa0527eb09c3238cf15a0f582816e9f9c18cb3b"}
Sep 18 17:17:50.315360 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:50.315358    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl" event={"ID":"b17786bb-e59e-4104-ae4c-65e0e3db8256","Type":"ContainerStarted","Data":"52497bb5f74be3c698aa17d3325ec3e80438b10d67876c7074b3a52f43f6f2fb"}
Sep 18 17:17:50.315945 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:50.315384    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl"
Sep 18 17:17:50.315945 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:50.315413    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl"
Sep 18 17:17:50.317250 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:50.317213    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl" podUID="b17786bb-e59e-4104-ae4c-65e0e3db8256" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: connect: connection refused"
Sep 18 17:17:50.317375 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:50.317293    2577 generic.go:356] "Generic (PLEG): container finished" podID="cf1783d6-7404-4a56-baad-1858de663182" containerID="4b17c75b8bd749400a65e3b57de995fabf700db04f109648499c9f88a74e0c30" exitCode=2
Sep 18 17:17:50.317422 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:50.317398    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25" event={"ID":"cf1783d6-7404-4a56-baad-1858de663182","Type":"ContainerDied","Data":"4b17c75b8bd749400a65e3b57de995fabf700db04f109648499c9f88a74e0c30"}
Sep 18 17:17:50.335920 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:50.335859    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl" podStartSLOduration=1.335845109 podStartE2EDuration="1.335845109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:17:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:17:50.334489206 +0000 UTC m=+1743.391778728" watchObservedRunningTime="2026-09-18 17:17:50.335845109 +0000 UTC m=+1743.393134714"
Sep 18 17:17:51.323653 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:51.323613    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl" podUID="b17786bb-e59e-4104-ae4c-65e0e3db8256" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: connect: connection refused"
Sep 18 17:17:51.931694 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:51.931648    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-1ff44-6b78b6c5c9-7dx42" podUID="470cfc94-b2b5-4781-99e8-bd1a02cd4cbc" containerName="switch-graph-1ff44" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:17:52.565599 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:52.565527    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25" podUID="cf1783d6-7404-4a56-baad-1858de663182" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.37:8643/healthz\": dial tcp 10.132.0.37:8643: connect: connection refused"
Sep 18 17:17:52.569890 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:52.569860    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25" podUID="cf1783d6-7404-4a56-baad-1858de663182" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused"
Sep 18 17:17:52.902720 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:52.902692    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25"
Sep 18 17:17:53.037252 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:53.037216    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4km6w\" (UniqueName: \"kubernetes.io/projected/cf1783d6-7404-4a56-baad-1858de663182-kube-api-access-4km6w\") pod \"cf1783d6-7404-4a56-baad-1858de663182\" (UID: \"cf1783d6-7404-4a56-baad-1858de663182\") "
Sep 18 17:17:53.037456 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:53.037286    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cf1783d6-7404-4a56-baad-1858de663182-kube-rbac-proxy-sar-config\") pod \"cf1783d6-7404-4a56-baad-1858de663182\" (UID: \"cf1783d6-7404-4a56-baad-1858de663182\") "
Sep 18 17:17:53.037456 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:53.037353    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cf1783d6-7404-4a56-baad-1858de663182-proxy-tls\") pod \"cf1783d6-7404-4a56-baad-1858de663182\" (UID: \"cf1783d6-7404-4a56-baad-1858de663182\") "
Sep 18 17:17:53.037685 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:53.037659    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf1783d6-7404-4a56-baad-1858de663182-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "cf1783d6-7404-4a56-baad-1858de663182" (UID: "cf1783d6-7404-4a56-baad-1858de663182"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:17:53.039366 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:53.039342    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf1783d6-7404-4a56-baad-1858de663182-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "cf1783d6-7404-4a56-baad-1858de663182" (UID: "cf1783d6-7404-4a56-baad-1858de663182"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:17:53.039438 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:53.039377    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf1783d6-7404-4a56-baad-1858de663182-kube-api-access-4km6w" (OuterVolumeSpecName: "kube-api-access-4km6w") pod "cf1783d6-7404-4a56-baad-1858de663182" (UID: "cf1783d6-7404-4a56-baad-1858de663182"). InnerVolumeSpecName "kube-api-access-4km6w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:17:53.138038 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:53.138011    2577 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cf1783d6-7404-4a56-baad-1858de663182-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:17:53.138038 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:53.138038    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cf1783d6-7404-4a56-baad-1858de663182-proxy-tls\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:17:53.138198 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:53.138049    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4km6w\" (UniqueName: \"kubernetes.io/projected/cf1783d6-7404-4a56-baad-1858de663182-kube-api-access-4km6w\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:17:53.334182 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:53.334133    2577 generic.go:356] "Generic (PLEG): container finished" podID="cf1783d6-7404-4a56-baad-1858de663182" containerID="452e8b6cf3234af17268c9052ce4b190afce82de8cc7c4174b25833d38fc62ea" exitCode=0
Sep 18 17:17:53.334182 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:53.334185    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25"
Sep 18 17:17:53.334441 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:53.334215    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25" event={"ID":"cf1783d6-7404-4a56-baad-1858de663182","Type":"ContainerDied","Data":"452e8b6cf3234af17268c9052ce4b190afce82de8cc7c4174b25833d38fc62ea"}
Sep 18 17:17:53.334441 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:53.334312    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25" event={"ID":"cf1783d6-7404-4a56-baad-1858de663182","Type":"ContainerDied","Data":"bfcb17a551962311331504bc01e2f1c764b262d9676108fbbecf44ca86388849"}
Sep 18 17:17:53.334441 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:53.334350    2577 scope.go:117] "RemoveContainer" containerID="4b17c75b8bd749400a65e3b57de995fabf700db04f109648499c9f88a74e0c30"
Sep 18 17:17:53.343175 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:53.343156    2577 scope.go:117] "RemoveContainer" containerID="452e8b6cf3234af17268c9052ce4b190afce82de8cc7c4174b25833d38fc62ea"
Sep 18 17:17:53.351417 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:53.351365    2577 scope.go:117] "RemoveContainer" containerID="4b17c75b8bd749400a65e3b57de995fabf700db04f109648499c9f88a74e0c30"
Sep 18 17:17:53.351697 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:17:53.351678    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b17c75b8bd749400a65e3b57de995fabf700db04f109648499c9f88a74e0c30\": container with ID starting with 4b17c75b8bd749400a65e3b57de995fabf700db04f109648499c9f88a74e0c30 not found: ID does not exist" containerID="4b17c75b8bd749400a65e3b57de995fabf700db04f109648499c9f88a74e0c30"
Sep 18 17:17:53.351788 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:53.351709    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b17c75b8bd749400a65e3b57de995fabf700db04f109648499c9f88a74e0c30"} err="failed to get container status \"4b17c75b8bd749400a65e3b57de995fabf700db04f109648499c9f88a74e0c30\": rpc error: code = NotFound desc = could not find container \"4b17c75b8bd749400a65e3b57de995fabf700db04f109648499c9f88a74e0c30\": container with ID starting with 4b17c75b8bd749400a65e3b57de995fabf700db04f109648499c9f88a74e0c30 not found: ID does not exist"
Sep 18 17:17:53.351788 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:53.351733    2577 scope.go:117] "RemoveContainer" containerID="452e8b6cf3234af17268c9052ce4b190afce82de8cc7c4174b25833d38fc62ea"
Sep 18 17:17:53.351962 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:17:53.351945    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"452e8b6cf3234af17268c9052ce4b190afce82de8cc7c4174b25833d38fc62ea\": container with ID starting with 452e8b6cf3234af17268c9052ce4b190afce82de8cc7c4174b25833d38fc62ea not found: ID does not exist" containerID="452e8b6cf3234af17268c9052ce4b190afce82de8cc7c4174b25833d38fc62ea"
Sep 18 17:17:53.352015 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:53.351967    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"452e8b6cf3234af17268c9052ce4b190afce82de8cc7c4174b25833d38fc62ea"} err="failed to get container status \"452e8b6cf3234af17268c9052ce4b190afce82de8cc7c4174b25833d38fc62ea\": rpc error: code = NotFound desc = could not find container \"452e8b6cf3234af17268c9052ce4b190afce82de8cc7c4174b25833d38fc62ea\": container with ID starting with 452e8b6cf3234af17268c9052ce4b190afce82de8cc7c4174b25833d38fc62ea not found: ID does not exist"
Sep 18 17:17:53.353260 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:53.353240    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25"]
Sep 18 17:17:53.360087 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:53.360067    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1ff44-predictor-54b47c469d-hwr25"]
Sep 18 17:17:55.123133 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:55.123096    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf1783d6-7404-4a56-baad-1858de663182" path="/var/lib/kubelet/pods/cf1783d6-7404-4a56-baad-1858de663182/volumes"
Sep 18 17:17:56.328343 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:56.328313    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl"
Sep 18 17:17:56.328955 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:56.328932    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl" podUID="b17786bb-e59e-4104-ae4c-65e0e3db8256" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: connect: connection refused"
Sep 18 17:17:56.932637 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:17:56.932592    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-1ff44-6b78b6c5c9-7dx42" podUID="470cfc94-b2b5-4781-99e8-bd1a02cd4cbc" containerName="switch-graph-1ff44" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:18:01.931895 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:01.931852    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-1ff44-6b78b6c5c9-7dx42" podUID="470cfc94-b2b5-4781-99e8-bd1a02cd4cbc" containerName="switch-graph-1ff44" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:18:01.932358 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:01.931981    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-1ff44-6b78b6c5c9-7dx42"
Sep 18 17:18:06.329788 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:06.329748    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl" podUID="b17786bb-e59e-4104-ae4c-65e0e3db8256" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: connect: connection refused"
Sep 18 17:18:06.932255 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:06.932214    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-1ff44-6b78b6c5c9-7dx42" podUID="470cfc94-b2b5-4781-99e8-bd1a02cd4cbc" containerName="switch-graph-1ff44" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:18:11.932465 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:11.932429    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-1ff44-6b78b6c5c9-7dx42" podUID="470cfc94-b2b5-4781-99e8-bd1a02cd4cbc" containerName="switch-graph-1ff44" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:18:16.329428 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:16.329386    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl" podUID="b17786bb-e59e-4104-ae4c-65e0e3db8256" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: connect: connection refused"
Sep 18 17:18:16.932063 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:16.932024    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-1ff44-6b78b6c5c9-7dx42" podUID="470cfc94-b2b5-4781-99e8-bd1a02cd4cbc" containerName="switch-graph-1ff44" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:18:19.285578 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:19.285541    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-1ff44-6b78b6c5c9-7dx42"
Sep 18 17:18:19.372365 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:19.372332    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/470cfc94-b2b5-4781-99e8-bd1a02cd4cbc-openshift-service-ca-bundle\") pod \"470cfc94-b2b5-4781-99e8-bd1a02cd4cbc\" (UID: \"470cfc94-b2b5-4781-99e8-bd1a02cd4cbc\") "
Sep 18 17:18:19.372563 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:19.372386    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/470cfc94-b2b5-4781-99e8-bd1a02cd4cbc-proxy-tls\") pod \"470cfc94-b2b5-4781-99e8-bd1a02cd4cbc\" (UID: \"470cfc94-b2b5-4781-99e8-bd1a02cd4cbc\") "
Sep 18 17:18:19.372734 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:19.372712    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/470cfc94-b2b5-4781-99e8-bd1a02cd4cbc-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "470cfc94-b2b5-4781-99e8-bd1a02cd4cbc" (UID: "470cfc94-b2b5-4781-99e8-bd1a02cd4cbc"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:18:19.374482 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:19.374458    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/470cfc94-b2b5-4781-99e8-bd1a02cd4cbc-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "470cfc94-b2b5-4781-99e8-bd1a02cd4cbc" (UID: "470cfc94-b2b5-4781-99e8-bd1a02cd4cbc"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:18:19.472961 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:19.472929    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/470cfc94-b2b5-4781-99e8-bd1a02cd4cbc-openshift-service-ca-bundle\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:18:19.472961 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:19.472956    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/470cfc94-b2b5-4781-99e8-bd1a02cd4cbc-proxy-tls\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:18:19.473669 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:19.473643    2577 generic.go:356] "Generic (PLEG): container finished" podID="470cfc94-b2b5-4781-99e8-bd1a02cd4cbc" containerID="c5e87b17911d056f0d461722a83cf0b5a37c5b79e2277b901af649926a4ab4ab" exitCode=0
Sep 18 17:18:19.473749 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:19.473679    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-1ff44-6b78b6c5c9-7dx42" event={"ID":"470cfc94-b2b5-4781-99e8-bd1a02cd4cbc","Type":"ContainerDied","Data":"c5e87b17911d056f0d461722a83cf0b5a37c5b79e2277b901af649926a4ab4ab"}
Sep 18 17:18:19.473749 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:19.473685    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-1ff44-6b78b6c5c9-7dx42"
Sep 18 17:18:19.473749 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:19.473717    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-1ff44-6b78b6c5c9-7dx42" event={"ID":"470cfc94-b2b5-4781-99e8-bd1a02cd4cbc","Type":"ContainerDied","Data":"e84b3ce4fa09ac396198c69328b72e7c0620689f9c2d1002fd21fca4ea6acf64"}
Sep 18 17:18:19.473749 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:19.473737    2577 scope.go:117] "RemoveContainer" containerID="c5e87b17911d056f0d461722a83cf0b5a37c5b79e2277b901af649926a4ab4ab"
Sep 18 17:18:19.482276 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:19.482260    2577 scope.go:117] "RemoveContainer" containerID="c5e87b17911d056f0d461722a83cf0b5a37c5b79e2277b901af649926a4ab4ab"
Sep 18 17:18:19.482578 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:18:19.482558    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5e87b17911d056f0d461722a83cf0b5a37c5b79e2277b901af649926a4ab4ab\": container with ID starting with c5e87b17911d056f0d461722a83cf0b5a37c5b79e2277b901af649926a4ab4ab not found: ID does not exist" containerID="c5e87b17911d056f0d461722a83cf0b5a37c5b79e2277b901af649926a4ab4ab"
Sep 18 17:18:19.482628 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:19.482588    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5e87b17911d056f0d461722a83cf0b5a37c5b79e2277b901af649926a4ab4ab"} err="failed to get container status \"c5e87b17911d056f0d461722a83cf0b5a37c5b79e2277b901af649926a4ab4ab\": rpc error: code = NotFound desc = could not find container \"c5e87b17911d056f0d461722a83cf0b5a37c5b79e2277b901af649926a4ab4ab\": container with ID starting with c5e87b17911d056f0d461722a83cf0b5a37c5b79e2277b901af649926a4ab4ab not found: ID does not exist"
Sep 18 17:18:19.496497 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:19.496467    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-1ff44-6b78b6c5c9-7dx42"]
Sep 18 17:18:19.500525 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:19.500496    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-1ff44-6b78b6c5c9-7dx42"]
Sep 18 17:18:20.026877 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:20.026845    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv"]
Sep 18 17:18:20.027154 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:20.027117    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv" podUID="f2712b96-4f47-4fb0-9e76-3c9458bf7bc8" containerName="kserve-container" containerID="cri-o://cea6b883241b413dc76f0635d4274b3a8c78e36931a9488ba88636dfe4ca67c8" gracePeriod=30
Sep 18 17:18:20.027293 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:20.027172    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv" podUID="f2712b96-4f47-4fb0-9e76-3c9458bf7bc8" containerName="kube-rbac-proxy" containerID="cri-o://41e86ad34d37da48f1ca7d680190c33fcdc6e032d9d0d276d4e3cedc0dcc0059" gracePeriod=30
Sep 18 17:18:20.152749 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:20.152719    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78"]
Sep 18 17:18:20.153176 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:20.153161    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf1783d6-7404-4a56-baad-1858de663182" containerName="kube-rbac-proxy"
Sep 18 17:18:20.153223 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:20.153178    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf1783d6-7404-4a56-baad-1858de663182" containerName="kube-rbac-proxy"
Sep 18 17:18:20.153223 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:20.153188    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="470cfc94-b2b5-4781-99e8-bd1a02cd4cbc" containerName="switch-graph-1ff44"
Sep 18 17:18:20.153223 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:20.153194    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="470cfc94-b2b5-4781-99e8-bd1a02cd4cbc" containerName="switch-graph-1ff44"
Sep 18 17:18:20.153223 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:20.153201    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf1783d6-7404-4a56-baad-1858de663182" containerName="kserve-container"
Sep 18 17:18:20.153223 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:20.153207    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf1783d6-7404-4a56-baad-1858de663182" containerName="kserve-container"
Sep 18 17:18:20.153398 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:20.153269    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf1783d6-7404-4a56-baad-1858de663182" containerName="kube-rbac-proxy"
Sep 18 17:18:20.153398 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:20.153279    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf1783d6-7404-4a56-baad-1858de663182" containerName="kserve-container"
Sep 18 17:18:20.153398 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:20.153286    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="470cfc94-b2b5-4781-99e8-bd1a02cd4cbc" containerName="switch-graph-1ff44"
Sep 18 17:18:20.156564 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:20.156544    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78"
Sep 18 17:18:20.158841 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:20.158811    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-78e6b-kube-rbac-proxy-sar-config\""
Sep 18 17:18:20.159002 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:20.158990    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-78e6b-predictor-serving-cert\""
Sep 18 17:18:20.176965 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:20.173657    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78"]
Sep 18 17:18:20.179618 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:20.179596    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hwsb\" (UniqueName: \"kubernetes.io/projected/904d024d-55c0-4f00-89ad-1a11e61dfddb-kube-api-access-6hwsb\") pod \"success-200-isvc-78e6b-predictor-6cd8944648-5vd78\" (UID: \"904d024d-55c0-4f00-89ad-1a11e61dfddb\") " pod="kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78"
Sep 18 17:18:20.179699 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:20.179652    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/904d024d-55c0-4f00-89ad-1a11e61dfddb-proxy-tls\") pod \"success-200-isvc-78e6b-predictor-6cd8944648-5vd78\" (UID: \"904d024d-55c0-4f00-89ad-1a11e61dfddb\") " pod="kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78"
Sep 18 17:18:20.179901 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:20.179771    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/904d024d-55c0-4f00-89ad-1a11e61dfddb-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-78e6b-predictor-6cd8944648-5vd78\" (UID: \"904d024d-55c0-4f00-89ad-1a11e61dfddb\") " pod="kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78"
Sep 18 17:18:20.281048 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:20.280959    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/904d024d-55c0-4f00-89ad-1a11e61dfddb-proxy-tls\") pod \"success-200-isvc-78e6b-predictor-6cd8944648-5vd78\" (UID: \"904d024d-55c0-4f00-89ad-1a11e61dfddb\") " pod="kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78"
Sep 18 17:18:20.281048 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:20.281043    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/904d024d-55c0-4f00-89ad-1a11e61dfddb-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-78e6b-predictor-6cd8944648-5vd78\" (UID: \"904d024d-55c0-4f00-89ad-1a11e61dfddb\") " pod="kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78"
Sep 18 17:18:20.281347 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:20.281080    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hwsb\" (UniqueName: \"kubernetes.io/projected/904d024d-55c0-4f00-89ad-1a11e61dfddb-kube-api-access-6hwsb\") pod \"success-200-isvc-78e6b-predictor-6cd8944648-5vd78\" (UID: \"904d024d-55c0-4f00-89ad-1a11e61dfddb\") " pod="kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78"
Sep 18 17:18:20.281347 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:18:20.281121    2577 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-serving-cert: secret "success-200-isvc-78e6b-predictor-serving-cert" not found
Sep 18 17:18:20.281347 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:18:20.281224    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/904d024d-55c0-4f00-89ad-1a11e61dfddb-proxy-tls podName:904d024d-55c0-4f00-89ad-1a11e61dfddb nodeName:}" failed. No retries permitted until 2026-09-18 17:18:20.781201538 +0000 UTC m=+1773.838491049 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/904d024d-55c0-4f00-89ad-1a11e61dfddb-proxy-tls") pod "success-200-isvc-78e6b-predictor-6cd8944648-5vd78" (UID: "904d024d-55c0-4f00-89ad-1a11e61dfddb") : secret "success-200-isvc-78e6b-predictor-serving-cert" not found
Sep 18 17:18:20.281864 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:20.281839    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/904d024d-55c0-4f00-89ad-1a11e61dfddb-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-78e6b-predictor-6cd8944648-5vd78\" (UID: \"904d024d-55c0-4f00-89ad-1a11e61dfddb\") " pod="kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78"
Sep 18 17:18:20.293023 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:20.292992    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hwsb\" (UniqueName: \"kubernetes.io/projected/904d024d-55c0-4f00-89ad-1a11e61dfddb-kube-api-access-6hwsb\") pod \"success-200-isvc-78e6b-predictor-6cd8944648-5vd78\" (UID: \"904d024d-55c0-4f00-89ad-1a11e61dfddb\") " pod="kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78"
Sep 18 17:18:20.481484 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:20.481446    2577 generic.go:356] "Generic (PLEG): container finished" podID="f2712b96-4f47-4fb0-9e76-3c9458bf7bc8" containerID="41e86ad34d37da48f1ca7d680190c33fcdc6e032d9d0d276d4e3cedc0dcc0059" exitCode=2
Sep 18 17:18:20.481678 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:20.481519    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv" event={"ID":"f2712b96-4f47-4fb0-9e76-3c9458bf7bc8","Type":"ContainerDied","Data":"41e86ad34d37da48f1ca7d680190c33fcdc6e032d9d0d276d4e3cedc0dcc0059"}
Sep 18 17:18:20.785877 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:20.785837    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/904d024d-55c0-4f00-89ad-1a11e61dfddb-proxy-tls\") pod \"success-200-isvc-78e6b-predictor-6cd8944648-5vd78\" (UID: \"904d024d-55c0-4f00-89ad-1a11e61dfddb\") " pod="kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78"
Sep 18 17:18:20.788368 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:20.788341    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/904d024d-55c0-4f00-89ad-1a11e61dfddb-proxy-tls\") pod \"success-200-isvc-78e6b-predictor-6cd8944648-5vd78\" (UID: \"904d024d-55c0-4f00-89ad-1a11e61dfddb\") " pod="kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78"
Sep 18 17:18:21.072292 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:21.072200    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78"
Sep 18 17:18:21.124296 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:21.124266    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="470cfc94-b2b5-4781-99e8-bd1a02cd4cbc" path="/var/lib/kubelet/pods/470cfc94-b2b5-4781-99e8-bd1a02cd4cbc/volumes"
Sep 18 17:18:21.347478 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:21.347425    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78"]
Sep 18 17:18:21.350015 ip-10-0-132-41 kubenswrapper[2577]: W0918 17:18:21.349982    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod904d024d_55c0_4f00_89ad_1a11e61dfddb.slice/crio-704c243f2f9c2a452f0b39ca7edb2d73f7dec6241e1381459d6189e74b9644ae WatchSource:0}: Error finding container 704c243f2f9c2a452f0b39ca7edb2d73f7dec6241e1381459d6189e74b9644ae: Status 404 returned error can't find the container with id 704c243f2f9c2a452f0b39ca7edb2d73f7dec6241e1381459d6189e74b9644ae
Sep 18 17:18:21.492690 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:21.492657    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78" event={"ID":"904d024d-55c0-4f00-89ad-1a11e61dfddb","Type":"ContainerStarted","Data":"ebf869cfffc715a7274bd459c868fb963bd67a3bfc523a4a72b928c2a95bff39"}
Sep 18 17:18:21.492827 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:21.492718    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78" event={"ID":"904d024d-55c0-4f00-89ad-1a11e61dfddb","Type":"ContainerStarted","Data":"704c243f2f9c2a452f0b39ca7edb2d73f7dec6241e1381459d6189e74b9644ae"}
Sep 18 17:18:21.720708 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:21.720668    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv" podUID="f2712b96-4f47-4fb0-9e76-3c9458bf7bc8" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.39:8643/healthz\": dial tcp 10.132.0.39:8643: connect: connection refused"
Sep 18 17:18:21.725429 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:21.725401    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv" podUID="f2712b96-4f47-4fb0-9e76-3c9458bf7bc8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Sep 18 17:18:22.499845 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:22.499811    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78" event={"ID":"904d024d-55c0-4f00-89ad-1a11e61dfddb","Type":"ContainerStarted","Data":"08864da552ed45bcb2346bfc9335bfc3693a68342cf1baf2ab4c272a329358f8"}
Sep 18 17:18:22.500239 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:22.499948    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78"
Sep 18 17:18:22.518284 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:22.518234    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78" podStartSLOduration=2.518219448 podStartE2EDuration="2.518219448s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:18:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:18:22.517787901 +0000 UTC m=+1775.575077429" watchObservedRunningTime="2026-09-18 17:18:22.518219448 +0000 UTC m=+1775.575508975"
Sep 18 17:18:23.504174 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:23.504139    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78"
Sep 18 17:18:23.505501 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:23.505472    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78" podUID="904d024d-55c0-4f00-89ad-1a11e61dfddb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.42:8080: connect: connection refused"
Sep 18 17:18:24.510822 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:24.510736    2577 generic.go:356] "Generic (PLEG): container finished" podID="f2712b96-4f47-4fb0-9e76-3c9458bf7bc8" containerID="cea6b883241b413dc76f0635d4274b3a8c78e36931a9488ba88636dfe4ca67c8" exitCode=0
Sep 18 17:18:24.510822 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:24.510810    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv" event={"ID":"f2712b96-4f47-4fb0-9e76-3c9458bf7bc8","Type":"ContainerDied","Data":"cea6b883241b413dc76f0635d4274b3a8c78e36931a9488ba88636dfe4ca67c8"}
Sep 18 17:18:24.511253 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:24.511199    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78" podUID="904d024d-55c0-4f00-89ad-1a11e61dfddb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.42:8080: connect: connection refused"
Sep 18 17:18:24.776436 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:24.776371    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv"
Sep 18 17:18:24.821047 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:24.821011    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ss25v\" (UniqueName: \"kubernetes.io/projected/f2712b96-4f47-4fb0-9e76-3c9458bf7bc8-kube-api-access-ss25v\") pod \"f2712b96-4f47-4fb0-9e76-3c9458bf7bc8\" (UID: \"f2712b96-4f47-4fb0-9e76-3c9458bf7bc8\") "
Sep 18 17:18:24.821234 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:24.821077    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f2712b96-4f47-4fb0-9e76-3c9458bf7bc8-proxy-tls\") pod \"f2712b96-4f47-4fb0-9e76-3c9458bf7bc8\" (UID: \"f2712b96-4f47-4fb0-9e76-3c9458bf7bc8\") "
Sep 18 17:18:24.821234 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:24.821123    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f2712b96-4f47-4fb0-9e76-3c9458bf7bc8-kube-rbac-proxy-sar-config\") pod \"f2712b96-4f47-4fb0-9e76-3c9458bf7bc8\" (UID: \"f2712b96-4f47-4fb0-9e76-3c9458bf7bc8\") "
Sep 18 17:18:24.821520 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:24.821489    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2712b96-4f47-4fb0-9e76-3c9458bf7bc8-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "f2712b96-4f47-4fb0-9e76-3c9458bf7bc8" (UID: "f2712b96-4f47-4fb0-9e76-3c9458bf7bc8"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:18:24.823156 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:24.823132    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2712b96-4f47-4fb0-9e76-3c9458bf7bc8-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "f2712b96-4f47-4fb0-9e76-3c9458bf7bc8" (UID: "f2712b96-4f47-4fb0-9e76-3c9458bf7bc8"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:18:24.823257 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:24.823191    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2712b96-4f47-4fb0-9e76-3c9458bf7bc8-kube-api-access-ss25v" (OuterVolumeSpecName: "kube-api-access-ss25v") pod "f2712b96-4f47-4fb0-9e76-3c9458bf7bc8" (UID: "f2712b96-4f47-4fb0-9e76-3c9458bf7bc8"). InnerVolumeSpecName "kube-api-access-ss25v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:18:24.922420 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:24.922382    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ss25v\" (UniqueName: \"kubernetes.io/projected/f2712b96-4f47-4fb0-9e76-3c9458bf7bc8-kube-api-access-ss25v\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:18:24.922420 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:24.922416    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f2712b96-4f47-4fb0-9e76-3c9458bf7bc8-proxy-tls\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:18:24.922420 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:24.922427    2577 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f2712b96-4f47-4fb0-9e76-3c9458bf7bc8-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:18:25.517908 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:25.517830    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv"
Sep 18 17:18:25.518295 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:25.517835    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv" event={"ID":"f2712b96-4f47-4fb0-9e76-3c9458bf7bc8","Type":"ContainerDied","Data":"6a4d79453f7cf9f603ff68cd082d4d9f4649bf9b6f201d31a4b2ecbd9761cd33"}
Sep 18 17:18:25.518295 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:25.517964    2577 scope.go:117] "RemoveContainer" containerID="41e86ad34d37da48f1ca7d680190c33fcdc6e032d9d0d276d4e3cedc0dcc0059"
Sep 18 17:18:25.526723 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:25.526702    2577 scope.go:117] "RemoveContainer" containerID="cea6b883241b413dc76f0635d4274b3a8c78e36931a9488ba88636dfe4ca67c8"
Sep 18 17:18:25.538153 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:25.538131    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv"]
Sep 18 17:18:25.542052 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:25.542032    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9846a-predictor-84848664-z4zxv"]
Sep 18 17:18:26.329340 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:26.329301    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl" podUID="b17786bb-e59e-4104-ae4c-65e0e3db8256" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: connect: connection refused"
Sep 18 17:18:27.122639 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:27.122606    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2712b96-4f47-4fb0-9e76-3c9458bf7bc8" path="/var/lib/kubelet/pods/f2712b96-4f47-4fb0-9e76-3c9458bf7bc8/volumes"
Sep 18 17:18:29.515747 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:29.515713    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78"
Sep 18 17:18:29.516219 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:29.516194    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78" podUID="904d024d-55c0-4f00-89ad-1a11e61dfddb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.42:8080: connect: connection refused"
Sep 18 17:18:36.329237 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:36.329149    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl" podUID="b17786bb-e59e-4104-ae4c-65e0e3db8256" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: connect: connection refused"
Sep 18 17:18:39.516745 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:39.516703    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78" podUID="904d024d-55c0-4f00-89ad-1a11e61dfddb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.42:8080: connect: connection refused"
Sep 18 17:18:46.329525 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:46.329494    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl"
Sep 18 17:18:49.180835 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:49.180806    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-t4p6q_60bae8ea-9599-47f8-b066-df7c46c011b3/console-operator/1.log"
Sep 18 17:18:49.181330 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:49.181081    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-t4p6q_60bae8ea-9599-47f8-b066-df7c46c011b3/console-operator/1.log"
Sep 18 17:18:49.193170 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:49.193137    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktklw_3c1064f0-18a0-4c28-8fb9-a320535dcbbf/ovn-acl-logging/0.log"
Sep 18 17:18:49.193352 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:49.193203    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktklw_3c1064f0-18a0-4c28-8fb9-a320535dcbbf/ovn-acl-logging/0.log"
Sep 18 17:18:49.516754 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:49.516659    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78" podUID="904d024d-55c0-4f00-89ad-1a11e61dfddb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.42:8080: connect: connection refused"
Sep 18 17:18:59.517156 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:18:59.517115    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78" podUID="904d024d-55c0-4f00-89ad-1a11e61dfddb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.42:8080: connect: connection refused"
Sep 18 17:19:09.516221 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:09.516182    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78" podUID="904d024d-55c0-4f00-89ad-1a11e61dfddb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.42:8080: connect: connection refused"
Sep 18 17:19:10.315997 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:10.315965    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl"]
Sep 18 17:19:10.316224 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:10.316181    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl" podUID="b17786bb-e59e-4104-ae4c-65e0e3db8256" containerName="kserve-container" containerID="cri-o://4c7fc3ba40a0717c9357b60d8fa0527eb09c3238cf15a0f582816e9f9c18cb3b" gracePeriod=30
Sep 18 17:19:10.316375 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:10.316212    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl" podUID="b17786bb-e59e-4104-ae4c-65e0e3db8256" containerName="kube-rbac-proxy" containerID="cri-o://a2ac75e8eb17866244cb667df42814cb363ec1177ac3cabd9b4d0091bca997a4" gracePeriod=30
Sep 18 17:19:10.440969 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:10.440938    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts"]
Sep 18 17:19:10.441364 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:10.441351    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2712b96-4f47-4fb0-9e76-3c9458bf7bc8" containerName="kserve-container"
Sep 18 17:19:10.441407 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:10.441366    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2712b96-4f47-4fb0-9e76-3c9458bf7bc8" containerName="kserve-container"
Sep 18 17:19:10.441407 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:10.441384    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2712b96-4f47-4fb0-9e76-3c9458bf7bc8" containerName="kube-rbac-proxy"
Sep 18 17:19:10.441407 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:10.441393    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2712b96-4f47-4fb0-9e76-3c9458bf7bc8" containerName="kube-rbac-proxy"
Sep 18 17:19:10.441592 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:10.441467    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2712b96-4f47-4fb0-9e76-3c9458bf7bc8" containerName="kube-rbac-proxy"
Sep 18 17:19:10.441592 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:10.441479    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2712b96-4f47-4fb0-9e76-3c9458bf7bc8" containerName="kserve-container"
Sep 18 17:19:10.444400 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:10.444372    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts"
Sep 18 17:19:10.450001 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:10.449980    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-cca0b-predictor-serving-cert\""
Sep 18 17:19:10.450365 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:10.450342    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-cca0b-kube-rbac-proxy-sar-config\""
Sep 18 17:19:10.459462 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:10.459433    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts"]
Sep 18 17:19:10.525067 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:10.525026    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsr9j\" (UniqueName: \"kubernetes.io/projected/f8eab596-268c-4b37-9bd0-8f2084a18df9-kube-api-access-lsr9j\") pod \"success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts\" (UID: \"f8eab596-268c-4b37-9bd0-8f2084a18df9\") " pod="kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts"
Sep 18 17:19:10.525471 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:10.525084    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f8eab596-268c-4b37-9bd0-8f2084a18df9-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts\" (UID: \"f8eab596-268c-4b37-9bd0-8f2084a18df9\") " pod="kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts"
Sep 18 17:19:10.525471 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:10.525139    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f8eab596-268c-4b37-9bd0-8f2084a18df9-proxy-tls\") pod \"success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts\" (UID: \"f8eab596-268c-4b37-9bd0-8f2084a18df9\") " pod="kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts"
Sep 18 17:19:10.626101 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:10.626060    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsr9j\" (UniqueName: \"kubernetes.io/projected/f8eab596-268c-4b37-9bd0-8f2084a18df9-kube-api-access-lsr9j\") pod \"success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts\" (UID: \"f8eab596-268c-4b37-9bd0-8f2084a18df9\") " pod="kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts"
Sep 18 17:19:10.626284 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:10.626117    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f8eab596-268c-4b37-9bd0-8f2084a18df9-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts\" (UID: \"f8eab596-268c-4b37-9bd0-8f2084a18df9\") " pod="kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts"
Sep 18 17:19:10.626284 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:10.626149    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f8eab596-268c-4b37-9bd0-8f2084a18df9-proxy-tls\") pod \"success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts\" (UID: \"f8eab596-268c-4b37-9bd0-8f2084a18df9\") " pod="kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts"
Sep 18 17:19:10.626284 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:19:10.626253    2577 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-serving-cert: secret "success-200-isvc-cca0b-predictor-serving-cert" not found
Sep 18 17:19:10.626436 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:19:10.626310    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8eab596-268c-4b37-9bd0-8f2084a18df9-proxy-tls podName:f8eab596-268c-4b37-9bd0-8f2084a18df9 nodeName:}" failed. No retries permitted until 2026-09-18 17:19:11.126291434 +0000 UTC m=+1824.183580943 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/f8eab596-268c-4b37-9bd0-8f2084a18df9-proxy-tls") pod "success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts" (UID: "f8eab596-268c-4b37-9bd0-8f2084a18df9") : secret "success-200-isvc-cca0b-predictor-serving-cert" not found
Sep 18 17:19:10.626857 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:10.626838    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f8eab596-268c-4b37-9bd0-8f2084a18df9-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts\" (UID: \"f8eab596-268c-4b37-9bd0-8f2084a18df9\") " pod="kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts"
Sep 18 17:19:10.649249 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:10.649212    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsr9j\" (UniqueName: \"kubernetes.io/projected/f8eab596-268c-4b37-9bd0-8f2084a18df9-kube-api-access-lsr9j\") pod \"success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts\" (UID: \"f8eab596-268c-4b37-9bd0-8f2084a18df9\") " pod="kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts"
Sep 18 17:19:10.741497 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:10.741462    2577 generic.go:356] "Generic (PLEG): container finished" podID="b17786bb-e59e-4104-ae4c-65e0e3db8256" containerID="a2ac75e8eb17866244cb667df42814cb363ec1177ac3cabd9b4d0091bca997a4" exitCode=2
Sep 18 17:19:10.741707 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:10.741518    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl" event={"ID":"b17786bb-e59e-4104-ae4c-65e0e3db8256","Type":"ContainerDied","Data":"a2ac75e8eb17866244cb667df42814cb363ec1177ac3cabd9b4d0091bca997a4"}
Sep 18 17:19:11.131466 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:11.131432    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f8eab596-268c-4b37-9bd0-8f2084a18df9-proxy-tls\") pod \"success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts\" (UID: \"f8eab596-268c-4b37-9bd0-8f2084a18df9\") " pod="kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts"
Sep 18 17:19:11.133889 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:11.133863    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f8eab596-268c-4b37-9bd0-8f2084a18df9-proxy-tls\") pod \"success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts\" (UID: \"f8eab596-268c-4b37-9bd0-8f2084a18df9\") " pod="kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts"
Sep 18 17:19:11.324610 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:11.324561    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl" podUID="b17786bb-e59e-4104-ae4c-65e0e3db8256" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.41:8643/healthz\": dial tcp 10.132.0.41:8643: connect: connection refused"
Sep 18 17:19:11.355999 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:11.355968    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts"
Sep 18 17:19:11.639340 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:11.639316    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts"]
Sep 18 17:19:11.641164 ip-10-0-132-41 kubenswrapper[2577]: W0918 17:19:11.641136    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8eab596_268c_4b37_9bd0_8f2084a18df9.slice/crio-50f23af1ab4e4e21dfa62b6cf4623adf126d4c33673e59a7e9ead8bbf4f4dfc8 WatchSource:0}: Error finding container 50f23af1ab4e4e21dfa62b6cf4623adf126d4c33673e59a7e9ead8bbf4f4dfc8: Status 404 returned error can't find the container with id 50f23af1ab4e4e21dfa62b6cf4623adf126d4c33673e59a7e9ead8bbf4f4dfc8
Sep 18 17:19:11.749747 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:11.749718    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts" event={"ID":"f8eab596-268c-4b37-9bd0-8f2084a18df9","Type":"ContainerStarted","Data":"347265a5c112c5a27f09deba5c5e28862847c92c1e08d3f68b50cc95c368e7b3"}
Sep 18 17:19:11.749864 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:11.749774    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts" event={"ID":"f8eab596-268c-4b37-9bd0-8f2084a18df9","Type":"ContainerStarted","Data":"50f23af1ab4e4e21dfa62b6cf4623adf126d4c33673e59a7e9ead8bbf4f4dfc8"}
Sep 18 17:19:12.756742 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:12.756700    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts" event={"ID":"f8eab596-268c-4b37-9bd0-8f2084a18df9","Type":"ContainerStarted","Data":"be31f5f7daafbbdea5b99c8d26b458475f160f61e321424c2e394d8b9f856b9a"}
Sep 18 17:19:12.757150 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:12.756932    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts"
Sep 18 17:19:12.757150 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:12.756973    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts"
Sep 18 17:19:12.758331 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:12.758302    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts" podUID="f8eab596-268c-4b37-9bd0-8f2084a18df9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.43:8080: connect: connection refused"
Sep 18 17:19:12.779713 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:12.779664    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts" podStartSLOduration=2.77964902 podStartE2EDuration="2.77964902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:19:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:19:12.777644331 +0000 UTC m=+1825.834933854" watchObservedRunningTime="2026-09-18 17:19:12.77964902 +0000 UTC m=+1825.836938547"
Sep 18 17:19:13.761270 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:13.761233    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts" podUID="f8eab596-268c-4b37-9bd0-8f2084a18df9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.43:8080: connect: connection refused"
Sep 18 17:19:13.966948 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:13.966924    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl"
Sep 18 17:19:14.057450 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:14.057367    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b17786bb-e59e-4104-ae4c-65e0e3db8256-kube-rbac-proxy-sar-config\") pod \"b17786bb-e59e-4104-ae4c-65e0e3db8256\" (UID: \"b17786bb-e59e-4104-ae4c-65e0e3db8256\") "
Sep 18 17:19:14.057450 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:14.057444    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b17786bb-e59e-4104-ae4c-65e0e3db8256-proxy-tls\") pod \"b17786bb-e59e-4104-ae4c-65e0e3db8256\" (UID: \"b17786bb-e59e-4104-ae4c-65e0e3db8256\") "
Sep 18 17:19:14.057693 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:14.057492    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45dp4\" (UniqueName: \"kubernetes.io/projected/b17786bb-e59e-4104-ae4c-65e0e3db8256-kube-api-access-45dp4\") pod \"b17786bb-e59e-4104-ae4c-65e0e3db8256\" (UID: \"b17786bb-e59e-4104-ae4c-65e0e3db8256\") "
Sep 18 17:19:14.057843 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:14.057816    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b17786bb-e59e-4104-ae4c-65e0e3db8256-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "b17786bb-e59e-4104-ae4c-65e0e3db8256" (UID: "b17786bb-e59e-4104-ae4c-65e0e3db8256"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:19:14.059600 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:14.059579    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b17786bb-e59e-4104-ae4c-65e0e3db8256-kube-api-access-45dp4" (OuterVolumeSpecName: "kube-api-access-45dp4") pod "b17786bb-e59e-4104-ae4c-65e0e3db8256" (UID: "b17786bb-e59e-4104-ae4c-65e0e3db8256"). InnerVolumeSpecName "kube-api-access-45dp4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:19:14.059677 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:14.059669    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b17786bb-e59e-4104-ae4c-65e0e3db8256-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "b17786bb-e59e-4104-ae4c-65e0e3db8256" (UID: "b17786bb-e59e-4104-ae4c-65e0e3db8256"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:19:14.159026 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:14.158993    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45dp4\" (UniqueName: \"kubernetes.io/projected/b17786bb-e59e-4104-ae4c-65e0e3db8256-kube-api-access-45dp4\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:19:14.159026 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:14.159020    2577 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b17786bb-e59e-4104-ae4c-65e0e3db8256-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:19:14.159026 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:14.159031    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b17786bb-e59e-4104-ae4c-65e0e3db8256-proxy-tls\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:19:14.769154 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:14.769096    2577 generic.go:356] "Generic (PLEG): container finished" podID="b17786bb-e59e-4104-ae4c-65e0e3db8256" containerID="4c7fc3ba40a0717c9357b60d8fa0527eb09c3238cf15a0f582816e9f9c18cb3b" exitCode=0
Sep 18 17:19:14.769590 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:14.769160    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl" event={"ID":"b17786bb-e59e-4104-ae4c-65e0e3db8256","Type":"ContainerDied","Data":"4c7fc3ba40a0717c9357b60d8fa0527eb09c3238cf15a0f582816e9f9c18cb3b"}
Sep 18 17:19:14.769590 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:14.769173    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl"
Sep 18 17:19:14.769590 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:14.769252    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl" event={"ID":"b17786bb-e59e-4104-ae4c-65e0e3db8256","Type":"ContainerDied","Data":"52497bb5f74be3c698aa17d3325ec3e80438b10d67876c7074b3a52f43f6f2fb"}
Sep 18 17:19:14.769590 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:14.769291    2577 scope.go:117] "RemoveContainer" containerID="a2ac75e8eb17866244cb667df42814cb363ec1177ac3cabd9b4d0091bca997a4"
Sep 18 17:19:14.778596 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:14.778575    2577 scope.go:117] "RemoveContainer" containerID="4c7fc3ba40a0717c9357b60d8fa0527eb09c3238cf15a0f582816e9f9c18cb3b"
Sep 18 17:19:14.787382 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:14.787362    2577 scope.go:117] "RemoveContainer" containerID="a2ac75e8eb17866244cb667df42814cb363ec1177ac3cabd9b4d0091bca997a4"
Sep 18 17:19:14.787683 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:19:14.787663    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2ac75e8eb17866244cb667df42814cb363ec1177ac3cabd9b4d0091bca997a4\": container with ID starting with a2ac75e8eb17866244cb667df42814cb363ec1177ac3cabd9b4d0091bca997a4 not found: ID does not exist" containerID="a2ac75e8eb17866244cb667df42814cb363ec1177ac3cabd9b4d0091bca997a4"
Sep 18 17:19:14.787753 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:14.787692    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2ac75e8eb17866244cb667df42814cb363ec1177ac3cabd9b4d0091bca997a4"} err="failed to get container status \"a2ac75e8eb17866244cb667df42814cb363ec1177ac3cabd9b4d0091bca997a4\": rpc error: code = NotFound desc = could not find container \"a2ac75e8eb17866244cb667df42814cb363ec1177ac3cabd9b4d0091bca997a4\": container with ID starting with a2ac75e8eb17866244cb667df42814cb363ec1177ac3cabd9b4d0091bca997a4 not found: ID does not exist"
Sep 18 17:19:14.787753 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:14.787709    2577 scope.go:117] "RemoveContainer" containerID="4c7fc3ba40a0717c9357b60d8fa0527eb09c3238cf15a0f582816e9f9c18cb3b"
Sep 18 17:19:14.787926 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:19:14.787912    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c7fc3ba40a0717c9357b60d8fa0527eb09c3238cf15a0f582816e9f9c18cb3b\": container with ID starting with 4c7fc3ba40a0717c9357b60d8fa0527eb09c3238cf15a0f582816e9f9c18cb3b not found: ID does not exist" containerID="4c7fc3ba40a0717c9357b60d8fa0527eb09c3238cf15a0f582816e9f9c18cb3b"
Sep 18 17:19:14.787969 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:14.787928    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c7fc3ba40a0717c9357b60d8fa0527eb09c3238cf15a0f582816e9f9c18cb3b"} err="failed to get container status \"4c7fc3ba40a0717c9357b60d8fa0527eb09c3238cf15a0f582816e9f9c18cb3b\": rpc error: code = NotFound desc = could not find container \"4c7fc3ba40a0717c9357b60d8fa0527eb09c3238cf15a0f582816e9f9c18cb3b\": container with ID starting with 4c7fc3ba40a0717c9357b60d8fa0527eb09c3238cf15a0f582816e9f9c18cb3b not found: ID does not exist"
Sep 18 17:19:14.792518 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:14.792482    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl"]
Sep 18 17:19:14.795977 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:14.795956    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-21436-predictor-c549db5dd-4klsl"]
Sep 18 17:19:15.122844 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:15.122816    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b17786bb-e59e-4104-ae4c-65e0e3db8256" path="/var/lib/kubelet/pods/b17786bb-e59e-4104-ae4c-65e0e3db8256/volumes"
Sep 18 17:19:18.767236 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:18.767205    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts"
Sep 18 17:19:18.767768 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:18.767738    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts" podUID="f8eab596-268c-4b37-9bd0-8f2084a18df9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.43:8080: connect: connection refused"
Sep 18 17:19:19.516685 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:19.516659    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78"
Sep 18 17:19:28.767805 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:28.767765    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts" podUID="f8eab596-268c-4b37-9bd0-8f2084a18df9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.43:8080: connect: connection refused"
Sep 18 17:19:38.768060 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:38.768021    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts" podUID="f8eab596-268c-4b37-9bd0-8f2084a18df9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.43:8080: connect: connection refused"
Sep 18 17:19:41.246615 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:41.246570    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78"]
Sep 18 17:19:41.247092 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:41.246949    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78" podUID="904d024d-55c0-4f00-89ad-1a11e61dfddb" containerName="kserve-container" containerID="cri-o://ebf869cfffc715a7274bd459c868fb963bd67a3bfc523a4a72b928c2a95bff39" gracePeriod=30
Sep 18 17:19:41.247092 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:41.247047    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78" podUID="904d024d-55c0-4f00-89ad-1a11e61dfddb" containerName="kube-rbac-proxy" containerID="cri-o://08864da552ed45bcb2346bfc9335bfc3693a68342cf1baf2ab4c272a329358f8" gracePeriod=30
Sep 18 17:19:41.460383 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:41.460346    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv"]
Sep 18 17:19:41.460802 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:41.460786    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b17786bb-e59e-4104-ae4c-65e0e3db8256" containerName="kube-rbac-proxy"
Sep 18 17:19:41.460873 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:41.460805    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b17786bb-e59e-4104-ae4c-65e0e3db8256" containerName="kube-rbac-proxy"
Sep 18 17:19:41.460873 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:41.460830    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b17786bb-e59e-4104-ae4c-65e0e3db8256" containerName="kserve-container"
Sep 18 17:19:41.460873 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:41.460836    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b17786bb-e59e-4104-ae4c-65e0e3db8256" containerName="kserve-container"
Sep 18 17:19:41.461035 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:41.460909    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b17786bb-e59e-4104-ae4c-65e0e3db8256" containerName="kube-rbac-proxy"
Sep 18 17:19:41.461035 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:41.460917    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b17786bb-e59e-4104-ae4c-65e0e3db8256" containerName="kserve-container"
Sep 18 17:19:41.464176 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:41.464155    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv"
Sep 18 17:19:41.469508 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:41.469477    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-792b5-predictor-serving-cert\""
Sep 18 17:19:41.469673 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:41.469480    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-792b5-kube-rbac-proxy-sar-config\""
Sep 18 17:19:41.479376 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:41.479346    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv"]
Sep 18 17:19:41.607848 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:41.607822    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjjd9\" (UniqueName: \"kubernetes.io/projected/c9bf7cd4-8630-4584-bee8-5de542d492bb-kube-api-access-qjjd9\") pod \"success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv\" (UID: \"c9bf7cd4-8630-4584-bee8-5de542d492bb\") " pod="kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv"
Sep 18 17:19:41.608038 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:41.607881    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c9bf7cd4-8630-4584-bee8-5de542d492bb-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv\" (UID: \"c9bf7cd4-8630-4584-bee8-5de542d492bb\") " pod="kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv"
Sep 18 17:19:41.608038 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:41.607910    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c9bf7cd4-8630-4584-bee8-5de542d492bb-proxy-tls\") pod \"success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv\" (UID: \"c9bf7cd4-8630-4584-bee8-5de542d492bb\") " pod="kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv"
Sep 18 17:19:41.709106 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:41.709073    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c9bf7cd4-8630-4584-bee8-5de542d492bb-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv\" (UID: \"c9bf7cd4-8630-4584-bee8-5de542d492bb\") " pod="kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv"
Sep 18 17:19:41.709106 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:41.709111    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c9bf7cd4-8630-4584-bee8-5de542d492bb-proxy-tls\") pod \"success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv\" (UID: \"c9bf7cd4-8630-4584-bee8-5de542d492bb\") " pod="kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv"
Sep 18 17:19:41.709452 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:41.709173    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjjd9\" (UniqueName: \"kubernetes.io/projected/c9bf7cd4-8630-4584-bee8-5de542d492bb-kube-api-access-qjjd9\") pod \"success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv\" (UID: \"c9bf7cd4-8630-4584-bee8-5de542d492bb\") " pod="kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv"
Sep 18 17:19:41.709883 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:41.709858    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c9bf7cd4-8630-4584-bee8-5de542d492bb-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv\" (UID: \"c9bf7cd4-8630-4584-bee8-5de542d492bb\") " pod="kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv"
Sep 18 17:19:41.711803 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:41.711776    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c9bf7cd4-8630-4584-bee8-5de542d492bb-proxy-tls\") pod \"success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv\" (UID: \"c9bf7cd4-8630-4584-bee8-5de542d492bb\") " pod="kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv"
Sep 18 17:19:41.717978 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:41.717949    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjjd9\" (UniqueName: \"kubernetes.io/projected/c9bf7cd4-8630-4584-bee8-5de542d492bb-kube-api-access-qjjd9\") pod \"success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv\" (UID: \"c9bf7cd4-8630-4584-bee8-5de542d492bb\") " pod="kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv"
Sep 18 17:19:41.775146 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:41.775111    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv"
Sep 18 17:19:41.907085 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:41.907000    2577 generic.go:356] "Generic (PLEG): container finished" podID="904d024d-55c0-4f00-89ad-1a11e61dfddb" containerID="08864da552ed45bcb2346bfc9335bfc3693a68342cf1baf2ab4c272a329358f8" exitCode=2
Sep 18 17:19:41.907085 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:41.907064    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78" event={"ID":"904d024d-55c0-4f00-89ad-1a11e61dfddb","Type":"ContainerDied","Data":"08864da552ed45bcb2346bfc9335bfc3693a68342cf1baf2ab4c272a329358f8"}
Sep 18 17:19:42.057336 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:42.057313    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv"]
Sep 18 17:19:42.059303 ip-10-0-132-41 kubenswrapper[2577]: W0918 17:19:42.059267    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9bf7cd4_8630_4584_bee8_5de542d492bb.slice/crio-b6b87f1420c709c78a8d57912a5241f6f4dab170ff7df7bdd2a7cec26fd36e8f WatchSource:0}: Error finding container b6b87f1420c709c78a8d57912a5241f6f4dab170ff7df7bdd2a7cec26fd36e8f: Status 404 returned error can't find the container with id b6b87f1420c709c78a8d57912a5241f6f4dab170ff7df7bdd2a7cec26fd36e8f
Sep 18 17:19:42.913386 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:42.913345    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv" event={"ID":"c9bf7cd4-8630-4584-bee8-5de542d492bb","Type":"ContainerStarted","Data":"b531d10e842338adc4f0e18725cc24068c01358dd8eff1658f012d4bd2c56980"}
Sep 18 17:19:42.913865 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:42.913412    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv" event={"ID":"c9bf7cd4-8630-4584-bee8-5de542d492bb","Type":"ContainerStarted","Data":"4bb8a20078d6be60f785795f301d0b1b2a8f5143b8c50cec4e7d3f8ebdfe473f"}
Sep 18 17:19:42.913865 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:42.913437    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv" event={"ID":"c9bf7cd4-8630-4584-bee8-5de542d492bb","Type":"ContainerStarted","Data":"b6b87f1420c709c78a8d57912a5241f6f4dab170ff7df7bdd2a7cec26fd36e8f"}
Sep 18 17:19:42.913865 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:42.913553    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv"
Sep 18 17:19:42.913865 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:42.913581    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv"
Sep 18 17:19:42.914912 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:42.914885    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv" podUID="c9bf7cd4-8630-4584-bee8-5de542d492bb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.44:8080: connect: connection refused"
Sep 18 17:19:42.935109 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:42.935060    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv" podStartSLOduration=1.935044585 podStartE2EDuration="1.935044585s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:19:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:19:42.932849022 +0000 UTC m=+1855.990138552" watchObservedRunningTime="2026-09-18 17:19:42.935044585 +0000 UTC m=+1855.992334113"
Sep 18 17:19:43.918671 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:43.918627    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv" podUID="c9bf7cd4-8630-4584-bee8-5de542d492bb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.44:8080: connect: connection refused"
Sep 18 17:19:44.511677 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:44.511637    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78" podUID="904d024d-55c0-4f00-89ad-1a11e61dfddb" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.42:8643/healthz\": dial tcp 10.132.0.42:8643: connect: connection refused"
Sep 18 17:19:44.926222 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:44.926188    2577 generic.go:356] "Generic (PLEG): container finished" podID="904d024d-55c0-4f00-89ad-1a11e61dfddb" containerID="ebf869cfffc715a7274bd459c868fb963bd67a3bfc523a4a72b928c2a95bff39" exitCode=0
Sep 18 17:19:44.926579 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:44.926225    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78" event={"ID":"904d024d-55c0-4f00-89ad-1a11e61dfddb","Type":"ContainerDied","Data":"ebf869cfffc715a7274bd459c868fb963bd67a3bfc523a4a72b928c2a95bff39"}
Sep 18 17:19:45.000327 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:45.000302    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78"
Sep 18 17:19:45.140029 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:45.140003    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/904d024d-55c0-4f00-89ad-1a11e61dfddb-kube-rbac-proxy-sar-config\") pod \"904d024d-55c0-4f00-89ad-1a11e61dfddb\" (UID: \"904d024d-55c0-4f00-89ad-1a11e61dfddb\") "
Sep 18 17:19:45.140193 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:45.140084    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hwsb\" (UniqueName: \"kubernetes.io/projected/904d024d-55c0-4f00-89ad-1a11e61dfddb-kube-api-access-6hwsb\") pod \"904d024d-55c0-4f00-89ad-1a11e61dfddb\" (UID: \"904d024d-55c0-4f00-89ad-1a11e61dfddb\") "
Sep 18 17:19:45.140193 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:45.140125    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/904d024d-55c0-4f00-89ad-1a11e61dfddb-proxy-tls\") pod \"904d024d-55c0-4f00-89ad-1a11e61dfddb\" (UID: \"904d024d-55c0-4f00-89ad-1a11e61dfddb\") "
Sep 18 17:19:45.140405 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:45.140378    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/904d024d-55c0-4f00-89ad-1a11e61dfddb-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "904d024d-55c0-4f00-89ad-1a11e61dfddb" (UID: "904d024d-55c0-4f00-89ad-1a11e61dfddb"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:19:45.142137 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:45.142109    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/904d024d-55c0-4f00-89ad-1a11e61dfddb-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "904d024d-55c0-4f00-89ad-1a11e61dfddb" (UID: "904d024d-55c0-4f00-89ad-1a11e61dfddb"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:19:45.142137 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:45.142105    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/904d024d-55c0-4f00-89ad-1a11e61dfddb-kube-api-access-6hwsb" (OuterVolumeSpecName: "kube-api-access-6hwsb") pod "904d024d-55c0-4f00-89ad-1a11e61dfddb" (UID: "904d024d-55c0-4f00-89ad-1a11e61dfddb"). InnerVolumeSpecName "kube-api-access-6hwsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:19:45.240667 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:45.240638    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/904d024d-55c0-4f00-89ad-1a11e61dfddb-proxy-tls\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:19:45.240667 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:45.240665    2577 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/904d024d-55c0-4f00-89ad-1a11e61dfddb-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:19:45.240667 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:45.240675    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hwsb\" (UniqueName: \"kubernetes.io/projected/904d024d-55c0-4f00-89ad-1a11e61dfddb-kube-api-access-6hwsb\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:19:45.933035 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:45.933006    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78"
Sep 18 17:19:45.933496 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:45.933000    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78" event={"ID":"904d024d-55c0-4f00-89ad-1a11e61dfddb","Type":"ContainerDied","Data":"704c243f2f9c2a452f0b39ca7edb2d73f7dec6241e1381459d6189e74b9644ae"}
Sep 18 17:19:45.933496 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:45.933197    2577 scope.go:117] "RemoveContainer" containerID="08864da552ed45bcb2346bfc9335bfc3693a68342cf1baf2ab4c272a329358f8"
Sep 18 17:19:45.942808 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:45.942788    2577 scope.go:117] "RemoveContainer" containerID="ebf869cfffc715a7274bd459c868fb963bd67a3bfc523a4a72b928c2a95bff39"
Sep 18 17:19:45.956103 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:45.956078    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78"]
Sep 18 17:19:45.963217 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:45.963190    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-78e6b-predictor-6cd8944648-5vd78"]
Sep 18 17:19:47.122724 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:47.122690    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="904d024d-55c0-4f00-89ad-1a11e61dfddb" path="/var/lib/kubelet/pods/904d024d-55c0-4f00-89ad-1a11e61dfddb/volumes"
Sep 18 17:19:48.767664 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:48.767628    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts" podUID="f8eab596-268c-4b37-9bd0-8f2084a18df9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.43:8080: connect: connection refused"
Sep 18 17:19:48.924673 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:48.924640    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv"
Sep 18 17:19:48.925067 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:48.925041    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv" podUID="c9bf7cd4-8630-4584-bee8-5de542d492bb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.44:8080: connect: connection refused"
Sep 18 17:19:58.768248 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:58.768206    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts" podUID="f8eab596-268c-4b37-9bd0-8f2084a18df9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.43:8080: connect: connection refused"
Sep 18 17:19:58.925085 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:19:58.925047    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv" podUID="c9bf7cd4-8630-4584-bee8-5de542d492bb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.44:8080: connect: connection refused"
Sep 18 17:20:08.768761 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:20:08.768690    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts"
Sep 18 17:20:08.925574 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:20:08.925515    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv" podUID="c9bf7cd4-8630-4584-bee8-5de542d492bb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.44:8080: connect: connection refused"
Sep 18 17:20:18.925910 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:20:18.925871    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv" podUID="c9bf7cd4-8630-4584-bee8-5de542d492bb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.44:8080: connect: connection refused"
Sep 18 17:20:28.925549 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:20:28.925477    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv" podUID="c9bf7cd4-8630-4584-bee8-5de542d492bb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.44:8080: connect: connection refused"
Sep 18 17:20:38.925698 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:20:38.925665    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv"
Sep 18 17:23:49.219267 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:23:49.219241    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-t4p6q_60bae8ea-9599-47f8-b066-df7c46c011b3/console-operator/1.log"
Sep 18 17:23:49.221717 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:23:49.221695    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-t4p6q_60bae8ea-9599-47f8-b066-df7c46c011b3/console-operator/1.log"
Sep 18 17:23:49.225065 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:23:49.225047    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktklw_3c1064f0-18a0-4c28-8fb9-a320535dcbbf/ovn-acl-logging/0.log"
Sep 18 17:23:49.227231 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:23:49.227215    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktklw_3c1064f0-18a0-4c28-8fb9-a320535dcbbf/ovn-acl-logging/0.log"
Sep 18 17:28:35.717643 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:35.717603    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts"]
Sep 18 17:28:35.720113 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:35.717876    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts" podUID="f8eab596-268c-4b37-9bd0-8f2084a18df9" containerName="kserve-container" containerID="cri-o://347265a5c112c5a27f09deba5c5e28862847c92c1e08d3f68b50cc95c368e7b3" gracePeriod=30
Sep 18 17:28:35.720113 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:35.717880    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts" podUID="f8eab596-268c-4b37-9bd0-8f2084a18df9" containerName="kube-rbac-proxy" containerID="cri-o://be31f5f7daafbbdea5b99c8d26b458475f160f61e321424c2e394d8b9f856b9a" gracePeriod=30
Sep 18 17:28:35.905044 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:35.905012    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7"]
Sep 18 17:28:35.905427 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:35.905407    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="904d024d-55c0-4f00-89ad-1a11e61dfddb" containerName="kube-rbac-proxy"
Sep 18 17:28:35.905427 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:35.905422    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="904d024d-55c0-4f00-89ad-1a11e61dfddb" containerName="kube-rbac-proxy"
Sep 18 17:28:35.905684 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:35.905447    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="904d024d-55c0-4f00-89ad-1a11e61dfddb" containerName="kserve-container"
Sep 18 17:28:35.905684 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:35.905456    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="904d024d-55c0-4f00-89ad-1a11e61dfddb" containerName="kserve-container"
Sep 18 17:28:35.905684 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:35.905593    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="904d024d-55c0-4f00-89ad-1a11e61dfddb" containerName="kube-rbac-proxy"
Sep 18 17:28:35.905684 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:35.905621    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="904d024d-55c0-4f00-89ad-1a11e61dfddb" containerName="kserve-container"
Sep 18 17:28:35.909443 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:35.909418    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7"
Sep 18 17:28:35.912172 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:35.912058    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-054ab-predictor-serving-cert\""
Sep 18 17:28:35.912402 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:35.912351    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-054ab-kube-rbac-proxy-sar-config\""
Sep 18 17:28:35.921007 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:35.918329    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7"]
Sep 18 17:28:36.051432 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:36.051342    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a6d09c8f-128f-4aa7-846e-dde485898f05-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-054ab-predictor-665d69d7f6-pdpl7\" (UID: \"a6d09c8f-128f-4aa7-846e-dde485898f05\") " pod="kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7"
Sep 18 17:28:36.051608 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:36.051433    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a6d09c8f-128f-4aa7-846e-dde485898f05-proxy-tls\") pod \"success-200-isvc-054ab-predictor-665d69d7f6-pdpl7\" (UID: \"a6d09c8f-128f-4aa7-846e-dde485898f05\") " pod="kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7"
Sep 18 17:28:36.051608 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:36.051512    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m9bs\" (UniqueName: \"kubernetes.io/projected/a6d09c8f-128f-4aa7-846e-dde485898f05-kube-api-access-7m9bs\") pod \"success-200-isvc-054ab-predictor-665d69d7f6-pdpl7\" (UID: \"a6d09c8f-128f-4aa7-846e-dde485898f05\") " pod="kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7"
Sep 18 17:28:36.152667 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:36.152625    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a6d09c8f-128f-4aa7-846e-dde485898f05-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-054ab-predictor-665d69d7f6-pdpl7\" (UID: \"a6d09c8f-128f-4aa7-846e-dde485898f05\") " pod="kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7"
Sep 18 17:28:36.152843 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:36.152687    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a6d09c8f-128f-4aa7-846e-dde485898f05-proxy-tls\") pod \"success-200-isvc-054ab-predictor-665d69d7f6-pdpl7\" (UID: \"a6d09c8f-128f-4aa7-846e-dde485898f05\") " pod="kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7"
Sep 18 17:28:36.152843 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:36.152753    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m9bs\" (UniqueName: \"kubernetes.io/projected/a6d09c8f-128f-4aa7-846e-dde485898f05-kube-api-access-7m9bs\") pod \"success-200-isvc-054ab-predictor-665d69d7f6-pdpl7\" (UID: \"a6d09c8f-128f-4aa7-846e-dde485898f05\") " pod="kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7"
Sep 18 17:28:36.152951 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:28:36.152853    2577 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-054ab-predictor-serving-cert: secret "success-200-isvc-054ab-predictor-serving-cert" not found
Sep 18 17:28:36.152951 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:28:36.152944    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6d09c8f-128f-4aa7-846e-dde485898f05-proxy-tls podName:a6d09c8f-128f-4aa7-846e-dde485898f05 nodeName:}" failed. No retries permitted until 2026-09-18 17:28:36.652921901 +0000 UTC m=+2389.710211410 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/a6d09c8f-128f-4aa7-846e-dde485898f05-proxy-tls") pod "success-200-isvc-054ab-predictor-665d69d7f6-pdpl7" (UID: "a6d09c8f-128f-4aa7-846e-dde485898f05") : secret "success-200-isvc-054ab-predictor-serving-cert" not found
Sep 18 17:28:36.153330 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:36.153311    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a6d09c8f-128f-4aa7-846e-dde485898f05-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-054ab-predictor-665d69d7f6-pdpl7\" (UID: \"a6d09c8f-128f-4aa7-846e-dde485898f05\") " pod="kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7"
Sep 18 17:28:36.163255 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:36.163231    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m9bs\" (UniqueName: \"kubernetes.io/projected/a6d09c8f-128f-4aa7-846e-dde485898f05-kube-api-access-7m9bs\") pod \"success-200-isvc-054ab-predictor-665d69d7f6-pdpl7\" (UID: \"a6d09c8f-128f-4aa7-846e-dde485898f05\") " pod="kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7"
Sep 18 17:28:36.492803 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:36.492766    2577 generic.go:356] "Generic (PLEG): container finished" podID="f8eab596-268c-4b37-9bd0-8f2084a18df9" containerID="be31f5f7daafbbdea5b99c8d26b458475f160f61e321424c2e394d8b9f856b9a" exitCode=2
Sep 18 17:28:36.492976 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:36.492835    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts" event={"ID":"f8eab596-268c-4b37-9bd0-8f2084a18df9","Type":"ContainerDied","Data":"be31f5f7daafbbdea5b99c8d26b458475f160f61e321424c2e394d8b9f856b9a"}
Sep 18 17:28:36.658180 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:36.658142    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a6d09c8f-128f-4aa7-846e-dde485898f05-proxy-tls\") pod \"success-200-isvc-054ab-predictor-665d69d7f6-pdpl7\" (UID: \"a6d09c8f-128f-4aa7-846e-dde485898f05\") " pod="kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7"
Sep 18 17:28:36.660692 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:36.660670    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a6d09c8f-128f-4aa7-846e-dde485898f05-proxy-tls\") pod \"success-200-isvc-054ab-predictor-665d69d7f6-pdpl7\" (UID: \"a6d09c8f-128f-4aa7-846e-dde485898f05\") " pod="kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7"
Sep 18 17:28:36.824002 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:36.823923    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7"
Sep 18 17:28:37.115340 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:37.115313    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7"]
Sep 18 17:28:37.118364 ip-10-0-132-41 kubenswrapper[2577]: W0918 17:28:37.118335    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6d09c8f_128f_4aa7_846e_dde485898f05.slice/crio-fe9a17b4fce468858d0a05b8dcfb4da914fd1b71e2206d4fafa53e142e637451 WatchSource:0}: Error finding container fe9a17b4fce468858d0a05b8dcfb4da914fd1b71e2206d4fafa53e142e637451: Status 404 returned error can't find the container with id fe9a17b4fce468858d0a05b8dcfb4da914fd1b71e2206d4fafa53e142e637451
Sep 18 17:28:37.499550 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:37.499453    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7" event={"ID":"a6d09c8f-128f-4aa7-846e-dde485898f05","Type":"ContainerStarted","Data":"6effd143987bb0ee77a3b9a9d71121176376c2c10c677e6935a37e025ad8a12a"}
Sep 18 17:28:37.499550 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:37.499512    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7" event={"ID":"a6d09c8f-128f-4aa7-846e-dde485898f05","Type":"ContainerStarted","Data":"380160960c06a2ef0be171759cf357c95eda7a1a85ffbf6515b4a40214691a18"}
Sep 18 17:28:37.499550 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:37.499545    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7" event={"ID":"a6d09c8f-128f-4aa7-846e-dde485898f05","Type":"ContainerStarted","Data":"fe9a17b4fce468858d0a05b8dcfb4da914fd1b71e2206d4fafa53e142e637451"}
Sep 18 17:28:37.499773 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:37.499572    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7"
Sep 18 17:28:37.520707 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:37.520658    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7" podStartSLOduration=2.5206423300000003 podStartE2EDuration="2.52064233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:28:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:28:37.518557221 +0000 UTC m=+2390.575846748" watchObservedRunningTime="2026-09-18 17:28:37.52064233 +0000 UTC m=+2390.577931858"
Sep 18 17:28:38.504504 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:38.504474    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7"
Sep 18 17:28:38.505792 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:38.505766    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7" podUID="a6d09c8f-128f-4aa7-846e-dde485898f05" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.45:8080: connect: connection refused"
Sep 18 17:28:38.762440 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:38.762341    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts" podUID="f8eab596-268c-4b37-9bd0-8f2084a18df9" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.43:8643/healthz\": dial tcp 10.132.0.43:8643: connect: connection refused"
Sep 18 17:28:38.767765 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:38.767732    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts" podUID="f8eab596-268c-4b37-9bd0-8f2084a18df9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.43:8080: connect: connection refused"
Sep 18 17:28:39.269852 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:39.269825    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts"
Sep 18 17:28:39.384299 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:39.384272    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsr9j\" (UniqueName: \"kubernetes.io/projected/f8eab596-268c-4b37-9bd0-8f2084a18df9-kube-api-access-lsr9j\") pod \"f8eab596-268c-4b37-9bd0-8f2084a18df9\" (UID: \"f8eab596-268c-4b37-9bd0-8f2084a18df9\") "
Sep 18 17:28:39.384451 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:39.384319    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f8eab596-268c-4b37-9bd0-8f2084a18df9-proxy-tls\") pod \"f8eab596-268c-4b37-9bd0-8f2084a18df9\" (UID: \"f8eab596-268c-4b37-9bd0-8f2084a18df9\") "
Sep 18 17:28:39.384451 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:39.384351    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f8eab596-268c-4b37-9bd0-8f2084a18df9-kube-rbac-proxy-sar-config\") pod \"f8eab596-268c-4b37-9bd0-8f2084a18df9\" (UID: \"f8eab596-268c-4b37-9bd0-8f2084a18df9\") "
Sep 18 17:28:39.384893 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:39.384863    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8eab596-268c-4b37-9bd0-8f2084a18df9-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "f8eab596-268c-4b37-9bd0-8f2084a18df9" (UID: "f8eab596-268c-4b37-9bd0-8f2084a18df9"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:28:39.386476 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:39.386441    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8eab596-268c-4b37-9bd0-8f2084a18df9-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "f8eab596-268c-4b37-9bd0-8f2084a18df9" (UID: "f8eab596-268c-4b37-9bd0-8f2084a18df9"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:28:39.386611 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:39.386496    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8eab596-268c-4b37-9bd0-8f2084a18df9-kube-api-access-lsr9j" (OuterVolumeSpecName: "kube-api-access-lsr9j") pod "f8eab596-268c-4b37-9bd0-8f2084a18df9" (UID: "f8eab596-268c-4b37-9bd0-8f2084a18df9"). InnerVolumeSpecName "kube-api-access-lsr9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:28:39.486107 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:39.486071    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsr9j\" (UniqueName: \"kubernetes.io/projected/f8eab596-268c-4b37-9bd0-8f2084a18df9-kube-api-access-lsr9j\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:28:39.486107 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:39.486101    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f8eab596-268c-4b37-9bd0-8f2084a18df9-proxy-tls\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:28:39.486107 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:39.486112    2577 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f8eab596-268c-4b37-9bd0-8f2084a18df9-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:28:39.511737 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:39.511706    2577 generic.go:356] "Generic (PLEG): container finished" podID="f8eab596-268c-4b37-9bd0-8f2084a18df9" containerID="347265a5c112c5a27f09deba5c5e28862847c92c1e08d3f68b50cc95c368e7b3" exitCode=0
Sep 18 17:28:39.512112 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:39.511759    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts"
Sep 18 17:28:39.512112 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:39.511785    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts" event={"ID":"f8eab596-268c-4b37-9bd0-8f2084a18df9","Type":"ContainerDied","Data":"347265a5c112c5a27f09deba5c5e28862847c92c1e08d3f68b50cc95c368e7b3"}
Sep 18 17:28:39.512112 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:39.511852    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts" event={"ID":"f8eab596-268c-4b37-9bd0-8f2084a18df9","Type":"ContainerDied","Data":"50f23af1ab4e4e21dfa62b6cf4623adf126d4c33673e59a7e9ead8bbf4f4dfc8"}
Sep 18 17:28:39.512112 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:39.511879    2577 scope.go:117] "RemoveContainer" containerID="be31f5f7daafbbdea5b99c8d26b458475f160f61e321424c2e394d8b9f856b9a"
Sep 18 17:28:39.512325 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:39.512225    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7" podUID="a6d09c8f-128f-4aa7-846e-dde485898f05" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.45:8080: connect: connection refused"
Sep 18 17:28:39.521166 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:39.521150    2577 scope.go:117] "RemoveContainer" containerID="347265a5c112c5a27f09deba5c5e28862847c92c1e08d3f68b50cc95c368e7b3"
Sep 18 17:28:39.528754 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:39.528735    2577 scope.go:117] "RemoveContainer" containerID="be31f5f7daafbbdea5b99c8d26b458475f160f61e321424c2e394d8b9f856b9a"
Sep 18 17:28:39.529008 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:28:39.528992    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be31f5f7daafbbdea5b99c8d26b458475f160f61e321424c2e394d8b9f856b9a\": container with ID starting with be31f5f7daafbbdea5b99c8d26b458475f160f61e321424c2e394d8b9f856b9a not found: ID does not exist" containerID="be31f5f7daafbbdea5b99c8d26b458475f160f61e321424c2e394d8b9f856b9a"
Sep 18 17:28:39.529054 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:39.529016    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be31f5f7daafbbdea5b99c8d26b458475f160f61e321424c2e394d8b9f856b9a"} err="failed to get container status \"be31f5f7daafbbdea5b99c8d26b458475f160f61e321424c2e394d8b9f856b9a\": rpc error: code = NotFound desc = could not find container \"be31f5f7daafbbdea5b99c8d26b458475f160f61e321424c2e394d8b9f856b9a\": container with ID starting with be31f5f7daafbbdea5b99c8d26b458475f160f61e321424c2e394d8b9f856b9a not found: ID does not exist"
Sep 18 17:28:39.529054 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:39.529031    2577 scope.go:117] "RemoveContainer" containerID="347265a5c112c5a27f09deba5c5e28862847c92c1e08d3f68b50cc95c368e7b3"
Sep 18 17:28:39.529276 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:28:39.529261    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"347265a5c112c5a27f09deba5c5e28862847c92c1e08d3f68b50cc95c368e7b3\": container with ID starting with 347265a5c112c5a27f09deba5c5e28862847c92c1e08d3f68b50cc95c368e7b3 not found: ID does not exist" containerID="347265a5c112c5a27f09deba5c5e28862847c92c1e08d3f68b50cc95c368e7b3"
Sep 18 17:28:39.529328 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:39.529278    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"347265a5c112c5a27f09deba5c5e28862847c92c1e08d3f68b50cc95c368e7b3"} err="failed to get container status \"347265a5c112c5a27f09deba5c5e28862847c92c1e08d3f68b50cc95c368e7b3\": rpc error: code = NotFound desc = could not find container \"347265a5c112c5a27f09deba5c5e28862847c92c1e08d3f68b50cc95c368e7b3\": container with ID starting with 347265a5c112c5a27f09deba5c5e28862847c92c1e08d3f68b50cc95c368e7b3 not found: ID does not exist"
Sep 18 17:28:39.533179 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:39.533160    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts"]
Sep 18 17:28:39.539340 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:39.539319    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-cca0b-predictor-6bf79666fd-7q7ts"]
Sep 18 17:28:41.122290 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:41.122257    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8eab596-268c-4b37-9bd0-8f2084a18df9" path="/var/lib/kubelet/pods/f8eab596-268c-4b37-9bd0-8f2084a18df9/volumes"
Sep 18 17:28:44.516341 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:44.516313    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7"
Sep 18 17:28:44.516778 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:44.516703    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7" podUID="a6d09c8f-128f-4aa7-846e-dde485898f05" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.45:8080: connect: connection refused"
Sep 18 17:28:49.254879 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:49.254850    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-t4p6q_60bae8ea-9599-47f8-b066-df7c46c011b3/console-operator/1.log"
Sep 18 17:28:49.259477 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:49.259452    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-t4p6q_60bae8ea-9599-47f8-b066-df7c46c011b3/console-operator/1.log"
Sep 18 17:28:49.261028 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:49.261009    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktklw_3c1064f0-18a0-4c28-8fb9-a320535dcbbf/ovn-acl-logging/0.log"
Sep 18 17:28:49.265515 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:49.265498    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktklw_3c1064f0-18a0-4c28-8fb9-a320535dcbbf/ovn-acl-logging/0.log"
Sep 18 17:28:54.517005 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:28:54.516962    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7" podUID="a6d09c8f-128f-4aa7-846e-dde485898f05" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.45:8080: connect: connection refused"
Sep 18 17:29:04.517141 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:04.517052    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7" podUID="a6d09c8f-128f-4aa7-846e-dde485898f05" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.45:8080: connect: connection refused"
Sep 18 17:29:06.753850 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:06.753817    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv"]
Sep 18 17:29:06.754393 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:06.754038    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv" podUID="c9bf7cd4-8630-4584-bee8-5de542d492bb" containerName="kserve-container" containerID="cri-o://4bb8a20078d6be60f785795f301d0b1b2a8f5143b8c50cec4e7d3f8ebdfe473f" gracePeriod=30
Sep 18 17:29:06.754393 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:06.754078    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv" podUID="c9bf7cd4-8630-4584-bee8-5de542d492bb" containerName="kube-rbac-proxy" containerID="cri-o://b531d10e842338adc4f0e18725cc24068c01358dd8eff1658f012d4bd2c56980" gracePeriod=30
Sep 18 17:29:06.935166 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:06.935133    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg"]
Sep 18 17:29:06.935613 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:06.935595    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8eab596-268c-4b37-9bd0-8f2084a18df9" containerName="kube-rbac-proxy"
Sep 18 17:29:06.935715 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:06.935615    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8eab596-268c-4b37-9bd0-8f2084a18df9" containerName="kube-rbac-proxy"
Sep 18 17:29:06.935715 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:06.935662    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8eab596-268c-4b37-9bd0-8f2084a18df9" containerName="kserve-container"
Sep 18 17:29:06.935715 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:06.935672    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8eab596-268c-4b37-9bd0-8f2084a18df9" containerName="kserve-container"
Sep 18 17:29:06.935881 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:06.935772    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8eab596-268c-4b37-9bd0-8f2084a18df9" containerName="kube-rbac-proxy"
Sep 18 17:29:06.935881 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:06.935784    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8eab596-268c-4b37-9bd0-8f2084a18df9" containerName="kserve-container"
Sep 18 17:29:06.939124 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:06.939102    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg"
Sep 18 17:29:06.959703 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:06.959680    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-0cb05-kube-rbac-proxy-sar-config\""
Sep 18 17:29:06.960366 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:06.960347    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-0cb05-predictor-serving-cert\""
Sep 18 17:29:06.961336 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:06.961312    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg"]
Sep 18 17:29:07.024409 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:07.024329    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fdf0fc94-7aca-4994-a00c-ac28739a3c80-proxy-tls\") pod \"success-200-isvc-0cb05-predictor-75df596dd-w7jqg\" (UID: \"fdf0fc94-7aca-4994-a00c-ac28739a3c80\") " pod="kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg"
Sep 18 17:29:07.024409 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:07.024363    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc4f8\" (UniqueName: \"kubernetes.io/projected/fdf0fc94-7aca-4994-a00c-ac28739a3c80-kube-api-access-wc4f8\") pod \"success-200-isvc-0cb05-predictor-75df596dd-w7jqg\" (UID: \"fdf0fc94-7aca-4994-a00c-ac28739a3c80\") " pod="kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg"
Sep 18 17:29:07.024409 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:07.024400    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fdf0fc94-7aca-4994-a00c-ac28739a3c80-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-0cb05-predictor-75df596dd-w7jqg\" (UID: \"fdf0fc94-7aca-4994-a00c-ac28739a3c80\") " pod="kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg"
Sep 18 17:29:07.125410 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:07.125381    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fdf0fc94-7aca-4994-a00c-ac28739a3c80-proxy-tls\") pod \"success-200-isvc-0cb05-predictor-75df596dd-w7jqg\" (UID: \"fdf0fc94-7aca-4994-a00c-ac28739a3c80\") " pod="kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg"
Sep 18 17:29:07.125637 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:07.125419    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc4f8\" (UniqueName: \"kubernetes.io/projected/fdf0fc94-7aca-4994-a00c-ac28739a3c80-kube-api-access-wc4f8\") pod \"success-200-isvc-0cb05-predictor-75df596dd-w7jqg\" (UID: \"fdf0fc94-7aca-4994-a00c-ac28739a3c80\") " pod="kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg"
Sep 18 17:29:07.125637 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:07.125474    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fdf0fc94-7aca-4994-a00c-ac28739a3c80-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-0cb05-predictor-75df596dd-w7jqg\" (UID: \"fdf0fc94-7aca-4994-a00c-ac28739a3c80\") " pod="kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg"
Sep 18 17:29:07.125637 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:29:07.125563    2577 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-serving-cert: secret "success-200-isvc-0cb05-predictor-serving-cert" not found
Sep 18 17:29:07.125828 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:29:07.125653    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdf0fc94-7aca-4994-a00c-ac28739a3c80-proxy-tls podName:fdf0fc94-7aca-4994-a00c-ac28739a3c80 nodeName:}" failed. No retries permitted until 2026-09-18 17:29:07.625631375 +0000 UTC m=+2420.682920887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/fdf0fc94-7aca-4994-a00c-ac28739a3c80-proxy-tls") pod "success-200-isvc-0cb05-predictor-75df596dd-w7jqg" (UID: "fdf0fc94-7aca-4994-a00c-ac28739a3c80") : secret "success-200-isvc-0cb05-predictor-serving-cert" not found
Sep 18 17:29:07.126175 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:07.126152    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fdf0fc94-7aca-4994-a00c-ac28739a3c80-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-0cb05-predictor-75df596dd-w7jqg\" (UID: \"fdf0fc94-7aca-4994-a00c-ac28739a3c80\") " pod="kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg"
Sep 18 17:29:07.139347 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:07.139314    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc4f8\" (UniqueName: \"kubernetes.io/projected/fdf0fc94-7aca-4994-a00c-ac28739a3c80-kube-api-access-wc4f8\") pod \"success-200-isvc-0cb05-predictor-75df596dd-w7jqg\" (UID: \"fdf0fc94-7aca-4994-a00c-ac28739a3c80\") " pod="kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg"
Sep 18 17:29:07.630774 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:07.630735    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fdf0fc94-7aca-4994-a00c-ac28739a3c80-proxy-tls\") pod \"success-200-isvc-0cb05-predictor-75df596dd-w7jqg\" (UID: \"fdf0fc94-7aca-4994-a00c-ac28739a3c80\") " pod="kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg"
Sep 18 17:29:07.633125 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:07.633106    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fdf0fc94-7aca-4994-a00c-ac28739a3c80-proxy-tls\") pod \"success-200-isvc-0cb05-predictor-75df596dd-w7jqg\" (UID: \"fdf0fc94-7aca-4994-a00c-ac28739a3c80\") " pod="kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg"
Sep 18 17:29:07.659448 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:07.659415    2577 generic.go:356] "Generic (PLEG): container finished" podID="c9bf7cd4-8630-4584-bee8-5de542d492bb" containerID="b531d10e842338adc4f0e18725cc24068c01358dd8eff1658f012d4bd2c56980" exitCode=2
Sep 18 17:29:07.659627 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:07.659483    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv" event={"ID":"c9bf7cd4-8630-4584-bee8-5de542d492bb","Type":"ContainerDied","Data":"b531d10e842338adc4f0e18725cc24068c01358dd8eff1658f012d4bd2c56980"}
Sep 18 17:29:07.849842 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:07.849798    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg"
Sep 18 17:29:08.126849 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:08.126814    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg"]
Sep 18 17:29:08.129621 ip-10-0-132-41 kubenswrapper[2577]: W0918 17:29:08.129588    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdf0fc94_7aca_4994_a00c_ac28739a3c80.slice/crio-b9732ba2db0cf76154f0e20f6e00170ff730d8e15f184d315b4d553f71e3b7b6 WatchSource:0}: Error finding container b9732ba2db0cf76154f0e20f6e00170ff730d8e15f184d315b4d553f71e3b7b6: Status 404 returned error can't find the container with id b9732ba2db0cf76154f0e20f6e00170ff730d8e15f184d315b4d553f71e3b7b6
Sep 18 17:29:08.666826 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:08.666786    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg" event={"ID":"fdf0fc94-7aca-4994-a00c-ac28739a3c80","Type":"ContainerStarted","Data":"ca989ce9054f4b6bf029f8da6509512397dbc1f2ca0af5aa186514ce49cc557b"}
Sep 18 17:29:08.666997 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:08.666859    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg" event={"ID":"fdf0fc94-7aca-4994-a00c-ac28739a3c80","Type":"ContainerStarted","Data":"d13fef0983466ee901f860856b1b91fd618946685940bb5ca437a0643919779e"}
Sep 18 17:29:08.666997 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:08.666892    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg" event={"ID":"fdf0fc94-7aca-4994-a00c-ac28739a3c80","Type":"ContainerStarted","Data":"b9732ba2db0cf76154f0e20f6e00170ff730d8e15f184d315b4d553f71e3b7b6"}
Sep 18 17:29:08.667072 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:08.667021    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg"
Sep 18 17:29:08.704354 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:08.704294    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg" podStartSLOduration=2.704278342 podStartE2EDuration="2.704278342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:29:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:29:08.703415249 +0000 UTC m=+2421.760704793" watchObservedRunningTime="2026-09-18 17:29:08.704278342 +0000 UTC m=+2421.761567869"
Sep 18 17:29:08.919743 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:08.919644    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv" podUID="c9bf7cd4-8630-4584-bee8-5de542d492bb" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.44:8643/healthz\": dial tcp 10.132.0.44:8643: connect: connection refused"
Sep 18 17:29:08.925077 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:08.925046    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv" podUID="c9bf7cd4-8630-4584-bee8-5de542d492bb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.44:8080: connect: connection refused"
Sep 18 17:29:09.672191 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:09.672161    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg"
Sep 18 17:29:09.673522 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:09.673497    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg" podUID="fdf0fc94-7aca-4994-a00c-ac28739a3c80" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.46:8080: connect: connection refused"
Sep 18 17:29:10.676820 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:10.676779    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg" podUID="fdf0fc94-7aca-4994-a00c-ac28739a3c80" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.46:8080: connect: connection refused"
Sep 18 17:29:13.696391 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:13.696360    2577 generic.go:356] "Generic (PLEG): container finished" podID="c9bf7cd4-8630-4584-bee8-5de542d492bb" containerID="4bb8a20078d6be60f785795f301d0b1b2a8f5143b8c50cec4e7d3f8ebdfe473f" exitCode=0
Sep 18 17:29:13.696748 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:13.696412    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv" event={"ID":"c9bf7cd4-8630-4584-bee8-5de542d492bb","Type":"ContainerDied","Data":"4bb8a20078d6be60f785795f301d0b1b2a8f5143b8c50cec4e7d3f8ebdfe473f"}
Sep 18 17:29:13.696748 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:13.696459    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv" event={"ID":"c9bf7cd4-8630-4584-bee8-5de542d492bb","Type":"ContainerDied","Data":"b6b87f1420c709c78a8d57912a5241f6f4dab170ff7df7bdd2a7cec26fd36e8f"}
Sep 18 17:29:13.696748 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:13.696485    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b6b87f1420c709c78a8d57912a5241f6f4dab170ff7df7bdd2a7cec26fd36e8f"
Sep 18 17:29:13.699793 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:13.699774    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv"
Sep 18 17:29:13.787227 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:13.787131    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c9bf7cd4-8630-4584-bee8-5de542d492bb-proxy-tls\") pod \"c9bf7cd4-8630-4584-bee8-5de542d492bb\" (UID: \"c9bf7cd4-8630-4584-bee8-5de542d492bb\") "
Sep 18 17:29:13.787227 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:13.787177    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjjd9\" (UniqueName: \"kubernetes.io/projected/c9bf7cd4-8630-4584-bee8-5de542d492bb-kube-api-access-qjjd9\") pod \"c9bf7cd4-8630-4584-bee8-5de542d492bb\" (UID: \"c9bf7cd4-8630-4584-bee8-5de542d492bb\") "
Sep 18 17:29:13.787227 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:13.787213    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c9bf7cd4-8630-4584-bee8-5de542d492bb-kube-rbac-proxy-sar-config\") pod \"c9bf7cd4-8630-4584-bee8-5de542d492bb\" (UID: \"c9bf7cd4-8630-4584-bee8-5de542d492bb\") "
Sep 18 17:29:13.787682 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:13.787642    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9bf7cd4-8630-4584-bee8-5de542d492bb-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "c9bf7cd4-8630-4584-bee8-5de542d492bb" (UID: "c9bf7cd4-8630-4584-bee8-5de542d492bb"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:29:13.789345 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:13.789316    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9bf7cd4-8630-4584-bee8-5de542d492bb-kube-api-access-qjjd9" (OuterVolumeSpecName: "kube-api-access-qjjd9") pod "c9bf7cd4-8630-4584-bee8-5de542d492bb" (UID: "c9bf7cd4-8630-4584-bee8-5de542d492bb"). InnerVolumeSpecName "kube-api-access-qjjd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:29:13.789461 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:13.789341    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9bf7cd4-8630-4584-bee8-5de542d492bb-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "c9bf7cd4-8630-4584-bee8-5de542d492bb" (UID: "c9bf7cd4-8630-4584-bee8-5de542d492bb"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:29:13.888074 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:13.888036    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c9bf7cd4-8630-4584-bee8-5de542d492bb-proxy-tls\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:29:13.888074 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:13.888073    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjjd9\" (UniqueName: \"kubernetes.io/projected/c9bf7cd4-8630-4584-bee8-5de542d492bb-kube-api-access-qjjd9\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:29:13.888274 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:13.888087    2577 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c9bf7cd4-8630-4584-bee8-5de542d492bb-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:29:14.516998 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:14.516960    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7" podUID="a6d09c8f-128f-4aa7-846e-dde485898f05" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.45:8080: connect: connection refused"
Sep 18 17:29:14.701670 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:14.701640    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv"
Sep 18 17:29:14.722946 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:14.722919    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv"]
Sep 18 17:29:14.729389 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:14.729366    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-792b5-predictor-8d4d6d7cd-spnxv"]
Sep 18 17:29:15.122934 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:15.122902    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9bf7cd4-8630-4584-bee8-5de542d492bb" path="/var/lib/kubelet/pods/c9bf7cd4-8630-4584-bee8-5de542d492bb/volumes"
Sep 18 17:29:15.682478 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:15.682447    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg"
Sep 18 17:29:15.682986 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:15.682954    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg" podUID="fdf0fc94-7aca-4994-a00c-ac28739a3c80" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.46:8080: connect: connection refused"
Sep 18 17:29:24.517060 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:24.517018    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7" podUID="a6d09c8f-128f-4aa7-846e-dde485898f05" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.45:8080: connect: connection refused"
Sep 18 17:29:25.683293 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:25.683249    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg" podUID="fdf0fc94-7aca-4994-a00c-ac28739a3c80" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.46:8080: connect: connection refused"
Sep 18 17:29:34.518268 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:34.518234    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7"
Sep 18 17:29:35.683811 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:35.683769    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg" podUID="fdf0fc94-7aca-4994-a00c-ac28739a3c80" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.46:8080: connect: connection refused"
Sep 18 17:29:45.682985 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:45.682938    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg" podUID="fdf0fc94-7aca-4994-a00c-ac28739a3c80" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.46:8080: connect: connection refused"
Sep 18 17:29:49.316815 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:49.316782    2577 scope.go:117] "RemoveContainer" containerID="b531d10e842338adc4f0e18725cc24068c01358dd8eff1658f012d4bd2c56980"
Sep 18 17:29:49.325468 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:49.325446    2577 scope.go:117] "RemoveContainer" containerID="4bb8a20078d6be60f785795f301d0b1b2a8f5143b8c50cec4e7d3f8ebdfe473f"
Sep 18 17:29:55.683053 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:55.683010    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg" podUID="fdf0fc94-7aca-4994-a00c-ac28739a3c80" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.46:8080: connect: connection refused"
Sep 18 17:29:56.882966 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:56.882926    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7"]
Sep 18 17:29:56.883572 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:56.883225    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7" podUID="a6d09c8f-128f-4aa7-846e-dde485898f05" containerName="kserve-container" containerID="cri-o://380160960c06a2ef0be171759cf357c95eda7a1a85ffbf6515b4a40214691a18" gracePeriod=30
Sep 18 17:29:56.883572 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:56.883372    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7" podUID="a6d09c8f-128f-4aa7-846e-dde485898f05" containerName="kube-rbac-proxy" containerID="cri-o://6effd143987bb0ee77a3b9a9d71121176376c2c10c677e6935a37e025ad8a12a" gracePeriod=30
Sep 18 17:29:57.028593 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:57.028548    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f"]
Sep 18 17:29:57.029023 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:57.029008    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9bf7cd4-8630-4584-bee8-5de542d492bb" containerName="kube-rbac-proxy"
Sep 18 17:29:57.029075 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:57.029025    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9bf7cd4-8630-4584-bee8-5de542d492bb" containerName="kube-rbac-proxy"
Sep 18 17:29:57.029075 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:57.029061    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9bf7cd4-8630-4584-bee8-5de542d492bb" containerName="kserve-container"
Sep 18 17:29:57.029075 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:57.029067    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9bf7cd4-8630-4584-bee8-5de542d492bb" containerName="kserve-container"
Sep 18 17:29:57.029189 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:57.029127    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9bf7cd4-8630-4584-bee8-5de542d492bb" containerName="kserve-container"
Sep 18 17:29:57.029189 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:57.029139    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9bf7cd4-8630-4584-bee8-5de542d492bb" containerName="kube-rbac-proxy"
Sep 18 17:29:57.032561 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:57.032505    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f"
Sep 18 17:29:57.035719 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:57.035696    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-f0fb0-kube-rbac-proxy-sar-config\""
Sep 18 17:29:57.035834 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:57.035696    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-f0fb0-predictor-serving-cert\""
Sep 18 17:29:57.047685 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:57.047652    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f\" (UID: \"4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83\") " pod="kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f"
Sep 18 17:29:57.047685 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:57.047691    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk4jr\" (UniqueName: \"kubernetes.io/projected/4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83-kube-api-access-jk4jr\") pod \"success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f\" (UID: \"4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83\") " pod="kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f"
Sep 18 17:29:57.047954 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:57.047808    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83-proxy-tls\") pod \"success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f\" (UID: \"4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83\") " pod="kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f"
Sep 18 17:29:57.050894 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:57.050873    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f"]
Sep 18 17:29:57.148726 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:57.148643    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83-proxy-tls\") pod \"success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f\" (UID: \"4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83\") " pod="kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f"
Sep 18 17:29:57.148726 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:57.148722    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f\" (UID: \"4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83\") " pod="kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f"
Sep 18 17:29:57.148926 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:57.148743    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk4jr\" (UniqueName: \"kubernetes.io/projected/4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83-kube-api-access-jk4jr\") pod \"success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f\" (UID: \"4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83\") " pod="kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f"
Sep 18 17:29:57.149438 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:57.149412    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f\" (UID: \"4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83\") " pod="kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f"
Sep 18 17:29:57.151159 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:57.151133    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83-proxy-tls\") pod \"success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f\" (UID: \"4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83\") " pod="kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f"
Sep 18 17:29:57.167983 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:57.167948    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk4jr\" (UniqueName: \"kubernetes.io/projected/4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83-kube-api-access-jk4jr\") pod \"success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f\" (UID: \"4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83\") " pod="kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f"
Sep 18 17:29:57.342856 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:57.342816    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f"
Sep 18 17:29:57.617503 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:57.617476    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f"]
Sep 18 17:29:57.620301 ip-10-0-132-41 kubenswrapper[2577]: W0918 17:29:57.620277    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4379ec2e_7b0d_4ae3_bfaa_07e70ea2ca83.slice/crio-a302917b896f234d824dd52181e6779b5a09c3b62ec86840a4e663ca9b982061 WatchSource:0}: Error finding container a302917b896f234d824dd52181e6779b5a09c3b62ec86840a4e663ca9b982061: Status 404 returned error can't find the container with id a302917b896f234d824dd52181e6779b5a09c3b62ec86840a4e663ca9b982061
Sep 18 17:29:57.930306 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:57.930202    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f" event={"ID":"4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83","Type":"ContainerStarted","Data":"7e31dd42d5241c7859e7677f7d475bf05a4b7c0a7382d38b03f15fc52cbb2311"}
Sep 18 17:29:57.930306 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:57.930276    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f"
Sep 18 17:29:57.930306 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:57.930306    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f" event={"ID":"4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83","Type":"ContainerStarted","Data":"e148dc50df9991471e3dc9ba7c565104a22fcc26ea4bcccd8f7dc6a8f454d794"}
Sep 18 17:29:57.931000 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:57.930333    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f" event={"ID":"4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83","Type":"ContainerStarted","Data":"a302917b896f234d824dd52181e6779b5a09c3b62ec86840a4e663ca9b982061"}
Sep 18 17:29:57.931000 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:57.930363    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f"
Sep 18 17:29:57.931915 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:57.931886    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f" podUID="4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.47:8080: connect: connection refused"
Sep 18 17:29:57.932274 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:57.932255    2577 generic.go:356] "Generic (PLEG): container finished" podID="a6d09c8f-128f-4aa7-846e-dde485898f05" containerID="6effd143987bb0ee77a3b9a9d71121176376c2c10c677e6935a37e025ad8a12a" exitCode=2
Sep 18 17:29:57.932357 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:57.932322    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7" event={"ID":"a6d09c8f-128f-4aa7-846e-dde485898f05","Type":"ContainerDied","Data":"6effd143987bb0ee77a3b9a9d71121176376c2c10c677e6935a37e025ad8a12a"}
Sep 18 17:29:57.949553 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:57.949485    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f" podStartSLOduration=0.949468053 podStartE2EDuration="949.468053ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:29:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:29:57.948526805 +0000 UTC m=+2471.005816334" watchObservedRunningTime="2026-09-18 17:29:57.949468053 +0000 UTC m=+2471.006757580"
Sep 18 17:29:58.940647 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:58.940609    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f" podUID="4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.47:8080: connect: connection refused"
Sep 18 17:29:59.513160 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:29:59.513112    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7" podUID="a6d09c8f-128f-4aa7-846e-dde485898f05" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.45:8643/healthz\": dial tcp 10.132.0.45:8643: connect: connection refused"
Sep 18 17:30:00.835442 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:30:00.835416    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7"
Sep 18 17:30:00.882641 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:30:00.882613    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a6d09c8f-128f-4aa7-846e-dde485898f05-kube-rbac-proxy-sar-config\") pod \"a6d09c8f-128f-4aa7-846e-dde485898f05\" (UID: \"a6d09c8f-128f-4aa7-846e-dde485898f05\") "
Sep 18 17:30:00.882810 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:30:00.882681    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a6d09c8f-128f-4aa7-846e-dde485898f05-proxy-tls\") pod \"a6d09c8f-128f-4aa7-846e-dde485898f05\" (UID: \"a6d09c8f-128f-4aa7-846e-dde485898f05\") "
Sep 18 17:30:00.882810 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:30:00.882716    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7m9bs\" (UniqueName: \"kubernetes.io/projected/a6d09c8f-128f-4aa7-846e-dde485898f05-kube-api-access-7m9bs\") pod \"a6d09c8f-128f-4aa7-846e-dde485898f05\" (UID: \"a6d09c8f-128f-4aa7-846e-dde485898f05\") "
Sep 18 17:30:00.883087 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:30:00.883059    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6d09c8f-128f-4aa7-846e-dde485898f05-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "a6d09c8f-128f-4aa7-846e-dde485898f05" (UID: "a6d09c8f-128f-4aa7-846e-dde485898f05"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:30:00.884904 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:30:00.884875    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6d09c8f-128f-4aa7-846e-dde485898f05-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "a6d09c8f-128f-4aa7-846e-dde485898f05" (UID: "a6d09c8f-128f-4aa7-846e-dde485898f05"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:30:00.885001 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:30:00.884909    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6d09c8f-128f-4aa7-846e-dde485898f05-kube-api-access-7m9bs" (OuterVolumeSpecName: "kube-api-access-7m9bs") pod "a6d09c8f-128f-4aa7-846e-dde485898f05" (UID: "a6d09c8f-128f-4aa7-846e-dde485898f05"). InnerVolumeSpecName "kube-api-access-7m9bs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:30:00.951090 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:30:00.951060    2577 generic.go:356] "Generic (PLEG): container finished" podID="a6d09c8f-128f-4aa7-846e-dde485898f05" containerID="380160960c06a2ef0be171759cf357c95eda7a1a85ffbf6515b4a40214691a18" exitCode=0
Sep 18 17:30:00.951258 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:30:00.951107    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7"
Sep 18 17:30:00.951258 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:30:00.951140    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7" event={"ID":"a6d09c8f-128f-4aa7-846e-dde485898f05","Type":"ContainerDied","Data":"380160960c06a2ef0be171759cf357c95eda7a1a85ffbf6515b4a40214691a18"}
Sep 18 17:30:00.951258 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:30:00.951223    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7" event={"ID":"a6d09c8f-128f-4aa7-846e-dde485898f05","Type":"ContainerDied","Data":"fe9a17b4fce468858d0a05b8dcfb4da914fd1b71e2206d4fafa53e142e637451"}
Sep 18 17:30:00.951258 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:30:00.951250    2577 scope.go:117] "RemoveContainer" containerID="6effd143987bb0ee77a3b9a9d71121176376c2c10c677e6935a37e025ad8a12a"
Sep 18 17:30:00.960293 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:30:00.960272    2577 scope.go:117] "RemoveContainer" containerID="380160960c06a2ef0be171759cf357c95eda7a1a85ffbf6515b4a40214691a18"
Sep 18 17:30:00.968240 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:30:00.968223    2577 scope.go:117] "RemoveContainer" containerID="6effd143987bb0ee77a3b9a9d71121176376c2c10c677e6935a37e025ad8a12a"
Sep 18 17:30:00.968504 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:30:00.968484    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6effd143987bb0ee77a3b9a9d71121176376c2c10c677e6935a37e025ad8a12a\": container with ID starting with 6effd143987bb0ee77a3b9a9d71121176376c2c10c677e6935a37e025ad8a12a not found: ID does not exist" containerID="6effd143987bb0ee77a3b9a9d71121176376c2c10c677e6935a37e025ad8a12a"
Sep 18 17:30:00.968606 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:30:00.968514    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6effd143987bb0ee77a3b9a9d71121176376c2c10c677e6935a37e025ad8a12a"} err="failed to get container status \"6effd143987bb0ee77a3b9a9d71121176376c2c10c677e6935a37e025ad8a12a\": rpc error: code = NotFound desc = could not find container \"6effd143987bb0ee77a3b9a9d71121176376c2c10c677e6935a37e025ad8a12a\": container with ID starting with 6effd143987bb0ee77a3b9a9d71121176376c2c10c677e6935a37e025ad8a12a not found: ID does not exist"
Sep 18 17:30:00.968606 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:30:00.968543    2577 scope.go:117] "RemoveContainer" containerID="380160960c06a2ef0be171759cf357c95eda7a1a85ffbf6515b4a40214691a18"
Sep 18 17:30:00.968793 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:30:00.968776    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"380160960c06a2ef0be171759cf357c95eda7a1a85ffbf6515b4a40214691a18\": container with ID starting with 380160960c06a2ef0be171759cf357c95eda7a1a85ffbf6515b4a40214691a18 not found: ID does not exist" containerID="380160960c06a2ef0be171759cf357c95eda7a1a85ffbf6515b4a40214691a18"
Sep 18 17:30:00.968834 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:30:00.968797    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"380160960c06a2ef0be171759cf357c95eda7a1a85ffbf6515b4a40214691a18"} err="failed to get container status \"380160960c06a2ef0be171759cf357c95eda7a1a85ffbf6515b4a40214691a18\": rpc error: code = NotFound desc = could not find container \"380160960c06a2ef0be171759cf357c95eda7a1a85ffbf6515b4a40214691a18\": container with ID starting with 380160960c06a2ef0be171759cf357c95eda7a1a85ffbf6515b4a40214691a18 not found: ID does not exist"
Sep 18 17:30:00.984276 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:30:00.984252    2577 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a6d09c8f-128f-4aa7-846e-dde485898f05-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:30:00.984378 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:30:00.984277    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a6d09c8f-128f-4aa7-846e-dde485898f05-proxy-tls\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:30:00.984378 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:30:00.984294    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7m9bs\" (UniqueName: \"kubernetes.io/projected/a6d09c8f-128f-4aa7-846e-dde485898f05-kube-api-access-7m9bs\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:30:00.995424 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:30:00.995398    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7"]
Sep 18 17:30:01.000516 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:30:01.000493    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-054ab-predictor-665d69d7f6-pdpl7"]
Sep 18 17:30:01.122337 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:30:01.122303    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6d09c8f-128f-4aa7-846e-dde485898f05" path="/var/lib/kubelet/pods/a6d09c8f-128f-4aa7-846e-dde485898f05/volumes"
Sep 18 17:30:03.944806 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:30:03.944777    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f"
Sep 18 17:30:03.945252 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:30:03.945228    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f" podUID="4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.47:8080: connect: connection refused"
Sep 18 17:30:05.684400 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:30:05.684364    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg"
Sep 18 17:30:13.946056 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:30:13.946019    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f" podUID="4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.47:8080: connect: connection refused"
Sep 18 17:30:23.945691 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:30:23.945646    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f" podUID="4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.47:8080: connect: connection refused"
Sep 18 17:30:33.945558 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:30:33.945445    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f" podUID="4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.47:8080: connect: connection refused"
Sep 18 17:30:43.945568 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:30:43.945492    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f" podUID="4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.47:8080: connect: connection refused"
Sep 18 17:30:53.946310 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:30:53.946277    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f"
Sep 18 17:33:49.288285 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:33:49.288259    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-t4p6q_60bae8ea-9599-47f8-b066-df7c46c011b3/console-operator/1.log"
Sep 18 17:33:49.297162 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:33:49.297141    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktklw_3c1064f0-18a0-4c28-8fb9-a320535dcbbf/ovn-acl-logging/0.log"
Sep 18 17:33:49.297886 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:33:49.297861    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-t4p6q_60bae8ea-9599-47f8-b066-df7c46c011b3/console-operator/1.log"
Sep 18 17:33:49.303130 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:33:49.303112    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktklw_3c1064f0-18a0-4c28-8fb9-a320535dcbbf/ovn-acl-logging/0.log"
Sep 18 17:38:49.324113 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:38:49.324006    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-t4p6q_60bae8ea-9599-47f8-b066-df7c46c011b3/console-operator/1.log"
Sep 18 17:38:49.329936 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:38:49.329913    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktklw_3c1064f0-18a0-4c28-8fb9-a320535dcbbf/ovn-acl-logging/0.log"
Sep 18 17:38:49.332239 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:38:49.332220    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-t4p6q_60bae8ea-9599-47f8-b066-df7c46c011b3/console-operator/1.log"
Sep 18 17:38:49.337644 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:38:49.337627    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktklw_3c1064f0-18a0-4c28-8fb9-a320535dcbbf/ovn-acl-logging/0.log"
Sep 18 17:39:22.057213 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:39:22.057177    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f"]
Sep 18 17:39:22.057717 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:39:22.057452    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f" podUID="4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83" containerName="kserve-container" containerID="cri-o://e148dc50df9991471e3dc9ba7c565104a22fcc26ea4bcccd8f7dc6a8f454d794" gracePeriod=30
Sep 18 17:39:22.057717 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:39:22.057543    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f" podUID="4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83" containerName="kube-rbac-proxy" containerID="cri-o://7e31dd42d5241c7859e7677f7d475bf05a4b7c0a7382d38b03f15fc52cbb2311" gracePeriod=30
Sep 18 17:39:22.672980 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:39:22.672944    2577 generic.go:356] "Generic (PLEG): container finished" podID="4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83" containerID="7e31dd42d5241c7859e7677f7d475bf05a4b7c0a7382d38b03f15fc52cbb2311" exitCode=2
Sep 18 17:39:22.673156 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:39:22.673024    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f" event={"ID":"4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83","Type":"ContainerDied","Data":"7e31dd42d5241c7859e7677f7d475bf05a4b7c0a7382d38b03f15fc52cbb2311"}
Sep 18 17:39:23.941327 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:39:23.941282    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f" podUID="4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.47:8643/healthz\": dial tcp 10.132.0.47:8643: connect: connection refused"
Sep 18 17:39:23.945878 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:39:23.945851    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f" podUID="4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.47:8080: connect: connection refused"
Sep 18 17:39:25.512495 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:39:25.512468    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f"
Sep 18 17:39:25.534362 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:39:25.534333    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83-proxy-tls\") pod \"4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83\" (UID: \"4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83\") "
Sep 18 17:39:25.534519 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:39:25.534375    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83-kube-rbac-proxy-sar-config\") pod \"4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83\" (UID: \"4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83\") "
Sep 18 17:39:25.534519 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:39:25.534432    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jk4jr\" (UniqueName: \"kubernetes.io/projected/4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83-kube-api-access-jk4jr\") pod \"4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83\" (UID: \"4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83\") "
Sep 18 17:39:25.534783 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:39:25.534759    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83" (UID: "4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:39:25.536489 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:39:25.536462    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83-kube-api-access-jk4jr" (OuterVolumeSpecName: "kube-api-access-jk4jr") pod "4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83" (UID: "4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83"). InnerVolumeSpecName "kube-api-access-jk4jr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:39:25.536692 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:39:25.536555    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83" (UID: "4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:39:25.635164 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:39:25.635123    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83-proxy-tls\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:39:25.635164 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:39:25.635156    2577 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:39:25.635164 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:39:25.635168    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jk4jr\" (UniqueName: \"kubernetes.io/projected/4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83-kube-api-access-jk4jr\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:39:25.689410 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:39:25.689377    2577 generic.go:356] "Generic (PLEG): container finished" podID="4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83" containerID="e148dc50df9991471e3dc9ba7c565104a22fcc26ea4bcccd8f7dc6a8f454d794" exitCode=0
Sep 18 17:39:25.689591 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:39:25.689421    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f"
Sep 18 17:39:25.689591 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:39:25.689424    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f" event={"ID":"4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83","Type":"ContainerDied","Data":"e148dc50df9991471e3dc9ba7c565104a22fcc26ea4bcccd8f7dc6a8f454d794"}
Sep 18 17:39:25.689591 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:39:25.689552    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f" event={"ID":"4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83","Type":"ContainerDied","Data":"a302917b896f234d824dd52181e6779b5a09c3b62ec86840a4e663ca9b982061"}
Sep 18 17:39:25.689591 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:39:25.689578    2577 scope.go:117] "RemoveContainer" containerID="7e31dd42d5241c7859e7677f7d475bf05a4b7c0a7382d38b03f15fc52cbb2311"
Sep 18 17:39:25.698607 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:39:25.698589    2577 scope.go:117] "RemoveContainer" containerID="e148dc50df9991471e3dc9ba7c565104a22fcc26ea4bcccd8f7dc6a8f454d794"
Sep 18 17:39:25.706375 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:39:25.706358    2577 scope.go:117] "RemoveContainer" containerID="7e31dd42d5241c7859e7677f7d475bf05a4b7c0a7382d38b03f15fc52cbb2311"
Sep 18 17:39:25.706668 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:39:25.706649    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e31dd42d5241c7859e7677f7d475bf05a4b7c0a7382d38b03f15fc52cbb2311\": container with ID starting with 7e31dd42d5241c7859e7677f7d475bf05a4b7c0a7382d38b03f15fc52cbb2311 not found: ID does not exist" containerID="7e31dd42d5241c7859e7677f7d475bf05a4b7c0a7382d38b03f15fc52cbb2311"
Sep 18 17:39:25.706722 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:39:25.706677    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e31dd42d5241c7859e7677f7d475bf05a4b7c0a7382d38b03f15fc52cbb2311"} err="failed to get container status \"7e31dd42d5241c7859e7677f7d475bf05a4b7c0a7382d38b03f15fc52cbb2311\": rpc error: code = NotFound desc = could not find container \"7e31dd42d5241c7859e7677f7d475bf05a4b7c0a7382d38b03f15fc52cbb2311\": container with ID starting with 7e31dd42d5241c7859e7677f7d475bf05a4b7c0a7382d38b03f15fc52cbb2311 not found: ID does not exist"
Sep 18 17:39:25.706722 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:39:25.706694    2577 scope.go:117] "RemoveContainer" containerID="e148dc50df9991471e3dc9ba7c565104a22fcc26ea4bcccd8f7dc6a8f454d794"
Sep 18 17:39:25.706947 ip-10-0-132-41 kubenswrapper[2577]: E0918 17:39:25.706927    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e148dc50df9991471e3dc9ba7c565104a22fcc26ea4bcccd8f7dc6a8f454d794\": container with ID starting with e148dc50df9991471e3dc9ba7c565104a22fcc26ea4bcccd8f7dc6a8f454d794 not found: ID does not exist" containerID="e148dc50df9991471e3dc9ba7c565104a22fcc26ea4bcccd8f7dc6a8f454d794"
Sep 18 17:39:25.707008 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:39:25.706957    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e148dc50df9991471e3dc9ba7c565104a22fcc26ea4bcccd8f7dc6a8f454d794"} err="failed to get container status \"e148dc50df9991471e3dc9ba7c565104a22fcc26ea4bcccd8f7dc6a8f454d794\": rpc error: code = NotFound desc = could not find container \"e148dc50df9991471e3dc9ba7c565104a22fcc26ea4bcccd8f7dc6a8f454d794\": container with ID starting with e148dc50df9991471e3dc9ba7c565104a22fcc26ea4bcccd8f7dc6a8f454d794 not found: ID does not exist"
Sep 18 17:39:25.711049 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:39:25.711027    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f"]
Sep 18 17:39:25.715331 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:39:25.715310    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-f0fb0-predictor-7cbb4c9f9b-5zb9f"]
Sep 18 17:39:27.122862 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:39:27.122831    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83" path="/var/lib/kubelet/pods/4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83/volumes"
Sep 18 17:43:49.360115 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:43:49.360085    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-t4p6q_60bae8ea-9599-47f8-b066-df7c46c011b3/console-operator/1.log"
Sep 18 17:43:49.366435 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:43:49.366409    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktklw_3c1064f0-18a0-4c28-8fb9-a320535dcbbf/ovn-acl-logging/0.log"
Sep 18 17:43:49.367492 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:43:49.367472    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-t4p6q_60bae8ea-9599-47f8-b066-df7c46c011b3/console-operator/1.log"
Sep 18 17:43:49.373399 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:43:49.373380    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktklw_3c1064f0-18a0-4c28-8fb9-a320535dcbbf/ovn-acl-logging/0.log"
Sep 18 17:46:37.136960 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:46:37.136922    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg"]
Sep 18 17:46:37.137834 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:46:37.137797    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg" podUID="fdf0fc94-7aca-4994-a00c-ac28739a3c80" containerName="kserve-container" containerID="cri-o://d13fef0983466ee901f860856b1b91fd618946685940bb5ca437a0643919779e" gracePeriod=30
Sep 18 17:46:37.137974 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:46:37.137842    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg" podUID="fdf0fc94-7aca-4994-a00c-ac28739a3c80" containerName="kube-rbac-proxy" containerID="cri-o://ca989ce9054f4b6bf029f8da6509512397dbc1f2ca0af5aa186514ce49cc557b" gracePeriod=30
Sep 18 17:46:37.761127 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:46:37.761091    2577 generic.go:356] "Generic (PLEG): container finished" podID="fdf0fc94-7aca-4994-a00c-ac28739a3c80" containerID="ca989ce9054f4b6bf029f8da6509512397dbc1f2ca0af5aa186514ce49cc557b" exitCode=2
Sep 18 17:46:37.761303 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:46:37.761161    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg" event={"ID":"fdf0fc94-7aca-4994-a00c-ac28739a3c80","Type":"ContainerDied","Data":"ca989ce9054f4b6bf029f8da6509512397dbc1f2ca0af5aa186514ce49cc557b"}
Sep 18 17:46:40.677550 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:46:40.677497    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg" podUID="fdf0fc94-7aca-4994-a00c-ac28739a3c80" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.46:8643/healthz\": dial tcp 10.132.0.46:8643: connect: connection refused"
Sep 18 17:46:40.784938 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:46:40.784904    2577 generic.go:356] "Generic (PLEG): container finished" podID="fdf0fc94-7aca-4994-a00c-ac28739a3c80" containerID="d13fef0983466ee901f860856b1b91fd618946685940bb5ca437a0643919779e" exitCode=0
Sep 18 17:46:40.785118 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:46:40.784956    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg" event={"ID":"fdf0fc94-7aca-4994-a00c-ac28739a3c80","Type":"ContainerDied","Data":"d13fef0983466ee901f860856b1b91fd618946685940bb5ca437a0643919779e"}
Sep 18 17:46:40.892199 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:46:40.892173    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg"
Sep 18 17:46:41.043046 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:46:41.042932    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fdf0fc94-7aca-4994-a00c-ac28739a3c80-proxy-tls\") pod \"fdf0fc94-7aca-4994-a00c-ac28739a3c80\" (UID: \"fdf0fc94-7aca-4994-a00c-ac28739a3c80\") "
Sep 18 17:46:41.043046 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:46:41.042984    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fdf0fc94-7aca-4994-a00c-ac28739a3c80-kube-rbac-proxy-sar-config\") pod \"fdf0fc94-7aca-4994-a00c-ac28739a3c80\" (UID: \"fdf0fc94-7aca-4994-a00c-ac28739a3c80\") "
Sep 18 17:46:41.043046 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:46:41.043042    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wc4f8\" (UniqueName: \"kubernetes.io/projected/fdf0fc94-7aca-4994-a00c-ac28739a3c80-kube-api-access-wc4f8\") pod \"fdf0fc94-7aca-4994-a00c-ac28739a3c80\" (UID: \"fdf0fc94-7aca-4994-a00c-ac28739a3c80\") "
Sep 18 17:46:41.043508 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:46:41.043479    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdf0fc94-7aca-4994-a00c-ac28739a3c80-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "fdf0fc94-7aca-4994-a00c-ac28739a3c80" (UID: "fdf0fc94-7aca-4994-a00c-ac28739a3c80"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:46:41.045274 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:46:41.045247    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdf0fc94-7aca-4994-a00c-ac28739a3c80-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "fdf0fc94-7aca-4994-a00c-ac28739a3c80" (UID: "fdf0fc94-7aca-4994-a00c-ac28739a3c80"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:46:41.045383 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:46:41.045363    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdf0fc94-7aca-4994-a00c-ac28739a3c80-kube-api-access-wc4f8" (OuterVolumeSpecName: "kube-api-access-wc4f8") pod "fdf0fc94-7aca-4994-a00c-ac28739a3c80" (UID: "fdf0fc94-7aca-4994-a00c-ac28739a3c80"). InnerVolumeSpecName "kube-api-access-wc4f8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:46:41.143663 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:46:41.143625    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wc4f8\" (UniqueName: \"kubernetes.io/projected/fdf0fc94-7aca-4994-a00c-ac28739a3c80-kube-api-access-wc4f8\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:46:41.143663 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:46:41.143658    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fdf0fc94-7aca-4994-a00c-ac28739a3c80-proxy-tls\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:46:41.143835 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:46:41.143671    2577 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fdf0fc94-7aca-4994-a00c-ac28739a3c80-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-41.ec2.internal\" DevicePath \"\""
Sep 18 17:46:41.791339 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:46:41.791303    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg"
Sep 18 17:46:41.791339 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:46:41.791315    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg" event={"ID":"fdf0fc94-7aca-4994-a00c-ac28739a3c80","Type":"ContainerDied","Data":"b9732ba2db0cf76154f0e20f6e00170ff730d8e15f184d315b4d553f71e3b7b6"}
Sep 18 17:46:41.791896 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:46:41.791377    2577 scope.go:117] "RemoveContainer" containerID="ca989ce9054f4b6bf029f8da6509512397dbc1f2ca0af5aa186514ce49cc557b"
Sep 18 17:46:41.799989 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:46:41.799968    2577 scope.go:117] "RemoveContainer" containerID="d13fef0983466ee901f860856b1b91fd618946685940bb5ca437a0643919779e"
Sep 18 17:46:41.811512 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:46:41.811436    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg"]
Sep 18 17:46:41.813419 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:46:41.813395    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0cb05-predictor-75df596dd-w7jqg"]
Sep 18 17:46:43.124096 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:46:43.124061    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdf0fc94-7aca-4994-a00c-ac28739a3c80" path="/var/lib/kubelet/pods/fdf0fc94-7aca-4994-a00c-ac28739a3c80/volumes"
Sep 18 17:47:09.832851 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:09.832759    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9l6m9/must-gather-w5mjt"]
Sep 18 17:47:09.833242 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:09.833130    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83" containerName="kube-rbac-proxy"
Sep 18 17:47:09.833242 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:09.833141    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83" containerName="kube-rbac-proxy"
Sep 18 17:47:09.833242 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:09.833150    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdf0fc94-7aca-4994-a00c-ac28739a3c80" containerName="kserve-container"
Sep 18 17:47:09.833242 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:09.833156    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdf0fc94-7aca-4994-a00c-ac28739a3c80" containerName="kserve-container"
Sep 18 17:47:09.833242 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:09.833176    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6d09c8f-128f-4aa7-846e-dde485898f05" containerName="kserve-container"
Sep 18 17:47:09.833242 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:09.833182    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6d09c8f-128f-4aa7-846e-dde485898f05" containerName="kserve-container"
Sep 18 17:47:09.833242 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:09.833201    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6d09c8f-128f-4aa7-846e-dde485898f05" containerName="kube-rbac-proxy"
Sep 18 17:47:09.833242 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:09.833206    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6d09c8f-128f-4aa7-846e-dde485898f05" containerName="kube-rbac-proxy"
Sep 18 17:47:09.833242 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:09.833214    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdf0fc94-7aca-4994-a00c-ac28739a3c80" containerName="kube-rbac-proxy"
Sep 18 17:47:09.833242 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:09.833220    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdf0fc94-7aca-4994-a00c-ac28739a3c80" containerName="kube-rbac-proxy"
Sep 18 17:47:09.833242 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:09.833228    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83" containerName="kserve-container"
Sep 18 17:47:09.833242 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:09.833233    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83" containerName="kserve-container"
Sep 18 17:47:09.833661 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:09.833287    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6d09c8f-128f-4aa7-846e-dde485898f05" containerName="kube-rbac-proxy"
Sep 18 17:47:09.833661 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:09.833294    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdf0fc94-7aca-4994-a00c-ac28739a3c80" containerName="kube-rbac-proxy"
Sep 18 17:47:09.833661 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:09.833300    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdf0fc94-7aca-4994-a00c-ac28739a3c80" containerName="kserve-container"
Sep 18 17:47:09.833661 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:09.833309    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6d09c8f-128f-4aa7-846e-dde485898f05" containerName="kserve-container"
Sep 18 17:47:09.833661 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:09.833315    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83" containerName="kube-rbac-proxy"
Sep 18 17:47:09.833661 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:09.833321    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4379ec2e-7b0d-4ae3-bfaa-07e70ea2ca83" containerName="kserve-container"
Sep 18 17:47:09.836860 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:09.836840    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9l6m9/must-gather-w5mjt"
Sep 18 17:47:09.839136 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:09.839108    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9l6m9\"/\"default-dockercfg-drjkb\""
Sep 18 17:47:09.839286 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:09.839176    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9l6m9\"/\"kube-root-ca.crt\""
Sep 18 17:47:09.839286 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:09.839247    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9l6m9\"/\"openshift-service-ca.crt\""
Sep 18 17:47:09.844168 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:09.844141    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9l6m9/must-gather-w5mjt"]
Sep 18 17:47:09.884832 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:09.884795    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6ea8ed8c-3b5d-42ad-9b9e-7905b53d334d-must-gather-output\") pod \"must-gather-w5mjt\" (UID: \"6ea8ed8c-3b5d-42ad-9b9e-7905b53d334d\") " pod="openshift-must-gather-9l6m9/must-gather-w5mjt"
Sep 18 17:47:09.885019 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:09.884841    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz2w5\" (UniqueName: \"kubernetes.io/projected/6ea8ed8c-3b5d-42ad-9b9e-7905b53d334d-kube-api-access-xz2w5\") pod \"must-gather-w5mjt\" (UID: \"6ea8ed8c-3b5d-42ad-9b9e-7905b53d334d\") " pod="openshift-must-gather-9l6m9/must-gather-w5mjt"
Sep 18 17:47:09.986292 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:09.986246    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6ea8ed8c-3b5d-42ad-9b9e-7905b53d334d-must-gather-output\") pod \"must-gather-w5mjt\" (UID: \"6ea8ed8c-3b5d-42ad-9b9e-7905b53d334d\") " pod="openshift-must-gather-9l6m9/must-gather-w5mjt"
Sep 18 17:47:09.986292 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:09.986293    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz2w5\" (UniqueName: \"kubernetes.io/projected/6ea8ed8c-3b5d-42ad-9b9e-7905b53d334d-kube-api-access-xz2w5\") pod \"must-gather-w5mjt\" (UID: \"6ea8ed8c-3b5d-42ad-9b9e-7905b53d334d\") " pod="openshift-must-gather-9l6m9/must-gather-w5mjt"
Sep 18 17:47:09.986692 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:09.986671    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6ea8ed8c-3b5d-42ad-9b9e-7905b53d334d-must-gather-output\") pod \"must-gather-w5mjt\" (UID: \"6ea8ed8c-3b5d-42ad-9b9e-7905b53d334d\") " pod="openshift-must-gather-9l6m9/must-gather-w5mjt"
Sep 18 17:47:09.995402 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:09.995374    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz2w5\" (UniqueName: \"kubernetes.io/projected/6ea8ed8c-3b5d-42ad-9b9e-7905b53d334d-kube-api-access-xz2w5\") pod \"must-gather-w5mjt\" (UID: \"6ea8ed8c-3b5d-42ad-9b9e-7905b53d334d\") " pod="openshift-must-gather-9l6m9/must-gather-w5mjt"
Sep 18 17:47:10.153652 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:10.153603    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9l6m9/must-gather-w5mjt"
Sep 18 17:47:10.439511 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:10.439416    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9l6m9/must-gather-w5mjt"]
Sep 18 17:47:10.442640 ip-10-0-132-41 kubenswrapper[2577]: W0918 17:47:10.442604    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ea8ed8c_3b5d_42ad_9b9e_7905b53d334d.slice/crio-c5a32917489bdbc81a7387a4a34bb66d7deb6e319221682ea85be5295046d07b WatchSource:0}: Error finding container c5a32917489bdbc81a7387a4a34bb66d7deb6e319221682ea85be5295046d07b: Status 404 returned error can't find the container with id c5a32917489bdbc81a7387a4a34bb66d7deb6e319221682ea85be5295046d07b
Sep 18 17:47:10.444587 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:10.444571    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 17:47:10.941564 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:10.941505    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9l6m9/must-gather-w5mjt" event={"ID":"6ea8ed8c-3b5d-42ad-9b9e-7905b53d334d","Type":"ContainerStarted","Data":"c5a32917489bdbc81a7387a4a34bb66d7deb6e319221682ea85be5295046d07b"}
Sep 18 17:47:11.950057 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:11.950017    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9l6m9/must-gather-w5mjt" event={"ID":"6ea8ed8c-3b5d-42ad-9b9e-7905b53d334d","Type":"ContainerStarted","Data":"d666b50375e534955d50ecd2368c2fb7cb01484532de1b74a3b0633c8cdcefea"}
Sep 18 17:47:11.950057 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:11.950071    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9l6m9/must-gather-w5mjt" event={"ID":"6ea8ed8c-3b5d-42ad-9b9e-7905b53d334d","Type":"ContainerStarted","Data":"d296533f8f2ce90aa2f1ebddd5a5711c59fcb26eb2ddf2afa2f813351448fe54"}
Sep 18 17:47:12.844639 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:12.844609    2577 ???:1] "http: TLS handshake error from 10.0.142.7:39416: EOF"
Sep 18 17:47:12.855959 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:12.855927    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wrq7r_b7774138-6ff0-4571-8f2e-4a8020126c37/global-pull-secret-syncer/0.log"
Sep 18 17:47:12.961116 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:12.961063    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-l2bv5_1534a00e-3417-441a-9df8-29be1ac81b77/konnectivity-agent/0.log"
Sep 18 17:47:13.035698 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:13.035664    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-41.ec2.internal_9ae31834f4280439711acddc59629bae/haproxy/0.log"
Sep 18 17:47:17.450470 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:17.450437    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_43e18a4a-10e4-4204-b0d9-42b8f0e802a2/alertmanager/0.log"
Sep 18 17:47:17.502639 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:17.502606    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_43e18a4a-10e4-4204-b0d9-42b8f0e802a2/config-reloader/0.log"
Sep 18 17:47:17.563407 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:17.563376    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_43e18a4a-10e4-4204-b0d9-42b8f0e802a2/kube-rbac-proxy-web/0.log"
Sep 18 17:47:17.695947 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:17.695915    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_43e18a4a-10e4-4204-b0d9-42b8f0e802a2/kube-rbac-proxy/0.log"
Sep 18 17:47:17.789226 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:17.789134    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_43e18a4a-10e4-4204-b0d9-42b8f0e802a2/kube-rbac-proxy-metric/0.log"
Sep 18 17:47:17.894775 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:17.894741    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_43e18a4a-10e4-4204-b0d9-42b8f0e802a2/prom-label-proxy/0.log"
Sep 18 17:47:17.958170 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:17.958116    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_43e18a4a-10e4-4204-b0d9-42b8f0e802a2/init-config-reloader/0.log"
Sep 18 17:47:18.065018 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:18.064933    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-847b8bd8d7-4w84l_f4bc850b-a864-4436-a183-799c111bb01f/cluster-monitoring-operator/0.log"
Sep 18 17:47:18.109556 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:18.109515    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-86pwd_0cb31f04-f48e-4dda-9147-915c238fc857/kube-state-metrics/0.log"
Sep 18 17:47:18.161691 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:18.161661    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-86pwd_0cb31f04-f48e-4dda-9147-915c238fc857/kube-rbac-proxy-main/0.log"
Sep 18 17:47:18.216606 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:18.216575    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-86pwd_0cb31f04-f48e-4dda-9147-915c238fc857/kube-rbac-proxy-self/0.log"
Sep 18 17:47:18.298383 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:18.298356    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6b74996fcf-fzjx5_f4074d69-35a8-4ded-9721-ec5ce7994c0d/metrics-server/0.log"
Sep 18 17:47:18.389195 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:18.389159    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-bcw4j_0668115e-a46e-4f74-806b-445fe858939a/monitoring-plugin/0.log"
Sep 18 17:47:18.451145 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:18.451116    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6tl5z_57cef12e-d07e-4c77-9de9-895b066092e1/node-exporter/0.log"
Sep 18 17:47:18.551763 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:18.551739    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6tl5z_57cef12e-d07e-4c77-9de9-895b066092e1/kube-rbac-proxy/0.log"
Sep 18 17:47:18.646254 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:18.646174    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6tl5z_57cef12e-d07e-4c77-9de9-895b066092e1/init-textfile/0.log"
Sep 18 17:47:19.000375 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:19.000292    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-sk6jr_67895b79-4bdd-45ed-82e9-e9921052c81e/kube-rbac-proxy-main/0.log"
Sep 18 17:47:19.035774 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:19.035744    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-sk6jr_67895b79-4bdd-45ed-82e9-e9921052c81e/kube-rbac-proxy-self/0.log"
Sep 18 17:47:19.083050 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:19.082983    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-sk6jr_67895b79-4bdd-45ed-82e9-e9921052c81e/openshift-state-metrics/0.log"
Sep 18 17:47:19.408727 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:19.408690    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-59n4l_7dabee8c-f83f-45cc-8e91-042849088339/prometheus-operator/0.log"
Sep 18 17:47:19.441021 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:19.440990    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-59n4l_7dabee8c-f83f-45cc-8e91-042849088339/kube-rbac-proxy/0.log"
Sep 18 17:47:19.475503 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:19.475476    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-9pqbj_8d069742-d2b5-475e-8240-eddb4ae53bbe/prometheus-operator-admission-webhook/0.log"
Sep 18 17:47:19.514822 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:19.514789    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6b8658d9bc-44d9c_8f9134ad-d07d-4c88-977b-c04e0c51bc21/telemeter-client/0.log"
Sep 18 17:47:19.543334 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:19.543305    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6b8658d9bc-44d9c_8f9134ad-d07d-4c88-977b-c04e0c51bc21/reload/0.log"
Sep 18 17:47:19.571759 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:19.571698    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6b8658d9bc-44d9c_8f9134ad-d07d-4c88-977b-c04e0c51bc21/kube-rbac-proxy/0.log"
Sep 18 17:47:20.545672 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:20.545593    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9l6m9/must-gather-w5mjt" podStartSLOduration=10.917106728 podStartE2EDuration="11.545560295s" totalImagesPullingTime="628.453567ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:47:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:47:11.969249639 +0000 UTC m=+3505.026539167" watchObservedRunningTime="2026-09-18 17:47:20.545560295 +0000 UTC m=+3513.602849825"
Sep 18 17:47:20.546749 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:20.546715    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9l6m9/perf-node-gather-daemonset-2g5qq"]
Sep 18 17:47:20.552886 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:20.552858    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-2g5qq"
Sep 18 17:47:20.560065 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:20.560029    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9l6m9/perf-node-gather-daemonset-2g5qq"]
Sep 18 17:47:20.697868 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:20.697826    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/929f72b3-e1ae-4675-831a-4d2cf4b99cf3-sys\") pod \"perf-node-gather-daemonset-2g5qq\" (UID: \"929f72b3-e1ae-4675-831a-4d2cf4b99cf3\") " pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-2g5qq"
Sep 18 17:47:20.698085 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:20.697894    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/929f72b3-e1ae-4675-831a-4d2cf4b99cf3-lib-modules\") pod \"perf-node-gather-daemonset-2g5qq\" (UID: \"929f72b3-e1ae-4675-831a-4d2cf4b99cf3\") " pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-2g5qq"
Sep 18 17:47:20.698085 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:20.697921    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85xc2\" (UniqueName: \"kubernetes.io/projected/929f72b3-e1ae-4675-831a-4d2cf4b99cf3-kube-api-access-85xc2\") pod \"perf-node-gather-daemonset-2g5qq\" (UID: \"929f72b3-e1ae-4675-831a-4d2cf4b99cf3\") " pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-2g5qq"
Sep 18 17:47:20.698085 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:20.697989    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/929f72b3-e1ae-4675-831a-4d2cf4b99cf3-proc\") pod \"perf-node-gather-daemonset-2g5qq\" (UID: \"929f72b3-e1ae-4675-831a-4d2cf4b99cf3\") " pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-2g5qq"
Sep 18 17:47:20.698248 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:20.698122    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/929f72b3-e1ae-4675-831a-4d2cf4b99cf3-podres\") pod \"perf-node-gather-daemonset-2g5qq\" (UID: \"929f72b3-e1ae-4675-831a-4d2cf4b99cf3\") " pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-2g5qq"
Sep 18 17:47:20.799489 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:20.799394    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/929f72b3-e1ae-4675-831a-4d2cf4b99cf3-sys\") pod \"perf-node-gather-daemonset-2g5qq\" (UID: \"929f72b3-e1ae-4675-831a-4d2cf4b99cf3\") " pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-2g5qq"
Sep 18 17:47:20.799489 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:20.799464    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/929f72b3-e1ae-4675-831a-4d2cf4b99cf3-lib-modules\") pod \"perf-node-gather-daemonset-2g5qq\" (UID: \"929f72b3-e1ae-4675-831a-4d2cf4b99cf3\") " pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-2g5qq"
Sep 18 17:47:20.799745 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:20.799491    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85xc2\" (UniqueName: \"kubernetes.io/projected/929f72b3-e1ae-4675-831a-4d2cf4b99cf3-kube-api-access-85xc2\") pod \"perf-node-gather-daemonset-2g5qq\" (UID: \"929f72b3-e1ae-4675-831a-4d2cf4b99cf3\") " pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-2g5qq"
Sep 18 17:47:20.799745 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:20.799517    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/929f72b3-e1ae-4675-831a-4d2cf4b99cf3-proc\") pod \"perf-node-gather-daemonset-2g5qq\" (UID: \"929f72b3-e1ae-4675-831a-4d2cf4b99cf3\") " pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-2g5qq"
Sep 18 17:47:20.799745 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:20.799646    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/929f72b3-e1ae-4675-831a-4d2cf4b99cf3-podres\") pod \"perf-node-gather-daemonset-2g5qq\" (UID: \"929f72b3-e1ae-4675-831a-4d2cf4b99cf3\") " pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-2g5qq"
Sep 18 17:47:20.799911 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:20.799831    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/929f72b3-e1ae-4675-831a-4d2cf4b99cf3-podres\") pod \"perf-node-gather-daemonset-2g5qq\" (UID: \"929f72b3-e1ae-4675-831a-4d2cf4b99cf3\") " pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-2g5qq"
Sep 18 17:47:20.799911 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:20.799889    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/929f72b3-e1ae-4675-831a-4d2cf4b99cf3-sys\") pod \"perf-node-gather-daemonset-2g5qq\" (UID: \"929f72b3-e1ae-4675-831a-4d2cf4b99cf3\") " pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-2g5qq"
Sep 18 17:47:20.800016 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:20.799972    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/929f72b3-e1ae-4675-831a-4d2cf4b99cf3-lib-modules\") pod \"perf-node-gather-daemonset-2g5qq\" (UID: \"929f72b3-e1ae-4675-831a-4d2cf4b99cf3\") " pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-2g5qq"
Sep 18 17:47:20.800323 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:20.800299    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/929f72b3-e1ae-4675-831a-4d2cf4b99cf3-proc\") pod \"perf-node-gather-daemonset-2g5qq\" (UID: \"929f72b3-e1ae-4675-831a-4d2cf4b99cf3\") " pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-2g5qq"
Sep 18 17:47:20.810754 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:20.810721    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85xc2\" (UniqueName: \"kubernetes.io/projected/929f72b3-e1ae-4675-831a-4d2cf4b99cf3-kube-api-access-85xc2\") pod \"perf-node-gather-daemonset-2g5qq\" (UID: \"929f72b3-e1ae-4675-831a-4d2cf4b99cf3\") " pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-2g5qq"
Sep 18 17:47:20.813211 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:20.813181    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6446c8d75d-x9bk4_5bd1c70f-d4b2-4d0c-8ac4-2d10df8b4965/networking-console-plugin/0.log"
Sep 18 17:47:20.866618 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:20.866578    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-2g5qq"
Sep 18 17:47:21.171017 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:21.169966    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9l6m9/perf-node-gather-daemonset-2g5qq"]
Sep 18 17:47:21.172973 ip-10-0-132-41 kubenswrapper[2577]: W0918 17:47:21.172939    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod929f72b3_e1ae_4675_831a_4d2cf4b99cf3.slice/crio-2bf30b9d3a07d222fb99fafba7171a03799dbe93b7644bb16907697d7bb12fd5 WatchSource:0}: Error finding container 2bf30b9d3a07d222fb99fafba7171a03799dbe93b7644bb16907697d7bb12fd5: Status 404 returned error can't find the container with id 2bf30b9d3a07d222fb99fafba7171a03799dbe93b7644bb16907697d7bb12fd5
Sep 18 17:47:21.346692 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:21.346657    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-t4p6q_60bae8ea-9599-47f8-b066-df7c46c011b3/console-operator/1.log"
Sep 18 17:47:21.367602 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:21.367514    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-t4p6q_60bae8ea-9599-47f8-b066-df7c46c011b3/console-operator/2.log"
Sep 18 17:47:21.895140 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:21.895109    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6594f4c75-dq25h_4f028e9f-c895-4f71-870a-0d2ff7102024/download-server/0.log"
Sep 18 17:47:22.013836 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:22.013803    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-2g5qq" event={"ID":"929f72b3-e1ae-4675-831a-4d2cf4b99cf3","Type":"ContainerStarted","Data":"aa361fa296e3aff51fd97fee6eb11035e919f9cb0213dc421ae5c0c15b07c143"}
Sep 18 17:47:22.014011 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:22.013855    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-2g5qq" event={"ID":"929f72b3-e1ae-4675-831a-4d2cf4b99cf3","Type":"ContainerStarted","Data":"2bf30b9d3a07d222fb99fafba7171a03799dbe93b7644bb16907697d7bb12fd5"}
Sep 18 17:47:22.014011 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:22.013893    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-2g5qq"
Sep 18 17:47:22.052569 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:22.052495    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-2g5qq" podStartSLOduration=2.052477758 podStartE2EDuration="2.052477758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 17:47:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:47:22.051885128 +0000 UTC m=+3515.109174658" watchObservedRunningTime="2026-09-18 17:47:22.052477758 +0000 UTC m=+3515.109767288"
Sep 18 17:47:22.505068 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:22.505029    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5c4db8bdf9-czc2k_bcd40bb5-3d11-4d73-9b14-0372247d9bc7/volume-data-source-validator/0.log"
Sep 18 17:47:23.448547 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:23.448501    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ttxjb_9fc84d1c-d436-4b1a-9557-182688c69eff/dns/0.log"
Sep 18 17:47:23.472726 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:23.472696    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ttxjb_9fc84d1c-d436-4b1a-9557-182688c69eff/kube-rbac-proxy/0.log"
Sep 18 17:47:23.548466 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:23.548439    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5rc4b_95f739d8-990d-4aa8-a1e3-ed8cefd56bd2/dns-node-resolver/0.log"
Sep 18 17:47:24.184830 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:24.184795    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v7rt9_cb0bea49-0666-42ee-9d96-221eee1b5aa8/node-ca/0.log"
Sep 18 17:47:25.403822 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:25.403792    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pkl4j_b20e181a-e088-448d-8ee1-d052e787955e/serve-healthcheck-canary/0.log"
Sep 18 17:47:25.779474 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:25.779388    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-mk2d9_e5bb8736-917b-4bb1-bf19-f6b88a528de8/insights-operator/0.log"
Sep 18 17:47:25.782095 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:25.782075    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-mk2d9_e5bb8736-917b-4bb1-bf19-f6b88a528de8/insights-operator/1.log"
Sep 18 17:47:25.887031 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:25.887007    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ghtv5_770f3c28-b304-40a6-a804-5bbe9e49bab3/kube-rbac-proxy/0.log"
Sep 18 17:47:25.910356 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:25.910325    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ghtv5_770f3c28-b304-40a6-a804-5bbe9e49bab3/exporter/0.log"
Sep 18 17:47:25.933450 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:25.933422    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ghtv5_770f3c28-b304-40a6-a804-5bbe9e49bab3/extractor/0.log"
Sep 18 17:47:28.030215 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:28.030185    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-2g5qq"
Sep 18 17:47:28.390982 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:28.390944    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-5c47bdc49c-6q6nz_1229258a-a5c8-4531-b801-8fcd53cdb578/manager/0.log"
Sep 18 17:47:28.457411 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:28.457384    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-7b954ffc95-kwdkh_26a3f8bb-ddd8-4599-be7f-f4bf0f6b0148/server/0.log"
Sep 18 17:47:28.643065 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:28.642972    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-zgckq_783f10a3-dbfa-4132-95f4-fefc06c21594/seaweedfs/0.log"
Sep 18 17:47:33.323235 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:33.323203    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-b2dcg_4383ecc4-e1ec-49ab-9fef-cfd5fc19e88a/migrator/0.log"
Sep 18 17:47:33.348095 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:33.348057    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-b2dcg_4383ecc4-e1ec-49ab-9fef-cfd5fc19e88a/graceful-termination/0.log"
Sep 18 17:47:33.768873 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:33.768834    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-87vfw_bf32dd38-8c07-4cb1-bae7-d8f2613669e0/kube-storage-version-migrator-operator/1.log"
Sep 18 17:47:33.770262 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:33.770237    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-87vfw_bf32dd38-8c07-4cb1-bae7-d8f2613669e0/kube-storage-version-migrator-operator/0.log"
Sep 18 17:47:35.036698 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:35.036667    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5lj92_e45baf5d-f62f-40d2-b368-51925ce7d95c/kube-multus-additional-cni-plugins/0.log"
Sep 18 17:47:35.059347 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:35.059323    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5lj92_e45baf5d-f62f-40d2-b368-51925ce7d95c/egress-router-binary-copy/0.log"
Sep 18 17:47:35.082401 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:35.082369    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5lj92_e45baf5d-f62f-40d2-b368-51925ce7d95c/cni-plugins/0.log"
Sep 18 17:47:35.106982 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:35.106954    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5lj92_e45baf5d-f62f-40d2-b368-51925ce7d95c/bond-cni-plugin/0.log"
Sep 18 17:47:35.129623 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:35.129594    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5lj92_e45baf5d-f62f-40d2-b368-51925ce7d95c/routeoverride-cni/0.log"
Sep 18 17:47:35.153391 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:35.153360    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5lj92_e45baf5d-f62f-40d2-b368-51925ce7d95c/whereabouts-cni-bincopy/0.log"
Sep 18 17:47:35.178953 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:35.178930    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5lj92_e45baf5d-f62f-40d2-b368-51925ce7d95c/whereabouts-cni/0.log"
Sep 18 17:47:35.432951 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:35.432922    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mrfpx_b2091824-1069-4f53-8ed7-963ad1fb6076/kube-multus/0.log"
Sep 18 17:47:35.553552 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:35.553508    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xggf7_056bb4ff-01e7-45b4-b5d0-e15f0779692b/network-metrics-daemon/0.log"
Sep 18 17:47:35.573983 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:35.573956    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xggf7_056bb4ff-01e7-45b4-b5d0-e15f0779692b/kube-rbac-proxy/0.log"
Sep 18 17:47:36.628108 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:36.628066    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktklw_3c1064f0-18a0-4c28-8fb9-a320535dcbbf/ovn-controller/0.log"
Sep 18 17:47:36.648519 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:36.648486    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktklw_3c1064f0-18a0-4c28-8fb9-a320535dcbbf/ovn-acl-logging/1.log"
Sep 18 17:47:36.648781 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:36.648600    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktklw_3c1064f0-18a0-4c28-8fb9-a320535dcbbf/ovn-acl-logging/0.log"
Sep 18 17:47:36.671674 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:36.671650    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktklw_3c1064f0-18a0-4c28-8fb9-a320535dcbbf/kube-rbac-proxy-node/0.log"
Sep 18 17:47:36.696582 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:36.696556    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktklw_3c1064f0-18a0-4c28-8fb9-a320535dcbbf/kube-rbac-proxy-ovn-metrics/0.log"
Sep 18 17:47:36.719214 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:36.719183    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktklw_3c1064f0-18a0-4c28-8fb9-a320535dcbbf/northd/0.log"
Sep 18 17:47:36.740869 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:36.740838    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktklw_3c1064f0-18a0-4c28-8fb9-a320535dcbbf/nbdb/0.log"
Sep 18 17:47:36.767326 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:36.767299    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktklw_3c1064f0-18a0-4c28-8fb9-a320535dcbbf/sbdb/0.log"
Sep 18 17:47:36.835682 ip-10-0-132-41 kubenswrapper[2577]: I0918 17:47:36.835648    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktklw_3c1064f0-18a0-4c28-8fb9-a320535dcbbf/ovnkube-controller/0.log"