May 20 13:49:50.009201 ip-10-0-130-144 systemd[1]: Starting Kubernetes Kubelet...
May 20 13:49:50.633635 ip-10-0-130-144 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 20 13:49:50.633635 ip-10-0-130-144 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 20 13:49:50.633635 ip-10-0-130-144 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 20 13:49:50.633635 ip-10-0-130-144 kubenswrapper[2571]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 20 13:49:50.633635 ip-10-0-130-144 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 20 13:49:50.633635 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.449285    2571 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 20 13:49:50.633635 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453282    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 13:49:50.633635 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453292    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 13:49:50.633635 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453296    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 13:49:50.633635 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453300    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 13:49:50.633635 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453304    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 13:49:50.633635 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453307    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 13:49:50.633635 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453309    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 13:49:50.633635 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453312    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 13:49:50.551244 ip-10-0-130-144 systemd[1]: Started Kubernetes Kubelet.
May 20 13:49:50.643232 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453315    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 13:49:50.643232 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453318    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 13:49:50.643232 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453320    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 13:49:50.643232 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453323    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 13:49:50.643232 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453326    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 13:49:50.643232 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453329    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 13:49:50.643232 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453331    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 13:49:50.643232 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453339    2571 feature_gate.go:328] unrecognized feature gate: Example2
May 20 13:49:50.643232 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453341    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 13:49:50.643232 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453344    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 13:49:50.643232 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453347    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 13:49:50.643232 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453349    2571 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 13:49:50.643232 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453351    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 13:49:50.643232 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453355    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 13:49:50.643232 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453359    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 13:49:50.643232 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453361    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 13:49:50.643232 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453365    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 13:49:50.643232 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453367    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 13:49:50.643232 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453370    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 13:49:50.643232 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453372    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 13:49:50.643914 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453375    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 13:49:50.643914 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453377    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 13:49:50.643914 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453380    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 13:49:50.643914 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453383    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 13:49:50.643914 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453385    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 13:49:50.643914 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453387    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 13:49:50.643914 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453390    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 13:49:50.643914 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453392    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 13:49:50.643914 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453395    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 13:49:50.643914 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453399    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 13:49:50.643914 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453403    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 13:49:50.643914 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453406    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 13:49:50.643914 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453410    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 13:49:50.643914 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453413    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 13:49:50.643914 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453415    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 13:49:50.643914 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453419    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 13:49:50.643914 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453422    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 13:49:50.643914 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453425    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 13:49:50.644690 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453428    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 13:49:50.644690 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453431    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 13:49:50.644690 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453434    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 13:49:50.644690 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453436    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 13:49:50.644690 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453439    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 13:49:50.644690 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453442    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 13:49:50.644690 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453445    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 13:49:50.644690 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453448    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 13:49:50.644690 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453450    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 13:49:50.644690 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453453    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 13:49:50.644690 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453455    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 13:49:50.644690 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453458    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 13:49:50.644690 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453460    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 13:49:50.644690 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453464    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 13:49:50.644690 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453467    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 13:49:50.644690 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453469    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 13:49:50.644690 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453472    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 13:49:50.644690 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453474    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 13:49:50.644690 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453477    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 13:49:50.644690 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453479    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 13:49:50.645309 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453483    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 13:49:50.645309 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453486    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 13:49:50.645309 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453488    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 13:49:50.645309 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453491    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 13:49:50.645309 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453493    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 13:49:50.645309 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453496    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 13:49:50.645309 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453498    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 13:49:50.645309 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453501    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 13:49:50.645309 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453504    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 13:49:50.645309 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453506    2571 feature_gate.go:328] unrecognized feature gate: Example
May 20 13:49:50.645309 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453509    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 13:49:50.645309 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453511    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 13:49:50.645309 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453514    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 13:49:50.645309 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453516    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 13:49:50.645309 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453518    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 13:49:50.645309 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453521    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 13:49:50.645309 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453523    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 13:49:50.645309 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453525    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 13:49:50.645309 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453527    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 13:49:50.645309 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453530    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 13:49:50.645883 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453911    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 13:49:50.645883 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453917    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 13:49:50.645883 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453921    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 13:49:50.645883 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453924    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 13:49:50.645883 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453927    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 13:49:50.645883 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453943    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 13:49:50.645883 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453948    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 13:49:50.645883 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453951    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 13:49:50.645883 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453954    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 13:49:50.645883 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453958    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 13:49:50.645883 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453960    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 13:49:50.645883 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453963    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 13:49:50.645883 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453966    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 13:49:50.645883 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453969    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 13:49:50.645883 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453971    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 13:49:50.645883 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453974    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 13:49:50.645883 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453977    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 13:49:50.645883 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453980    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 13:49:50.645883 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453982    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 13:49:50.646599 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453985    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 13:49:50.646599 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453988    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 13:49:50.646599 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453991    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 13:49:50.646599 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453993    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 13:49:50.646599 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453996    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 13:49:50.646599 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.453999    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 13:49:50.646599 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454001    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 13:49:50.646599 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454004    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 13:49:50.646599 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454006    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 13:49:50.646599 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454009    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 13:49:50.646599 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454011    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 13:49:50.646599 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454014    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 13:49:50.646599 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454017    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 13:49:50.646599 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454019    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 13:49:50.646599 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454022    2571 feature_gate.go:328] unrecognized feature gate: Example
May 20 13:49:50.646599 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454024    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 13:49:50.646599 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454027    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 13:49:50.646599 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454030    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 13:49:50.646599 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454033    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 13:49:50.646599 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454035    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 13:49:50.647220 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454037    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 13:49:50.647220 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454041    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 13:49:50.647220 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454043    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 13:49:50.647220 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454046    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 13:49:50.647220 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454049    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 13:49:50.647220 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454051    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 13:49:50.647220 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454054    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 13:49:50.647220 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454056    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 13:49:50.647220 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454059    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 13:49:50.647220 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454062    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 13:49:50.647220 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454064    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 13:49:50.647220 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454067    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 13:49:50.647220 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454070    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 13:49:50.647220 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454073    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 13:49:50.647220 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454075    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 13:49:50.647220 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454078    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 13:49:50.647220 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454080    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 13:49:50.647220 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454083    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 13:49:50.647220 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454086    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 13:49:50.647220 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454088    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 13:49:50.648733 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454091    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 13:49:50.648733 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454093    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 13:49:50.648733 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454095    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 13:49:50.648733 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454098    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 13:49:50.648733 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454100    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 13:49:50.648733 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454103    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 13:49:50.648733 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454106    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 13:49:50.648733 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454109    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 13:49:50.648733 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454111    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 13:49:50.648733 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454114    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 13:49:50.648733 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454116    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 13:49:50.648733 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454119    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 13:49:50.648733 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454123    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 13:49:50.648733 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454126    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 13:49:50.648733 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454129    2571 feature_gate.go:328] unrecognized feature gate: Example2
May 20 13:49:50.648733 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454132    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 13:49:50.648733 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454134    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 13:49:50.648733 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454137    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 13:49:50.648733 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454139    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 13:49:50.648733 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454141    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 13:49:50.649552 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454144    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 13:49:50.649552 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454146    2571 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 13:49:50.649552 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454148    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 13:49:50.649552 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454151    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 13:49:50.649552 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454153    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 13:49:50.649552 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454156    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 13:49:50.649552 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.454159    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 13:49:50.649552 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454821    2571 flags.go:64] FLAG: --address="0.0.0.0"
May 20 13:49:50.649552 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454830    2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 20 13:49:50.649552 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454836    2571 flags.go:64] FLAG: --anonymous-auth="true"
May 20 13:49:50.649552 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454841    2571 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 20 13:49:50.649552 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454845    2571 flags.go:64] FLAG: --authentication-token-webhook="false"
May 20 13:49:50.649552 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454848    2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 20 13:49:50.649552 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454852    2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 20 13:49:50.649552 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454857    2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 20 13:49:50.649552 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454860    2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 20 13:49:50.649552 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454863    2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 20 13:49:50.649552 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454866    2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 20 13:49:50.649552 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454869    2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 20 13:49:50.649552 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454872    2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 20 13:49:50.649552 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454875    2571 flags.go:64] FLAG: --cgroup-root=""
May 20 13:49:50.649552 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454878    2571 flags.go:64] FLAG: --cgroups-per-qos="true"
May 20 13:49:50.649552 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454881    2571 flags.go:64] FLAG: --client-ca-file=""
May 20 13:49:50.650419 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454885    2571 flags.go:64] FLAG: --cloud-config=""
May 20 13:49:50.650419 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454887    2571 flags.go:64] FLAG: --cloud-provider="external"
May 20 13:49:50.650419 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454890    2571 flags.go:64] FLAG: --cluster-dns="[]"
May 20 13:49:50.650419 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454894    2571 flags.go:64] FLAG: --cluster-domain=""
May 20 13:49:50.650419 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454897    2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 20 13:49:50.650419 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454900    2571 flags.go:64] FLAG: --config-dir=""
May 20 13:49:50.650419 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454904    2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 20 13:49:50.650419 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454908    2571 flags.go:64] FLAG: --container-log-max-files="5"
May 20 13:49:50.650419 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454911    2571 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 20 13:49:50.650419 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454914    2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 20 13:49:50.650419 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454917    2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 20 13:49:50.650419 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454920    2571 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 20 13:49:50.650419 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454923    2571 flags.go:64] FLAG: --contention-profiling="false"
May 20 13:49:50.650419 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454926    2571 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 20 13:49:50.650419 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454940    2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 20 13:49:50.650419 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454943    2571 flags.go:64] FLAG: --cpu-manager-policy="none"
May 20 13:49:50.650419 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454947    2571 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 20 13:49:50.650419 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454951    2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 20 13:49:50.650419 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454954    2571 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 20 13:49:50.650419 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454958    2571 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 20 13:49:50.650419 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454960    2571 flags.go:64] FLAG: --enable-load-reader="false"
May 20 13:49:50.650419 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454963    2571 flags.go:64] FLAG: --enable-server="true"
May 20 13:49:50.650419 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454966    2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 20 13:49:50.650419 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454971    2571 flags.go:64] FLAG: --event-burst="100"
May 20 13:49:50.650419 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454974    2571 flags.go:64] FLAG: --event-qps="50"
May 20 13:49:50.651139 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454977    2571 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 20 13:49:50.651139 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454981    2571 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 20 13:49:50.651139 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454984    2571 flags.go:64] FLAG: --eviction-hard=""
May 20 13:49:50.651139 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454988    2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 20 13:49:50.651139 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454992    2571 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 20 13:49:50.651139 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454995    2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 20 13:49:50.651139 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.454998    2571 flags.go:64] FLAG: --eviction-soft=""
May 20 13:49:50.651139 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455000    2571 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 20 13:49:50.651139 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455003    2571 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 20 13:49:50.651139 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455006    2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 20 13:49:50.651139 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455009    2571 flags.go:64] FLAG: --experimental-mounter-path=""
May 20 13:49:50.651139 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455012    2571 flags.go:64] FLAG: --fail-cgroupv1="false"
May 20 13:49:50.651139 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455014    2571 flags.go:64] FLAG: --fail-swap-on="true"
May 20 13:49:50.651139 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455018    2571 flags.go:64] FLAG: --feature-gates=""
May 20 13:49:50.651139 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455022    2571 flags.go:64] FLAG: --file-check-frequency="20s"
May 20 13:49:50.651139 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455025    2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 20 13:49:50.651139 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455028    2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 20 13:49:50.651139 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455031    2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 20 13:49:50.651139 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455034    2571 flags.go:64] FLAG: --healthz-port="10248"
May 20 13:49:50.651139 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455037    2571 flags.go:64] FLAG: --help="false"
May 20 13:49:50.651139 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455040    2571 flags.go:64] FLAG: --hostname-override="ip-10-0-130-144.ec2.internal"
May 20 13:49:50.651139 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455043    2571 flags.go:64] FLAG: --housekeeping-interval="10s"
May 20 13:49:50.651139 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455045    2571 flags.go:64] FLAG: --http-check-frequency="20s"
May 20 13:49:50.651139 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455048    2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 20 13:49:50.651785 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455052    2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 20 13:49:50.651785 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455055    2571 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 20 13:49:50.651785 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455058    2571 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 20 13:49:50.651785 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455061    2571 flags.go:64] FLAG: --image-service-endpoint=""
May 20 13:49:50.651785 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455063    2571 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 20 13:49:50.651785 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455066    2571 flags.go:64] FLAG: --kube-api-burst="100"
May 20 13:49:50.651785 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455069    2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 20 13:49:50.651785 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455072    2571 flags.go:64] FLAG: --kube-api-qps="50"
May 20 13:49:50.651785 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455075    2571 flags.go:64] FLAG: --kube-reserved=""
May 20 13:49:50.651785 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455078    2571 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 20 13:49:50.651785 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455080    2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 20 13:49:50.651785 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455083    2571 flags.go:64] FLAG: --kubelet-cgroups=""
May 20 13:49:50.651785 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455087    2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 20 13:49:50.651785 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455090    2571 flags.go:64] FLAG: --lock-file=""
May 20 13:49:50.651785 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455093    2571 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 20 13:49:50.651785 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455095    2571 flags.go:64] FLAG: --log-flush-frequency="5s"
May 20 13:49:50.651785 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455098    2571 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 20 13:49:50.651785 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455104    2571 flags.go:64] FLAG: --log-json-split-stream="false"
May 20 13:49:50.651785 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455106    2571 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 20 13:49:50.651785 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455109    2571 flags.go:64] FLAG: --log-text-split-stream="false"
May 20 13:49:50.651785 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455111    2571 flags.go:64] FLAG: --logging-format="text"
May 20 13:49:50.651785 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455115    2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 20 13:49:50.651785 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455119    2571 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 20 13:49:50.651785 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455122    2571 flags.go:64] FLAG: --manifest-url=""
May 20 13:49:50.652490 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455124    2571 flags.go:64] FLAG: --manifest-url-header=""
May 20 13:49:50.652490 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455128    2571 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 20 13:49:50.652490 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455131    2571 flags.go:64] FLAG: --max-open-files="1000000"
May 20 13:49:50.652490 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455136    2571 flags.go:64] FLAG: --max-pods="110"
May 20 13:49:50.652490 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455138    2571 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 20 13:49:50.652490 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455141    2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 20 13:49:50.652490 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455144    2571 flags.go:64] FLAG: --memory-manager-policy="None"
May 20 13:49:50.652490 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455147    2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 20 13:49:50.652490 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455150    2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 20 13:49:50.652490 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455154    2571 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 20 13:49:50.652490 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455157    2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 20 13:49:50.652490 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455163    2571 flags.go:64] FLAG: --node-status-max-images="50"
May 20 13:49:50.652490 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455167    2571 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 20 13:49:50.652490 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455169    2571 flags.go:64] FLAG: --oom-score-adj="-999"
May 20 13:49:50.652490 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455172    2571 flags.go:64] FLAG: --pod-cidr=""
May 20 13:49:50.652490 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455175    2571 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 20 13:49:50.652490 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455180    2571 flags.go:64] FLAG: --pod-manifest-path=""
May 20 13:49:50.652490 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455183    2571 flags.go:64] FLAG: --pod-max-pids="-1"
May 20 13:49:50.652490 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455186    2571 flags.go:64] FLAG: --pods-per-core="0"
May 20 13:49:50.652490 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455189    2571 flags.go:64] FLAG: --port="10250"
May 20 13:49:50.652490 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455193    2571 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 20 13:49:50.652490 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455195    2571 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0794c32c381ada330"
May 20 13:49:50.652490 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455198    2571 flags.go:64] FLAG: --qos-reserved=""
May 20 13:49:50.652490 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455201    2571 flags.go:64] FLAG: --read-only-port="10255"
May 20 13:49:50.653130 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455204    2571 flags.go:64] FLAG: --register-node="true"
May 20 13:49:50.653130 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455207    2571 flags.go:64] FLAG: --register-schedulable="true"
May 20 13:49:50.653130 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455210    2571 flags.go:64] FLAG: --register-with-taints=""
May 20 13:49:50.653130 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455214    2571 flags.go:64] FLAG: --registry-burst="10"
May 20 13:49:50.653130 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455217    2571 flags.go:64] FLAG: --registry-qps="5"
May 20 13:49:50.653130 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455220    2571 flags.go:64] FLAG: --reserved-cpus=""
May 20 13:49:50.653130 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455224    2571 flags.go:64] FLAG: --reserved-memory=""
May 20 13:49:50.653130 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455228    2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 20 13:49:50.653130 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455231    2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 20 13:49:50.653130 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455233    2571 flags.go:64] FLAG: --rotate-certificates="false"
May 20 13:49:50.653130 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455236    2571 flags.go:64] FLAG: --rotate-server-certificates="false"
May 20 13:49:50.653130 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455239    2571 flags.go:64] FLAG: --runonce="false"
May 20 13:49:50.653130 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455242    2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 20 13:49:50.653130 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455245    2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 20 13:49:50.653130 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455248    2571 flags.go:64] FLAG: --seccomp-default="false"
May 20 13:49:50.653130 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455251    2571 flags.go:64] FLAG: --serialize-image-pulls="true"
May 20 13:49:50.653130 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455253    2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 20 13:49:50.653130 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455257    2571 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 20 13:49:50.653130 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455260    2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 20 13:49:50.653130 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455263    2571 flags.go:64] FLAG: --storage-driver-password="root"
May 20 13:49:50.653130 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455266    2571 flags.go:64] FLAG: --storage-driver-secure="false"
May 20 13:49:50.653130 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455269    2571 flags.go:64] FLAG: --storage-driver-table="stats"
May 20 13:49:50.653130 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455272    2571 flags.go:64] FLAG: --storage-driver-user="root"
May 20 13:49:50.653130 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455274    2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 20 13:49:50.653130 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455277    2571 flags.go:64] FLAG: --sync-frequency="1m0s"
May 20 13:49:50.653130 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455280    2571 flags.go:64] FLAG: --system-cgroups=""
May 20 13:49:50.653794 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455283    2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 20 13:49:50.653794 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455288    2571 flags.go:64] FLAG: --system-reserved-cgroup=""
May 20 13:49:50.653794 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455293    2571 flags.go:64] FLAG: --tls-cert-file=""
May 20 13:49:50.653794 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455295    2571 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 20 13:49:50.653794 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455299    2571 flags.go:64] FLAG: --tls-min-version=""
May 20 13:49:50.653794 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455302    2571 flags.go:64] FLAG: --tls-private-key-file=""
May 20 13:49:50.653794 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455304    2571 flags.go:64] FLAG: --topology-manager-policy="none"
May 20 13:49:50.653794 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455307    2571 flags.go:64] FLAG: --topology-manager-policy-options=""
May 20 13:49:50.653794 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455310    2571 flags.go:64] FLAG: --topology-manager-scope="container"
May 20 13:49:50.653794 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455312    2571 flags.go:64] FLAG: --v="2"
May 20 13:49:50.653794 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455317    2571 flags.go:64] FLAG: --version="false"
May 20 13:49:50.653794 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455320    2571 flags.go:64] FLAG: --vmodule=""
May 20 13:49:50.653794 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455327    2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 20 13:49:50.653794 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.455330    2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 20 13:49:50.653794 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.455448    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 13:49:50.653794 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.455453    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 13:49:50.653794 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.455456    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 13:49:50.653794 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.455458    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 13:49:50.653794 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.455462    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 13:49:50.653794 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.455465    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 13:49:50.653794 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.455467    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 13:49:50.653794 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.455470    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 13:49:50.653794 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.455472    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 13:49:50.654397 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.455475    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 13:49:50.654397 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.455477    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 13:49:50.654397 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.455480    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 13:49:50.654397 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.455483    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 13:49:50.654397 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.455485    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 13:49:50.654397 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.455489    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 13:49:50.654397 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.455492    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 13:49:50.654397 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.455495    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 13:49:50.654397 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.455498    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 13:49:50.654397 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.455500    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 13:49:50.654397 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.455503    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 13:49:50.654397 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.455507    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 13:49:50.654397 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.455510    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 13:49:50.654397 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.455512    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 13:49:50.654397 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.455659    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 13:49:50.654397 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.455662    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 13:49:50.654397 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.455664    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 13:49:50.654397 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.455667    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 13:49:50.654397 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.455669    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 13:49:50.654965 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.455672    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 13:49:50.654965 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.455858    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 13:49:50.654965 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.455863    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 13:49:50.654965 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.455865    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 13:49:50.654965 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.455868    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 13:49:50.654965 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.455871    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 13:49:50.654965 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.456260    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 13:49:50.654965 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.456264    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 13:49:50.654965 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.456266    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 13:49:50.654965 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.456269    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 13:49:50.654965 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.456272    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 13:49:50.654965 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.456459    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 13:49:50.654965 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.456462    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 13:49:50.654965 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.456465    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 13:49:50.654965 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.456467    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 13:49:50.654965 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.456470    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 13:49:50.654965 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.456658    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 13:49:50.654965 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.456662    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 13:49:50.654965 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.456664    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 13:49:50.655501 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.456666    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 13:49:50.655501 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.456669    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 13:49:50.655501 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.456671    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 13:49:50.655501 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.456674    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 13:49:50.655501 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.456676    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 13:49:50.655501 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.456866    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 13:49:50.655501 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.456869    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 13:49:50.655501 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.456871    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 13:49:50.655501 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.456874    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 13:49:50.655501 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.456876    2571 feature_gate.go:328] unrecognized feature gate: Example
May 20 13:49:50.655501 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.456879    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 13:49:50.655501 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.456881    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 13:49:50.655501 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.457078    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 13:49:50.655501 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.457081    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 13:49:50.655501 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.457083    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 13:49:50.655501 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.457272    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 13:49:50.655501 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.457275    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 13:49:50.655501 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.457277    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 13:49:50.655501 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.457280    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 13:49:50.655501 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.457282    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 13:49:50.656117 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.457469    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 13:49:50.656117 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.457472    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 13:49:50.656117 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.457474    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 13:49:50.656117 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.457477    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 13:49:50.656117 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.457479    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 13:49:50.656117 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.457482    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 13:49:50.656117 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.457485    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 13:49:50.656117 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.457487    2571 feature_gate.go:328] unrecognized feature gate: Example2
May 20 13:49:50.656117 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.457490    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 13:49:50.656117 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.457492    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 13:49:50.656117 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.457495    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 13:49:50.656117 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.457498    2571 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 13:49:50.656117 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.457500    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 13:49:50.656117 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.457503    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 13:49:50.656117 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.457505    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 13:49:50.656117 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.457508    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 13:49:50.656117 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.457510    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 13:49:50.656117 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.457515    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 13:49:50.656117 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.457517    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 13:49:50.656614 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.457526    2571 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 20 13:49:50.656614 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.464925    2571 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 20 13:49:50.656614 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.464959    2571 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 20 13:49:50.656614 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465005    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 13:49:50.656614 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465010    2571 feature_gate.go:328] unrecognized feature gate: Example2
May 20 13:49:50.656614 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465013    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 13:49:50.656614 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465016    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 13:49:50.656614 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465019    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 13:49:50.656614 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465022    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 13:49:50.656614 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465024    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 13:49:50.656614 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465027    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 13:49:50.656614 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465030    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 13:49:50.656614 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465032    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 13:49:50.656614 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465035    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 13:49:50.656614 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465037    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 13:49:50.656614 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465040    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 13:49:50.657097 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465042    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 13:49:50.657097 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465045    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 13:49:50.657097 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465047    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 13:49:50.657097 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465050    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 13:49:50.657097 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465052    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 13:49:50.657097 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465055    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 13:49:50.657097 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465057    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 13:49:50.657097 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465060    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 13:49:50.657097 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465062    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 13:49:50.657097 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465065    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 13:49:50.657097 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465067    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 13:49:50.657097 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465070    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 13:49:50.657097 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465073    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 13:49:50.657097 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465075    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 13:49:50.657097 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465078    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 13:49:50.657097 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465081    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 13:49:50.657097 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465084    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 13:49:50.657097 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465086    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 13:49:50.657097 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465089    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 13:49:50.942369 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465092    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 13:49:50.942369 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465094    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 13:49:50.942369 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465097    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 13:49:50.942369 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465099    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 13:49:50.942369 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465102    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 13:49:50.942369 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465104    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 13:49:50.942369 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465107    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 13:49:50.942369 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465110    2571 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 13:49:50.942369 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465112    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 13:49:50.942369 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465115    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 13:49:50.942369 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465117    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 13:49:50.942369 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465120    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 13:49:50.942369 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465123    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 13:49:50.942369 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465127    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 13:49:50.942369 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465130    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 13:49:50.942369 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465133    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 13:49:50.942369 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465136    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 13:49:50.942369 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465138    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 13:49:50.942369 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465141    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 13:49:50.942993 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465144    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 13:49:50.942993 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465146    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 13:49:50.942993 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465149    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 13:49:50.942993 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465152    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 13:49:50.942993 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465154    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 13:49:50.942993 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465157    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 13:49:50.942993 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465159    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 13:49:50.942993 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465162    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 13:49:50.942993 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465164    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 13:49:50.942993 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465170    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 13:49:50.942993 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465173    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 13:49:50.942993 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465176    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 13:49:50.942993 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465178    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 13:49:50.942993 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465181    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 13:49:50.942993 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465183    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 13:49:50.942993 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465186    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 13:49:50.942993 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465188    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 13:49:50.942993 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465191    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 13:49:50.942993 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465193    2571 feature_gate.go:328] unrecognized feature gate: Example
May 20 13:49:50.942993 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465196    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 13:49:50.943677 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465199    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 13:49:50.943677 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465201    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 13:49:50.943677 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465204    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 13:49:50.943677 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465207    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 13:49:50.943677 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465209    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 13:49:50.943677 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465212    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 13:49:50.943677 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465217    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 13:49:50.943677 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465221    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 13:49:50.943677 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465224    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 13:49:50.943677 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465226    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 13:49:50.943677 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465229    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 13:49:50.943677 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465232    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 13:49:50.943677 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465234    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 13:49:50.943677 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465237    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 13:49:50.943677 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465239    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 13:49:50.944121 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.465244    2571 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 20 13:49:50.944121 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465336    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 13:49:50.944121 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465341    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 13:49:50.944121 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465343    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 13:49:50.944121 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465346    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 13:49:50.944121 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465349    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 13:49:50.944121 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465351    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 13:49:50.944121 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465357    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 13:49:50.944121 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465360    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 13:49:50.944121 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465363    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 13:49:50.944121 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465367    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 13:49:50.944121 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465370    2571 feature_gate.go:328] unrecognized feature gate: Example2
May 20 13:49:50.944121 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465374    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 13:49:50.944121 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465376    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 13:49:50.944121 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465379    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 13:49:50.944558 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465382    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 13:49:50.944558 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465385    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 13:49:50.944558 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465388    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 13:49:50.944558 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465391    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 13:49:50.944558 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465393    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 13:49:50.944558 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465396    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 13:49:50.944558 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465399    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 13:49:50.944558 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465401    2571 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 13:49:50.944558 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465404    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 13:49:50.944558 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465407    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 13:49:50.944558 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465409    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 13:49:50.944558 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465412    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 13:49:50.944558 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465414    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 13:49:50.944558 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465417    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 13:49:50.944558 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465420    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 13:49:50.944558 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465422    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 13:49:50.944558 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465424    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 13:49:50.944558 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465427    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 13:49:50.944558 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465429    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 13:49:50.944558 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465432    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 13:49:50.945106 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465434    2571 feature_gate.go:328] unrecognized feature gate: Example
May 20 13:49:50.945106 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465437    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 13:49:50.945106 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465439    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 13:49:50.945106 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465442    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 13:49:50.945106 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465449    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 13:49:50.945106 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465452    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 13:49:50.945106 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465454    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 13:49:50.945106 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465457    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 13:49:50.945106 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465459    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 13:49:50.945106 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465462    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 13:49:50.945106 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465465    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 13:49:50.945106 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465467    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 13:49:50.945106 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465469    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 13:49:50.945106 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465472    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 13:49:50.945106 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465474    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 13:49:50.945106 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465477    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 13:49:50.945106 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465479    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 13:49:50.945106 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465482    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 13:49:50.945106 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465484    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 13:49:50.945629 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465486    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 13:49:50.945629 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465489    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 13:49:50.945629 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465492    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 13:49:50.945629 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465495    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 13:49:50.945629 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465497    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 13:49:50.945629 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465499    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 13:49:50.945629 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465502    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 13:49:50.945629 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465504    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 13:49:50.945629 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465507    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 13:49:50.945629 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465511    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 13:49:50.945629 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465513    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 13:49:50.945629 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465516    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 13:49:50.945629 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465518    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 13:49:50.945629 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465520    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 13:49:50.945629 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465523    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 13:49:50.945629 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465525    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 13:49:50.945629 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465528    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 13:49:50.945629 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465532    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 13:49:50.945629 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465535    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 13:49:50.945629 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465538    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 13:49:50.946276 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465540    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 13:49:50.946276 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465543    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 13:49:50.946276 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465545    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 13:49:50.946276 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465548    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 13:49:50.946276 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465550    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 13:49:50.946276 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465553    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 13:49:50.946276 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465556    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 13:49:50.946276 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465558    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 13:49:50.946276 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465560    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 13:49:50.946276 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465563    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 13:49:50.946276 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465565    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 13:49:50.946276 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465568    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 13:49:50.946276 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:50.465570    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 13:49:50.946276 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.465575    2571 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 20 13:49:50.946276 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.466373    2571 server.go:962] "Client rotation is on, will bootstrap in background"
May 20 13:49:50.946705 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.468269    2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 20 13:49:50.946705 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.469137    2571 server.go:1019] "Starting client certificate rotation"
May 20 13:49:50.946705 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.469241    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 20 13:49:50.946705 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.469270    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 20 13:49:50.946705 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.493252    2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 20 13:49:50.946705 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.496356    2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 20 13:49:50.946705 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.511138    2571 log.go:25] "Validated CRI v1 runtime API"
May 20 13:49:50.946705 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.520075    2571 log.go:25] "Validated CRI v1 image API"
May 20 13:49:50.946705 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.520672    2571 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 20 13:49:50.946705 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.521268    2571 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 20 13:49:50.946705 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.525839    2571 fs.go:135] Filesystem UUIDs: map[6cceb3b3-5e2a-44c9-ad7d-f02155b3fe65:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d4454f30-a311-421d-b13d-edb1101a7946:/dev/nvme0n1p3]
May 20 13:49:50.946705 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.525855    2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 20 13:49:50.947124 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.530098    2571 manager.go:217] Machine: {Timestamp:2026-05-20 13:49:50.529621879 +0000 UTC m=+0.402409026 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3197929 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21a8ccad5c65b6e9e804d3fc126c27 SystemUUID:ec21a8cc-ad5c-65b6-e9e8-04d3fc126c27 BootID:e41cd246-8163-4c0a-b43f-dec056424f4a Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b8:3e:db:4f:11 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b8:3e:db:4f:11 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:d5:d4:51:21:34 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 20 13:49:50.947124 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.530198    2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 20 13:49:50.947124 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.530264    2571 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 20 13:49:50.947124 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.531305    2571 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 20 13:49:50.947124 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.531328    2571 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-144.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 20 13:49:50.947124 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.531464    2571 topology_manager.go:138] "Creating topology manager with none policy"
May 20 13:49:50.947124 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.531472    2571 container_manager_linux.go:306] "Creating device plugin manager"
May 20 13:49:50.947124 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.531478    2571 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 20 13:49:50.947124 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.532359    2571 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 20 13:49:50.947124 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.534531    2571 state_mem.go:36] "Initialized new in-memory state store"
May 20 13:49:50.947124 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.534636    2571 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 20 13:49:50.947124 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.538033    2571 kubelet.go:491] "Attempting to sync node with API server"
May 20 13:49:50.947124 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.538047    2571 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 20 13:49:50.947124 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.538060    2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 20 13:49:50.947124 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.538069    2571 kubelet.go:397] "Adding apiserver pod source"
May 20 13:49:50.947124 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.538076    2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 20 13:49:50.947124 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.539318    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 20 13:49:50.947124 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.539334    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.540002    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p2rct"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.543030    2571 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.545209    2571 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.545656    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p2rct"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.546121    2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.546135    2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.546140    2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.546146    2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.546154    2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.546160    2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.546166    2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.546172    2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.546178    2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.546184    2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.546200    2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.546485    2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.547468    2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.547482    2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.550528    2571 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.550562    2571 server.go:1295] "Started kubelet"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.551220    2571 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.551209    2571 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.551305    2571 server_v1.go:47] "podresources" method="list" useActivePods=true
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.552045    2571 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.552556    2571 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.554075    2571 server.go:317] "Adding debug handlers to kubelet server"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.557236    2571 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-130-144.ec2.internal" not found
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.558109    2571 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.563054    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.563213    2571 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.563403    2571 volume_manager.go:295] "The desired_state_of_world populator starts"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.563423    2571 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.563495    2571 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.563534    2571 reconstruct.go:97] "Volume reconstruction finished"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.563542    2571 reconciler.go:26] "Reconciler: start to sync state"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.564117    2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:50.564372    2571 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-144.ec2.internal\" not found"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:50.564824    2571 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.565153    2571 factory.go:55] Registering systemd factory
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.565175    2571 factory.go:223] Registration of the systemd container factory successfully
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.565408    2571 factory.go:153] Registering CRI-O factory
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.565422    2571 factory.go:223] Registration of the crio container factory successfully
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.565438    2571 factory.go:103] Registering Raw factory
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.565451    2571 manager.go:1196] Started watching for new ooms in manager
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.566540    2571 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.566547    2571 manager.go:319] Starting recovery of all containers
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:50.569119    2571 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-144.ec2.internal\" not found" node="ip-10-0-130-144.ec2.internal"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.572707    2571 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-130-144.ec2.internal" not found
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.576264    2571 manager.go:324] Recovery completed
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.580809    2571 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.582636    2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-144.ec2.internal" event="NodeHasSufficientMemory"
May 20 13:49:50.947697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.582735    2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-144.ec2.internal" event="NodeHasNoDiskPressure"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.582745    2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-144.ec2.internal" event="NodeHasSufficientPID"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.583161    2571 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.583172    2571 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.583190    2571 state_mem.go:36] "Initialized new in-memory state store"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.586297    2571 policy_none.go:49] "None policy: Start"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.586308    2571 memory_manager.go:186] "Starting memorymanager" policy="None"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.586318    2571 state_mem.go:35] "Initializing new in-memory state store"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.629191    2571 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-130-144.ec2.internal" not found
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.631451    2571 manager.go:341] "Starting Device Plugin manager"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:50.631474    2571 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.631483    2571 server.go:85] "Starting device plugin registration server"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.631668    2571 eviction_manager.go:189] "Eviction manager: starting control loop"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.631679    2571 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.632025    2571 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.632087    2571 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.632096    2571 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:50.632430    2571 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:50.632462    2571 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-144.ec2.internal\" not found"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.659999    2571 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.661078    2571 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.661101    2571 status_manager.go:230] "Starting to sync pod status with apiserver"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.661116    2571 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.661136    2571 kubelet.go:2451] "Starting kubelet main sync loop"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:50.661177    2571 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.667087    2571 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.732172    2571 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.732903    2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-144.ec2.internal" event="NodeHasSufficientMemory"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.732944    2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-144.ec2.internal" event="NodeHasNoDiskPressure"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.732959    2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-144.ec2.internal" event="NodeHasSufficientPID"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.732989    2571 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-144.ec2.internal"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.741306    2571 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-144.ec2.internal"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.762444    2571 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-144.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-144.ec2.internal"]
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.763704    2571 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-144.ec2.internal"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.764671    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3b58d901cc6734ae2a8b3c707deb5d52-config\") pod \"kube-apiserver-proxy-ip-10-0-130-144.ec2.internal\" (UID: \"3b58d901cc6734ae2a8b3c707deb5d52\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-144.ec2.internal"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.764836    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-144.ec2.internal"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.764837    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-144.ec2.internal"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.774006    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.798337    2571 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-144.ec2.internal"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.804266    2571 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-144.ec2.internal"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.808567    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:50.808597    2571 kubelet.go:3342] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-130-144.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-144.ec2.internal"
May 20 13:49:50.949013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.833975    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 20 13:49:50.950121 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.864779    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3b58d901cc6734ae2a8b3c707deb5d52-config\") pod \"kube-apiserver-proxy-ip-10-0-130-144.ec2.internal\" (UID: \"3b58d901cc6734ae2a8b3c707deb5d52\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-144.ec2.internal"
May 20 13:49:50.950121 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.864801    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0e619104d9ea30333bb983da7ab1a496-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-144.ec2.internal\" (UID: \"0e619104d9ea30333bb983da7ab1a496\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-144.ec2.internal"
May 20 13:49:50.950121 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.864821    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e619104d9ea30333bb983da7ab1a496-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-144.ec2.internal\" (UID: \"0e619104d9ea30333bb983da7ab1a496\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-144.ec2.internal"
May 20 13:49:50.950121 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.864877    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3b58d901cc6734ae2a8b3c707deb5d52-config\") pod \"kube-apiserver-proxy-ip-10-0-130-144.ec2.internal\" (UID: \"3b58d901cc6734ae2a8b3c707deb5d52\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-144.ec2.internal"
May 20 13:49:51.224391 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.965377    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e619104d9ea30333bb983da7ab1a496-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-144.ec2.internal\" (UID: \"0e619104d9ea30333bb983da7ab1a496\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-144.ec2.internal"
May 20 13:49:51.224391 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.965402    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0e619104d9ea30333bb983da7ab1a496-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-144.ec2.internal\" (UID: \"0e619104d9ea30333bb983da7ab1a496\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-144.ec2.internal"
May 20 13:49:51.224391 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.965430    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0e619104d9ea30333bb983da7ab1a496-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-144.ec2.internal\" (UID: \"0e619104d9ea30333bb983da7ab1a496\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-144.ec2.internal"
May 20 13:49:51.224391 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:50.965471    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e619104d9ea30333bb983da7ab1a496-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-144.ec2.internal\" (UID: \"0e619104d9ea30333bb983da7ab1a496\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-144.ec2.internal"
May 20 13:49:51.224391 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.111499    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-144.ec2.internal"
May 20 13:49:51.224391 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.136995    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-144.ec2.internal"
May 20 13:49:51.514630 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.469434    2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 20 13:49:51.514630 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.469544    2571 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 20 13:49:51.514630 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.469573    2571 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 20 13:49:51.514630 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.469612    2571 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 20 13:49:51.768945 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.538655    2571 apiserver.go:52] "Watching apiserver"
May 20 13:49:51.768945 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.547289    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-19 13:44:50 +0000 UTC" deadline="2027-12-09 09:06:35.46641691 +0000 UTC"
May 20 13:49:51.768945 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.547318    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13627h16m43.919101379s"
May 20 13:49:51.768945 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.549049    2571 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 20 13:49:51.768945 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.549366    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-zhqmq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmwjr","openshift-cluster-node-tuning-operator/tuned-md4j7","openshift-network-diagnostics/network-check-target-lbcdw","openshift-network-operator/iptables-alerter-vgw8s","openshift-ovn-kubernetes/ovnkube-node-crztq","kube-system/konnectivity-agent-gmcz8","kube-system/kube-apiserver-proxy-ip-10-0-130-144.ec2.internal","openshift-dns/node-resolver-jczc6","openshift-image-registry/node-ca-g8gjr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-144.ec2.internal","openshift-multus/multus-additional-cni-plugins-p86kx","openshift-multus/multus-l5gz6"]
May 20 13:49:51.768945 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.550756    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhqmq"
May 20 13:49:51.768945 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:51.550814    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhqmq" podUID="96bd478e-69c0-43e6-8df1-d6f775d6c864"
May 20 13:49:51.768945 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.552028    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmwjr"
May 20 13:49:51.768945 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.553083    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:51.768945 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.554008    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sg95f\""
May 20 13:49:51.768945 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.554195    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 20 13:49:51.768945 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.554242    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 20 13:49:51.768945 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.554248    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 20 13:49:51.768945 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.554550    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcdw"
May 20 13:49:51.768945 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:51.554613    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbcdw" podUID="9428938d-ef32-4fe7-9138-aca8852fdefe"
May 20 13:49:51.768945 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.555716    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vgw8s"
May 20 13:49:51.768945 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.555853    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 20 13:49:51.768945 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.555869    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 20 13:49:51.768945 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.555853    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bfqjm\""
May 20 13:49:51.768945 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.556815    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.768945 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.557911    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gmcz8"
May 20 13:49:51.768945 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.558922    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jczc6"
May 20 13:49:51.768945 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.560115    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g8gjr"
May 20 13:49:51.768945 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.560177    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 20 13:49:51.768945 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.560661    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-98fpp\""
May 20 13:49:51.768945 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.563020    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 20 13:49:51.768945 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.563139    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 20 13:49:51.768945 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.563429    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 20 13:49:51.768945 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.563500    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 20 13:49:51.768945 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.563622    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p86kx"
May 20 13:49:51.768945 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.564531    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 20 13:49:51.770702 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.564763    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 20 13:49:51.770702 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.565477    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7qzbk\""
May 20 13:49:51.770702 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.565726    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 20 13:49:51.770702 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.565965    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 20 13:49:51.770702 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.566004    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 20 13:49:51.770702 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.566233    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 20 13:49:51.770702 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.566592    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.770702 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.566726    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 20 13:49:51.770702 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.566947    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 20 13:49:51.770702 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.567532    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qjs29\""
May 20 13:49:51.770702 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.567624    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 20 13:49:51.770702 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.567669    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 20 13:49:51.770702 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.567686    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 20 13:49:51.770702 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.567740    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 20 13:49:51.770702 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.567944    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-grmr7\""
May 20 13:49:51.770702 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.567985    2571 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 20 13:49:51.770702 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.568132    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 20 13:49:51.770702 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.568243    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8w7l9\""
May 20 13:49:51.770702 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.568467    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 20 13:49:51.770702 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.568552    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 20 13:49:51.770702 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.568559    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 20 13:49:51.770702 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.568665    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fpxpd\""
May 20 13:49:51.770702 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.569031    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 20 13:49:51.770702 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.569652    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44dl2\" (UniqueName: \"kubernetes.io/projected/7685d6b2-b593-4ea9-a2b8-a427f2f0d129-kube-api-access-44dl2\") pod \"iptables-alerter-vgw8s\" (UID: \"7685d6b2-b593-4ea9-a2b8-a427f2f0d129\") " pod="openshift-network-operator/iptables-alerter-vgw8s"
May 20 13:49:51.770702 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.569671    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-env-overrides\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.770702 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.569686    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-multus-cni-dir\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.770702 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.569726    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-cni-binary-copy\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.770702 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.569769    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrww9\" (UniqueName: \"kubernetes.io/projected/7fb2aae9-8e70-4380-b813-b15da35d6bb4-kube-api-access-mrww9\") pod \"multus-additional-cni-plugins-p86kx\" (UID: \"7fb2aae9-8e70-4380-b813-b15da35d6bb4\") " pod="openshift-multus/multus-additional-cni-plugins-p86kx"
May 20 13:49:51.770702 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.569825    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a9148b87-b372-4314-a484-2aad1d67c649-agent-certs\") pod \"konnectivity-agent-gmcz8\" (UID: \"a9148b87-b372-4314-a484-2aad1d67c649\") " pod="kube-system/konnectivity-agent-gmcz8"
May 20 13:49:51.770702 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.569853    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-os-release\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.771633 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.569901    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-host-run-multus-certs\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.771633 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.569925    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-node-log\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.771633 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.569979    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-host-run-ovn-kubernetes\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.771633 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.569998    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qlpw\" (UniqueName: \"kubernetes.io/projected/e8bd843f-d4d6-4179-a9b7-48c5fcce16f2-kube-api-access-4qlpw\") pod \"node-resolver-jczc6\" (UID: \"e8bd843f-d4d6-4179-a9b7-48c5fcce16f2\") " pod="openshift-dns/node-resolver-jczc6"
May 20 13:49:51.771633 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570019    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/69bab5d8-9702-4c77-b23e-f9a7310d983c-etc-selinux\") pod \"aws-ebs-csi-driver-node-zmwjr\" (UID: \"69bab5d8-9702-4c77-b23e-f9a7310d983c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmwjr"
May 20 13:49:51.771633 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570040    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-host-var-lib-cni-bin\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.771633 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570058    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-hostroot\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.771633 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570072    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/69bab5d8-9702-4c77-b23e-f9a7310d983c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zmwjr\" (UID: \"69bab5d8-9702-4c77-b23e-f9a7310d983c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmwjr"
May 20 13:49:51.771633 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570112    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7685d6b2-b593-4ea9-a2b8-a427f2f0d129-iptables-alerter-script\") pod \"iptables-alerter-vgw8s\" (UID: \"7685d6b2-b593-4ea9-a2b8-a427f2f0d129\") " pod="openshift-network-operator/iptables-alerter-vgw8s"
May 20 13:49:51.771633 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570132    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-host-cni-netd\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.771633 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570151    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46s7l\" (UniqueName: \"kubernetes.io/projected/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-kube-api-access-46s7l\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.771633 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570166    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7fb2aae9-8e70-4380-b813-b15da35d6bb4-cnibin\") pod \"multus-additional-cni-plugins-p86kx\" (UID: \"7fb2aae9-8e70-4380-b813-b15da35d6bb4\") " pod="openshift-multus/multus-additional-cni-plugins-p86kx"
May 20 13:49:51.771633 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570180    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-host-run-netns\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.771633 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570201    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-host-var-lib-cni-multus\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.771633 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570219    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhwpr\" (UniqueName: \"kubernetes.io/projected/a65737a0-1eac-4f7e-bc96-c5b3281da578-kube-api-access-dhwpr\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:51.771633 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570233    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7fb2aae9-8e70-4380-b813-b15da35d6bb4-system-cni-dir\") pod \"multus-additional-cni-plugins-p86kx\" (UID: \"7fb2aae9-8e70-4380-b813-b15da35d6bb4\") " pod="openshift-multus/multus-additional-cni-plugins-p86kx"
May 20 13:49:51.772195 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570251    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7fb2aae9-8e70-4380-b813-b15da35d6bb4-os-release\") pod \"multus-additional-cni-plugins-p86kx\" (UID: \"7fb2aae9-8e70-4380-b813-b15da35d6bb4\") " pod="openshift-multus/multus-additional-cni-plugins-p86kx"
May 20 13:49:51.772195 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570272    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/69bab5d8-9702-4c77-b23e-f9a7310d983c-socket-dir\") pod \"aws-ebs-csi-driver-node-zmwjr\" (UID: \"69bab5d8-9702-4c77-b23e-f9a7310d983c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmwjr"
May 20 13:49:51.772195 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570292    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/69bab5d8-9702-4c77-b23e-f9a7310d983c-registration-dir\") pod \"aws-ebs-csi-driver-node-zmwjr\" (UID: \"69bab5d8-9702-4c77-b23e-f9a7310d983c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmwjr"
May 20 13:49:51.772195 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570325    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/80b8fd3b-57c3-42a7-8028-8d04d797d224-serviceca\") pod \"node-ca-g8gjr\" (UID: \"80b8fd3b-57c3-42a7-8028-8d04d797d224\") " pod="openshift-image-registry/node-ca-g8gjr"
May 20 13:49:51.772195 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570345    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96bd478e-69c0-43e6-8df1-d6f775d6c864-metrics-certs\") pod \"network-metrics-daemon-zhqmq\" (UID: \"96bd478e-69c0-43e6-8df1-d6f775d6c864\") " pod="openshift-multus/network-metrics-daemon-zhqmq"
May 20 13:49:51.772195 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570366    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-log-socket\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.772195 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570402    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-host-var-lib-kubelet\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.772195 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570417    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-etc-kubernetes\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.772195 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570437    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a65737a0-1eac-4f7e-bc96-c5b3281da578-etc-sysconfig\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:51.772195 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570487    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a65737a0-1eac-4f7e-bc96-c5b3281da578-etc-sysctl-conf\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:51.772195 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570508    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a65737a0-1eac-4f7e-bc96-c5b3281da578-sys\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:51.772195 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570544    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-var-lib-openvswitch\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.772195 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570568    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8bd843f-d4d6-4179-a9b7-48c5fcce16f2-hosts-file\") pod \"node-resolver-jczc6\" (UID: \"e8bd843f-d4d6-4179-a9b7-48c5fcce16f2\") " pod="openshift-dns/node-resolver-jczc6"
May 20 13:49:51.772195 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570594    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7fb2aae9-8e70-4380-b813-b15da35d6bb4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p86kx\" (UID: \"7fb2aae9-8e70-4380-b813-b15da35d6bb4\") " pod="openshift-multus/multus-additional-cni-plugins-p86kx"
May 20 13:49:51.772195 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570610    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a65737a0-1eac-4f7e-bc96-c5b3281da578-etc-systemd\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:51.772195 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570633    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-host-slash\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.772734 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570666    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-etc-openvswitch\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.772734 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570693    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-run-openvswitch\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.772734 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570709    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6bmk\" (UniqueName: \"kubernetes.io/projected/96bd478e-69c0-43e6-8df1-d6f775d6c864-kube-api-access-d6bmk\") pod \"network-metrics-daemon-zhqmq\" (UID: \"96bd478e-69c0-43e6-8df1-d6f775d6c864\") " pod="openshift-multus/network-metrics-daemon-zhqmq"
May 20 13:49:51.772734 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570734    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a65737a0-1eac-4f7e-bc96-c5b3281da578-etc-modprobe-d\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:51.772734 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570750    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-run-systemd\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.772734 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570766    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7fb2aae9-8e70-4380-b813-b15da35d6bb4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p86kx\" (UID: \"7fb2aae9-8e70-4380-b813-b15da35d6bb4\") " pod="openshift-multus/multus-additional-cni-plugins-p86kx"
May 20 13:49:51.772734 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570784    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-cnibin\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.772734 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570798    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-multus-daemon-config\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.772734 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570812    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a65737a0-1eac-4f7e-bc96-c5b3281da578-etc-sysctl-d\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:51.772734 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570825    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a65737a0-1eac-4f7e-bc96-c5b3281da578-var-lib-kubelet\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:51.772734 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570845    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-systemd-units\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.772734 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570862    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpzgn\" (UniqueName: \"kubernetes.io/projected/9428938d-ef32-4fe7-9138-aca8852fdefe-kube-api-access-wpzgn\") pod \"network-check-target-lbcdw\" (UID: \"9428938d-ef32-4fe7-9138-aca8852fdefe\") " pod="openshift-network-diagnostics/network-check-target-lbcdw"
May 20 13:49:51.772734 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570876    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a9148b87-b372-4314-a484-2aad1d67c649-konnectivity-ca\") pod \"konnectivity-agent-gmcz8\" (UID: \"a9148b87-b372-4314-a484-2aad1d67c649\") " pod="kube-system/konnectivity-agent-gmcz8"
May 20 13:49:51.772734 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570899    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-host-run-k8s-cni-cncf-io\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.772734 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570913    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a65737a0-1eac-4f7e-bc96-c5b3281da578-etc-tuned\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:51.772734 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570956    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sksp\" (UniqueName: \"kubernetes.io/projected/80b8fd3b-57c3-42a7-8028-8d04d797d224-kube-api-access-2sksp\") pod \"node-ca-g8gjr\" (UID: \"80b8fd3b-57c3-42a7-8028-8d04d797d224\") " pod="openshift-image-registry/node-ca-g8gjr"
May 20 13:49:51.773433 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.570983    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a65737a0-1eac-4f7e-bc96-c5b3281da578-etc-kubernetes\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:51.773433 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.571004    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a65737a0-1eac-4f7e-bc96-c5b3281da578-tmp\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:51.773433 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.571035    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-run-ovn\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.773433 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.571051    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8bd843f-d4d6-4179-a9b7-48c5fcce16f2-tmp-dir\") pod \"node-resolver-jczc6\" (UID: \"e8bd843f-d4d6-4179-a9b7-48c5fcce16f2\") " pod="openshift-dns/node-resolver-jczc6"
May 20 13:49:51.773433 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.571096    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7fb2aae9-8e70-4380-b813-b15da35d6bb4-cni-binary-copy\") pod \"multus-additional-cni-plugins-p86kx\" (UID: \"7fb2aae9-8e70-4380-b813-b15da35d6bb4\") " pod="openshift-multus/multus-additional-cni-plugins-p86kx"
May 20 13:49:51.773433 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.571117    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-multus-conf-dir\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.773433 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.571156    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7685d6b2-b593-4ea9-a2b8-a427f2f0d129-host-slash\") pod \"iptables-alerter-vgw8s\" (UID: \"7685d6b2-b593-4ea9-a2b8-a427f2f0d129\") " pod="openshift-network-operator/iptables-alerter-vgw8s"
May 20 13:49:51.773433 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.571205    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-host-cni-bin\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.773433 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.571297    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.773433 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.571323    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-ovnkube-config\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.773433 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.571339    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ldbtc\""
May 20 13:49:51.773433 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.571353    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kpmn\" (UniqueName: \"kubernetes.io/projected/69bab5d8-9702-4c77-b23e-f9a7310d983c-kube-api-access-9kpmn\") pod \"aws-ebs-csi-driver-node-zmwjr\" (UID: \"69bab5d8-9702-4c77-b23e-f9a7310d983c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmwjr"
May 20 13:49:51.773433 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.571368    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80b8fd3b-57c3-42a7-8028-8d04d797d224-host\") pod \"node-ca-g8gjr\" (UID: \"80b8fd3b-57c3-42a7-8028-8d04d797d224\") " pod="openshift-image-registry/node-ca-g8gjr"
May 20 13:49:51.773433 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.571382    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-host-run-netns\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.773433 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.571398    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-ovnkube-script-lib\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.773433 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.571419    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/69bab5d8-9702-4c77-b23e-f9a7310d983c-device-dir\") pod \"aws-ebs-csi-driver-node-zmwjr\" (UID: \"69bab5d8-9702-4c77-b23e-f9a7310d983c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmwjr"
May 20 13:49:51.773433 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.571435    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-system-cni-dir\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.773433 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.571439    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 20 13:49:51.774070 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.571449    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a65737a0-1eac-4f7e-bc96-c5b3281da578-run\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:51.774070 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.571463    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a65737a0-1eac-4f7e-bc96-c5b3281da578-host\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:51.774070 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.571477    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-ovn-node-metrics-cert\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.774070 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.571490    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj4mr\" (UniqueName: \"kubernetes.io/projected/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-kube-api-access-bj4mr\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.774070 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.571504    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a65737a0-1eac-4f7e-bc96-c5b3281da578-lib-modules\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:51.774070 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.571525    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-host-kubelet\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.774070 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.571567    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7fb2aae9-8e70-4380-b813-b15da35d6bb4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p86kx\" (UID: \"7fb2aae9-8e70-4380-b813-b15da35d6bb4\") " pod="openshift-multus/multus-additional-cni-plugins-p86kx"
May 20 13:49:51.774070 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.571600    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/69bab5d8-9702-4c77-b23e-f9a7310d983c-sys-fs\") pod \"aws-ebs-csi-driver-node-zmwjr\" (UID: \"69bab5d8-9702-4c77-b23e-f9a7310d983c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmwjr"
May 20 13:49:51.774070 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.571624    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-multus-socket-dir-parent\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.774070 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.573910    2571 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 20 13:49:51.774070 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.603652    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-556wd"
May 20 13:49:51.774070 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.610530    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-556wd"
May 20 13:49:51.774070 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:51.613893    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b58d901cc6734ae2a8b3c707deb5d52.slice/crio-e7e6483dd9d963c3d49aab369b6af6d0b09323706f2b22388fd26f9a121d4273 WatchSource:0}: Error finding container e7e6483dd9d963c3d49aab369b6af6d0b09323706f2b22388fd26f9a121d4273: Status 404 returned error can't find the container with id e7e6483dd9d963c3d49aab369b6af6d0b09323706f2b22388fd26f9a121d4273
May 20 13:49:51.774070 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:51.614139    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e619104d9ea30333bb983da7ab1a496.slice/crio-2a4ac3844bd47e253d20be21a8b24297fee894752e24c32bf9d4a0059f921cae WatchSource:0}: Error finding container 2a4ac3844bd47e253d20be21a8b24297fee894752e24c32bf9d4a0059f921cae: Status 404 returned error can't find the container with id 2a4ac3844bd47e253d20be21a8b24297fee894752e24c32bf9d4a0059f921cae
May 20 13:49:51.774070 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.617171    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 13:49:51.774070 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.663274    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-144.ec2.internal" event={"ID":"0e619104d9ea30333bb983da7ab1a496","Type":"ContainerStarted","Data":"2a4ac3844bd47e253d20be21a8b24297fee894752e24c32bf9d4a0059f921cae"}
May 20 13:49:51.774070 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.664011    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-144.ec2.internal" event={"ID":"3b58d901cc6734ae2a8b3c707deb5d52","Type":"ContainerStarted","Data":"e7e6483dd9d963c3d49aab369b6af6d0b09323706f2b22388fd26f9a121d4273"}
May 20 13:49:51.774070 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.671824    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-ovn-node-metrics-cert\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.774749 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.671846    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bj4mr\" (UniqueName: \"kubernetes.io/projected/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-kube-api-access-bj4mr\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.774749 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.671861    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a65737a0-1eac-4f7e-bc96-c5b3281da578-lib-modules\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:51.774749 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.671875    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-host-kubelet\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.774749 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.671889    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7fb2aae9-8e70-4380-b813-b15da35d6bb4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p86kx\" (UID: \"7fb2aae9-8e70-4380-b813-b15da35d6bb4\") " pod="openshift-multus/multus-additional-cni-plugins-p86kx"
May 20 13:49:51.774749 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.671902    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/69bab5d8-9702-4c77-b23e-f9a7310d983c-sys-fs\") pod \"aws-ebs-csi-driver-node-zmwjr\" (UID: \"69bab5d8-9702-4c77-b23e-f9a7310d983c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmwjr"
May 20 13:49:51.774749 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.671949    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-multus-socket-dir-parent\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.774749 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.671956    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/69bab5d8-9702-4c77-b23e-f9a7310d983c-sys-fs\") pod \"aws-ebs-csi-driver-node-zmwjr\" (UID: \"69bab5d8-9702-4c77-b23e-f9a7310d983c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmwjr"
May 20 13:49:51.774749 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.671978    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-44dl2\" (UniqueName: \"kubernetes.io/projected/7685d6b2-b593-4ea9-a2b8-a427f2f0d129-kube-api-access-44dl2\") pod \"iptables-alerter-vgw8s\" (UID: \"7685d6b2-b593-4ea9-a2b8-a427f2f0d129\") " pod="openshift-network-operator/iptables-alerter-vgw8s"
May 20 13:49:51.774749 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672003    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-env-overrides\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.774749 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672020    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-multus-cni-dir\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.774749 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672034    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-cni-binary-copy\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.774749 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672049    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mrww9\" (UniqueName: \"kubernetes.io/projected/7fb2aae9-8e70-4380-b813-b15da35d6bb4-kube-api-access-mrww9\") pod \"multus-additional-cni-plugins-p86kx\" (UID: \"7fb2aae9-8e70-4380-b813-b15da35d6bb4\") " pod="openshift-multus/multus-additional-cni-plugins-p86kx"
May 20 13:49:51.774749 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672063    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a9148b87-b372-4314-a484-2aad1d67c649-agent-certs\") pod \"konnectivity-agent-gmcz8\" (UID: \"a9148b87-b372-4314-a484-2aad1d67c649\") " pod="kube-system/konnectivity-agent-gmcz8"
May 20 13:49:51.774749 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672077    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-os-release\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.774749 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672091    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-host-run-multus-certs\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.774749 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672105    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-node-log\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.774749 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672119    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-host-run-ovn-kubernetes\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.775338 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672135    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4qlpw\" (UniqueName: \"kubernetes.io/projected/e8bd843f-d4d6-4179-a9b7-48c5fcce16f2-kube-api-access-4qlpw\") pod \"node-resolver-jczc6\" (UID: \"e8bd843f-d4d6-4179-a9b7-48c5fcce16f2\") " pod="openshift-dns/node-resolver-jczc6"
May 20 13:49:51.775338 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672150    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/69bab5d8-9702-4c77-b23e-f9a7310d983c-etc-selinux\") pod \"aws-ebs-csi-driver-node-zmwjr\" (UID: \"69bab5d8-9702-4c77-b23e-f9a7310d983c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmwjr"
May 20 13:49:51.775338 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672166    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-host-var-lib-cni-bin\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.775338 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672180    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-hostroot\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.775338 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672194    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/69bab5d8-9702-4c77-b23e-f9a7310d983c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zmwjr\" (UID: \"69bab5d8-9702-4c77-b23e-f9a7310d983c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmwjr"
May 20 13:49:51.775338 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672204    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-multus-socket-dir-parent\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.775338 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672248    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-os-release\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.775338 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672274    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-host-run-multus-certs\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.775338 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672209    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7685d6b2-b593-4ea9-a2b8-a427f2f0d129-iptables-alerter-script\") pod \"iptables-alerter-vgw8s\" (UID: \"7685d6b2-b593-4ea9-a2b8-a427f2f0d129\") " pod="openshift-network-operator/iptables-alerter-vgw8s"
May 20 13:49:51.775338 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672308    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7fb2aae9-8e70-4380-b813-b15da35d6bb4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p86kx\" (UID: \"7fb2aae9-8e70-4380-b813-b15da35d6bb4\") " pod="openshift-multus/multus-additional-cni-plugins-p86kx"
May 20 13:49:51.775338 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672318    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-host-run-ovn-kubernetes\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.775338 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672332    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-host-cni-netd\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.775338 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672352    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-host-kubelet\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.775338 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672358    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-46s7l\" (UniqueName: \"kubernetes.io/projected/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-kube-api-access-46s7l\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.775338 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672358    2571 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 20 13:49:51.775338 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672391    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7fb2aae9-8e70-4380-b813-b15da35d6bb4-cnibin\") pod \"multus-additional-cni-plugins-p86kx\" (UID: \"7fb2aae9-8e70-4380-b813-b15da35d6bb4\") " pod="openshift-multus/multus-additional-cni-plugins-p86kx"
May 20 13:49:51.775338 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672416    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-host-run-netns\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.775338 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672440    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-host-var-lib-cni-multus\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.776845 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672299    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-node-log\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.776845 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672466    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dhwpr\" (UniqueName: \"kubernetes.io/projected/a65737a0-1eac-4f7e-bc96-c5b3281da578-kube-api-access-dhwpr\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:51.776845 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672498    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7fb2aae9-8e70-4380-b813-b15da35d6bb4-system-cni-dir\") pod \"multus-additional-cni-plugins-p86kx\" (UID: \"7fb2aae9-8e70-4380-b813-b15da35d6bb4\") " pod="openshift-multus/multus-additional-cni-plugins-p86kx"
May 20 13:49:51.776845 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672521    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7fb2aae9-8e70-4380-b813-b15da35d6bb4-os-release\") pod \"multus-additional-cni-plugins-p86kx\" (UID: \"7fb2aae9-8e70-4380-b813-b15da35d6bb4\") " pod="openshift-multus/multus-additional-cni-plugins-p86kx"
May 20 13:49:51.776845 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672543    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/69bab5d8-9702-4c77-b23e-f9a7310d983c-socket-dir\") pod \"aws-ebs-csi-driver-node-zmwjr\" (UID: \"69bab5d8-9702-4c77-b23e-f9a7310d983c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmwjr"
May 20 13:49:51.776845 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672565    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/69bab5d8-9702-4c77-b23e-f9a7310d983c-registration-dir\") pod \"aws-ebs-csi-driver-node-zmwjr\" (UID: \"69bab5d8-9702-4c77-b23e-f9a7310d983c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmwjr"
May 20 13:49:51.776845 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672587    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/80b8fd3b-57c3-42a7-8028-8d04d797d224-serviceca\") pod \"node-ca-g8gjr\" (UID: \"80b8fd3b-57c3-42a7-8028-8d04d797d224\") " pod="openshift-image-registry/node-ca-g8gjr"
May 20 13:49:51.776845 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672593    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/69bab5d8-9702-4c77-b23e-f9a7310d983c-etc-selinux\") pod \"aws-ebs-csi-driver-node-zmwjr\" (UID: \"69bab5d8-9702-4c77-b23e-f9a7310d983c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmwjr"
May 20 13:49:51.776845 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672616    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96bd478e-69c0-43e6-8df1-d6f775d6c864-metrics-certs\") pod \"network-metrics-daemon-zhqmq\" (UID: \"96bd478e-69c0-43e6-8df1-d6f775d6c864\") " pod="openshift-multus/network-metrics-daemon-zhqmq"
May 20 13:49:51.776845 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672661    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-log-socket\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.776845 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672676    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-host-var-lib-kubelet\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.776845 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672686    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7685d6b2-b593-4ea9-a2b8-a427f2f0d129-iptables-alerter-script\") pod \"iptables-alerter-vgw8s\" (UID: \"7685d6b2-b593-4ea9-a2b8-a427f2f0d129\") " pod="openshift-network-operator/iptables-alerter-vgw8s"
May 20 13:49:51.776845 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672710    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-etc-kubernetes\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.776845 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672692    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-etc-kubernetes\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.776845 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672750    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a65737a0-1eac-4f7e-bc96-c5b3281da578-etc-sysconfig\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:51.776845 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672768    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a65737a0-1eac-4f7e-bc96-c5b3281da578-lib-modules\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:51.776845 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672779    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a65737a0-1eac-4f7e-bc96-c5b3281da578-etc-sysctl-conf\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:51.777425 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672795    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-host-var-lib-cni-bin\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.777425 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672802    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a65737a0-1eac-4f7e-bc96-c5b3281da578-sys\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:51.777425 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672818    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-hostroot\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.777425 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672826    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-var-lib-openvswitch\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.777425 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672846    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/69bab5d8-9702-4c77-b23e-f9a7310d983c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zmwjr\" (UID: \"69bab5d8-9702-4c77-b23e-f9a7310d983c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmwjr"
May 20 13:49:51.777425 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672851    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8bd843f-d4d6-4179-a9b7-48c5fcce16f2-hosts-file\") pod \"node-resolver-jczc6\" (UID: \"e8bd843f-d4d6-4179-a9b7-48c5fcce16f2\") " pod="openshift-dns/node-resolver-jczc6"
May 20 13:49:51.777425 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672857    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-env-overrides\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.777425 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672877    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7fb2aae9-8e70-4380-b813-b15da35d6bb4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p86kx\" (UID: \"7fb2aae9-8e70-4380-b813-b15da35d6bb4\") " pod="openshift-multus/multus-additional-cni-plugins-p86kx"
May 20 13:49:51.777425 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672902    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a65737a0-1eac-4f7e-bc96-c5b3281da578-etc-systemd\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:51.777425 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672920    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/80b8fd3b-57c3-42a7-8028-8d04d797d224-serviceca\") pod \"node-ca-g8gjr\" (UID: \"80b8fd3b-57c3-42a7-8028-8d04d797d224\") " pod="openshift-image-registry/node-ca-g8gjr"
May 20 13:49:51.777425 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672922    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-host-slash\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.777425 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672978    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-etc-openvswitch\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.777425 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672983    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-multus-cni-dir\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.777425 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.672979    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-host-slash\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.777425 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673014    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-run-openvswitch\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.777425 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673025    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-host-cni-netd\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.777425 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673039    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d6bmk\" (UniqueName: \"kubernetes.io/projected/96bd478e-69c0-43e6-8df1-d6f775d6c864-kube-api-access-d6bmk\") pod \"network-metrics-daemon-zhqmq\" (UID: \"96bd478e-69c0-43e6-8df1-d6f775d6c864\") " pod="openshift-multus/network-metrics-daemon-zhqmq"
May 20 13:49:51.777425 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673061    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a65737a0-1eac-4f7e-bc96-c5b3281da578-etc-modprobe-d\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:51.778074 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673086    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-run-systemd\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.778074 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673094    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a65737a0-1eac-4f7e-bc96-c5b3281da578-etc-sysctl-conf\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:51.778074 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673114    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7fb2aae9-8e70-4380-b813-b15da35d6bb4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p86kx\" (UID: \"7fb2aae9-8e70-4380-b813-b15da35d6bb4\") " pod="openshift-multus/multus-additional-cni-plugins-p86kx"
May 20 13:49:51.778074 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673131    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a65737a0-1eac-4f7e-bc96-c5b3281da578-sys\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:51.778074 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673142    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-cnibin\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.778074 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673166    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-multus-daemon-config\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.778074 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673190    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a65737a0-1eac-4f7e-bc96-c5b3281da578-etc-sysctl-d\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:51.778074 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673216    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a65737a0-1eac-4f7e-bc96-c5b3281da578-var-lib-kubelet\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:51.778074 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673168    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-var-lib-openvswitch\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.778074 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673236    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-systemd-units\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:51.778074 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673325    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7fb2aae9-8e70-4380-b813-b15da35d6bb4-system-cni-dir\") pod \"multus-additional-cni-plugins-p86kx\" (UID: \"7fb2aae9-8e70-4380-b813-b15da35d6bb4\") " pod="openshift-multus/multus-additional-cni-plugins-p86kx"
May 20 13:49:51.778074 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673346    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wpzgn\" (UniqueName: \"kubernetes.io/projected/9428938d-ef32-4fe7-9138-aca8852fdefe-kube-api-access-wpzgn\") pod \"network-check-target-lbcdw\" (UID: \"9428938d-ef32-4fe7-9138-aca8852fdefe\") " pod="openshift-network-diagnostics/network-check-target-lbcdw"
May 20 13:49:51.778074 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673371    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a9148b87-b372-4314-a484-2aad1d67c649-konnectivity-ca\") pod \"konnectivity-agent-gmcz8\" (UID: \"a9148b87-b372-4314-a484-2aad1d67c649\") " pod="kube-system/konnectivity-agent-gmcz8"
May 20 13:49:51.778074 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673382    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7fb2aae9-8e70-4380-b813-b15da35d6bb4-os-release\") pod \"multus-additional-cni-plugins-p86kx\" (UID: \"7fb2aae9-8e70-4380-b813-b15da35d6bb4\") " pod="openshift-multus/multus-additional-cni-plugins-p86kx"
May 20 13:49:51.778074 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673395    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-host-run-k8s-cni-cncf-io\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:51.778074 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673420    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a65737a0-1eac-4f7e-bc96-c5b3281da578-etc-tuned\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:51.778074 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673444    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2sksp\" (UniqueName: \"kubernetes.io/projected/80b8fd3b-57c3-42a7-8028-8d04d797d224-kube-api-access-2sksp\") pod \"node-ca-g8gjr\" (UID: \"80b8fd3b-57c3-42a7-8028-8d04d797d224\") " pod="openshift-image-registry/node-ca-g8gjr"
May 20 13:49:52.031488 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673469    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a65737a0-1eac-4f7e-bc96-c5b3281da578-etc-kubernetes\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:52.031488 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673491    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a65737a0-1eac-4f7e-bc96-c5b3281da578-tmp\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:52.031488 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673513    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-run-ovn\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:52.031488 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673538    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8bd843f-d4d6-4179-a9b7-48c5fcce16f2-tmp-dir\") pod \"node-resolver-jczc6\" (UID: \"e8bd843f-d4d6-4179-a9b7-48c5fcce16f2\") " pod="openshift-dns/node-resolver-jczc6"
May 20 13:49:52.031488 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673564    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7fb2aae9-8e70-4380-b813-b15da35d6bb4-cni-binary-copy\") pod \"multus-additional-cni-plugins-p86kx\" (UID: \"7fb2aae9-8e70-4380-b813-b15da35d6bb4\") " pod="openshift-multus/multus-additional-cni-plugins-p86kx"
May 20 13:49:52.031488 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:51.673584    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 13:49:52.031488 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673590    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-multus-conf-dir\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:52.031488 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673594    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-host-var-lib-cni-multus\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:52.031488 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673615    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7685d6b2-b593-4ea9-a2b8-a427f2f0d129-host-slash\") pod \"iptables-alerter-vgw8s\" (UID: \"7685d6b2-b593-4ea9-a2b8-a427f2f0d129\") " pod="openshift-network-operator/iptables-alerter-vgw8s"
May 20 13:49:52.031488 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673635    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-run-openvswitch\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:52.031488 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673015    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a65737a0-1eac-4f7e-bc96-c5b3281da578-etc-sysconfig\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:52.031488 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673654    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7685d6b2-b593-4ea9-a2b8-a427f2f0d129-host-slash\") pod \"iptables-alerter-vgw8s\" (UID: \"7685d6b2-b593-4ea9-a2b8-a427f2f0d129\") " pod="openshift-network-operator/iptables-alerter-vgw8s"
May 20 13:49:52.031488 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:51.673711    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96bd478e-69c0-43e6-8df1-d6f775d6c864-metrics-certs podName:96bd478e-69c0-43e6-8df1-d6f775d6c864 nodeName:}" failed. No retries permitted until 2026-05-20 13:49:52.173621233 +0000 UTC m=+2.046408386 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96bd478e-69c0-43e6-8df1-d6f775d6c864-metrics-certs") pod "network-metrics-daemon-zhqmq" (UID: "96bd478e-69c0-43e6-8df1-d6f775d6c864") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 13:49:52.031488 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673725    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8bd843f-d4d6-4179-a9b7-48c5fcce16f2-hosts-file\") pod \"node-resolver-jczc6\" (UID: \"e8bd843f-d4d6-4179-a9b7-48c5fcce16f2\") " pod="openshift-dns/node-resolver-jczc6"
May 20 13:49:52.031488 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673746    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-log-socket\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:52.031488 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673772    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a65737a0-1eac-4f7e-bc96-c5b3281da578-etc-modprobe-d\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:52.031488 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673781    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-host-var-lib-kubelet\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:52.034788 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673813    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-run-systemd\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:52.034788 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673822    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-cni-binary-copy\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:52.034788 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673879    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-host-cni-bin\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:52.034788 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673904    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:52.034788 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673955    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/69bab5d8-9702-4c77-b23e-f9a7310d983c-registration-dir\") pod \"aws-ebs-csi-driver-node-zmwjr\" (UID: \"69bab5d8-9702-4c77-b23e-f9a7310d983c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmwjr"
May 20 13:49:52.034788 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673977    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-ovnkube-config\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:52.034788 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673990    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-etc-openvswitch\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:52.034788 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673988    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a65737a0-1eac-4f7e-bc96-c5b3281da578-etc-kubernetes\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:52.034788 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.674005    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9kpmn\" (UniqueName: \"kubernetes.io/projected/69bab5d8-9702-4c77-b23e-f9a7310d983c-kube-api-access-9kpmn\") pod \"aws-ebs-csi-driver-node-zmwjr\" (UID: \"69bab5d8-9702-4c77-b23e-f9a7310d983c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmwjr"
May 20 13:49:52.034788 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.674031    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80b8fd3b-57c3-42a7-8028-8d04d797d224-host\") pod \"node-ca-g8gjr\" (UID: \"80b8fd3b-57c3-42a7-8028-8d04d797d224\") " pod="openshift-image-registry/node-ca-g8gjr"
May 20 13:49:52.034788 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.674033    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:52.034788 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.674058    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-host-run-netns\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:52.034788 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.674067    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-host-cni-bin\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:52.034788 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673539    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7fb2aae9-8e70-4380-b813-b15da35d6bb4-cnibin\") pod \"multus-additional-cni-plugins-p86kx\" (UID: \"7fb2aae9-8e70-4380-b813-b15da35d6bb4\") " pod="openshift-multus/multus-additional-cni-plugins-p86kx"
May 20 13:49:52.034788 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.674100    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-ovnkube-script-lib\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:52.034788 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.674115    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-run-ovn\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:52.034788 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.674126    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/69bab5d8-9702-4c77-b23e-f9a7310d983c-device-dir\") pod \"aws-ebs-csi-driver-node-zmwjr\" (UID: \"69bab5d8-9702-4c77-b23e-f9a7310d983c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmwjr"
May 20 13:49:52.036509 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.674151    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-system-cni-dir\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:52.036509 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.674176    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a65737a0-1eac-4f7e-bc96-c5b3281da578-run\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:52.036509 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.674203    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a65737a0-1eac-4f7e-bc96-c5b3281da578-host\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:52.036509 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.674272    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a65737a0-1eac-4f7e-bc96-c5b3281da578-host\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:52.036509 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673906    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/69bab5d8-9702-4c77-b23e-f9a7310d983c-socket-dir\") pod \"aws-ebs-csi-driver-node-zmwjr\" (UID: \"69bab5d8-9702-4c77-b23e-f9a7310d983c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmwjr"
May 20 13:49:52.036509 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.674323    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7fb2aae9-8e70-4380-b813-b15da35d6bb4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p86kx\" (UID: \"7fb2aae9-8e70-4380-b813-b15da35d6bb4\") " pod="openshift-multus/multus-additional-cni-plugins-p86kx"
May 20 13:49:52.036509 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.674396    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-cnibin\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:52.036509 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.674405    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8bd843f-d4d6-4179-a9b7-48c5fcce16f2-tmp-dir\") pod \"node-resolver-jczc6\" (UID: \"e8bd843f-d4d6-4179-a9b7-48c5fcce16f2\") " pod="openshift-dns/node-resolver-jczc6"
May 20 13:49:52.036509 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.674552    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7fb2aae9-8e70-4380-b813-b15da35d6bb4-cni-binary-copy\") pod \"multus-additional-cni-plugins-p86kx\" (UID: \"7fb2aae9-8e70-4380-b813-b15da35d6bb4\") " pod="openshift-multus/multus-additional-cni-plugins-p86kx"
May 20 13:49:52.036509 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.674691    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7fb2aae9-8e70-4380-b813-b15da35d6bb4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p86kx\" (UID: \"7fb2aae9-8e70-4380-b813-b15da35d6bb4\") " pod="openshift-multus/multus-additional-cni-plugins-p86kx"
May 20 13:49:52.036509 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.674759    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-multus-conf-dir\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:52.036509 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.674837    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-host-run-k8s-cni-cncf-io\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:52.036509 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.674870    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80b8fd3b-57c3-42a7-8028-8d04d797d224-host\") pod \"node-ca-g8gjr\" (UID: \"80b8fd3b-57c3-42a7-8028-8d04d797d224\") " pod="openshift-image-registry/node-ca-g8gjr"
May 20 13:49:52.036509 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.674924    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/69bab5d8-9702-4c77-b23e-f9a7310d983c-device-dir\") pod \"aws-ebs-csi-driver-node-zmwjr\" (UID: \"69bab5d8-9702-4c77-b23e-f9a7310d983c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmwjr"
May 20 13:49:52.036509 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.674875    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-ovnkube-config\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:52.036509 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.674985    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-ovnkube-script-lib\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:52.036509 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.675052    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-systemd-units\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:52.036509 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.673567    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-host-run-netns\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:52.037807 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.675153    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-system-cni-dir\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:52.037807 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.675189    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a65737a0-1eac-4f7e-bc96-c5b3281da578-etc-systemd\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:52.037807 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.675188    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a65737a0-1eac-4f7e-bc96-c5b3281da578-etc-sysctl-d\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:52.037807 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.675210    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a65737a0-1eac-4f7e-bc96-c5b3281da578-var-lib-kubelet\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:52.037807 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.675224    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-host-run-netns\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:52.037807 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.675260    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a65737a0-1eac-4f7e-bc96-c5b3281da578-run\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:52.037807 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.676225    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a65737a0-1eac-4f7e-bc96-c5b3281da578-tmp\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:52.037807 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.676286    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-multus-daemon-config\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:52.037807 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.676516    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-ovn-node-metrics-cert\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:52.037807 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.676586    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a9148b87-b372-4314-a484-2aad1d67c649-konnectivity-ca\") pod \"konnectivity-agent-gmcz8\" (UID: \"a9148b87-b372-4314-a484-2aad1d67c649\") " pod="kube-system/konnectivity-agent-gmcz8"
May 20 13:49:52.037807 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.676609    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a9148b87-b372-4314-a484-2aad1d67c649-agent-certs\") pod \"konnectivity-agent-gmcz8\" (UID: \"a9148b87-b372-4314-a484-2aad1d67c649\") " pod="kube-system/konnectivity-agent-gmcz8"
May 20 13:49:52.037807 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.676914    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a65737a0-1eac-4f7e-bc96-c5b3281da578-etc-tuned\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:52.037807 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.679592    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qlpw\" (UniqueName: \"kubernetes.io/projected/e8bd843f-d4d6-4179-a9b7-48c5fcce16f2-kube-api-access-4qlpw\") pod \"node-resolver-jczc6\" (UID: \"e8bd843f-d4d6-4179-a9b7-48c5fcce16f2\") " pod="openshift-dns/node-resolver-jczc6"
May 20 13:49:52.037807 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.680266    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44dl2\" (UniqueName: \"kubernetes.io/projected/7685d6b2-b593-4ea9-a2b8-a427f2f0d129-kube-api-access-44dl2\") pod \"iptables-alerter-vgw8s\" (UID: \"7685d6b2-b593-4ea9-a2b8-a427f2f0d129\") " pod="openshift-network-operator/iptables-alerter-vgw8s"
May 20 13:49:52.037807 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.680286    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46s7l\" (UniqueName: \"kubernetes.io/projected/86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b-kube-api-access-46s7l\") pod \"ovnkube-node-crztq\" (UID: \"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:52.037807 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.680476    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj4mr\" (UniqueName: \"kubernetes.io/projected/b8eb933d-81b4-49cd-ad5e-4c78099bfbd9-kube-api-access-bj4mr\") pod \"multus-l5gz6\" (UID: \"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9\") " pod="openshift-multus/multus-l5gz6"
May 20 13:49:52.037807 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.680734    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhwpr\" (UniqueName: \"kubernetes.io/projected/a65737a0-1eac-4f7e-bc96-c5b3281da578-kube-api-access-dhwpr\") pod \"tuned-md4j7\" (UID: \"a65737a0-1eac-4f7e-bc96-c5b3281da578\") " pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:52.037807 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:51.680806    2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 13:49:52.037807 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:51.680824    2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 13:49:52.038865 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:51.680835    2571 projected.go:194] Error preparing data for projected volume kube-api-access-wpzgn for pod openshift-network-diagnostics/network-check-target-lbcdw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 13:49:52.038865 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:51.680905    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9428938d-ef32-4fe7-9138-aca8852fdefe-kube-api-access-wpzgn podName:9428938d-ef32-4fe7-9138-aca8852fdefe nodeName:}" failed. No retries permitted until 2026-05-20 13:49:52.18088602 +0000 UTC m=+2.053673176 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wpzgn" (UniqueName: "kubernetes.io/projected/9428938d-ef32-4fe7-9138-aca8852fdefe-kube-api-access-wpzgn") pod "network-check-target-lbcdw" (UID: "9428938d-ef32-4fe7-9138-aca8852fdefe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 13:49:52.038865 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.681948    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sksp\" (UniqueName: \"kubernetes.io/projected/80b8fd3b-57c3-42a7-8028-8d04d797d224-kube-api-access-2sksp\") pod \"node-ca-g8gjr\" (UID: \"80b8fd3b-57c3-42a7-8028-8d04d797d224\") " pod="openshift-image-registry/node-ca-g8gjr"
May 20 13:49:52.038865 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.682141    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrww9\" (UniqueName: \"kubernetes.io/projected/7fb2aae9-8e70-4380-b813-b15da35d6bb4-kube-api-access-mrww9\") pod \"multus-additional-cni-plugins-p86kx\" (UID: \"7fb2aae9-8e70-4380-b813-b15da35d6bb4\") " pod="openshift-multus/multus-additional-cni-plugins-p86kx"
May 20 13:49:52.038865 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.682247    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6bmk\" (UniqueName: \"kubernetes.io/projected/96bd478e-69c0-43e6-8df1-d6f775d6c864-kube-api-access-d6bmk\") pod \"network-metrics-daemon-zhqmq\" (UID: \"96bd478e-69c0-43e6-8df1-d6f775d6c864\") " pod="openshift-multus/network-metrics-daemon-zhqmq"
May 20 13:49:52.038865 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.682386    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kpmn\" (UniqueName: \"kubernetes.io/projected/69bab5d8-9702-4c77-b23e-f9a7310d983c-kube-api-access-9kpmn\") pod \"aws-ebs-csi-driver-node-zmwjr\" (UID: \"69bab5d8-9702-4c77-b23e-f9a7310d983c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmwjr"
May 20 13:49:52.038865 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.891056    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmwjr"
May 20 13:49:52.038865 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:51.897366    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69bab5d8_9702_4c77_b23e_f9a7310d983c.slice/crio-066f85afedf3abf66013ab21c6b0ec706fa8bacdd9063ea8e9d75849901b8be8 WatchSource:0}: Error finding container 066f85afedf3abf66013ab21c6b0ec706fa8bacdd9063ea8e9d75849901b8be8: Status 404 returned error can't find the container with id 066f85afedf3abf66013ab21c6b0ec706fa8bacdd9063ea8e9d75849901b8be8
May 20 13:49:52.038865 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.914251    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-md4j7"
May 20 13:49:52.038865 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:51.919633    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda65737a0_1eac_4f7e_bc96_c5b3281da578.slice/crio-54121ce6d787e1aba76528adc4dc9a1deb1687605adfca3e9f9753db4ecc1ae1 WatchSource:0}: Error finding container 54121ce6d787e1aba76528adc4dc9a1deb1687605adfca3e9f9753db4ecc1ae1: Status 404 returned error can't find the container with id 54121ce6d787e1aba76528adc4dc9a1deb1687605adfca3e9f9753db4ecc1ae1
May 20 13:49:52.038865 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.920666    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vgw8s"
May 20 13:49:52.038865 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:51.926800    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7685d6b2_b593_4ea9_a2b8_a427f2f0d129.slice/crio-bfbb325d8f300451ad9263047995bf934a6c7857da325b082f2a657c46c84c84 WatchSource:0}: Error finding container bfbb325d8f300451ad9263047995bf934a6c7857da325b082f2a657c46c84c84: Status 404 returned error can't find the container with id bfbb325d8f300451ad9263047995bf934a6c7857da325b082f2a657c46c84c84
May 20 13:49:52.038865 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.929744    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:49:52.038865 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.934236    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gmcz8"
May 20 13:49:52.038865 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:51.936331    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86c1e7d3_9fba_4c39_8f01_fb3e20c1ab0b.slice/crio-f1e3c14ec1d01b01192abe5dc048cf815fe4ca72383623b82ed9d0dc6e8b1fea WatchSource:0}: Error finding container f1e3c14ec1d01b01192abe5dc048cf815fe4ca72383623b82ed9d0dc6e8b1fea: Status 404 returned error can't find the container with id f1e3c14ec1d01b01192abe5dc048cf815fe4ca72383623b82ed9d0dc6e8b1fea
May 20 13:49:52.038865 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.939761    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jczc6"
May 20 13:49:52.038865 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:51.940408    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9148b87_b372_4314_a484_2aad1d67c649.slice/crio-abde3a48f17e765b1307bbfece7a47d9ef6d6f5cc3ed43e909bae85cb541f876 WatchSource:0}: Error finding container abde3a48f17e765b1307bbfece7a47d9ef6d6f5cc3ed43e909bae85cb541f876: Status 404 returned error can't find the container with id abde3a48f17e765b1307bbfece7a47d9ef6d6f5cc3ed43e909bae85cb541f876
May 20 13:49:52.040083 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:51.945236    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8bd843f_d4d6_4179_a9b7_48c5fcce16f2.slice/crio-311dd7a121c8fcccefe146435af9ef23785adfe213865c4eccda3b83b7a0eb37 WatchSource:0}: Error finding container 311dd7a121c8fcccefe146435af9ef23785adfe213865c4eccda3b83b7a0eb37: Status 404 returned error can't find the container with id 311dd7a121c8fcccefe146435af9ef23785adfe213865c4eccda3b83b7a0eb37
May 20 13:49:52.040083 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.949983    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g8gjr"
May 20 13:49:52.040083 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.955604    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p86kx"
May 20 13:49:52.040083 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:51.958615    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80b8fd3b_57c3_42a7_8028_8d04d797d224.slice/crio-5a8236b53a111422b6b19dfb1b17e6a926e9ac29634974c4bafd21995fca88d4 WatchSource:0}: Error finding container 5a8236b53a111422b6b19dfb1b17e6a926e9ac29634974c4bafd21995fca88d4: Status 404 returned error can't find the container with id 5a8236b53a111422b6b19dfb1b17e6a926e9ac29634974c4bafd21995fca88d4
May 20 13:49:52.040083 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:51.961599    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-l5gz6"
May 20 13:49:52.040083 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:51.963505    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fb2aae9_8e70_4380_b813_b15da35d6bb4.slice/crio-7d4fcb26017c8e7420ad8349b86c25f32e85dbdb1d4d5f70eb56939a7c5bf5cf WatchSource:0}: Error finding container 7d4fcb26017c8e7420ad8349b86c25f32e85dbdb1d4d5f70eb56939a7c5bf5cf: Status 404 returned error can't find the container with id 7d4fcb26017c8e7420ad8349b86c25f32e85dbdb1d4d5f70eb56939a7c5bf5cf
May 20 13:49:52.040083 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:49:51.968208    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8eb933d_81b4_49cd_ad5e_4c78099bfbd9.slice/crio-b1e07463c1d945084bdf91d2d6294171addc25b63e41ddc85e647eee20f92388 WatchSource:0}: Error finding container b1e07463c1d945084bdf91d2d6294171addc25b63e41ddc85e647eee20f92388: Status 404 returned error can't find the container with id b1e07463c1d945084bdf91d2d6294171addc25b63e41ddc85e647eee20f92388
May 20 13:49:52.204561 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:52.176831    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96bd478e-69c0-43e6-8df1-d6f775d6c864-metrics-certs\") pod \"network-metrics-daemon-zhqmq\" (UID: \"96bd478e-69c0-43e6-8df1-d6f775d6c864\") " pod="openshift-multus/network-metrics-daemon-zhqmq"
May 20 13:49:52.204561 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:52.176972    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 13:49:52.204561 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:52.177036    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96bd478e-69c0-43e6-8df1-d6f775d6c864-metrics-certs podName:96bd478e-69c0-43e6-8df1-d6f775d6c864 nodeName:}" failed. No retries permitted until 2026-05-20 13:49:53.177017532 +0000 UTC m=+3.049804680 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96bd478e-69c0-43e6-8df1-d6f775d6c864-metrics-certs") pod "network-metrics-daemon-zhqmq" (UID: "96bd478e-69c0-43e6-8df1-d6f775d6c864") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 13:49:52.349207 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:52.277491    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wpzgn\" (UniqueName: \"kubernetes.io/projected/9428938d-ef32-4fe7-9138-aca8852fdefe-kube-api-access-wpzgn\") pod \"network-check-target-lbcdw\" (UID: \"9428938d-ef32-4fe7-9138-aca8852fdefe\") " pod="openshift-network-diagnostics/network-check-target-lbcdw"
May 20 13:49:52.349207 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:52.277670    2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 13:49:52.349207 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:52.277690    2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 13:49:52.349207 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:52.277701    2571 projected.go:194] Error preparing data for projected volume kube-api-access-wpzgn for pod openshift-network-diagnostics/network-check-target-lbcdw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 13:49:52.349207 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:52.277752    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9428938d-ef32-4fe7-9138-aca8852fdefe-kube-api-access-wpzgn podName:9428938d-ef32-4fe7-9138-aca8852fdefe nodeName:}" failed. No retries permitted until 2026-05-20 13:49:53.27773495 +0000 UTC m=+3.150522089 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wpzgn" (UniqueName: "kubernetes.io/projected/9428938d-ef32-4fe7-9138-aca8852fdefe-kube-api-access-wpzgn") pod "network-check-target-lbcdw" (UID: "9428938d-ef32-4fe7-9138-aca8852fdefe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 13:49:52.349207 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:52.310184    2571 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 13:49:52.614362 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:52.614325    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 13:44:51 +0000 UTC" deadline="2027-11-17 16:09:59.207627613 +0000 UTC"
May 20 13:49:52.614464 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:52.614363    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13106h20m6.593267965s"
May 20 13:49:52.695625 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:52.695591    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-l5gz6" event={"ID":"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9","Type":"ContainerStarted","Data":"b1e07463c1d945084bdf91d2d6294171addc25b63e41ddc85e647eee20f92388"}
May 20 13:49:52.712688 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:52.712657    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gmcz8" event={"ID":"a9148b87-b372-4314-a484-2aad1d67c649","Type":"ContainerStarted","Data":"abde3a48f17e765b1307bbfece7a47d9ef6d6f5cc3ed43e909bae85cb541f876"}
May 20 13:49:52.744740 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:52.744708    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-crztq" event={"ID":"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b","Type":"ContainerStarted","Data":"f1e3c14ec1d01b01192abe5dc048cf815fe4ca72383623b82ed9d0dc6e8b1fea"}
May 20 13:49:52.751866 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:52.751827    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vgw8s" event={"ID":"7685d6b2-b593-4ea9-a2b8-a427f2f0d129","Type":"ContainerStarted","Data":"bfbb325d8f300451ad9263047995bf934a6c7857da325b082f2a657c46c84c84"}
May 20 13:49:52.756527 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:52.756501    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-md4j7" event={"ID":"a65737a0-1eac-4f7e-bc96-c5b3281da578","Type":"ContainerStarted","Data":"54121ce6d787e1aba76528adc4dc9a1deb1687605adfca3e9f9753db4ecc1ae1"}
May 20 13:49:52.760790 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:52.760752    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmwjr" event={"ID":"69bab5d8-9702-4c77-b23e-f9a7310d983c","Type":"ContainerStarted","Data":"066f85afedf3abf66013ab21c6b0ec706fa8bacdd9063ea8e9d75849901b8be8"}
May 20 13:49:52.770679 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:52.770641    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p86kx" event={"ID":"7fb2aae9-8e70-4380-b813-b15da35d6bb4","Type":"ContainerStarted","Data":"7d4fcb26017c8e7420ad8349b86c25f32e85dbdb1d4d5f70eb56939a7c5bf5cf"}
May 20 13:49:52.796357 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:52.796331    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g8gjr" event={"ID":"80b8fd3b-57c3-42a7-8028-8d04d797d224","Type":"ContainerStarted","Data":"5a8236b53a111422b6b19dfb1b17e6a926e9ac29634974c4bafd21995fca88d4"}
May 20 13:49:52.802778 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:52.802747    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jczc6" event={"ID":"e8bd843f-d4d6-4179-a9b7-48c5fcce16f2","Type":"ContainerStarted","Data":"311dd7a121c8fcccefe146435af9ef23785adfe213865c4eccda3b83b7a0eb37"}
May 20 13:49:52.848987 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:52.848966    2571 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 13:49:52.998975 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:52.998893    2571 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 13:49:53.186993 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:53.186957    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96bd478e-69c0-43e6-8df1-d6f775d6c864-metrics-certs\") pod \"network-metrics-daemon-zhqmq\" (UID: \"96bd478e-69c0-43e6-8df1-d6f775d6c864\") " pod="openshift-multus/network-metrics-daemon-zhqmq"
May 20 13:49:53.187144 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:53.187124    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 13:49:53.187202 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:53.187183    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96bd478e-69c0-43e6-8df1-d6f775d6c864-metrics-certs podName:96bd478e-69c0-43e6-8df1-d6f775d6c864 nodeName:}" failed. No retries permitted until 2026-05-20 13:49:55.18716392 +0000 UTC m=+5.059951056 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96bd478e-69c0-43e6-8df1-d6f775d6c864-metrics-certs") pod "network-metrics-daemon-zhqmq" (UID: "96bd478e-69c0-43e6-8df1-d6f775d6c864") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 13:49:53.287511 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:53.287436    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wpzgn\" (UniqueName: \"kubernetes.io/projected/9428938d-ef32-4fe7-9138-aca8852fdefe-kube-api-access-wpzgn\") pod \"network-check-target-lbcdw\" (UID: \"9428938d-ef32-4fe7-9138-aca8852fdefe\") " pod="openshift-network-diagnostics/network-check-target-lbcdw"
May 20 13:49:53.287669 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:53.287616    2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 13:49:53.287669 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:53.287634    2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 13:49:53.287669 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:53.287648    2571 projected.go:194] Error preparing data for projected volume kube-api-access-wpzgn for pod openshift-network-diagnostics/network-check-target-lbcdw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 13:49:53.287818 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:53.287699    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9428938d-ef32-4fe7-9138-aca8852fdefe-kube-api-access-wpzgn podName:9428938d-ef32-4fe7-9138-aca8852fdefe nodeName:}" failed. No retries permitted until 2026-05-20 13:49:55.287681366 +0000 UTC m=+5.160468506 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wpzgn" (UniqueName: "kubernetes.io/projected/9428938d-ef32-4fe7-9138-aca8852fdefe-kube-api-access-wpzgn") pod "network-check-target-lbcdw" (UID: "9428938d-ef32-4fe7-9138-aca8852fdefe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 13:49:53.615415 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:53.615326    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 13:44:51 +0000 UTC" deadline="2027-12-15 02:06:33.55650565 +0000 UTC"
May 20 13:49:53.615415 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:53.615365    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13764h16m39.941146554s"
May 20 13:49:53.662044 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:53.662017    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcdw"
May 20 13:49:53.662199 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:53.662138    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbcdw" podUID="9428938d-ef32-4fe7-9138-aca8852fdefe"
May 20 13:49:53.662567 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:53.662545    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhqmq"
May 20 13:49:53.662667 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:53.662646    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhqmq" podUID="96bd478e-69c0-43e6-8df1-d6f775d6c864"
May 20 13:49:55.205208 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:55.204564    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96bd478e-69c0-43e6-8df1-d6f775d6c864-metrics-certs\") pod \"network-metrics-daemon-zhqmq\" (UID: \"96bd478e-69c0-43e6-8df1-d6f775d6c864\") " pod="openshift-multus/network-metrics-daemon-zhqmq"
May 20 13:49:55.205208 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:55.204742    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 13:49:55.205208 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:55.204802    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96bd478e-69c0-43e6-8df1-d6f775d6c864-metrics-certs podName:96bd478e-69c0-43e6-8df1-d6f775d6c864 nodeName:}" failed. No retries permitted until 2026-05-20 13:49:59.204781861 +0000 UTC m=+9.077569002 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96bd478e-69c0-43e6-8df1-d6f775d6c864-metrics-certs") pod "network-metrics-daemon-zhqmq" (UID: "96bd478e-69c0-43e6-8df1-d6f775d6c864") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 13:49:55.306841 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:55.306223    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wpzgn\" (UniqueName: \"kubernetes.io/projected/9428938d-ef32-4fe7-9138-aca8852fdefe-kube-api-access-wpzgn\") pod \"network-check-target-lbcdw\" (UID: \"9428938d-ef32-4fe7-9138-aca8852fdefe\") " pod="openshift-network-diagnostics/network-check-target-lbcdw"
May 20 13:49:55.306841 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:55.306425    2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 13:49:55.306841 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:55.306448    2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 13:49:55.306841 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:55.306460    2571 projected.go:194] Error preparing data for projected volume kube-api-access-wpzgn for pod openshift-network-diagnostics/network-check-target-lbcdw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 13:49:55.306841 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:55.306515    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9428938d-ef32-4fe7-9138-aca8852fdefe-kube-api-access-wpzgn podName:9428938d-ef32-4fe7-9138-aca8852fdefe nodeName:}" failed. No retries permitted until 2026-05-20 13:49:59.306497655 +0000 UTC m=+9.179284797 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wpzgn" (UniqueName: "kubernetes.io/projected/9428938d-ef32-4fe7-9138-aca8852fdefe-kube-api-access-wpzgn") pod "network-check-target-lbcdw" (UID: "9428938d-ef32-4fe7-9138-aca8852fdefe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 13:49:55.662241 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:55.662160    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcdw"
May 20 13:49:55.662398 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:55.662286    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbcdw" podUID="9428938d-ef32-4fe7-9138-aca8852fdefe"
May 20 13:49:55.662711 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:55.662688    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhqmq"
May 20 13:49:55.662809 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:55.662789    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhqmq" podUID="96bd478e-69c0-43e6-8df1-d6f775d6c864"
May 20 13:49:57.661638 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:57.661606    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcdw"
May 20 13:49:57.662087 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:57.661606    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhqmq"
May 20 13:49:57.662087 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:57.661726    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbcdw" podUID="9428938d-ef32-4fe7-9138-aca8852fdefe"
May 20 13:49:57.662087 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:57.661767    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhqmq" podUID="96bd478e-69c0-43e6-8df1-d6f775d6c864"
May 20 13:49:59.237580 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:59.237537    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96bd478e-69c0-43e6-8df1-d6f775d6c864-metrics-certs\") pod \"network-metrics-daemon-zhqmq\" (UID: \"96bd478e-69c0-43e6-8df1-d6f775d6c864\") " pod="openshift-multus/network-metrics-daemon-zhqmq"
May 20 13:49:59.238038 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:59.237699    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 13:49:59.238038 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:59.237757    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96bd478e-69c0-43e6-8df1-d6f775d6c864-metrics-certs podName:96bd478e-69c0-43e6-8df1-d6f775d6c864 nodeName:}" failed. No retries permitted until 2026-05-20 13:50:07.237739307 +0000 UTC m=+17.110526446 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96bd478e-69c0-43e6-8df1-d6f775d6c864-metrics-certs") pod "network-metrics-daemon-zhqmq" (UID: "96bd478e-69c0-43e6-8df1-d6f775d6c864") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 13:49:59.338166 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:59.338133    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wpzgn\" (UniqueName: \"kubernetes.io/projected/9428938d-ef32-4fe7-9138-aca8852fdefe-kube-api-access-wpzgn\") pod \"network-check-target-lbcdw\" (UID: \"9428938d-ef32-4fe7-9138-aca8852fdefe\") " pod="openshift-network-diagnostics/network-check-target-lbcdw"
May 20 13:49:59.338324 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:59.338307    2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 13:49:59.338379 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:59.338330    2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 13:49:59.338379 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:59.338344    2571 projected.go:194] Error preparing data for projected volume kube-api-access-wpzgn for pod openshift-network-diagnostics/network-check-target-lbcdw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 13:49:59.338480 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:59.338405    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9428938d-ef32-4fe7-9138-aca8852fdefe-kube-api-access-wpzgn podName:9428938d-ef32-4fe7-9138-aca8852fdefe nodeName:}" failed. No retries permitted until 2026-05-20 13:50:07.338385388 +0000 UTC m=+17.211172524 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wpzgn" (UniqueName: "kubernetes.io/projected/9428938d-ef32-4fe7-9138-aca8852fdefe-kube-api-access-wpzgn") pod "network-check-target-lbcdw" (UID: "9428938d-ef32-4fe7-9138-aca8852fdefe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 13:49:59.662164 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:59.662084    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcdw"
May 20 13:49:59.662309 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:59.662206    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbcdw" podUID="9428938d-ef32-4fe7-9138-aca8852fdefe"
May 20 13:49:59.662309 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:49:59.662299    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhqmq"
May 20 13:49:59.662416 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:49:59.662391    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhqmq" podUID="96bd478e-69c0-43e6-8df1-d6f775d6c864"
May 20 13:50:01.661773 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:01.661742    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcdw"
May 20 13:50:01.661773 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:01.661761    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhqmq"
May 20 13:50:01.662228 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:01.661846    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbcdw" podUID="9428938d-ef32-4fe7-9138-aca8852fdefe"
May 20 13:50:01.662228 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:01.661958    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhqmq" podUID="96bd478e-69c0-43e6-8df1-d6f775d6c864"
May 20 13:50:03.662086 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:03.662053    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcdw"
May 20 13:50:03.662482 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:03.662055    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhqmq"
May 20 13:50:03.662482 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:03.662166    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbcdw" podUID="9428938d-ef32-4fe7-9138-aca8852fdefe"
May 20 13:50:03.662482 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:03.662262    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhqmq" podUID="96bd478e-69c0-43e6-8df1-d6f775d6c864"
May 20 13:50:05.661740 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:05.661705    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcdw"
May 20 13:50:05.662171 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:05.661714    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhqmq"
May 20 13:50:05.662171 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:05.661814    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbcdw" podUID="9428938d-ef32-4fe7-9138-aca8852fdefe"
May 20 13:50:05.662171 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:05.661880    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhqmq" podUID="96bd478e-69c0-43e6-8df1-d6f775d6c864"
May 20 13:50:07.302928 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:07.302696    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96bd478e-69c0-43e6-8df1-d6f775d6c864-metrics-certs\") pod \"network-metrics-daemon-zhqmq\" (UID: \"96bd478e-69c0-43e6-8df1-d6f775d6c864\") " pod="openshift-multus/network-metrics-daemon-zhqmq"
May 20 13:50:07.303368 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:07.302835    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 13:50:07.303368 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:07.303015    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96bd478e-69c0-43e6-8df1-d6f775d6c864-metrics-certs podName:96bd478e-69c0-43e6-8df1-d6f775d6c864 nodeName:}" failed. No retries permitted until 2026-05-20 13:50:23.302992992 +0000 UTC m=+33.175780129 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96bd478e-69c0-43e6-8df1-d6f775d6c864-metrics-certs") pod "network-metrics-daemon-zhqmq" (UID: "96bd478e-69c0-43e6-8df1-d6f775d6c864") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 13:50:07.403740 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:07.403711    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wpzgn\" (UniqueName: \"kubernetes.io/projected/9428938d-ef32-4fe7-9138-aca8852fdefe-kube-api-access-wpzgn\") pod \"network-check-target-lbcdw\" (UID: \"9428938d-ef32-4fe7-9138-aca8852fdefe\") " pod="openshift-network-diagnostics/network-check-target-lbcdw"
May 20 13:50:07.403880 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:07.403834    2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 13:50:07.403880 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:07.403849    2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 13:50:07.403880 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:07.403860    2571 projected.go:194] Error preparing data for projected volume kube-api-access-wpzgn for pod openshift-network-diagnostics/network-check-target-lbcdw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 13:50:07.404003 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:07.403907    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9428938d-ef32-4fe7-9138-aca8852fdefe-kube-api-access-wpzgn podName:9428938d-ef32-4fe7-9138-aca8852fdefe nodeName:}" failed. No retries permitted until 2026-05-20 13:50:23.40389384 +0000 UTC m=+33.276680974 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wpzgn" (UniqueName: "kubernetes.io/projected/9428938d-ef32-4fe7-9138-aca8852fdefe-kube-api-access-wpzgn") pod "network-check-target-lbcdw" (UID: "9428938d-ef32-4fe7-9138-aca8852fdefe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 13:50:07.661861 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:07.661781    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcdw"
May 20 13:50:07.662024 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:07.661870    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhqmq"
May 20 13:50:07.662067 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:07.662027    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhqmq" podUID="96bd478e-69c0-43e6-8df1-d6f775d6c864"
May 20 13:50:07.662176 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:07.662152    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbcdw" podUID="9428938d-ef32-4fe7-9138-aca8852fdefe"
May 20 13:50:09.662283 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:09.662248    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcdw"
May 20 13:50:09.662681 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:09.662248    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhqmq"
May 20 13:50:09.662681 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:09.662350    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbcdw" podUID="9428938d-ef32-4fe7-9138-aca8852fdefe"
May 20 13:50:09.662681 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:09.662424    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhqmq" podUID="96bd478e-69c0-43e6-8df1-d6f775d6c864"
May 20 13:50:10.839238 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:10.839205    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-144.ec2.internal" event={"ID":"3b58d901cc6734ae2a8b3c707deb5d52","Type":"ContainerStarted","Data":"97c80326f67ad49543002e40ac6cede6bc134b76ae95c040720e3b219b2e8192"}
May 20 13:50:10.841523 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:10.841499    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-l5gz6" event={"ID":"b8eb933d-81b4-49cd-ad5e-4c78099bfbd9","Type":"ContainerStarted","Data":"ccd019cd96799b258c6739e323be8cf1ccae134a4aa7a53e95ba903dacc2425a"}
May 20 13:50:10.843117 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:10.843025    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-md4j7" event={"ID":"a65737a0-1eac-4f7e-bc96-c5b3281da578","Type":"ContainerStarted","Data":"9e2ba52ad748eb0d418c851990ffcaa791dfb79a768445d3d22afe048e30d135"}
May 20 13:50:10.871107 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:10.871056    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-144.ec2.internal" podStartSLOduration=20.871036482 podStartE2EDuration="20.871036482s" podCreationTimestamp="2026-05-20 13:49:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 13:50:10.85457825 +0000 UTC m=+20.727365398" watchObservedRunningTime="2026-05-20 13:50:10.871036482 +0000 UTC m=+20.743823636"
May 20 13:50:10.872111 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:10.872068    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-md4j7" podStartSLOduration=2.630438869 podStartE2EDuration="20.872057471s" podCreationTimestamp="2026-05-20 13:49:50 +0000 UTC" firstStartedPulling="2026-05-20 13:49:51.921243138 +0000 UTC m=+1.794030272" lastFinishedPulling="2026-05-20 13:50:10.162861737 +0000 UTC m=+20.035648874" observedRunningTime="2026-05-20 13:50:10.871511761 +0000 UTC m=+20.744298910" watchObservedRunningTime="2026-05-20 13:50:10.872057471 +0000 UTC m=+20.744844627"
May 20 13:50:10.888703 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:10.888664    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-l5gz6" podStartSLOduration=2.680687507 podStartE2EDuration="20.888651505s" podCreationTimestamp="2026-05-20 13:49:50 +0000 UTC" firstStartedPulling="2026-05-20 13:49:51.969619699 +0000 UTC m=+1.842406851" lastFinishedPulling="2026-05-20 13:50:10.177583712 +0000 UTC m=+20.050370849" observedRunningTime="2026-05-20 13:50:10.887696159 +0000 UTC m=+20.760483316" watchObservedRunningTime="2026-05-20 13:50:10.888651505 +0000 UTC m=+20.761438663"
May 20 13:50:11.661496 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:11.661272    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcdw"
May 20 13:50:11.661634 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:11.661371    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhqmq"
May 20 13:50:11.661634 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:11.661575    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbcdw" podUID="9428938d-ef32-4fe7-9138-aca8852fdefe"
May 20 13:50:11.661634 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:11.661616    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhqmq" podUID="96bd478e-69c0-43e6-8df1-d6f775d6c864"
May 20 13:50:11.845545 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:11.845518    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gmcz8" event={"ID":"a9148b87-b372-4314-a484-2aad1d67c649","Type":"ContainerStarted","Data":"515da8d0f2604841aaaf00396389e8bbd43d91052b2003547c9ae50081d66f06"}
May 20 13:50:11.847668 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:11.847646    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-crztq" event={"ID":"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b","Type":"ContainerStarted","Data":"cc7653dbcf275d3d3174590af276652beb9d6897ee1035e72173d7b38c7e5ba2"}
May 20 13:50:11.847758 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:11.847672    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-crztq" event={"ID":"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b","Type":"ContainerStarted","Data":"98fcc48fe653f177dbca687ddb44162906b3e44058a7f5aae8cb183854724f4c"}
May 20 13:50:11.847758 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:11.847685    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-crztq" event={"ID":"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b","Type":"ContainerStarted","Data":"3b1284294609fb502d406dc1f17d81de5e25043b4d5465005696bb826eb1dfe4"}
May 20 13:50:11.847758 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:11.847696    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-crztq" event={"ID":"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b","Type":"ContainerStarted","Data":"a0c302cca3346d9d1f81ca2385295be894775f814e894fa6020f2e04778be744"}
May 20 13:50:11.847758 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:11.847707    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-crztq" event={"ID":"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b","Type":"ContainerStarted","Data":"b7cf5702ed4404ef87e8165577d907d4259cd0f235b9229edc6a3b3f44a2f2e2"}
May 20 13:50:11.847758 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:11.847717    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-crztq" event={"ID":"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b","Type":"ContainerStarted","Data":"c48d936aef5a95b5280b16d0c44c504ac564aa0b238c2be4e1a65ba50cb8fff2"}
May 20 13:50:11.848787 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:11.848768    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vgw8s" event={"ID":"7685d6b2-b593-4ea9-a2b8-a427f2f0d129","Type":"ContainerStarted","Data":"692dfce3abafdbecb533610501506baa3f1fde3f4250e848a1a24805899380ae"}
May 20 13:50:11.849967 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:11.849948    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmwjr" event={"ID":"69bab5d8-9702-4c77-b23e-f9a7310d983c","Type":"ContainerStarted","Data":"05d67f3cd741b0fbc7fc1e5d53e65177bb89b645bc11876200d2572ba2c530e0"}
May 20 13:50:11.851049 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:11.851030    2571 generic.go:358] "Generic (PLEG): container finished" podID="0e619104d9ea30333bb983da7ab1a496" containerID="3ab775d0b28f8c63087a4ad29bb17f09d12b251acf262474d037abd0197bb9e8" exitCode=0
May 20 13:50:11.851121 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:11.851084    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-144.ec2.internal" event={"ID":"0e619104d9ea30333bb983da7ab1a496","Type":"ContainerDied","Data":"3ab775d0b28f8c63087a4ad29bb17f09d12b251acf262474d037abd0197bb9e8"}
May 20 13:50:11.852332 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:11.852312    2571 generic.go:358] "Generic (PLEG): container finished" podID="7fb2aae9-8e70-4380-b813-b15da35d6bb4" containerID="9373cafc78206b5743843e3d5d36fd6ff5edf72fcc1cea15e08f7f4f95440a12" exitCode=0
May 20 13:50:11.852414 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:11.852371    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p86kx" event={"ID":"7fb2aae9-8e70-4380-b813-b15da35d6bb4","Type":"ContainerDied","Data":"9373cafc78206b5743843e3d5d36fd6ff5edf72fcc1cea15e08f7f4f95440a12"}
May 20 13:50:11.853641 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:11.853619    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g8gjr" event={"ID":"80b8fd3b-57c3-42a7-8028-8d04d797d224","Type":"ContainerStarted","Data":"04664121e9a7f1d6a0b487abe6981e83f3cff8f77e4a336f7feb0219704f114b"}
May 20 13:50:11.854924 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:11.854819    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jczc6" event={"ID":"e8bd843f-d4d6-4179-a9b7-48c5fcce16f2","Type":"ContainerStarted","Data":"382cc9113a823036251ef1bec7ee3efd3d3a94c53009e6fde02d1d0152e083da"}
May 20 13:50:11.864389 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:11.864342    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gmcz8" podStartSLOduration=7.868622707 podStartE2EDuration="21.864328524s" podCreationTimestamp="2026-05-20 13:49:50 +0000 UTC" firstStartedPulling="2026-05-20 13:49:51.942467334 +0000 UTC m=+1.815254468" lastFinishedPulling="2026-05-20 13:50:05.938173151 +0000 UTC m=+15.810960285" observedRunningTime="2026-05-20 13:50:11.863882451 +0000 UTC m=+21.736669607" watchObservedRunningTime="2026-05-20 13:50:11.864328524 +0000 UTC m=+21.737115681"
May 20 13:50:11.873422 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:11.873399    2571 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 20 13:50:11.898411 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:11.898362    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-jczc6" podStartSLOduration=7.906788816 podStartE2EDuration="21.898348821s" podCreationTimestamp="2026-05-20 13:49:50 +0000 UTC" firstStartedPulling="2026-05-20 13:49:51.94665509 +0000 UTC m=+1.819442224" lastFinishedPulling="2026-05-20 13:50:05.938215082 +0000 UTC m=+15.811002229" observedRunningTime="2026-05-20 13:50:11.882377034 +0000 UTC m=+21.755164191" watchObservedRunningTime="2026-05-20 13:50:11.898348821 +0000 UTC m=+21.771135979"
May 20 13:50:11.914764 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:11.914714    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-g8gjr" podStartSLOduration=3.713805284 podStartE2EDuration="21.914704006s" podCreationTimestamp="2026-05-20 13:49:50 +0000 UTC" firstStartedPulling="2026-05-20 13:49:51.960263109 +0000 UTC m=+1.833050246" lastFinishedPulling="2026-05-20 13:50:10.161161828 +0000 UTC m=+20.033948968" observedRunningTime="2026-05-20 13:50:11.89872775 +0000 UTC m=+21.771514907" watchObservedRunningTime="2026-05-20 13:50:11.914704006 +0000 UTC m=+21.787491160"
May 20 13:50:11.935074 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:11.934060    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vgw8s" podStartSLOduration=3.694694289 podStartE2EDuration="21.934046986s" podCreationTimestamp="2026-05-20 13:49:50 +0000 UTC" firstStartedPulling="2026-05-20 13:49:51.928181214 +0000 UTC m=+1.800968348" lastFinishedPulling="2026-05-20 13:50:10.167533894 +0000 UTC m=+20.040321045" observedRunningTime="2026-05-20 13:50:11.933242658 +0000 UTC m=+21.806029815" watchObservedRunningTime="2026-05-20 13:50:11.934046986 +0000 UTC m=+21.806834142"
May 20 13:50:12.644799 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:12.644712    2571 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-20T13:50:11.873417167Z","UUID":"dfe0f6e2-1052-4762-b6d6-e9b40db52145","Handler":null,"Name":"","Endpoint":""}
May 20 13:50:12.647546 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:12.647521    2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 20 13:50:12.647691 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:12.647556    2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 20 13:50:12.860547 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:12.860472    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmwjr" event={"ID":"69bab5d8-9702-4c77-b23e-f9a7310d983c","Type":"ContainerStarted","Data":"9855ed33a95b09e8bc0e2fd5314b58f7b2d62b33b127bd3174379a5ca40c0bab"}
May 20 13:50:12.860547 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:12.860513    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmwjr" event={"ID":"69bab5d8-9702-4c77-b23e-f9a7310d983c","Type":"ContainerStarted","Data":"61d6b3cec0bf2f18e74e62ea21ff67d88f6e2d25e49b17d6c95ab2b21d9aac85"}
May 20 13:50:12.862336 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:12.862022    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-144.ec2.internal" event={"ID":"0e619104d9ea30333bb983da7ab1a496","Type":"ContainerStarted","Data":"8e78a593bc820297d90d7b003f1b372e9dd81d44f82e89c0c7cd68de6dd5f092"}
May 20 13:50:12.878562 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:12.878522    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmwjr" podStartSLOduration=2.208020165 podStartE2EDuration="22.878505584s" podCreationTimestamp="2026-05-20 13:49:50 +0000 UTC" firstStartedPulling="2026-05-20 13:49:51.898639883 +0000 UTC m=+1.771427017" lastFinishedPulling="2026-05-20 13:50:12.569125288 +0000 UTC m=+22.441912436" observedRunningTime="2026-05-20 13:50:12.8778718 +0000 UTC m=+22.750658956" watchObservedRunningTime="2026-05-20 13:50:12.878505584 +0000 UTC m=+22.751292754"
May 20 13:50:12.896911 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:12.896874    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-144.ec2.internal" podStartSLOduration=22.896861931 podStartE2EDuration="22.896861931s" podCreationTimestamp="2026-05-20 13:49:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 13:50:12.896573376 +0000 UTC m=+22.769360536" watchObservedRunningTime="2026-05-20 13:50:12.896861931 +0000 UTC m=+22.769649086"
May 20 13:50:12.994923 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:12.994898    2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gmcz8"
May 20 13:50:12.995622 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:12.995601    2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gmcz8"
May 20 13:50:13.661544 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:13.661513    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcdw"
May 20 13:50:13.661696 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:13.661552    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhqmq"
May 20 13:50:13.661696 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:13.661636    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbcdw" podUID="9428938d-ef32-4fe7-9138-aca8852fdefe"
May 20 13:50:13.661940 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:13.661902    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhqmq" podUID="96bd478e-69c0-43e6-8df1-d6f775d6c864"
May 20 13:50:13.866796 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:13.866753    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-crztq" event={"ID":"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b","Type":"ContainerStarted","Data":"f0b2e361b31d3dabf63cecb13a21d191a3bbb929f59061525bd458be826bb4de"}
May 20 13:50:13.870299 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:13.870274    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gmcz8"
May 20 13:50:13.870417 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:13.870375    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gmcz8"
May 20 13:50:15.662289 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:15.662068    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhqmq"
May 20 13:50:15.662709 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:15.662068    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcdw"
May 20 13:50:15.662709 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:15.662390    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhqmq" podUID="96bd478e-69c0-43e6-8df1-d6f775d6c864"
May 20 13:50:15.662709 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:15.662475    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbcdw" podUID="9428938d-ef32-4fe7-9138-aca8852fdefe"
May 20 13:50:15.874047 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:15.873904    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-crztq" event={"ID":"86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b","Type":"ContainerStarted","Data":"61e22783543bb5e7c5746f8cfcd6b77b48c2271a8cc63cef4a33cbae1c670cbc"}
May 20 13:50:15.874290 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:15.874270    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:50:15.888721 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:15.888607    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:50:15.902448 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:15.902317    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-crztq" podStartSLOduration=6.937718036 podStartE2EDuration="25.902302832s" podCreationTimestamp="2026-05-20 13:49:50 +0000 UTC" firstStartedPulling="2026-05-20 13:49:51.937382788 +0000 UTC m=+1.810169922" lastFinishedPulling="2026-05-20 13:50:10.901967577 +0000 UTC m=+20.774754718" observedRunningTime="2026-05-20 13:50:15.901674029 +0000 UTC m=+25.774461185" watchObservedRunningTime="2026-05-20 13:50:15.902302832 +0000 UTC m=+25.775089988"
May 20 13:50:16.877448 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:16.877246    2571 generic.go:358] "Generic (PLEG): container finished" podID="7fb2aae9-8e70-4380-b813-b15da35d6bb4" containerID="29272af22cbb4418cfb6ed6a1bdce108ed511269157036cb0daddb13fc94152a" exitCode=0
May 20 13:50:16.877448 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:16.877335    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p86kx" event={"ID":"7fb2aae9-8e70-4380-b813-b15da35d6bb4","Type":"ContainerDied","Data":"29272af22cbb4418cfb6ed6a1bdce108ed511269157036cb0daddb13fc94152a"}
May 20 13:50:16.878422 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:16.878002    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:50:16.878422 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:16.878024    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:50:16.894480 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:16.894457    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:50:17.661532 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:17.661503    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcdw"
May 20 13:50:17.661673 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:17.661503    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhqmq"
May 20 13:50:17.661673 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:17.661593    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbcdw" podUID="9428938d-ef32-4fe7-9138-aca8852fdefe"
May 20 13:50:17.661673 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:17.661668    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhqmq" podUID="96bd478e-69c0-43e6-8df1-d6f775d6c864"
May 20 13:50:17.776280 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:17.776253    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zhqmq"]
May 20 13:50:17.776847 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:17.776779    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lbcdw"]
May 20 13:50:17.881301 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:17.881245    2571 generic.go:358] "Generic (PLEG): container finished" podID="7fb2aae9-8e70-4380-b813-b15da35d6bb4" containerID="da2d82bb27cb9cf02d08ebad06389b3230271a9928cf09077e6a52335696e804" exitCode=0
May 20 13:50:17.881647 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:17.881342    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p86kx" event={"ID":"7fb2aae9-8e70-4380-b813-b15da35d6bb4","Type":"ContainerDied","Data":"da2d82bb27cb9cf02d08ebad06389b3230271a9928cf09077e6a52335696e804"}
May 20 13:50:17.881647 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:17.881433    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhqmq"
May 20 13:50:17.881647 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:17.881579    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcdw"
May 20 13:50:17.881647 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:17.881582    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhqmq" podUID="96bd478e-69c0-43e6-8df1-d6f775d6c864"
May 20 13:50:17.882357 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:17.882031    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbcdw" podUID="9428938d-ef32-4fe7-9138-aca8852fdefe"
May 20 13:50:18.885856 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:18.885820    2571 generic.go:358] "Generic (PLEG): container finished" podID="7fb2aae9-8e70-4380-b813-b15da35d6bb4" containerID="40877141cb9be732dbc31819b839bb2a75d5f5f55a22652e9ce82b7a7e888ec3" exitCode=0
May 20 13:50:18.886248 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:18.885900    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p86kx" event={"ID":"7fb2aae9-8e70-4380-b813-b15da35d6bb4","Type":"ContainerDied","Data":"40877141cb9be732dbc31819b839bb2a75d5f5f55a22652e9ce82b7a7e888ec3"}
May 20 13:50:19.661498 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:19.661468    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcdw"
May 20 13:50:19.661602 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:19.661468    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhqmq"
May 20 13:50:19.661602 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:19.661566    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbcdw" podUID="9428938d-ef32-4fe7-9138-aca8852fdefe"
May 20 13:50:19.661718 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:19.661642    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhqmq" podUID="96bd478e-69c0-43e6-8df1-d6f775d6c864"
May 20 13:50:20.718911 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:20.718876    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-qmxrv"]
May 20 13:50:20.721550 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:20.721531    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qmxrv"
May 20 13:50:20.721733 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:20.721597    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qmxrv" podUID="58bb5787-36d9-4965-928a-80631bd54fed"
May 20 13:50:20.730319 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:20.730297    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qmxrv"]
May 20 13:50:20.802744 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:20.802720    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/58bb5787-36d9-4965-928a-80631bd54fed-dbus\") pod \"global-pull-secret-syncer-qmxrv\" (UID: \"58bb5787-36d9-4965-928a-80631bd54fed\") " pod="kube-system/global-pull-secret-syncer-qmxrv"
May 20 13:50:20.802854 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:20.802780    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58bb5787-36d9-4965-928a-80631bd54fed-original-pull-secret\") pod \"global-pull-secret-syncer-qmxrv\" (UID: \"58bb5787-36d9-4965-928a-80631bd54fed\") " pod="kube-system/global-pull-secret-syncer-qmxrv"
May 20 13:50:20.802854 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:20.802836    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/58bb5787-36d9-4965-928a-80631bd54fed-kubelet-config\") pod \"global-pull-secret-syncer-qmxrv\" (UID: \"58bb5787-36d9-4965-928a-80631bd54fed\") " pod="kube-system/global-pull-secret-syncer-qmxrv"
May 20 13:50:20.889255 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:20.889234    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qmxrv"
May 20 13:50:20.889346 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:20.889334    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qmxrv" podUID="58bb5787-36d9-4965-928a-80631bd54fed"
May 20 13:50:20.903410 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:20.903379    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58bb5787-36d9-4965-928a-80631bd54fed-original-pull-secret\") pod \"global-pull-secret-syncer-qmxrv\" (UID: \"58bb5787-36d9-4965-928a-80631bd54fed\") " pod="kube-system/global-pull-secret-syncer-qmxrv"
May 20 13:50:20.903516 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:20.903431    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/58bb5787-36d9-4965-928a-80631bd54fed-kubelet-config\") pod \"global-pull-secret-syncer-qmxrv\" (UID: \"58bb5787-36d9-4965-928a-80631bd54fed\") " pod="kube-system/global-pull-secret-syncer-qmxrv"
May 20 13:50:20.903516 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:20.903497    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/58bb5787-36d9-4965-928a-80631bd54fed-dbus\") pod \"global-pull-secret-syncer-qmxrv\" (UID: \"58bb5787-36d9-4965-928a-80631bd54fed\") " pod="kube-system/global-pull-secret-syncer-qmxrv"
May 20 13:50:20.903620 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:20.903504    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/58bb5787-36d9-4965-928a-80631bd54fed-kubelet-config\") pod \"global-pull-secret-syncer-qmxrv\" (UID: \"58bb5787-36d9-4965-928a-80631bd54fed\") " pod="kube-system/global-pull-secret-syncer-qmxrv"
May 20 13:50:20.903620 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:20.903577    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 13:50:20.903713 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:20.903638    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58bb5787-36d9-4965-928a-80631bd54fed-original-pull-secret podName:58bb5787-36d9-4965-928a-80631bd54fed nodeName:}" failed. No retries permitted until 2026-05-20 13:50:21.403619014 +0000 UTC m=+31.276406151 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58bb5787-36d9-4965-928a-80631bd54fed-original-pull-secret") pod "global-pull-secret-syncer-qmxrv" (UID: "58bb5787-36d9-4965-928a-80631bd54fed") : object "kube-system"/"original-pull-secret" not registered
May 20 13:50:20.903713 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:20.903706    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/58bb5787-36d9-4965-928a-80631bd54fed-dbus\") pod \"global-pull-secret-syncer-qmxrv\" (UID: \"58bb5787-36d9-4965-928a-80631bd54fed\") " pod="kube-system/global-pull-secret-syncer-qmxrv"
May 20 13:50:21.408028 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:21.407995    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58bb5787-36d9-4965-928a-80631bd54fed-original-pull-secret\") pod \"global-pull-secret-syncer-qmxrv\" (UID: \"58bb5787-36d9-4965-928a-80631bd54fed\") " pod="kube-system/global-pull-secret-syncer-qmxrv"
May 20 13:50:21.408196 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:21.408121    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 13:50:21.408196 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:21.408176    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58bb5787-36d9-4965-928a-80631bd54fed-original-pull-secret podName:58bb5787-36d9-4965-928a-80631bd54fed nodeName:}" failed. No retries permitted until 2026-05-20 13:50:22.408159418 +0000 UTC m=+32.280946553 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58bb5787-36d9-4965-928a-80631bd54fed-original-pull-secret") pod "global-pull-secret-syncer-qmxrv" (UID: "58bb5787-36d9-4965-928a-80631bd54fed") : object "kube-system"/"original-pull-secret" not registered
May 20 13:50:21.661980 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:21.661894    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcdw"
May 20 13:50:21.662118 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:21.662027    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbcdw" podUID="9428938d-ef32-4fe7-9138-aca8852fdefe"
May 20 13:50:21.662118 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:21.662090    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhqmq"
May 20 13:50:21.662226 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:21.662207    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhqmq" podUID="96bd478e-69c0-43e6-8df1-d6f775d6c864"
May 20 13:50:22.415802 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:22.415637    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58bb5787-36d9-4965-928a-80631bd54fed-original-pull-secret\") pod \"global-pull-secret-syncer-qmxrv\" (UID: \"58bb5787-36d9-4965-928a-80631bd54fed\") " pod="kube-system/global-pull-secret-syncer-qmxrv"
May 20 13:50:22.416165 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:22.415807    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 13:50:22.416165 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:22.415866    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58bb5787-36d9-4965-928a-80631bd54fed-original-pull-secret podName:58bb5787-36d9-4965-928a-80631bd54fed nodeName:}" failed. No retries permitted until 2026-05-20 13:50:24.415850836 +0000 UTC m=+34.288637975 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58bb5787-36d9-4965-928a-80631bd54fed-original-pull-secret") pod "global-pull-secret-syncer-qmxrv" (UID: "58bb5787-36d9-4965-928a-80631bd54fed") : object "kube-system"/"original-pull-secret" not registered
May 20 13:50:22.661793 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:22.661719    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qmxrv"
May 20 13:50:22.661952 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:22.661847    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qmxrv" podUID="58bb5787-36d9-4965-928a-80631bd54fed"
May 20 13:50:23.323224 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:23.323192    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96bd478e-69c0-43e6-8df1-d6f775d6c864-metrics-certs\") pod \"network-metrics-daemon-zhqmq\" (UID: \"96bd478e-69c0-43e6-8df1-d6f775d6c864\") " pod="openshift-multus/network-metrics-daemon-zhqmq"
May 20 13:50:23.323406 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:23.323316    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 13:50:23.323406 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:23.323381    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96bd478e-69c0-43e6-8df1-d6f775d6c864-metrics-certs podName:96bd478e-69c0-43e6-8df1-d6f775d6c864 nodeName:}" failed. No retries permitted until 2026-05-20 13:50:55.323362667 +0000 UTC m=+65.196149814 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96bd478e-69c0-43e6-8df1-d6f775d6c864-metrics-certs") pod "network-metrics-daemon-zhqmq" (UID: "96bd478e-69c0-43e6-8df1-d6f775d6c864") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 13:50:23.423624 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:23.423597    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wpzgn\" (UniqueName: \"kubernetes.io/projected/9428938d-ef32-4fe7-9138-aca8852fdefe-kube-api-access-wpzgn\") pod \"network-check-target-lbcdw\" (UID: \"9428938d-ef32-4fe7-9138-aca8852fdefe\") " pod="openshift-network-diagnostics/network-check-target-lbcdw"
May 20 13:50:23.424052 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:23.423716    2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 13:50:23.424052 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:23.423735    2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 13:50:23.424052 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:23.423746    2571 projected.go:194] Error preparing data for projected volume kube-api-access-wpzgn for pod openshift-network-diagnostics/network-check-target-lbcdw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 13:50:23.424052 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:23.423798    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9428938d-ef32-4fe7-9138-aca8852fdefe-kube-api-access-wpzgn podName:9428938d-ef32-4fe7-9138-aca8852fdefe nodeName:}" failed. No retries permitted until 2026-05-20 13:50:55.423781265 +0000 UTC m=+65.296568410 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wpzgn" (UniqueName: "kubernetes.io/projected/9428938d-ef32-4fe7-9138-aca8852fdefe-kube-api-access-wpzgn") pod "network-check-target-lbcdw" (UID: "9428938d-ef32-4fe7-9138-aca8852fdefe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 13:50:23.662081 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:23.661997    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcdw"
May 20 13:50:23.662081 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:23.662037    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhqmq"
May 20 13:50:23.662294 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:23.662114    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbcdw" podUID="9428938d-ef32-4fe7-9138-aca8852fdefe"
May 20 13:50:23.662294 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:23.662269    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhqmq" podUID="96bd478e-69c0-43e6-8df1-d6f775d6c864"
May 20 13:50:24.422171 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:24.422102    2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-144.ec2.internal" event="NodeReady"
May 20 13:50:24.422321 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:24.422232    2571 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 20 13:50:24.431450 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:24.431421    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58bb5787-36d9-4965-928a-80631bd54fed-original-pull-secret\") pod \"global-pull-secret-syncer-qmxrv\" (UID: \"58bb5787-36d9-4965-928a-80631bd54fed\") " pod="kube-system/global-pull-secret-syncer-qmxrv"
May 20 13:50:24.431769 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:24.431558    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 13:50:24.431769 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:24.431608    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58bb5787-36d9-4965-928a-80631bd54fed-original-pull-secret podName:58bb5787-36d9-4965-928a-80631bd54fed nodeName:}" failed. No retries permitted until 2026-05-20 13:50:28.431594483 +0000 UTC m=+38.304381622 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58bb5787-36d9-4965-928a-80631bd54fed-original-pull-secret") pod "global-pull-secret-syncer-qmxrv" (UID: "58bb5787-36d9-4965-928a-80631bd54fed") : object "kube-system"/"original-pull-secret" not registered
May 20 13:50:24.470482 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:24.470452    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-b64ll"]
May 20 13:50:24.499844 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:24.499820    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9lhwc"]
May 20 13:50:24.499956 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:24.499926    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b64ll"
May 20 13:50:24.502406 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:24.502377    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 20 13:50:24.502547 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:24.502470    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 20 13:50:24.503378 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:24.503233    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wmcgw\""
May 20 13:50:24.518089 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:24.518072    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b64ll"]
May 20 13:50:24.518089 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:24.518091    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9lhwc"]
May 20 13:50:24.518200 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:24.518162    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9lhwc"
May 20 13:50:24.521825 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:24.521805    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 20 13:50:24.521958 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:24.521919    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8tpd8\""
May 20 13:50:24.521958 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:24.521957    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 20 13:50:24.522087 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:24.522062    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 20 13:50:24.632810 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:24.632792    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/465db268-d10e-4f15-937a-0ff0f966b831-tmp-dir\") pod \"dns-default-b64ll\" (UID: \"465db268-d10e-4f15-937a-0ff0f966b831\") " pod="openshift-dns/dns-default-b64ll"
May 20 13:50:24.632914 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:24.632819    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/465db268-d10e-4f15-937a-0ff0f966b831-config-volume\") pod \"dns-default-b64ll\" (UID: \"465db268-d10e-4f15-937a-0ff0f966b831\") " pod="openshift-dns/dns-default-b64ll"
May 20 13:50:24.632914 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:24.632837    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/465db268-d10e-4f15-937a-0ff0f966b831-metrics-tls\") pod \"dns-default-b64ll\" (UID: \"465db268-d10e-4f15-937a-0ff0f966b831\") " pod="openshift-dns/dns-default-b64ll"
May 20 13:50:24.632914 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:24.632851    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7mcw\" (UniqueName: \"kubernetes.io/projected/2605e754-d0c5-49d1-87e4-d0d4b0f4088e-kube-api-access-w7mcw\") pod \"ingress-canary-9lhwc\" (UID: \"2605e754-d0c5-49d1-87e4-d0d4b0f4088e\") " pod="openshift-ingress-canary/ingress-canary-9lhwc"
May 20 13:50:24.632914 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:24.632872    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzbhr\" (UniqueName: \"kubernetes.io/projected/465db268-d10e-4f15-937a-0ff0f966b831-kube-api-access-gzbhr\") pod \"dns-default-b64ll\" (UID: \"465db268-d10e-4f15-937a-0ff0f966b831\") " pod="openshift-dns/dns-default-b64ll"
May 20 13:50:24.633072 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:24.632959    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2605e754-d0c5-49d1-87e4-d0d4b0f4088e-cert\") pod \"ingress-canary-9lhwc\" (UID: \"2605e754-d0c5-49d1-87e4-d0d4b0f4088e\") " pod="openshift-ingress-canary/ingress-canary-9lhwc"
May 20 13:50:24.662248 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:24.662228    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qmxrv"
May 20 13:50:24.664777 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:24.664760    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 20 13:50:24.734196 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:24.734173    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/465db268-d10e-4f15-937a-0ff0f966b831-metrics-tls\") pod \"dns-default-b64ll\" (UID: \"465db268-d10e-4f15-937a-0ff0f966b831\") " pod="openshift-dns/dns-default-b64ll"
May 20 13:50:24.734283 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:24.734199    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w7mcw\" (UniqueName: \"kubernetes.io/projected/2605e754-d0c5-49d1-87e4-d0d4b0f4088e-kube-api-access-w7mcw\") pod \"ingress-canary-9lhwc\" (UID: \"2605e754-d0c5-49d1-87e4-d0d4b0f4088e\") " pod="openshift-ingress-canary/ingress-canary-9lhwc"
May 20 13:50:24.734283 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:24.734220    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gzbhr\" (UniqueName: \"kubernetes.io/projected/465db268-d10e-4f15-937a-0ff0f966b831-kube-api-access-gzbhr\") pod \"dns-default-b64ll\" (UID: \"465db268-d10e-4f15-937a-0ff0f966b831\") " pod="openshift-dns/dns-default-b64ll"
May 20 13:50:24.734283 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:24.734269    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2605e754-d0c5-49d1-87e4-d0d4b0f4088e-cert\") pod \"ingress-canary-9lhwc\" (UID: \"2605e754-d0c5-49d1-87e4-d0d4b0f4088e\") " pod="openshift-ingress-canary/ingress-canary-9lhwc"
May 20 13:50:24.734417 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:24.734287    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/465db268-d10e-4f15-937a-0ff0f966b831-tmp-dir\") pod \"dns-default-b64ll\" (UID: \"465db268-d10e-4f15-937a-0ff0f966b831\") " pod="openshift-dns/dns-default-b64ll"
May 20 13:50:24.734417 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:24.734302    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/465db268-d10e-4f15-937a-0ff0f966b831-config-volume\") pod \"dns-default-b64ll\" (UID: \"465db268-d10e-4f15-937a-0ff0f966b831\") " pod="openshift-dns/dns-default-b64ll"
May 20 13:50:24.734417 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:24.734322    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 13:50:24.734417 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:24.734380    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/465db268-d10e-4f15-937a-0ff0f966b831-metrics-tls podName:465db268-d10e-4f15-937a-0ff0f966b831 nodeName:}" failed. No retries permitted until 2026-05-20 13:50:25.234360349 +0000 UTC m=+35.107147485 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/465db268-d10e-4f15-937a-0ff0f966b831-metrics-tls") pod "dns-default-b64ll" (UID: "465db268-d10e-4f15-937a-0ff0f966b831") : secret "dns-default-metrics-tls" not found
May 20 13:50:24.734417 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:24.734395    2571 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 13:50:24.734686 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:24.734453    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2605e754-d0c5-49d1-87e4-d0d4b0f4088e-cert podName:2605e754-d0c5-49d1-87e4-d0d4b0f4088e nodeName:}" failed. No retries permitted until 2026-05-20 13:50:25.234437864 +0000 UTC m=+35.107225015 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2605e754-d0c5-49d1-87e4-d0d4b0f4088e-cert") pod "ingress-canary-9lhwc" (UID: "2605e754-d0c5-49d1-87e4-d0d4b0f4088e") : secret "canary-serving-cert" not found
May 20 13:50:24.734686 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:24.734583    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/465db268-d10e-4f15-937a-0ff0f966b831-tmp-dir\") pod \"dns-default-b64ll\" (UID: \"465db268-d10e-4f15-937a-0ff0f966b831\") " pod="openshift-dns/dns-default-b64ll"
May 20 13:50:24.734851 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:24.734828    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/465db268-d10e-4f15-937a-0ff0f966b831-config-volume\") pod \"dns-default-b64ll\" (UID: \"465db268-d10e-4f15-937a-0ff0f966b831\") " pod="openshift-dns/dns-default-b64ll"
May 20 13:50:24.746491 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:24.746471    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7mcw\" (UniqueName: \"kubernetes.io/projected/2605e754-d0c5-49d1-87e4-d0d4b0f4088e-kube-api-access-w7mcw\") pod \"ingress-canary-9lhwc\" (UID: \"2605e754-d0c5-49d1-87e4-d0d4b0f4088e\") " pod="openshift-ingress-canary/ingress-canary-9lhwc"
May 20 13:50:24.746571 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:24.746498    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzbhr\" (UniqueName: \"kubernetes.io/projected/465db268-d10e-4f15-937a-0ff0f966b831-kube-api-access-gzbhr\") pod \"dns-default-b64ll\" (UID: \"465db268-d10e-4f15-937a-0ff0f966b831\") " pod="openshift-dns/dns-default-b64ll"
May 20 13:50:25.237298 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:25.237241    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/465db268-d10e-4f15-937a-0ff0f966b831-metrics-tls\") pod \"dns-default-b64ll\" (UID: \"465db268-d10e-4f15-937a-0ff0f966b831\") " pod="openshift-dns/dns-default-b64ll"
May 20 13:50:25.237384 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:25.237305    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2605e754-d0c5-49d1-87e4-d0d4b0f4088e-cert\") pod \"ingress-canary-9lhwc\" (UID: \"2605e754-d0c5-49d1-87e4-d0d4b0f4088e\") " pod="openshift-ingress-canary/ingress-canary-9lhwc"
May 20 13:50:25.237424 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:25.237386    2571 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 13:50:25.237424 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:25.237392    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 13:50:25.237484 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:25.237435    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2605e754-d0c5-49d1-87e4-d0d4b0f4088e-cert podName:2605e754-d0c5-49d1-87e4-d0d4b0f4088e nodeName:}" failed. No retries permitted until 2026-05-20 13:50:26.23742212 +0000 UTC m=+36.110209267 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2605e754-d0c5-49d1-87e4-d0d4b0f4088e-cert") pod "ingress-canary-9lhwc" (UID: "2605e754-d0c5-49d1-87e4-d0d4b0f4088e") : secret "canary-serving-cert" not found
May 20 13:50:25.237484 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:25.237447    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/465db268-d10e-4f15-937a-0ff0f966b831-metrics-tls podName:465db268-d10e-4f15-937a-0ff0f966b831 nodeName:}" failed. No retries permitted until 2026-05-20 13:50:26.23744222 +0000 UTC m=+36.110229353 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/465db268-d10e-4f15-937a-0ff0f966b831-metrics-tls") pod "dns-default-b64ll" (UID: "465db268-d10e-4f15-937a-0ff0f966b831") : secret "dns-default-metrics-tls" not found
May 20 13:50:25.662311 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:25.662251    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcdw"
May 20 13:50:25.662311 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:25.662261    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhqmq"
May 20 13:50:25.676454 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:25.676429    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 20 13:50:25.676583 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:25.676460    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d6bxt\""
May 20 13:50:25.676583 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:25.676506    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hvv45\""
May 20 13:50:25.676583 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:25.676528    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 20 13:50:25.676583 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:25.676569    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 20 13:50:25.901132 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:25.901105    2571 generic.go:358] "Generic (PLEG): container finished" podID="7fb2aae9-8e70-4380-b813-b15da35d6bb4" containerID="53904b036c9b788f8932aa3f67bd2d973b4021bbc4cd90d9860f221c3377783b" exitCode=0
May 20 13:50:25.901236 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:25.901142    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p86kx" event={"ID":"7fb2aae9-8e70-4380-b813-b15da35d6bb4","Type":"ContainerDied","Data":"53904b036c9b788f8932aa3f67bd2d973b4021bbc4cd90d9860f221c3377783b"}
May 20 13:50:26.243852 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:26.243831    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2605e754-d0c5-49d1-87e4-d0d4b0f4088e-cert\") pod \"ingress-canary-9lhwc\" (UID: \"2605e754-d0c5-49d1-87e4-d0d4b0f4088e\") " pod="openshift-ingress-canary/ingress-canary-9lhwc"
May 20 13:50:26.243987 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:26.243866    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/465db268-d10e-4f15-937a-0ff0f966b831-metrics-tls\") pod \"dns-default-b64ll\" (UID: \"465db268-d10e-4f15-937a-0ff0f966b831\") " pod="openshift-dns/dns-default-b64ll"
May 20 13:50:26.243987 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:26.243978    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 13:50:26.243987 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:26.243980    2571 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 13:50:26.244084 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:26.244026    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/465db268-d10e-4f15-937a-0ff0f966b831-metrics-tls podName:465db268-d10e-4f15-937a-0ff0f966b831 nodeName:}" failed. No retries permitted until 2026-05-20 13:50:28.244010812 +0000 UTC m=+38.116797946 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/465db268-d10e-4f15-937a-0ff0f966b831-metrics-tls") pod "dns-default-b64ll" (UID: "465db268-d10e-4f15-937a-0ff0f966b831") : secret "dns-default-metrics-tls" not found
May 20 13:50:26.244084 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:26.244038    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2605e754-d0c5-49d1-87e4-d0d4b0f4088e-cert podName:2605e754-d0c5-49d1-87e4-d0d4b0f4088e nodeName:}" failed. No retries permitted until 2026-05-20 13:50:28.244032491 +0000 UTC m=+38.116819625 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2605e754-d0c5-49d1-87e4-d0d4b0f4088e-cert") pod "ingress-canary-9lhwc" (UID: "2605e754-d0c5-49d1-87e4-d0d4b0f4088e") : secret "canary-serving-cert" not found
May 20 13:50:26.905066 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:26.905038    2571 generic.go:358] "Generic (PLEG): container finished" podID="7fb2aae9-8e70-4380-b813-b15da35d6bb4" containerID="493cf24fd52c9f0b12665c0dc0ff3d05083490dd62dd2a6fa135bfb6b3fb47fe" exitCode=0
May 20 13:50:26.905593 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:26.905087    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p86kx" event={"ID":"7fb2aae9-8e70-4380-b813-b15da35d6bb4","Type":"ContainerDied","Data":"493cf24fd52c9f0b12665c0dc0ff3d05083490dd62dd2a6fa135bfb6b3fb47fe"}
May 20 13:50:27.910678 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:27.910636    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p86kx" event={"ID":"7fb2aae9-8e70-4380-b813-b15da35d6bb4","Type":"ContainerStarted","Data":"2b821e380686d31079d518e626fd7525ae1509798bcd9d64524a4a813228edca"}
May 20 13:50:27.934125 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:27.934077    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-p86kx" podStartSLOduration=5.035543661 podStartE2EDuration="37.934062182s" podCreationTimestamp="2026-05-20 13:49:50 +0000 UTC" firstStartedPulling="2026-05-20 13:49:51.965362244 +0000 UTC m=+1.838149378" lastFinishedPulling="2026-05-20 13:50:24.863880762 +0000 UTC m=+34.736667899" observedRunningTime="2026-05-20 13:50:27.933081998 +0000 UTC m=+37.805869154" watchObservedRunningTime="2026-05-20 13:50:27.934062182 +0000 UTC m=+37.806849317"
May 20 13:50:28.257962 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:28.257917    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2605e754-d0c5-49d1-87e4-d0d4b0f4088e-cert\") pod \"ingress-canary-9lhwc\" (UID: \"2605e754-d0c5-49d1-87e4-d0d4b0f4088e\") " pod="openshift-ingress-canary/ingress-canary-9lhwc"
May 20 13:50:28.258096 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:28.257981    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/465db268-d10e-4f15-937a-0ff0f966b831-metrics-tls\") pod \"dns-default-b64ll\" (UID: \"465db268-d10e-4f15-937a-0ff0f966b831\") " pod="openshift-dns/dns-default-b64ll"
May 20 13:50:28.258096 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:28.258040    2571 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 13:50:28.258213 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:28.258101    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2605e754-d0c5-49d1-87e4-d0d4b0f4088e-cert podName:2605e754-d0c5-49d1-87e4-d0d4b0f4088e nodeName:}" failed. No retries permitted until 2026-05-20 13:50:32.258085642 +0000 UTC m=+42.130872836 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2605e754-d0c5-49d1-87e4-d0d4b0f4088e-cert") pod "ingress-canary-9lhwc" (UID: "2605e754-d0c5-49d1-87e4-d0d4b0f4088e") : secret "canary-serving-cert" not found
May 20 13:50:28.258213 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:28.258124    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 13:50:28.258213 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:28.258208    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/465db268-d10e-4f15-937a-0ff0f966b831-metrics-tls podName:465db268-d10e-4f15-937a-0ff0f966b831 nodeName:}" failed. No retries permitted until 2026-05-20 13:50:32.258187807 +0000 UTC m=+42.130974995 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/465db268-d10e-4f15-937a-0ff0f966b831-metrics-tls") pod "dns-default-b64ll" (UID: "465db268-d10e-4f15-937a-0ff0f966b831") : secret "dns-default-metrics-tls" not found
May 20 13:50:28.459871 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:28.459843    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58bb5787-36d9-4965-928a-80631bd54fed-original-pull-secret\") pod \"global-pull-secret-syncer-qmxrv\" (UID: \"58bb5787-36d9-4965-928a-80631bd54fed\") " pod="kube-system/global-pull-secret-syncer-qmxrv"
May 20 13:50:28.462455 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:28.462425    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58bb5787-36d9-4965-928a-80631bd54fed-original-pull-secret\") pod \"global-pull-secret-syncer-qmxrv\" (UID: \"58bb5787-36d9-4965-928a-80631bd54fed\") " pod="kube-system/global-pull-secret-syncer-qmxrv"
May 20 13:50:28.570036 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:28.569858    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qmxrv"
May 20 13:50:28.703113 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:28.703087    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qmxrv"]
May 20 13:50:28.706250 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:50:28.706219    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58bb5787_36d9_4965_928a_80631bd54fed.slice/crio-a85e5e18299bf1fb165a6cf34cb7684887c315c86b8f3788cbd18e4605f4b3b8 WatchSource:0}: Error finding container a85e5e18299bf1fb165a6cf34cb7684887c315c86b8f3788cbd18e4605f4b3b8: Status 404 returned error can't find the container with id a85e5e18299bf1fb165a6cf34cb7684887c315c86b8f3788cbd18e4605f4b3b8
May 20 13:50:28.913533 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:28.913472    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qmxrv" event={"ID":"58bb5787-36d9-4965-928a-80631bd54fed","Type":"ContainerStarted","Data":"a85e5e18299bf1fb165a6cf34cb7684887c315c86b8f3788cbd18e4605f4b3b8"}
May 20 13:50:32.289869 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:32.289831    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2605e754-d0c5-49d1-87e4-d0d4b0f4088e-cert\") pod \"ingress-canary-9lhwc\" (UID: \"2605e754-d0c5-49d1-87e4-d0d4b0f4088e\") " pod="openshift-ingress-canary/ingress-canary-9lhwc"
May 20 13:50:32.289869 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:32.289874    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/465db268-d10e-4f15-937a-0ff0f966b831-metrics-tls\") pod \"dns-default-b64ll\" (UID: \"465db268-d10e-4f15-937a-0ff0f966b831\") " pod="openshift-dns/dns-default-b64ll"
May 20 13:50:32.290267 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:32.289981    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 13:50:32.290267 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:32.289984    2571 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 13:50:32.290267 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:32.290036    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/465db268-d10e-4f15-937a-0ff0f966b831-metrics-tls podName:465db268-d10e-4f15-937a-0ff0f966b831 nodeName:}" failed. No retries permitted until 2026-05-20 13:50:40.290019379 +0000 UTC m=+50.162806513 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/465db268-d10e-4f15-937a-0ff0f966b831-metrics-tls") pod "dns-default-b64ll" (UID: "465db268-d10e-4f15-937a-0ff0f966b831") : secret "dns-default-metrics-tls" not found
May 20 13:50:32.290267 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:32.290049    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2605e754-d0c5-49d1-87e4-d0d4b0f4088e-cert podName:2605e754-d0c5-49d1-87e4-d0d4b0f4088e nodeName:}" failed. No retries permitted until 2026-05-20 13:50:40.290043321 +0000 UTC m=+50.162830455 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2605e754-d0c5-49d1-87e4-d0d4b0f4088e-cert") pod "ingress-canary-9lhwc" (UID: "2605e754-d0c5-49d1-87e4-d0d4b0f4088e") : secret "canary-serving-cert" not found
May 20 13:50:32.923002 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:32.922899    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qmxrv" event={"ID":"58bb5787-36d9-4965-928a-80631bd54fed","Type":"ContainerStarted","Data":"3c9745f366da4cc14332b818b3fc666a5247197a2e83c92ff9c315251428bee9"}
May 20 13:50:32.939452 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:32.939384    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qmxrv" podStartSLOduration=9.155968098 podStartE2EDuration="12.939361953s" podCreationTimestamp="2026-05-20 13:50:20 +0000 UTC" firstStartedPulling="2026-05-20 13:50:28.707957021 +0000 UTC m=+38.580744155" lastFinishedPulling="2026-05-20 13:50:32.491350876 +0000 UTC m=+42.364138010" observedRunningTime="2026-05-20 13:50:32.938848788 +0000 UTC m=+42.811635945" watchObservedRunningTime="2026-05-20 13:50:32.939361953 +0000 UTC m=+42.812149108"
May 20 13:50:40.338903 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:40.338859    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/465db268-d10e-4f15-937a-0ff0f966b831-metrics-tls\") pod \"dns-default-b64ll\" (UID: \"465db268-d10e-4f15-937a-0ff0f966b831\") " pod="openshift-dns/dns-default-b64ll"
May 20 13:50:40.339420 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:40.338926    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2605e754-d0c5-49d1-87e4-d0d4b0f4088e-cert\") pod \"ingress-canary-9lhwc\" (UID: \"2605e754-d0c5-49d1-87e4-d0d4b0f4088e\") " pod="openshift-ingress-canary/ingress-canary-9lhwc"
May 20 13:50:40.339420 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:40.339038    2571 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 13:50:40.339420 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:40.339055    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 13:50:40.339420 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:40.339095    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2605e754-d0c5-49d1-87e4-d0d4b0f4088e-cert podName:2605e754-d0c5-49d1-87e4-d0d4b0f4088e nodeName:}" failed. No retries permitted until 2026-05-20 13:50:56.339079792 +0000 UTC m=+66.211866926 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2605e754-d0c5-49d1-87e4-d0d4b0f4088e-cert") pod "ingress-canary-9lhwc" (UID: "2605e754-d0c5-49d1-87e4-d0d4b0f4088e") : secret "canary-serving-cert" not found
May 20 13:50:40.339420 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:40.339121    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/465db268-d10e-4f15-937a-0ff0f966b831-metrics-tls podName:465db268-d10e-4f15-937a-0ff0f966b831 nodeName:}" failed. No retries permitted until 2026-05-20 13:50:56.339104605 +0000 UTC m=+66.211891744 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/465db268-d10e-4f15-937a-0ff0f966b831-metrics-tls") pod "dns-default-b64ll" (UID: "465db268-d10e-4f15-937a-0ff0f966b831") : secret "dns-default-metrics-tls" not found
May 20 13:50:48.906250 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:48.906219    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-crztq"
May 20 13:50:55.334588 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:55.334546    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96bd478e-69c0-43e6-8df1-d6f775d6c864-metrics-certs\") pod \"network-metrics-daemon-zhqmq\" (UID: \"96bd478e-69c0-43e6-8df1-d6f775d6c864\") " pod="openshift-multus/network-metrics-daemon-zhqmq"
May 20 13:50:55.337712 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:55.337690    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 20 13:50:55.344999 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:55.344980    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 20 13:50:55.345073 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:55.345036    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96bd478e-69c0-43e6-8df1-d6f775d6c864-metrics-certs podName:96bd478e-69c0-43e6-8df1-d6f775d6c864 nodeName:}" failed. No retries permitted until 2026-05-20 13:51:59.345020354 +0000 UTC m=+129.217807553 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96bd478e-69c0-43e6-8df1-d6f775d6c864-metrics-certs") pod "network-metrics-daemon-zhqmq" (UID: "96bd478e-69c0-43e6-8df1-d6f775d6c864") : secret "metrics-daemon-secret" not found
May 20 13:50:55.435042 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:55.435015    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wpzgn\" (UniqueName: \"kubernetes.io/projected/9428938d-ef32-4fe7-9138-aca8852fdefe-kube-api-access-wpzgn\") pod \"network-check-target-lbcdw\" (UID: \"9428938d-ef32-4fe7-9138-aca8852fdefe\") " pod="openshift-network-diagnostics/network-check-target-lbcdw"
May 20 13:50:55.438049 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:55.438028    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 20 13:50:55.448289 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:55.448271    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 20 13:50:55.459129 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:55.459107    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpzgn\" (UniqueName: \"kubernetes.io/projected/9428938d-ef32-4fe7-9138-aca8852fdefe-kube-api-access-wpzgn\") pod \"network-check-target-lbcdw\" (UID: \"9428938d-ef32-4fe7-9138-aca8852fdefe\") " pod="openshift-network-diagnostics/network-check-target-lbcdw"
May 20 13:50:55.674409 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:55.674356    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hvv45\""
May 20 13:50:55.683307 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:55.683286    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcdw"
May 20 13:50:55.819438 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:55.819409    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lbcdw"]
May 20 13:50:55.822321 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:50:55.822295    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9428938d_ef32_4fe7_9138_aca8852fdefe.slice/crio-57b80812defd17b91b061aa18374ce6fd516149301050152144d7958139ab65c WatchSource:0}: Error finding container 57b80812defd17b91b061aa18374ce6fd516149301050152144d7958139ab65c: Status 404 returned error can't find the container with id 57b80812defd17b91b061aa18374ce6fd516149301050152144d7958139ab65c
May 20 13:50:55.963489 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:55.963458    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lbcdw" event={"ID":"9428938d-ef32-4fe7-9138-aca8852fdefe","Type":"ContainerStarted","Data":"57b80812defd17b91b061aa18374ce6fd516149301050152144d7958139ab65c"}
May 20 13:50:56.343576 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:56.343506    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2605e754-d0c5-49d1-87e4-d0d4b0f4088e-cert\") pod \"ingress-canary-9lhwc\" (UID: \"2605e754-d0c5-49d1-87e4-d0d4b0f4088e\") " pod="openshift-ingress-canary/ingress-canary-9lhwc"
May 20 13:50:56.343576 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:56.343547    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/465db268-d10e-4f15-937a-0ff0f966b831-metrics-tls\") pod \"dns-default-b64ll\" (UID: \"465db268-d10e-4f15-937a-0ff0f966b831\") " pod="openshift-dns/dns-default-b64ll"
May 20 13:50:56.344035 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:56.343648    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 13:50:56.344035 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:56.343699    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/465db268-d10e-4f15-937a-0ff0f966b831-metrics-tls podName:465db268-d10e-4f15-937a-0ff0f966b831 nodeName:}" failed. No retries permitted until 2026-05-20 13:51:28.343686246 +0000 UTC m=+98.216473392 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/465db268-d10e-4f15-937a-0ff0f966b831-metrics-tls") pod "dns-default-b64ll" (UID: "465db268-d10e-4f15-937a-0ff0f966b831") : secret "dns-default-metrics-tls" not found
May 20 13:50:56.344035 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:56.343646    2571 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 13:50:56.344035 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:50:56.343772    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2605e754-d0c5-49d1-87e4-d0d4b0f4088e-cert podName:2605e754-d0c5-49d1-87e4-d0d4b0f4088e nodeName:}" failed. No retries permitted until 2026-05-20 13:51:28.343760969 +0000 UTC m=+98.216548107 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2605e754-d0c5-49d1-87e4-d0d4b0f4088e-cert") pod "ingress-canary-9lhwc" (UID: "2605e754-d0c5-49d1-87e4-d0d4b0f4088e") : secret "canary-serving-cert" not found
May 20 13:50:58.970443 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:58.970404    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lbcdw" event={"ID":"9428938d-ef32-4fe7-9138-aca8852fdefe","Type":"ContainerStarted","Data":"76025ed6050c9c2a4dc8f4a8da498e3b8c39276da155c4ef9ffb93f571c3acb5"}
May 20 13:50:58.970864 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:58.970567    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lbcdw"
May 20 13:50:58.987779 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:50:58.987737    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lbcdw" podStartSLOduration=66.457103405 podStartE2EDuration="1m8.987724783s" podCreationTimestamp="2026-05-20 13:49:50 +0000 UTC" firstStartedPulling="2026-05-20 13:50:55.823905655 +0000 UTC m=+65.696692793" lastFinishedPulling="2026-05-20 13:50:58.354527037 +0000 UTC m=+68.227314171" observedRunningTime="2026-05-20 13:50:58.987294597 +0000 UTC m=+68.860081753" watchObservedRunningTime="2026-05-20 13:50:58.987724783 +0000 UTC m=+68.860511940"
May 20 13:51:28.355404 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:51:28.355359    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2605e754-d0c5-49d1-87e4-d0d4b0f4088e-cert\") pod \"ingress-canary-9lhwc\" (UID: \"2605e754-d0c5-49d1-87e4-d0d4b0f4088e\") " pod="openshift-ingress-canary/ingress-canary-9lhwc"
May 20 13:51:28.355404 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:51:28.355408    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/465db268-d10e-4f15-937a-0ff0f966b831-metrics-tls\") pod \"dns-default-b64ll\" (UID: \"465db268-d10e-4f15-937a-0ff0f966b831\") " pod="openshift-dns/dns-default-b64ll"
May 20 13:51:28.355916 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:51:28.355506    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 13:51:28.355916 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:51:28.355511    2571 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 13:51:28.355916 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:51:28.355577    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/465db268-d10e-4f15-937a-0ff0f966b831-metrics-tls podName:465db268-d10e-4f15-937a-0ff0f966b831 nodeName:}" failed. No retries permitted until 2026-05-20 13:52:32.355561772 +0000 UTC m=+162.228348906 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/465db268-d10e-4f15-937a-0ff0f966b831-metrics-tls") pod "dns-default-b64ll" (UID: "465db268-d10e-4f15-937a-0ff0f966b831") : secret "dns-default-metrics-tls" not found
May 20 13:51:28.355916 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:51:28.355610    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2605e754-d0c5-49d1-87e4-d0d4b0f4088e-cert podName:2605e754-d0c5-49d1-87e4-d0d4b0f4088e nodeName:}" failed. No retries permitted until 2026-05-20 13:52:32.355594961 +0000 UTC m=+162.228382095 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2605e754-d0c5-49d1-87e4-d0d4b0f4088e-cert") pod "ingress-canary-9lhwc" (UID: "2605e754-d0c5-49d1-87e4-d0d4b0f4088e") : secret "canary-serving-cert" not found
May 20 13:51:29.974513 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:51:29.974480    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lbcdw"
May 20 13:51:59.362526 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:51:59.362488    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96bd478e-69c0-43e6-8df1-d6f775d6c864-metrics-certs\") pod \"network-metrics-daemon-zhqmq\" (UID: \"96bd478e-69c0-43e6-8df1-d6f775d6c864\") " pod="openshift-multus/network-metrics-daemon-zhqmq"
May 20 13:51:59.363073 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:51:59.362614    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 20 13:51:59.363073 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:51:59.362681    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96bd478e-69c0-43e6-8df1-d6f775d6c864-metrics-certs podName:96bd478e-69c0-43e6-8df1-d6f775d6c864 nodeName:}" failed. No retries permitted until 2026-05-20 13:54:01.362663965 +0000 UTC m=+251.235451099 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96bd478e-69c0-43e6-8df1-d6f775d6c864-metrics-certs") pod "network-metrics-daemon-zhqmq" (UID: "96bd478e-69c0-43e6-8df1-d6f775d6c864") : secret "metrics-daemon-secret" not found
May 20 13:52:03.514099 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.514060    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-ppgpb"]
May 20 13:52:03.516150 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.516129    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-ppgpb"
May 20 13:52:03.520520 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.520492    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
May 20 13:52:03.520669 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.520498    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 20 13:52:03.522807 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.522405    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 20 13:52:03.522807 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.522583    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
May 20 13:52:03.523121 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.523100    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-wvbn7\""
May 20 13:52:03.526915 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.526892    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
May 20 13:52:03.528856 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.528832    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-ppgpb"]
May 20 13:52:03.589510 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.589486    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzw6q\" (UniqueName: \"kubernetes.io/projected/496f0332-8b87-4f2e-b275-af4f3b0529fa-kube-api-access-tzw6q\") pod \"insights-operator-78bdfb888c-ppgpb\" (UID: \"496f0332-8b87-4f2e-b275-af4f3b0529fa\") " pod="openshift-insights/insights-operator-78bdfb888c-ppgpb"
May 20 13:52:03.589619 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.589600    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/496f0332-8b87-4f2e-b275-af4f3b0529fa-service-ca-bundle\") pod \"insights-operator-78bdfb888c-ppgpb\" (UID: \"496f0332-8b87-4f2e-b275-af4f3b0529fa\") " pod="openshift-insights/insights-operator-78bdfb888c-ppgpb"
May 20 13:52:03.589662 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.589631    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/496f0332-8b87-4f2e-b275-af4f3b0529fa-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-ppgpb\" (UID: \"496f0332-8b87-4f2e-b275-af4f3b0529fa\") " pod="openshift-insights/insights-operator-78bdfb888c-ppgpb"
May 20 13:52:03.589662 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.589654    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/496f0332-8b87-4f2e-b275-af4f3b0529fa-serving-cert\") pod \"insights-operator-78bdfb888c-ppgpb\" (UID: \"496f0332-8b87-4f2e-b275-af4f3b0529fa\") " pod="openshift-insights/insights-operator-78bdfb888c-ppgpb"
May 20 13:52:03.589729 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.589673    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/496f0332-8b87-4f2e-b275-af4f3b0529fa-snapshots\") pod \"insights-operator-78bdfb888c-ppgpb\" (UID: \"496f0332-8b87-4f2e-b275-af4f3b0529fa\") " pod="openshift-insights/insights-operator-78bdfb888c-ppgpb"
May 20 13:52:03.589729 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.589694    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/496f0332-8b87-4f2e-b275-af4f3b0529fa-tmp\") pod \"insights-operator-78bdfb888c-ppgpb\" (UID: \"496f0332-8b87-4f2e-b275-af4f3b0529fa\") " pod="openshift-insights/insights-operator-78bdfb888c-ppgpb"
May 20 13:52:03.623808 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.623784    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-9bc4w"]
May 20 13:52:03.625693 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.625676    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9bc4w"
May 20 13:52:03.629364 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.629338    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 20 13:52:03.630316 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.630285    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
May 20 13:52:03.630486 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.630461    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4699m\""
May 20 13:52:03.631013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.630989    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 20 13:52:03.631134 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.631107    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
May 20 13:52:03.647723 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.647701    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-9bc4w"]
May 20 13:52:03.690482 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.690463    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tzw6q\" (UniqueName: \"kubernetes.io/projected/496f0332-8b87-4f2e-b275-af4f3b0529fa-kube-api-access-tzw6q\") pod \"insights-operator-78bdfb888c-ppgpb\" (UID: \"496f0332-8b87-4f2e-b275-af4f3b0529fa\") " pod="openshift-insights/insights-operator-78bdfb888c-ppgpb"
May 20 13:52:03.690593 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.690517    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/011983a7-38e4-4e05-bace-2205c8447d2e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-9bc4w\" (UID: \"011983a7-38e4-4e05-bace-2205c8447d2e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9bc4w"
May 20 13:52:03.690593 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.690556    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/496f0332-8b87-4f2e-b275-af4f3b0529fa-service-ca-bundle\") pod \"insights-operator-78bdfb888c-ppgpb\" (UID: \"496f0332-8b87-4f2e-b275-af4f3b0529fa\") " pod="openshift-insights/insights-operator-78bdfb888c-ppgpb"
May 20 13:52:03.690701 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.690680    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/496f0332-8b87-4f2e-b275-af4f3b0529fa-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-ppgpb\" (UID: \"496f0332-8b87-4f2e-b275-af4f3b0529fa\") " pod="openshift-insights/insights-operator-78bdfb888c-ppgpb"
May 20 13:52:03.690759 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.690712    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/496f0332-8b87-4f2e-b275-af4f3b0529fa-serving-cert\") pod \"insights-operator-78bdfb888c-ppgpb\" (UID: \"496f0332-8b87-4f2e-b275-af4f3b0529fa\") " pod="openshift-insights/insights-operator-78bdfb888c-ppgpb"
May 20 13:52:03.690759 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.690744    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpzsl\" (UniqueName: \"kubernetes.io/projected/011983a7-38e4-4e05-bace-2205c8447d2e-kube-api-access-bpzsl\") pod \"cluster-monitoring-operator-6c75959455-9bc4w\" (UID: \"011983a7-38e4-4e05-bace-2205c8447d2e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9bc4w"
May 20 13:52:03.690860 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.690765    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/496f0332-8b87-4f2e-b275-af4f3b0529fa-snapshots\") pod \"insights-operator-78bdfb888c-ppgpb\" (UID: \"496f0332-8b87-4f2e-b275-af4f3b0529fa\") " pod="openshift-insights/insights-operator-78bdfb888c-ppgpb"
May 20 13:52:03.690860 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.690781    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/011983a7-38e4-4e05-bace-2205c8447d2e-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-9bc4w\" (UID: \"011983a7-38e4-4e05-bace-2205c8447d2e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9bc4w"
May 20 13:52:03.690860 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.690801    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/496f0332-8b87-4f2e-b275-af4f3b0529fa-tmp\") pod \"insights-operator-78bdfb888c-ppgpb\" (UID: \"496f0332-8b87-4f2e-b275-af4f3b0529fa\") " pod="openshift-insights/insights-operator-78bdfb888c-ppgpb"
May 20 13:52:03.691150 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.691131    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/496f0332-8b87-4f2e-b275-af4f3b0529fa-service-ca-bundle\") pod \"insights-operator-78bdfb888c-ppgpb\" (UID: \"496f0332-8b87-4f2e-b275-af4f3b0529fa\") " pod="openshift-insights/insights-operator-78bdfb888c-ppgpb"
May 20 13:52:03.691321 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.691304    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/496f0332-8b87-4f2e-b275-af4f3b0529fa-tmp\") pod \"insights-operator-78bdfb888c-ppgpb\" (UID: \"496f0332-8b87-4f2e-b275-af4f3b0529fa\") " pod="openshift-insights/insights-operator-78bdfb888c-ppgpb"
May 20 13:52:03.691406 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.691388    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/496f0332-8b87-4f2e-b275-af4f3b0529fa-snapshots\") pod \"insights-operator-78bdfb888c-ppgpb\" (UID: \"496f0332-8b87-4f2e-b275-af4f3b0529fa\") " pod="openshift-insights/insights-operator-78bdfb888c-ppgpb"
May 20 13:52:03.691471 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.691453    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/496f0332-8b87-4f2e-b275-af4f3b0529fa-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-ppgpb\" (UID: \"496f0332-8b87-4f2e-b275-af4f3b0529fa\") " pod="openshift-insights/insights-operator-78bdfb888c-ppgpb"
May 20 13:52:03.693082 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.693063    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/496f0332-8b87-4f2e-b275-af4f3b0529fa-serving-cert\") pod \"insights-operator-78bdfb888c-ppgpb\" (UID: \"496f0332-8b87-4f2e-b275-af4f3b0529fa\") " pod="openshift-insights/insights-operator-78bdfb888c-ppgpb"
May 20 13:52:03.701583 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.701560    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzw6q\" (UniqueName: \"kubernetes.io/projected/496f0332-8b87-4f2e-b275-af4f3b0529fa-kube-api-access-tzw6q\") pod \"insights-operator-78bdfb888c-ppgpb\" (UID: \"496f0332-8b87-4f2e-b275-af4f3b0529fa\") " pod="openshift-insights/insights-operator-78bdfb888c-ppgpb"
May 20 13:52:03.731533 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.731509    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-65965b4c78-z2crt"]
May 20 13:52:03.733266 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.733253    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65965b4c78-z2crt"
May 20 13:52:03.736419 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.736402    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 20 13:52:03.736799 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.736783    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 20 13:52:03.736887 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.736872    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 20 13:52:03.737166 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.737153    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zqds7\""
May 20 13:52:03.743604 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.743586    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 20 13:52:03.750473 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.750456    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65965b4c78-z2crt"]
May 20 13:52:03.791337 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.791294    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f7493ea8-da00-412d-9904-69f5291dabaf-trusted-ca\") pod \"image-registry-65965b4c78-z2crt\" (UID: \"f7493ea8-da00-412d-9904-69f5291dabaf\") " pod="openshift-image-registry/image-registry-65965b4c78-z2crt"
May 20 13:52:03.791337 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.791323    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bpzsl\" (UniqueName: \"kubernetes.io/projected/011983a7-38e4-4e05-bace-2205c8447d2e-kube-api-access-bpzsl\") pod \"cluster-monitoring-operator-6c75959455-9bc4w\" (UID: \"011983a7-38e4-4e05-bace-2205c8447d2e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9bc4w"
May 20 13:52:03.791337 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.791342    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/011983a7-38e4-4e05-bace-2205c8447d2e-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-9bc4w\" (UID: \"011983a7-38e4-4e05-bace-2205c8447d2e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9bc4w"
May 20 13:52:03.791549 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.791364    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmrvt\" (UniqueName: \"kubernetes.io/projected/f7493ea8-da00-412d-9904-69f5291dabaf-kube-api-access-jmrvt\") pod \"image-registry-65965b4c78-z2crt\" (UID: \"f7493ea8-da00-412d-9904-69f5291dabaf\") " pod="openshift-image-registry/image-registry-65965b4c78-z2crt"
May 20 13:52:03.791549 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.791444    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f7493ea8-da00-412d-9904-69f5291dabaf-image-registry-private-configuration\") pod \"image-registry-65965b4c78-z2crt\" (UID: \"f7493ea8-da00-412d-9904-69f5291dabaf\") " pod="openshift-image-registry/image-registry-65965b4c78-z2crt"
May 20 13:52:03.791549 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.791492    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f7493ea8-da00-412d-9904-69f5291dabaf-ca-trust-extracted\") pod \"image-registry-65965b4c78-z2crt\" (UID: \"f7493ea8-da00-412d-9904-69f5291dabaf\") " pod="openshift-image-registry/image-registry-65965b4c78-z2crt"
May 20 13:52:03.791695 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.791545    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/011983a7-38e4-4e05-bace-2205c8447d2e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-9bc4w\" (UID: \"011983a7-38e4-4e05-bace-2205c8447d2e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9bc4w"
May 20 13:52:03.791695 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.791585    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f7493ea8-da00-412d-9904-69f5291dabaf-registry-tls\") pod \"image-registry-65965b4c78-z2crt\" (UID: \"f7493ea8-da00-412d-9904-69f5291dabaf\") " pod="openshift-image-registry/image-registry-65965b4c78-z2crt"
May 20 13:52:03.791695 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.791610    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f7493ea8-da00-412d-9904-69f5291dabaf-registry-certificates\") pod \"image-registry-65965b4c78-z2crt\" (UID: \"f7493ea8-da00-412d-9904-69f5291dabaf\") " pod="openshift-image-registry/image-registry-65965b4c78-z2crt"
May 20 13:52:03.791695 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.791634    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f7493ea8-da00-412d-9904-69f5291dabaf-bound-sa-token\") pod \"image-registry-65965b4c78-z2crt\" (UID: \"f7493ea8-da00-412d-9904-69f5291dabaf\") " pod="openshift-image-registry/image-registry-65965b4c78-z2crt"
May 20 13:52:03.791695 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:52:03.791648    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 20 13:52:03.791695 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.791662    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f7493ea8-da00-412d-9904-69f5291dabaf-installation-pull-secrets\") pod \"image-registry-65965b4c78-z2crt\" (UID: \"f7493ea8-da00-412d-9904-69f5291dabaf\") " pod="openshift-image-registry/image-registry-65965b4c78-z2crt"
May 20 13:52:03.791892 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:52:03.791713    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/011983a7-38e4-4e05-bace-2205c8447d2e-cluster-monitoring-operator-tls podName:011983a7-38e4-4e05-bace-2205c8447d2e nodeName:}" failed. No retries permitted until 2026-05-20 13:52:04.291694563 +0000 UTC m=+134.164481711 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/011983a7-38e4-4e05-bace-2205c8447d2e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-9bc4w" (UID: "011983a7-38e4-4e05-bace-2205c8447d2e") : secret "cluster-monitoring-operator-tls" not found
May 20 13:52:03.792030 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.792016    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/011983a7-38e4-4e05-bace-2205c8447d2e-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-9bc4w\" (UID: \"011983a7-38e4-4e05-bace-2205c8447d2e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9bc4w"
May 20 13:52:03.824034 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.824016    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpzsl\" (UniqueName: \"kubernetes.io/projected/011983a7-38e4-4e05-bace-2205c8447d2e-kube-api-access-bpzsl\") pod \"cluster-monitoring-operator-6c75959455-9bc4w\" (UID: \"011983a7-38e4-4e05-bace-2205c8447d2e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9bc4w"
May 20 13:52:03.825817 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.825805    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-ppgpb"
May 20 13:52:03.892691 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.892661    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f7493ea8-da00-412d-9904-69f5291dabaf-image-registry-private-configuration\") pod \"image-registry-65965b4c78-z2crt\" (UID: \"f7493ea8-da00-412d-9904-69f5291dabaf\") " pod="openshift-image-registry/image-registry-65965b4c78-z2crt"
May 20 13:52:03.892819 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.892696    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f7493ea8-da00-412d-9904-69f5291dabaf-ca-trust-extracted\") pod \"image-registry-65965b4c78-z2crt\" (UID: \"f7493ea8-da00-412d-9904-69f5291dabaf\") " pod="openshift-image-registry/image-registry-65965b4c78-z2crt"
May 20 13:52:03.892898 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.892878    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f7493ea8-da00-412d-9904-69f5291dabaf-registry-tls\") pod \"image-registry-65965b4c78-z2crt\" (UID: \"f7493ea8-da00-412d-9904-69f5291dabaf\") " pod="openshift-image-registry/image-registry-65965b4c78-z2crt"
May 20 13:52:03.892954 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.892914    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f7493ea8-da00-412d-9904-69f5291dabaf-registry-certificates\") pod \"image-registry-65965b4c78-z2crt\" (UID: \"f7493ea8-da00-412d-9904-69f5291dabaf\") " pod="openshift-image-registry/image-registry-65965b4c78-z2crt"
May 20 13:52:03.892954 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.892948    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f7493ea8-da00-412d-9904-69f5291dabaf-bound-sa-token\") pod \"image-registry-65965b4c78-z2crt\" (UID: \"f7493ea8-da00-412d-9904-69f5291dabaf\") " pod="openshift-image-registry/image-registry-65965b4c78-z2crt"
May 20 13:52:03.893075 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:52:03.893057    2571 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 13:52:03.893120 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:52:03.893079    2571 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65965b4c78-z2crt: secret "image-registry-tls" not found
May 20 13:52:03.893156 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.893056    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f7493ea8-da00-412d-9904-69f5291dabaf-ca-trust-extracted\") pod \"image-registry-65965b4c78-z2crt\" (UID: \"f7493ea8-da00-412d-9904-69f5291dabaf\") " pod="openshift-image-registry/image-registry-65965b4c78-z2crt"
May 20 13:52:03.893156 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:52:03.893152    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7493ea8-da00-412d-9904-69f5291dabaf-registry-tls podName:f7493ea8-da00-412d-9904-69f5291dabaf nodeName:}" failed. No retries permitted until 2026-05-20 13:52:04.393130334 +0000 UTC m=+134.265917488 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f7493ea8-da00-412d-9904-69f5291dabaf-registry-tls") pod "image-registry-65965b4c78-z2crt" (UID: "f7493ea8-da00-412d-9904-69f5291dabaf") : secret "image-registry-tls" not found
May 20 13:52:03.893233 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.893189    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f7493ea8-da00-412d-9904-69f5291dabaf-installation-pull-secrets\") pod \"image-registry-65965b4c78-z2crt\" (UID: \"f7493ea8-da00-412d-9904-69f5291dabaf\") " pod="openshift-image-registry/image-registry-65965b4c78-z2crt"
May 20 13:52:03.893233 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.893210    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f7493ea8-da00-412d-9904-69f5291dabaf-trusted-ca\") pod \"image-registry-65965b4c78-z2crt\" (UID: \"f7493ea8-da00-412d-9904-69f5291dabaf\") " pod="openshift-image-registry/image-registry-65965b4c78-z2crt"
May 20 13:52:03.893303 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.893247    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jmrvt\" (UniqueName: \"kubernetes.io/projected/f7493ea8-da00-412d-9904-69f5291dabaf-kube-api-access-jmrvt\") pod \"image-registry-65965b4c78-z2crt\" (UID: \"f7493ea8-da00-412d-9904-69f5291dabaf\") " pod="openshift-image-registry/image-registry-65965b4c78-z2crt"
May 20 13:52:03.893543 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.893523    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f7493ea8-da00-412d-9904-69f5291dabaf-registry-certificates\") pod \"image-registry-65965b4c78-z2crt\" (UID: \"f7493ea8-da00-412d-9904-69f5291dabaf\") " pod="openshift-image-registry/image-registry-65965b4c78-z2crt"
May 20 13:52:03.894375 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.894354    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f7493ea8-da00-412d-9904-69f5291dabaf-trusted-ca\") pod \"image-registry-65965b4c78-z2crt\" (UID: \"f7493ea8-da00-412d-9904-69f5291dabaf\") " pod="openshift-image-registry/image-registry-65965b4c78-z2crt"
May 20 13:52:03.895652 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.895498    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f7493ea8-da00-412d-9904-69f5291dabaf-image-registry-private-configuration\") pod \"image-registry-65965b4c78-z2crt\" (UID: \"f7493ea8-da00-412d-9904-69f5291dabaf\") " pod="openshift-image-registry/image-registry-65965b4c78-z2crt"
May 20 13:52:03.895652 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.895599    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f7493ea8-da00-412d-9904-69f5291dabaf-installation-pull-secrets\") pod \"image-registry-65965b4c78-z2crt\" (UID: \"f7493ea8-da00-412d-9904-69f5291dabaf\") " pod="openshift-image-registry/image-registry-65965b4c78-z2crt"
May 20 13:52:03.901390 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.901368    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f7493ea8-da00-412d-9904-69f5291dabaf-bound-sa-token\") pod \"image-registry-65965b4c78-z2crt\" (UID: \"f7493ea8-da00-412d-9904-69f5291dabaf\") " pod="openshift-image-registry/image-registry-65965b4c78-z2crt"
May 20 13:52:03.901767 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.901747    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmrvt\" (UniqueName: \"kubernetes.io/projected/f7493ea8-da00-412d-9904-69f5291dabaf-kube-api-access-jmrvt\") pod \"image-registry-65965b4c78-z2crt\" (UID: \"f7493ea8-da00-412d-9904-69f5291dabaf\") " pod="openshift-image-registry/image-registry-65965b4c78-z2crt"
May 20 13:52:03.939571 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:03.939548    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-ppgpb"]
May 20 13:52:03.942383 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:52:03.942361    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod496f0332_8b87_4f2e_b275_af4f3b0529fa.slice/crio-9db571cc64e6cece2b80ab9756c039f5c7b15b5ef0d8dab0fc3062d5fcdf256a WatchSource:0}: Error finding container 9db571cc64e6cece2b80ab9756c039f5c7b15b5ef0d8dab0fc3062d5fcdf256a: Status 404 returned error can't find the container with id 9db571cc64e6cece2b80ab9756c039f5c7b15b5ef0d8dab0fc3062d5fcdf256a
May 20 13:52:04.086359 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:04.086304    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-ppgpb" event={"ID":"496f0332-8b87-4f2e-b275-af4f3b0529fa","Type":"ContainerStarted","Data":"9db571cc64e6cece2b80ab9756c039f5c7b15b5ef0d8dab0fc3062d5fcdf256a"}
May 20 13:52:04.296663 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:04.296634    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/011983a7-38e4-4e05-bace-2205c8447d2e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-9bc4w\" (UID: \"011983a7-38e4-4e05-bace-2205c8447d2e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9bc4w"
May 20 13:52:04.296790 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:52:04.296774    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 20 13:52:04.296847 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:52:04.296836    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/011983a7-38e4-4e05-bace-2205c8447d2e-cluster-monitoring-operator-tls podName:011983a7-38e4-4e05-bace-2205c8447d2e nodeName:}" failed. No retries permitted until 2026-05-20 13:52:05.296818493 +0000 UTC m=+135.169605634 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/011983a7-38e4-4e05-bace-2205c8447d2e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-9bc4w" (UID: "011983a7-38e4-4e05-bace-2205c8447d2e") : secret "cluster-monitoring-operator-tls" not found
May 20 13:52:04.397478 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:04.397416    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f7493ea8-da00-412d-9904-69f5291dabaf-registry-tls\") pod \"image-registry-65965b4c78-z2crt\" (UID: \"f7493ea8-da00-412d-9904-69f5291dabaf\") " pod="openshift-image-registry/image-registry-65965b4c78-z2crt"
May 20 13:52:04.397573 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:52:04.397519    2571 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 13:52:04.397573 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:52:04.397531    2571 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65965b4c78-z2crt: secret "image-registry-tls" not found
May 20 13:52:04.397639 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:52:04.397575    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7493ea8-da00-412d-9904-69f5291dabaf-registry-tls podName:f7493ea8-da00-412d-9904-69f5291dabaf nodeName:}" failed. No retries permitted until 2026-05-20 13:52:05.397562932 +0000 UTC m=+135.270350066 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f7493ea8-da00-412d-9904-69f5291dabaf-registry-tls") pod "image-registry-65965b4c78-z2crt" (UID: "f7493ea8-da00-412d-9904-69f5291dabaf") : secret "image-registry-tls" not found
May 20 13:52:05.304175 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:05.304140    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/011983a7-38e4-4e05-bace-2205c8447d2e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-9bc4w\" (UID: \"011983a7-38e4-4e05-bace-2205c8447d2e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9bc4w"
May 20 13:52:05.304590 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:52:05.304276    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 20 13:52:05.304590 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:52:05.304342    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/011983a7-38e4-4e05-bace-2205c8447d2e-cluster-monitoring-operator-tls podName:011983a7-38e4-4e05-bace-2205c8447d2e nodeName:}" failed. No retries permitted until 2026-05-20 13:52:07.304324386 +0000 UTC m=+137.177111520 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/011983a7-38e4-4e05-bace-2205c8447d2e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-9bc4w" (UID: "011983a7-38e4-4e05-bace-2205c8447d2e") : secret "cluster-monitoring-operator-tls" not found
May 20 13:52:05.404760 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:05.404721    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f7493ea8-da00-412d-9904-69f5291dabaf-registry-tls\") pod \"image-registry-65965b4c78-z2crt\" (UID: \"f7493ea8-da00-412d-9904-69f5291dabaf\") " pod="openshift-image-registry/image-registry-65965b4c78-z2crt"
May 20 13:52:05.404916 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:52:05.404821    2571 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 13:52:05.404916 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:52:05.404843    2571 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65965b4c78-z2crt: secret "image-registry-tls" not found
May 20 13:52:05.404916 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:52:05.404906    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7493ea8-da00-412d-9904-69f5291dabaf-registry-tls podName:f7493ea8-da00-412d-9904-69f5291dabaf nodeName:}" failed. No retries permitted until 2026-05-20 13:52:07.404886562 +0000 UTC m=+137.277673720 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f7493ea8-da00-412d-9904-69f5291dabaf-registry-tls") pod "image-registry-65965b4c78-z2crt" (UID: "f7493ea8-da00-412d-9904-69f5291dabaf") : secret "image-registry-tls" not found
May 20 13:52:05.477388 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:05.477357    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-hhgs4"]
May 20 13:52:05.479713 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:05.479695    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-hhgs4"
May 20 13:52:05.482217 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:05.482203    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
May 20 13:52:05.482367 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:05.482333    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
May 20 13:52:05.482367 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:05.482352    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
May 20 13:52:05.483070 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:05.483049    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
May 20 13:52:05.483070 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:05.483056    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-2wv2n\""
May 20 13:52:05.489348 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:05.489324    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-hhgs4"]
May 20 13:52:05.605646 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:05.605565    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/abb85415-7414-4df7-ace3-58550a8d0d19-serving-cert\") pod \"service-ca-operator-57b5b68b8-hhgs4\" (UID: \"abb85415-7414-4df7-ace3-58550a8d0d19\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-hhgs4"
May 20 13:52:05.605794 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:05.605772    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxxzv\" (UniqueName: \"kubernetes.io/projected/abb85415-7414-4df7-ace3-58550a8d0d19-kube-api-access-dxxzv\") pod \"service-ca-operator-57b5b68b8-hhgs4\" (UID: \"abb85415-7414-4df7-ace3-58550a8d0d19\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-hhgs4"
May 20 13:52:05.605861 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:05.605809    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/abb85415-7414-4df7-ace3-58550a8d0d19-config\") pod \"service-ca-operator-57b5b68b8-hhgs4\" (UID: \"abb85415-7414-4df7-ace3-58550a8d0d19\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-hhgs4"
May 20 13:52:05.706469 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:05.706430    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dxxzv\" (UniqueName: \"kubernetes.io/projected/abb85415-7414-4df7-ace3-58550a8d0d19-kube-api-access-dxxzv\") pod \"service-ca-operator-57b5b68b8-hhgs4\" (UID: \"abb85415-7414-4df7-ace3-58550a8d0d19\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-hhgs4"
May 20 13:52:05.706469 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:05.706469    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/abb85415-7414-4df7-ace3-58550a8d0d19-config\") pod \"service-ca-operator-57b5b68b8-hhgs4\" (UID: \"abb85415-7414-4df7-ace3-58550a8d0d19\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-hhgs4"
May 20 13:52:05.706653 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:05.706492    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/abb85415-7414-4df7-ace3-58550a8d0d19-serving-cert\") pod \"service-ca-operator-57b5b68b8-hhgs4\" (UID: \"abb85415-7414-4df7-ace3-58550a8d0d19\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-hhgs4"
May 20 13:52:05.707155 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:05.707116    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/abb85415-7414-4df7-ace3-58550a8d0d19-config\") pod \"service-ca-operator-57b5b68b8-hhgs4\" (UID: \"abb85415-7414-4df7-ace3-58550a8d0d19\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-hhgs4"
May 20 13:52:05.709115 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:05.709089    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/abb85415-7414-4df7-ace3-58550a8d0d19-serving-cert\") pod \"service-ca-operator-57b5b68b8-hhgs4\" (UID: \"abb85415-7414-4df7-ace3-58550a8d0d19\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-hhgs4"
May 20 13:52:05.719185 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:05.719163    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxxzv\" (UniqueName: \"kubernetes.io/projected/abb85415-7414-4df7-ace3-58550a8d0d19-kube-api-access-dxxzv\") pod \"service-ca-operator-57b5b68b8-hhgs4\" (UID: \"abb85415-7414-4df7-ace3-58550a8d0d19\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-hhgs4"
May 20 13:52:05.789882 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:05.789865    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-hhgs4"
May 20 13:52:05.909817 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:05.909653    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-hhgs4"]
May 20 13:52:05.912211 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:52:05.912185    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabb85415_7414_4df7_ace3_58550a8d0d19.slice/crio-20c3234d9cf0491f6a7900159fd66898c5b0ee2312753b47196e0a4832bc855a WatchSource:0}: Error finding container 20c3234d9cf0491f6a7900159fd66898c5b0ee2312753b47196e0a4832bc855a: Status 404 returned error can't find the container with id 20c3234d9cf0491f6a7900159fd66898c5b0ee2312753b47196e0a4832bc855a
May 20 13:52:06.090437 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:06.090408    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-ppgpb" event={"ID":"496f0332-8b87-4f2e-b275-af4f3b0529fa","Type":"ContainerStarted","Data":"722e6aee14f6821b956aecf2e958bfcfc57c8e499c7e01ea494f1ae21d6908dd"}
May 20 13:52:06.091348 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:06.091321    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-hhgs4" event={"ID":"abb85415-7414-4df7-ace3-58550a8d0d19","Type":"ContainerStarted","Data":"20c3234d9cf0491f6a7900159fd66898c5b0ee2312753b47196e0a4832bc855a"}
May 20 13:52:06.109704 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:06.109662    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-ppgpb" podStartSLOduration=1.269417348 podStartE2EDuration="3.109651208s" podCreationTimestamp="2026-05-20 13:52:03 +0000 UTC" firstStartedPulling="2026-05-20 13:52:03.944037047 +0000 UTC m=+133.816824185" lastFinishedPulling="2026-05-20 13:52:05.784270908 +0000 UTC m=+135.657058045" observedRunningTime="2026-05-20 13:52:06.108803489 +0000 UTC m=+135.981590646" watchObservedRunningTime="2026-05-20 13:52:06.109651208 +0000 UTC m=+135.982438372"
May 20 13:52:07.317105 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:07.317068    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/011983a7-38e4-4e05-bace-2205c8447d2e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-9bc4w\" (UID: \"011983a7-38e4-4e05-bace-2205c8447d2e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9bc4w"
May 20 13:52:07.317445 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:52:07.317202    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 20 13:52:07.317445 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:52:07.317265    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/011983a7-38e4-4e05-bace-2205c8447d2e-cluster-monitoring-operator-tls podName:011983a7-38e4-4e05-bace-2205c8447d2e nodeName:}" failed. No retries permitted until 2026-05-20 13:52:11.317247894 +0000 UTC m=+141.190035038 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/011983a7-38e4-4e05-bace-2205c8447d2e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-9bc4w" (UID: "011983a7-38e4-4e05-bace-2205c8447d2e") : secret "cluster-monitoring-operator-tls" not found
May 20 13:52:07.417625 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:07.417597    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f7493ea8-da00-412d-9904-69f5291dabaf-registry-tls\") pod \"image-registry-65965b4c78-z2crt\" (UID: \"f7493ea8-da00-412d-9904-69f5291dabaf\") " pod="openshift-image-registry/image-registry-65965b4c78-z2crt"
May 20 13:52:07.417801 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:52:07.417715    2571 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 13:52:07.417801 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:52:07.417731    2571 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65965b4c78-z2crt: secret "image-registry-tls" not found
May 20 13:52:07.417801 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:52:07.417789    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7493ea8-da00-412d-9904-69f5291dabaf-registry-tls podName:f7493ea8-da00-412d-9904-69f5291dabaf nodeName:}" failed. No retries permitted until 2026-05-20 13:52:11.417771637 +0000 UTC m=+141.290558790 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f7493ea8-da00-412d-9904-69f5291dabaf-registry-tls") pod "image-registry-65965b4c78-z2crt" (UID: "f7493ea8-da00-412d-9904-69f5291dabaf") : secret "image-registry-tls" not found
May 20 13:52:08.095329 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:08.095264    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-hhgs4" event={"ID":"abb85415-7414-4df7-ace3-58550a8d0d19","Type":"ContainerStarted","Data":"d3c9e0e55ae973d9dd013d6da096571be3f4d357d5f120a66965c6aa74fb5444"}
May 20 13:52:08.114212 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:08.114172    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-hhgs4" podStartSLOduration=1.206090109 podStartE2EDuration="3.11415553s" podCreationTimestamp="2026-05-20 13:52:05 +0000 UTC" firstStartedPulling="2026-05-20 13:52:05.914317051 +0000 UTC m=+135.787104186" lastFinishedPulling="2026-05-20 13:52:07.822382473 +0000 UTC m=+137.695169607" observedRunningTime="2026-05-20 13:52:08.114017174 +0000 UTC m=+137.986804356" watchObservedRunningTime="2026-05-20 13:52:08.11415553 +0000 UTC m=+137.986942687"
May 20 13:52:09.580509 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:09.580478    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jczc6_e8bd843f-d4d6-4179-a9b7-48c5fcce16f2/dns-node-resolver/0.log"
May 20 13:52:10.575859 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:10.575835    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g8gjr_80b8fd3b-57c3-42a7-8028-8d04d797d224/node-ca/0.log"
May 20 13:52:11.340147 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:11.340112    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-c7lg6"]
May 20 13:52:11.341817 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:11.341799    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-c7lg6"
May 20 13:52:11.344483 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:11.344462    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
May 20 13:52:11.344614 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:11.344597    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
May 20 13:52:11.344673 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:11.344652    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
May 20 13:52:11.345516 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:11.345500    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
May 20 13:52:11.345570 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:11.345533    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-c94lz\""
May 20 13:52:11.346713 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:11.346691    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/011983a7-38e4-4e05-bace-2205c8447d2e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-9bc4w\" (UID: \"011983a7-38e4-4e05-bace-2205c8447d2e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9bc4w"
May 20 13:52:11.346876 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:52:11.346850    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 20 13:52:11.347037 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:52:11.347020    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/011983a7-38e4-4e05-bace-2205c8447d2e-cluster-monitoring-operator-tls podName:011983a7-38e4-4e05-bace-2205c8447d2e nodeName:}" failed. No retries permitted until 2026-05-20 13:52:19.346999708 +0000 UTC m=+149.219786865 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/011983a7-38e4-4e05-bace-2205c8447d2e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-9bc4w" (UID: "011983a7-38e4-4e05-bace-2205c8447d2e") : secret "cluster-monitoring-operator-tls" not found
May 20 13:52:11.354585 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:11.354561    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-c7lg6"]
May 20 13:52:11.447915 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:11.447890    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9k7t\" (UniqueName: \"kubernetes.io/projected/51660c26-53b5-4cb1-9688-6dabba127510-kube-api-access-f9k7t\") pod \"service-ca-67d667c7d-c7lg6\" (UID: \"51660c26-53b5-4cb1-9688-6dabba127510\") " pod="openshift-service-ca/service-ca-67d667c7d-c7lg6"
May 20 13:52:11.448018 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:11.447952    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f7493ea8-da00-412d-9904-69f5291dabaf-registry-tls\") pod \"image-registry-65965b4c78-z2crt\" (UID: \"f7493ea8-da00-412d-9904-69f5291dabaf\") " pod="openshift-image-registry/image-registry-65965b4c78-z2crt"
May 20 13:52:11.448018 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:11.448004    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/51660c26-53b5-4cb1-9688-6dabba127510-signing-cabundle\") pod \"service-ca-67d667c7d-c7lg6\" (UID: \"51660c26-53b5-4cb1-9688-6dabba127510\") " pod="openshift-service-ca/service-ca-67d667c7d-c7lg6"
May 20 13:52:11.448102 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:11.448026    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/51660c26-53b5-4cb1-9688-6dabba127510-signing-key\") pod \"service-ca-67d667c7d-c7lg6\" (UID: \"51660c26-53b5-4cb1-9688-6dabba127510\") " pod="openshift-service-ca/service-ca-67d667c7d-c7lg6"
May 20 13:52:11.448102 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:52:11.448033    2571 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 13:52:11.448102 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:52:11.448049    2571 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65965b4c78-z2crt: secret "image-registry-tls" not found
May 20 13:52:11.448102 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:52:11.448090    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7493ea8-da00-412d-9904-69f5291dabaf-registry-tls podName:f7493ea8-da00-412d-9904-69f5291dabaf nodeName:}" failed. No retries permitted until 2026-05-20 13:52:19.448076802 +0000 UTC m=+149.320863936 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f7493ea8-da00-412d-9904-69f5291dabaf-registry-tls") pod "image-registry-65965b4c78-z2crt" (UID: "f7493ea8-da00-412d-9904-69f5291dabaf") : secret "image-registry-tls" not found
May 20 13:52:11.548417 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:11.548391    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/51660c26-53b5-4cb1-9688-6dabba127510-signing-key\") pod \"service-ca-67d667c7d-c7lg6\" (UID: \"51660c26-53b5-4cb1-9688-6dabba127510\") " pod="openshift-service-ca/service-ca-67d667c7d-c7lg6"
May 20 13:52:11.548523 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:11.548457    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f9k7t\" (UniqueName: \"kubernetes.io/projected/51660c26-53b5-4cb1-9688-6dabba127510-kube-api-access-f9k7t\") pod \"service-ca-67d667c7d-c7lg6\" (UID: \"51660c26-53b5-4cb1-9688-6dabba127510\") " pod="openshift-service-ca/service-ca-67d667c7d-c7lg6"
May 20 13:52:11.548646 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:11.548624    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/51660c26-53b5-4cb1-9688-6dabba127510-signing-cabundle\") pod \"service-ca-67d667c7d-c7lg6\" (UID: \"51660c26-53b5-4cb1-9688-6dabba127510\") " pod="openshift-service-ca/service-ca-67d667c7d-c7lg6"
May 20 13:52:11.549237 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:11.549217    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/51660c26-53b5-4cb1-9688-6dabba127510-signing-cabundle\") pod \"service-ca-67d667c7d-c7lg6\" (UID: \"51660c26-53b5-4cb1-9688-6dabba127510\") " pod="openshift-service-ca/service-ca-67d667c7d-c7lg6"
May 20 13:52:11.550709 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:11.550688    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/51660c26-53b5-4cb1-9688-6dabba127510-signing-key\") pod \"service-ca-67d667c7d-c7lg6\" (UID: \"51660c26-53b5-4cb1-9688-6dabba127510\") " pod="openshift-service-ca/service-ca-67d667c7d-c7lg6"
May 20 13:52:11.556638 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:11.556614    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9k7t\" (UniqueName: \"kubernetes.io/projected/51660c26-53b5-4cb1-9688-6dabba127510-kube-api-access-f9k7t\") pod \"service-ca-67d667c7d-c7lg6\" (UID: \"51660c26-53b5-4cb1-9688-6dabba127510\") " pod="openshift-service-ca/service-ca-67d667c7d-c7lg6"
May 20 13:52:11.650642 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:11.650592    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-c7lg6"
May 20 13:52:11.764490 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:11.764460    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-c7lg6"]
May 20 13:52:11.768157 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:52:11.768132    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51660c26_53b5_4cb1_9688_6dabba127510.slice/crio-aded9fed69623ad664c786a94bdeeeec10acfe64117a2afc64cf8229d157f37f WatchSource:0}: Error finding container aded9fed69623ad664c786a94bdeeeec10acfe64117a2afc64cf8229d157f37f: Status 404 returned error can't find the container with id aded9fed69623ad664c786a94bdeeeec10acfe64117a2afc64cf8229d157f37f
May 20 13:52:12.105046 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:12.105014    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-c7lg6" event={"ID":"51660c26-53b5-4cb1-9688-6dabba127510","Type":"ContainerStarted","Data":"6bdc10a988c9e63b524d8032b26370403854341af27bd234e63c7fd2f1dbb79d"}
May 20 13:52:12.105154 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:12.105052    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-c7lg6" event={"ID":"51660c26-53b5-4cb1-9688-6dabba127510","Type":"ContainerStarted","Data":"aded9fed69623ad664c786a94bdeeeec10acfe64117a2afc64cf8229d157f37f"}
May 20 13:52:12.121730 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:12.121664    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-c7lg6" podStartSLOduration=1.121651765 podStartE2EDuration="1.121651765s" podCreationTimestamp="2026-05-20 13:52:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 13:52:12.121036628 +0000 UTC m=+141.993823784" watchObservedRunningTime="2026-05-20 13:52:12.121651765 +0000 UTC m=+141.994438968"
May 20 13:52:19.409996 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:19.409953    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/011983a7-38e4-4e05-bace-2205c8447d2e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-9bc4w\" (UID: \"011983a7-38e4-4e05-bace-2205c8447d2e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9bc4w"
May 20 13:52:19.410429 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:52:19.410108    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 20 13:52:19.410429 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:52:19.410182    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/011983a7-38e4-4e05-bace-2205c8447d2e-cluster-monitoring-operator-tls podName:011983a7-38e4-4e05-bace-2205c8447d2e nodeName:}" failed. No retries permitted until 2026-05-20 13:52:35.410164011 +0000 UTC m=+165.282951149 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/011983a7-38e4-4e05-bace-2205c8447d2e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-9bc4w" (UID: "011983a7-38e4-4e05-bace-2205c8447d2e") : secret "cluster-monitoring-operator-tls" not found
May 20 13:52:19.510464 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:19.510432    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f7493ea8-da00-412d-9904-69f5291dabaf-registry-tls\") pod \"image-registry-65965b4c78-z2crt\" (UID: \"f7493ea8-da00-412d-9904-69f5291dabaf\") " pod="openshift-image-registry/image-registry-65965b4c78-z2crt"
May 20 13:52:19.512840 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:19.512800    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f7493ea8-da00-412d-9904-69f5291dabaf-registry-tls\") pod \"image-registry-65965b4c78-z2crt\" (UID: \"f7493ea8-da00-412d-9904-69f5291dabaf\") " pod="openshift-image-registry/image-registry-65965b4c78-z2crt"
May 20 13:52:19.640878 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:19.640839    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65965b4c78-z2crt"
May 20 13:52:19.768295 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:19.768267    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65965b4c78-z2crt"]
May 20 13:52:19.770687 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:52:19.770656    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7493ea8_da00_412d_9904_69f5291dabaf.slice/crio-374a2ef343c137b81bd8deeb6c23e3b26ab208a7d08c91bbdefe8ab7b09ceda5 WatchSource:0}: Error finding container 374a2ef343c137b81bd8deeb6c23e3b26ab208a7d08c91bbdefe8ab7b09ceda5: Status 404 returned error can't find the container with id 374a2ef343c137b81bd8deeb6c23e3b26ab208a7d08c91bbdefe8ab7b09ceda5
May 20 13:52:20.124072 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:20.124038    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65965b4c78-z2crt" event={"ID":"f7493ea8-da00-412d-9904-69f5291dabaf","Type":"ContainerStarted","Data":"3419bba894180f8207faecf5aea10427ee365a21ee7cc5f41b03949002ed95ae"}
May 20 13:52:20.124218 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:20.124079    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65965b4c78-z2crt" event={"ID":"f7493ea8-da00-412d-9904-69f5291dabaf","Type":"ContainerStarted","Data":"374a2ef343c137b81bd8deeb6c23e3b26ab208a7d08c91bbdefe8ab7b09ceda5"}
May 20 13:52:20.124218 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:20.124196    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-65965b4c78-z2crt"
May 20 13:52:20.143242 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:20.143203    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-65965b4c78-z2crt" podStartSLOduration=17.143191416 podStartE2EDuration="17.143191416s" podCreationTimestamp="2026-05-20 13:52:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 13:52:20.142189537 +0000 UTC m=+150.014976704" watchObservedRunningTime="2026-05-20 13:52:20.143191416 +0000 UTC m=+150.015978572"
May 20 13:52:27.511883 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:52:27.511828    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-b64ll" podUID="465db268-d10e-4f15-937a-0ff0f966b831"
May 20 13:52:27.525965 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:52:27.525917    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-9lhwc" podUID="2605e754-d0c5-49d1-87e4-d0d4b0f4088e"
May 20 13:52:28.147598 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:28.147568    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b64ll"
May 20 13:52:28.677856 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:52:28.677824    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-zhqmq" podUID="96bd478e-69c0-43e6-8df1-d6f775d6c864"
May 20 13:52:31.218256 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.218217    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-sh9dr"]
May 20 13:52:31.221542 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.221522    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sh9dr"
May 20 13:52:31.223634 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.223606    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gcddw\""
May 20 13:52:31.224548 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.224524    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 20 13:52:31.224548 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.224539    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 20 13:52:31.238640 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.238615    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sh9dr"]
May 20 13:52:31.239462 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.239436    2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65965b4c78-z2crt"]
May 20 13:52:31.289283 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.289262    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8cdb97686-22vqz"]
May 20 13:52:31.290993 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.290977    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8cdb97686-22vqz"
May 20 13:52:31.316195 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.316179    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8cdb97686-22vqz"]
May 20 13:52:31.400436 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.400414    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2dcb385e-d1a9-442f-85b2-b2f3537a783d-image-registry-private-configuration\") pod \"image-registry-8cdb97686-22vqz\" (UID: \"2dcb385e-d1a9-442f-85b2-b2f3537a783d\") " pod="openshift-image-registry/image-registry-8cdb97686-22vqz"
May 20 13:52:31.400516 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.400447    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2dcb385e-d1a9-442f-85b2-b2f3537a783d-registry-certificates\") pod \"image-registry-8cdb97686-22vqz\" (UID: \"2dcb385e-d1a9-442f-85b2-b2f3537a783d\") " pod="openshift-image-registry/image-registry-8cdb97686-22vqz"
May 20 13:52:31.400516 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.400486    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2dcb385e-d1a9-442f-85b2-b2f3537a783d-ca-trust-extracted\") pod \"image-registry-8cdb97686-22vqz\" (UID: \"2dcb385e-d1a9-442f-85b2-b2f3537a783d\") " pod="openshift-image-registry/image-registry-8cdb97686-22vqz"
May 20 13:52:31.400582 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.400538    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4a2208fd-d8f7-4b95-9a9c-82f7a55017e1-crio-socket\") pod \"insights-runtime-extractor-sh9dr\" (UID: \"4a2208fd-d8f7-4b95-9a9c-82f7a55017e1\") " pod="openshift-insights/insights-runtime-extractor-sh9dr"
May 20 13:52:31.400582 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.400568    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2dcb385e-d1a9-442f-85b2-b2f3537a783d-bound-sa-token\") pod \"image-registry-8cdb97686-22vqz\" (UID: \"2dcb385e-d1a9-442f-85b2-b2f3537a783d\") " pod="openshift-image-registry/image-registry-8cdb97686-22vqz"
May 20 13:52:31.400644 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.400588    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a2208fd-d8f7-4b95-9a9c-82f7a55017e1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sh9dr\" (UID: \"4a2208fd-d8f7-4b95-9a9c-82f7a55017e1\") " pod="openshift-insights/insights-runtime-extractor-sh9dr"
May 20 13:52:31.400644 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.400613    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrvr7\" (UniqueName: \"kubernetes.io/projected/4a2208fd-d8f7-4b95-9a9c-82f7a55017e1-kube-api-access-xrvr7\") pod \"insights-runtime-extractor-sh9dr\" (UID: \"4a2208fd-d8f7-4b95-9a9c-82f7a55017e1\") " pod="openshift-insights/insights-runtime-extractor-sh9dr"
May 20 13:52:31.400644 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.400629    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2dcb385e-d1a9-442f-85b2-b2f3537a783d-registry-tls\") pod \"image-registry-8cdb97686-22vqz\" (UID: \"2dcb385e-d1a9-442f-85b2-b2f3537a783d\") " pod="openshift-image-registry/image-registry-8cdb97686-22vqz"
May 20 13:52:31.400728 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.400670    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2dcb385e-d1a9-442f-85b2-b2f3537a783d-trusted-ca\") pod \"image-registry-8cdb97686-22vqz\" (UID: \"2dcb385e-d1a9-442f-85b2-b2f3537a783d\") " pod="openshift-image-registry/image-registry-8cdb97686-22vqz"
May 20 13:52:31.400728 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.400700    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a2208fd-d8f7-4b95-9a9c-82f7a55017e1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sh9dr\" (UID: \"4a2208fd-d8f7-4b95-9a9c-82f7a55017e1\") " pod="openshift-insights/insights-runtime-extractor-sh9dr"
May 20 13:52:31.400787 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.400727    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d974q\" (UniqueName: \"kubernetes.io/projected/2dcb385e-d1a9-442f-85b2-b2f3537a783d-kube-api-access-d974q\") pod \"image-registry-8cdb97686-22vqz\" (UID: \"2dcb385e-d1a9-442f-85b2-b2f3537a783d\") " pod="openshift-image-registry/image-registry-8cdb97686-22vqz"
May 20 13:52:31.400787 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.400779    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a2208fd-d8f7-4b95-9a9c-82f7a55017e1-data-volume\") pod \"insights-runtime-extractor-sh9dr\" (UID: \"4a2208fd-d8f7-4b95-9a9c-82f7a55017e1\") " pod="openshift-insights/insights-runtime-extractor-sh9dr"
May 20 13:52:31.400848 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.400797    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2dcb385e-d1a9-442f-85b2-b2f3537a783d-installation-pull-secrets\") pod \"image-registry-8cdb97686-22vqz\" (UID: \"2dcb385e-d1a9-442f-85b2-b2f3537a783d\") " pod="openshift-image-registry/image-registry-8cdb97686-22vqz"
May 20 13:52:31.501077 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.501024    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xrvr7\" (UniqueName: \"kubernetes.io/projected/4a2208fd-d8f7-4b95-9a9c-82f7a55017e1-kube-api-access-xrvr7\") pod \"insights-runtime-extractor-sh9dr\" (UID: \"4a2208fd-d8f7-4b95-9a9c-82f7a55017e1\") " pod="openshift-insights/insights-runtime-extractor-sh9dr"
May 20 13:52:31.501077 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.501053    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2dcb385e-d1a9-442f-85b2-b2f3537a783d-registry-tls\") pod \"image-registry-8cdb97686-22vqz\" (UID: \"2dcb385e-d1a9-442f-85b2-b2f3537a783d\") " pod="openshift-image-registry/image-registry-8cdb97686-22vqz"
May 20 13:52:31.501077 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.501068    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2dcb385e-d1a9-442f-85b2-b2f3537a783d-trusted-ca\") pod \"image-registry-8cdb97686-22vqz\" (UID: \"2dcb385e-d1a9-442f-85b2-b2f3537a783d\") " pod="openshift-image-registry/image-registry-8cdb97686-22vqz"
May 20 13:52:31.501240 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.501097    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a2208fd-d8f7-4b95-9a9c-82f7a55017e1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sh9dr\" (UID: \"4a2208fd-d8f7-4b95-9a9c-82f7a55017e1\") " pod="openshift-insights/insights-runtime-extractor-sh9dr"
May 20 13:52:31.501240 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.501121    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d974q\" (UniqueName: \"kubernetes.io/projected/2dcb385e-d1a9-442f-85b2-b2f3537a783d-kube-api-access-d974q\") pod \"image-registry-8cdb97686-22vqz\" (UID: \"2dcb385e-d1a9-442f-85b2-b2f3537a783d\") " pod="openshift-image-registry/image-registry-8cdb97686-22vqz"
May 20 13:52:31.501240 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.501167    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a2208fd-d8f7-4b95-9a9c-82f7a55017e1-data-volume\") pod \"insights-runtime-extractor-sh9dr\" (UID: \"4a2208fd-d8f7-4b95-9a9c-82f7a55017e1\") " pod="openshift-insights/insights-runtime-extractor-sh9dr"
May 20 13:52:31.501240 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.501191    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2dcb385e-d1a9-442f-85b2-b2f3537a783d-installation-pull-secrets\") pod \"image-registry-8cdb97686-22vqz\" (UID: \"2dcb385e-d1a9-442f-85b2-b2f3537a783d\") " pod="openshift-image-registry/image-registry-8cdb97686-22vqz"
May 20 13:52:31.501240 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.501223    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2dcb385e-d1a9-442f-85b2-b2f3537a783d-image-registry-private-configuration\") pod \"image-registry-8cdb97686-22vqz\" (UID: \"2dcb385e-d1a9-442f-85b2-b2f3537a783d\") " pod="openshift-image-registry/image-registry-8cdb97686-22vqz"
May 20 13:52:31.501496 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.501472    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2dcb385e-d1a9-442f-85b2-b2f3537a783d-registry-certificates\") pod \"image-registry-8cdb97686-22vqz\" (UID: \"2dcb385e-d1a9-442f-85b2-b2f3537a783d\") " pod="openshift-image-registry/image-registry-8cdb97686-22vqz"
May 20 13:52:31.501552 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.501532    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2dcb385e-d1a9-442f-85b2-b2f3537a783d-ca-trust-extracted\") pod \"image-registry-8cdb97686-22vqz\" (UID: \"2dcb385e-d1a9-442f-85b2-b2f3537a783d\") " pod="openshift-image-registry/image-registry-8cdb97686-22vqz"
May 20 13:52:31.501605 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.501578    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a2208fd-d8f7-4b95-9a9c-82f7a55017e1-data-volume\") pod \"insights-runtime-extractor-sh9dr\" (UID: \"4a2208fd-d8f7-4b95-9a9c-82f7a55017e1\") " pod="openshift-insights/insights-runtime-extractor-sh9dr"
May 20 13:52:31.501651 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.501583    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4a2208fd-d8f7-4b95-9a9c-82f7a55017e1-crio-socket\") pod \"insights-runtime-extractor-sh9dr\" (UID: \"4a2208fd-d8f7-4b95-9a9c-82f7a55017e1\") " pod="openshift-insights/insights-runtime-extractor-sh9dr"
May 20 13:52:31.501651 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.501640    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4a2208fd-d8f7-4b95-9a9c-82f7a55017e1-crio-socket\") pod \"insights-runtime-extractor-sh9dr\" (UID: \"4a2208fd-d8f7-4b95-9a9c-82f7a55017e1\") " pod="openshift-insights/insights-runtime-extractor-sh9dr"
May 20 13:52:31.501744 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.501654    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2dcb385e-d1a9-442f-85b2-b2f3537a783d-bound-sa-token\") pod \"image-registry-8cdb97686-22vqz\" (UID: \"2dcb385e-d1a9-442f-85b2-b2f3537a783d\") " pod="openshift-image-registry/image-registry-8cdb97686-22vqz"
May 20 13:52:31.501744 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.501694    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a2208fd-d8f7-4b95-9a9c-82f7a55017e1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sh9dr\" (UID: \"4a2208fd-d8f7-4b95-9a9c-82f7a55017e1\") " pod="openshift-insights/insights-runtime-extractor-sh9dr"
May 20 13:52:31.502237 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.502213    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2dcb385e-d1a9-442f-85b2-b2f3537a783d-trusted-ca\") pod \"image-registry-8cdb97686-22vqz\" (UID: \"2dcb385e-d1a9-442f-85b2-b2f3537a783d\") " pod="openshift-image-registry/image-registry-8cdb97686-22vqz"
May 20 13:52:31.502237 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.502228    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a2208fd-d8f7-4b95-9a9c-82f7a55017e1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sh9dr\" (UID: \"4a2208fd-d8f7-4b95-9a9c-82f7a55017e1\") " pod="openshift-insights/insights-runtime-extractor-sh9dr"
May 20 13:52:31.502461 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.502437    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2dcb385e-d1a9-442f-85b2-b2f3537a783d-ca-trust-extracted\") pod \"image-registry-8cdb97686-22vqz\" (UID: \"2dcb385e-d1a9-442f-85b2-b2f3537a783d\") " pod="openshift-image-registry/image-registry-8cdb97686-22vqz"
May 20 13:52:31.502514 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.502444    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2dcb385e-d1a9-442f-85b2-b2f3537a783d-registry-certificates\") pod \"image-registry-8cdb97686-22vqz\" (UID: \"2dcb385e-d1a9-442f-85b2-b2f3537a783d\") " pod="openshift-image-registry/image-registry-8cdb97686-22vqz"
May 20 13:52:31.503668 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.503650    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a2208fd-d8f7-4b95-9a9c-82f7a55017e1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sh9dr\" (UID: \"4a2208fd-d8f7-4b95-9a9c-82f7a55017e1\") " pod="openshift-insights/insights-runtime-extractor-sh9dr"
May 20 13:52:31.503668 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.503660    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2dcb385e-d1a9-442f-85b2-b2f3537a783d-installation-pull-secrets\") pod \"image-registry-8cdb97686-22vqz\" (UID: \"2dcb385e-d1a9-442f-85b2-b2f3537a783d\") " pod="openshift-image-registry/image-registry-8cdb97686-22vqz"
May 20 13:52:31.503962 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.503945    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2dcb385e-d1a9-442f-85b2-b2f3537a783d-registry-tls\") pod \"image-registry-8cdb97686-22vqz\" (UID: \"2dcb385e-d1a9-442f-85b2-b2f3537a783d\") " pod="openshift-image-registry/image-registry-8cdb97686-22vqz"
May 20 13:52:31.504053 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.504034    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2dcb385e-d1a9-442f-85b2-b2f3537a783d-image-registry-private-configuration\") pod \"image-registry-8cdb97686-22vqz\" (UID: \"2dcb385e-d1a9-442f-85b2-b2f3537a783d\") " pod="openshift-image-registry/image-registry-8cdb97686-22vqz"
May 20 13:52:31.514899 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.514878    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2dcb385e-d1a9-442f-85b2-b2f3537a783d-bound-sa-token\") pod \"image-registry-8cdb97686-22vqz\" (UID: \"2dcb385e-d1a9-442f-85b2-b2f3537a783d\") " pod="openshift-image-registry/image-registry-8cdb97686-22vqz"
May 20 13:52:31.515023 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.515008    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrvr7\" (UniqueName: \"kubernetes.io/projected/4a2208fd-d8f7-4b95-9a9c-82f7a55017e1-kube-api-access-xrvr7\") pod \"insights-runtime-extractor-sh9dr\" (UID: \"4a2208fd-d8f7-4b95-9a9c-82f7a55017e1\") " pod="openshift-insights/insights-runtime-extractor-sh9dr"
May 20 13:52:31.518416 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.518392    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d974q\" (UniqueName: \"kubernetes.io/projected/2dcb385e-d1a9-442f-85b2-b2f3537a783d-kube-api-access-d974q\") pod \"image-registry-8cdb97686-22vqz\" (UID: \"2dcb385e-d1a9-442f-85b2-b2f3537a783d\") " pod="openshift-image-registry/image-registry-8cdb97686-22vqz"
May 20 13:52:31.530392 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.530371    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sh9dr"
May 20 13:52:31.598966 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.598916    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8cdb97686-22vqz"
May 20 13:52:31.661671 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.661589    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sh9dr"]
May 20 13:52:31.663803 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:52:31.663776    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a2208fd_d8f7_4b95_9a9c_82f7a55017e1.slice/crio-40cb9bf248a6a827eb65fbd8eb3dbb32523894668e7b11cb05e4c517c98cfd45 WatchSource:0}: Error finding container 40cb9bf248a6a827eb65fbd8eb3dbb32523894668e7b11cb05e4c517c98cfd45: Status 404 returned error can't find the container with id 40cb9bf248a6a827eb65fbd8eb3dbb32523894668e7b11cb05e4c517c98cfd45
May 20 13:52:31.759048 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:31.758994    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8cdb97686-22vqz"]
May 20 13:52:31.763608 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:52:31.763583    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dcb385e_d1a9_442f_85b2_b2f3537a783d.slice/crio-3ffec154ce7ad5778cc6dd6aae9dacf54cfad974e19c3e4639d9670b78434f36 WatchSource:0}: Error finding container 3ffec154ce7ad5778cc6dd6aae9dacf54cfad974e19c3e4639d9670b78434f36: Status 404 returned error can't find the container with id 3ffec154ce7ad5778cc6dd6aae9dacf54cfad974e19c3e4639d9670b78434f36
May 20 13:52:32.158276 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:32.158201    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sh9dr" event={"ID":"4a2208fd-d8f7-4b95-9a9c-82f7a55017e1","Type":"ContainerStarted","Data":"d094b76a23381a804bbdedabe204240dadee224db99e146a80895270d3bf0297"}
May 20 13:52:32.158276 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:32.158236    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sh9dr" event={"ID":"4a2208fd-d8f7-4b95-9a9c-82f7a55017e1","Type":"ContainerStarted","Data":"40cb9bf248a6a827eb65fbd8eb3dbb32523894668e7b11cb05e4c517c98cfd45"}
May 20 13:52:32.159357 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:32.159331    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8cdb97686-22vqz" event={"ID":"2dcb385e-d1a9-442f-85b2-b2f3537a783d","Type":"ContainerStarted","Data":"5ed32eeda3f646d2a654c784dcdf3883575fff6f4228bc6f284b75fd1b8341c9"}
May 20 13:52:32.159490 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:32.159360    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8cdb97686-22vqz" event={"ID":"2dcb385e-d1a9-442f-85b2-b2f3537a783d","Type":"ContainerStarted","Data":"3ffec154ce7ad5778cc6dd6aae9dacf54cfad974e19c3e4639d9670b78434f36"}
May 20 13:52:32.159490 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:32.159467    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8cdb97686-22vqz"
May 20 13:52:32.197608 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:32.197575    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8cdb97686-22vqz" podStartSLOduration=1.197565037 podStartE2EDuration="1.197565037s" podCreationTimestamp="2026-05-20 13:52:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 13:52:32.197305925 +0000 UTC m=+162.070093072" watchObservedRunningTime="2026-05-20 13:52:32.197565037 +0000 UTC m=+162.070352192"
May 20 13:52:32.409744 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:32.409680    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/465db268-d10e-4f15-937a-0ff0f966b831-metrics-tls\") pod \"dns-default-b64ll\" (UID: \"465db268-d10e-4f15-937a-0ff0f966b831\") " pod="openshift-dns/dns-default-b64ll"
May 20 13:52:32.409744 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:32.409738    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2605e754-d0c5-49d1-87e4-d0d4b0f4088e-cert\") pod \"ingress-canary-9lhwc\" (UID: \"2605e754-d0c5-49d1-87e4-d0d4b0f4088e\") " pod="openshift-ingress-canary/ingress-canary-9lhwc"
May 20 13:52:32.412137 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:32.412111    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/465db268-d10e-4f15-937a-0ff0f966b831-metrics-tls\") pod \"dns-default-b64ll\" (UID: \"465db268-d10e-4f15-937a-0ff0f966b831\") " pod="openshift-dns/dns-default-b64ll"
May 20 13:52:32.412260 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:32.412188    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2605e754-d0c5-49d1-87e4-d0d4b0f4088e-cert\") pod \"ingress-canary-9lhwc\" (UID: \"2605e754-d0c5-49d1-87e4-d0d4b0f4088e\") " pod="openshift-ingress-canary/ingress-canary-9lhwc"
May 20 13:52:32.653770 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:32.653750    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wmcgw\""
May 20 13:52:32.658746 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:32.658731    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b64ll"
May 20 13:52:32.790357 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:32.790333    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b64ll"]
May 20 13:52:32.792684 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:52:32.792657    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod465db268_d10e_4f15_937a_0ff0f966b831.slice/crio-61a425dad524c88399069e286333cf145937348f6b3e3015f13eccc77636a8ef WatchSource:0}: Error finding container 61a425dad524c88399069e286333cf145937348f6b3e3015f13eccc77636a8ef: Status 404 returned error can't find the container with id 61a425dad524c88399069e286333cf145937348f6b3e3015f13eccc77636a8ef
May 20 13:52:33.164180 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:33.164141    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sh9dr" event={"ID":"4a2208fd-d8f7-4b95-9a9c-82f7a55017e1","Type":"ContainerStarted","Data":"90d398a99b50a946a790a6a0bae347b1d68cc1dfcf6c626cb2946b699dd77372"}
May 20 13:52:33.165432 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:33.165401    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b64ll" event={"ID":"465db268-d10e-4f15-937a-0ff0f966b831","Type":"ContainerStarted","Data":"61a425dad524c88399069e286333cf145937348f6b3e3015f13eccc77636a8ef"}
May 20 13:52:35.172392 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:35.172349    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sh9dr" event={"ID":"4a2208fd-d8f7-4b95-9a9c-82f7a55017e1","Type":"ContainerStarted","Data":"cc86cd28a8318f0b5d9fad4d3b2659bd4a7f33a5af0d9decb3ceed79498aaefb"}
May 20 13:52:35.174357 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:35.174330    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b64ll" event={"ID":"465db268-d10e-4f15-937a-0ff0f966b831","Type":"ContainerStarted","Data":"bd020f69134ceba9d638dc97549e95f0fbe974a924a97f4f6e2b89834783d59c"}
May 20 13:52:35.174437 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:35.174364    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b64ll" event={"ID":"465db268-d10e-4f15-937a-0ff0f966b831","Type":"ContainerStarted","Data":"ce3f19c80e0d8c64a6360810c5892a2346f55bc1451ef9e5d83c109ee3edd533"}
May 20 13:52:35.174500 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:35.174487    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-b64ll"
May 20 13:52:35.195264 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:35.195210    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-sh9dr" podStartSLOduration=1.665941572 podStartE2EDuration="4.195193666s" podCreationTimestamp="2026-05-20 13:52:31 +0000 UTC" firstStartedPulling="2026-05-20 13:52:31.719638496 +0000 UTC m=+161.592425631" lastFinishedPulling="2026-05-20 13:52:34.248890587 +0000 UTC m=+164.121677725" observedRunningTime="2026-05-20 13:52:35.194722786 +0000 UTC m=+165.067509943" watchObservedRunningTime="2026-05-20 13:52:35.195193666 +0000 UTC m=+165.067980823"
May 20 13:52:35.213640 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:35.213595    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-b64ll" podStartSLOduration=129.756078778 podStartE2EDuration="2m11.213586101s" podCreationTimestamp="2026-05-20 13:50:24 +0000 UTC" firstStartedPulling="2026-05-20 13:52:32.794373539 +0000 UTC m=+162.667160674" lastFinishedPulling="2026-05-20 13:52:34.251880863 +0000 UTC m=+164.124667997" observedRunningTime="2026-05-20 13:52:35.213412024 +0000 UTC m=+165.086199181" watchObservedRunningTime="2026-05-20 13:52:35.213586101 +0000 UTC m=+165.086373256"
May 20 13:52:35.431693 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:35.431627    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/011983a7-38e4-4e05-bace-2205c8447d2e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-9bc4w\" (UID: \"011983a7-38e4-4e05-bace-2205c8447d2e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9bc4w"
May 20 13:52:35.434141 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:35.434122    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/011983a7-38e4-4e05-bace-2205c8447d2e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-9bc4w\" (UID: \"011983a7-38e4-4e05-bace-2205c8447d2e\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9bc4w"
May 20 13:52:35.435978 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:35.435947    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9bc4w"
May 20 13:52:35.583787 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:35.583623    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-9bc4w"]
May 20 13:52:35.586084 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:52:35.586059    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod011983a7_38e4_4e05_bace_2205c8447d2e.slice/crio-6beed66b32fcd0912ebd6564d12144c5079e334a184e99cbf03ec353d7ed6733 WatchSource:0}: Error finding container 6beed66b32fcd0912ebd6564d12144c5079e334a184e99cbf03ec353d7ed6733: Status 404 returned error can't find the container with id 6beed66b32fcd0912ebd6564d12144c5079e334a184e99cbf03ec353d7ed6733
May 20 13:52:36.178379 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:36.178340    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9bc4w" event={"ID":"011983a7-38e4-4e05-bace-2205c8447d2e","Type":"ContainerStarted","Data":"6beed66b32fcd0912ebd6564d12144c5079e334a184e99cbf03ec353d7ed6733"}
May 20 13:52:37.993422 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:37.993391    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-j79t9"]
May 20 13:52:37.996407 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:37.996386    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-j79t9"
May 20 13:52:37.999275 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:37.999242    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 20 13:52:37.999972 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:37.999954    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-ktx6s\""
May 20 13:52:38.014082 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:38.014064    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-j79t9"]
May 20 13:52:38.149834 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:38.149809    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/340cddac-72d0-4800-a21d-8ee64d1a0177-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-j79t9\" (UID: \"340cddac-72d0-4800-a21d-8ee64d1a0177\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-j79t9"
May 20 13:52:38.185111 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:38.185088    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9bc4w" event={"ID":"011983a7-38e4-4e05-bace-2205c8447d2e","Type":"ContainerStarted","Data":"0b1687595cd106445376bbcb1c92fb1355153f913d31ce7c9e172bdcd8356321"}
May 20 13:52:38.206855 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:38.206819    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9bc4w" podStartSLOduration=33.411808242 podStartE2EDuration="35.2068098s" podCreationTimestamp="2026-05-20 13:52:03 +0000 UTC" firstStartedPulling="2026-05-20 13:52:35.589776998 +0000 UTC m=+165.462564150" lastFinishedPulling="2026-05-20 13:52:37.384778574 +0000 UTC m=+167.257565708" observedRunningTime="2026-05-20 13:52:38.205908934 +0000 UTC m=+168.078696352" watchObservedRunningTime="2026-05-20 13:52:38.2068098 +0000 UTC m=+168.079596955"
May 20 13:52:38.250698 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:38.250649    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/340cddac-72d0-4800-a21d-8ee64d1a0177-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-j79t9\" (UID: \"340cddac-72d0-4800-a21d-8ee64d1a0177\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-j79t9"
May 20 13:52:38.250808 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:52:38.250738    2571 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
May 20 13:52:38.250808 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:52:38.250782    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/340cddac-72d0-4800-a21d-8ee64d1a0177-tls-certificates podName:340cddac-72d0-4800-a21d-8ee64d1a0177 nodeName:}" failed. No retries permitted until 2026-05-20 13:52:38.750770393 +0000 UTC m=+168.623557528 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/340cddac-72d0-4800-a21d-8ee64d1a0177-tls-certificates") pod "prometheus-operator-admission-webhook-6c4bbc67b7-j79t9" (UID: "340cddac-72d0-4800-a21d-8ee64d1a0177") : secret "prometheus-operator-admission-webhook-tls" not found
May 20 13:52:38.754887 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:38.754859    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/340cddac-72d0-4800-a21d-8ee64d1a0177-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-j79t9\" (UID: \"340cddac-72d0-4800-a21d-8ee64d1a0177\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-j79t9"
May 20 13:52:38.757342 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:38.757314    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/340cddac-72d0-4800-a21d-8ee64d1a0177-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-j79t9\" (UID: \"340cddac-72d0-4800-a21d-8ee64d1a0177\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-j79t9"
May 20 13:52:38.904659 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:38.904627    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-j79t9"
May 20 13:52:39.026102 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:39.026044    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-j79t9"]
May 20 13:52:39.029291 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:52:39.029265    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod340cddac_72d0_4800_a21d_8ee64d1a0177.slice/crio-c8dc792140f0de89d40773bd94e2901cfe30b8866aef00a1485b6479f002d140 WatchSource:0}: Error finding container c8dc792140f0de89d40773bd94e2901cfe30b8866aef00a1485b6479f002d140: Status 404 returned error can't find the container with id c8dc792140f0de89d40773bd94e2901cfe30b8866aef00a1485b6479f002d140
May 20 13:52:39.187923 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:39.187896    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-j79t9" event={"ID":"340cddac-72d0-4800-a21d-8ee64d1a0177","Type":"ContainerStarted","Data":"c8dc792140f0de89d40773bd94e2901cfe30b8866aef00a1485b6479f002d140"}
May 20 13:52:41.194104 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:41.194055    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-j79t9" event={"ID":"340cddac-72d0-4800-a21d-8ee64d1a0177","Type":"ContainerStarted","Data":"8ed361e48232c9c159d1e637f7331919ac4dedbcf594435e2f0b01ae77224312"}
May 20 13:52:41.194520 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:41.194323    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-j79t9"
May 20 13:52:41.199177 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:41.199149    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-j79t9"
May 20 13:52:41.211427 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:41.211350    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-j79t9" podStartSLOduration=3.059704976 podStartE2EDuration="4.211335283s" podCreationTimestamp="2026-05-20 13:52:37 +0000 UTC" firstStartedPulling="2026-05-20 13:52:39.031136643 +0000 UTC m=+168.903923777" lastFinishedPulling="2026-05-20 13:52:40.182766935 +0000 UTC m=+170.055554084" observedRunningTime="2026-05-20 13:52:41.210625586 +0000 UTC m=+171.083412742" watchObservedRunningTime="2026-05-20 13:52:41.211335283 +0000 UTC m=+171.084122437"
May 20 13:52:41.244746 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:41.244718    2571 patch_prober.go:28] interesting pod/image-registry-65965b4c78-z2crt container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 20 13:52:41.244856 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:41.244773    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-65965b4c78-z2crt" podUID="f7493ea8-da00-412d-9904-69f5291dabaf" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 13:52:42.055223 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:42.055194    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-kpkch"]
May 20 13:52:42.058300 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:42.058284    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-kpkch"
May 20 13:52:42.061605 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:42.061580    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
May 20 13:52:42.061760 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:42.061591    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-dg74w\""
May 20 13:52:42.061914 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:42.061630    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 20 13:52:42.062026 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:42.061636    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
May 20 13:52:42.068734 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:42.068716    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-kpkch"]
May 20 13:52:42.178179 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:42.178148    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eef4416c-0eb6-4fa0-a5f4-c1237fdeadec-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-kpkch\" (UID: \"eef4416c-0eb6-4fa0-a5f4-c1237fdeadec\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-kpkch"
May 20 13:52:42.178291 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:42.178190    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eef4416c-0eb6-4fa0-a5f4-c1237fdeadec-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-kpkch\" (UID: \"eef4416c-0eb6-4fa0-a5f4-c1237fdeadec\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-kpkch"
May 20 13:52:42.178291 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:42.178227    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/eef4416c-0eb6-4fa0-a5f4-c1237fdeadec-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-kpkch\" (UID: \"eef4416c-0eb6-4fa0-a5f4-c1237fdeadec\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-kpkch"
May 20 13:52:42.178291 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:42.178260    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snmgd\" (UniqueName: \"kubernetes.io/projected/eef4416c-0eb6-4fa0-a5f4-c1237fdeadec-kube-api-access-snmgd\") pod \"prometheus-operator-7779bbdd78-kpkch\" (UID: \"eef4416c-0eb6-4fa0-a5f4-c1237fdeadec\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-kpkch"
May 20 13:52:42.278531 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:42.278506    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eef4416c-0eb6-4fa0-a5f4-c1237fdeadec-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-kpkch\" (UID: \"eef4416c-0eb6-4fa0-a5f4-c1237fdeadec\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-kpkch"
May 20 13:52:42.278861 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:42.278538    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eef4416c-0eb6-4fa0-a5f4-c1237fdeadec-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-kpkch\" (UID: \"eef4416c-0eb6-4fa0-a5f4-c1237fdeadec\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-kpkch"
May 20 13:52:42.278861 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:42.278560    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/eef4416c-0eb6-4fa0-a5f4-c1237fdeadec-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-kpkch\" (UID: \"eef4416c-0eb6-4fa0-a5f4-c1237fdeadec\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-kpkch"
May 20 13:52:42.278861 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:42.278581    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-snmgd\" (UniqueName: \"kubernetes.io/projected/eef4416c-0eb6-4fa0-a5f4-c1237fdeadec-kube-api-access-snmgd\") pod \"prometheus-operator-7779bbdd78-kpkch\" (UID: \"eef4416c-0eb6-4fa0-a5f4-c1237fdeadec\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-kpkch"
May 20 13:52:42.278861 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:52:42.278670    2571 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
May 20 13:52:42.278861 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:52:42.278728    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eef4416c-0eb6-4fa0-a5f4-c1237fdeadec-prometheus-operator-tls podName:eef4416c-0eb6-4fa0-a5f4-c1237fdeadec nodeName:}" failed. No retries permitted until 2026-05-20 13:52:42.778710955 +0000 UTC m=+172.651498107 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/eef4416c-0eb6-4fa0-a5f4-c1237fdeadec-prometheus-operator-tls") pod "prometheus-operator-7779bbdd78-kpkch" (UID: "eef4416c-0eb6-4fa0-a5f4-c1237fdeadec") : secret "prometheus-operator-tls" not found
May 20 13:52:42.279312 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:42.279291    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eef4416c-0eb6-4fa0-a5f4-c1237fdeadec-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-kpkch\" (UID: \"eef4416c-0eb6-4fa0-a5f4-c1237fdeadec\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-kpkch"
May 20 13:52:42.280837 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:42.280818    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eef4416c-0eb6-4fa0-a5f4-c1237fdeadec-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-kpkch\" (UID: \"eef4416c-0eb6-4fa0-a5f4-c1237fdeadec\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-kpkch"
May 20 13:52:42.287425 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:42.287403    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snmgd\" (UniqueName: \"kubernetes.io/projected/eef4416c-0eb6-4fa0-a5f4-c1237fdeadec-kube-api-access-snmgd\") pod \"prometheus-operator-7779bbdd78-kpkch\" (UID: \"eef4416c-0eb6-4fa0-a5f4-c1237fdeadec\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-kpkch"
May 20 13:52:42.661768 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:42.661742    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhqmq"
May 20 13:52:42.661898 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:42.661743    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9lhwc"
May 20 13:52:42.664287 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:42.664265    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8tpd8\""
May 20 13:52:42.672558 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:42.672543    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9lhwc"
May 20 13:52:42.780728 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:42.780697    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/eef4416c-0eb6-4fa0-a5f4-c1237fdeadec-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-kpkch\" (UID: \"eef4416c-0eb6-4fa0-a5f4-c1237fdeadec\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-kpkch"
May 20 13:52:42.782898 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:42.782872    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/eef4416c-0eb6-4fa0-a5f4-c1237fdeadec-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-kpkch\" (UID: \"eef4416c-0eb6-4fa0-a5f4-c1237fdeadec\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-kpkch"
May 20 13:52:42.791001 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:42.790979    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9lhwc"]
May 20 13:52:42.793736 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:52:42.793711    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2605e754_d0c5_49d1_87e4_d0d4b0f4088e.slice/crio-7ed77315b0803eac5dcb847a43e2eaa4739516041284e1377c8620ec8f32cb4e WatchSource:0}: Error finding container 7ed77315b0803eac5dcb847a43e2eaa4739516041284e1377c8620ec8f32cb4e: Status 404 returned error can't find the container with id 7ed77315b0803eac5dcb847a43e2eaa4739516041284e1377c8620ec8f32cb4e
May 20 13:52:42.967770 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:42.967741    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-kpkch"
May 20 13:52:43.084592 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:43.084561    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-kpkch"]
May 20 13:52:43.087406 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:52:43.087384    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeef4416c_0eb6_4fa0_a5f4_c1237fdeadec.slice/crio-9d3d21420e348ab0d1d213d15cce0d8895f508bdbe3359e46797b0905d8610c7 WatchSource:0}: Error finding container 9d3d21420e348ab0d1d213d15cce0d8895f508bdbe3359e46797b0905d8610c7: Status 404 returned error can't find the container with id 9d3d21420e348ab0d1d213d15cce0d8895f508bdbe3359e46797b0905d8610c7
May 20 13:52:43.199671 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:43.199644    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9lhwc" event={"ID":"2605e754-d0c5-49d1-87e4-d0d4b0f4088e","Type":"ContainerStarted","Data":"7ed77315b0803eac5dcb847a43e2eaa4739516041284e1377c8620ec8f32cb4e"}
May 20 13:52:43.200750 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:43.200729    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-kpkch" event={"ID":"eef4416c-0eb6-4fa0-a5f4-c1237fdeadec","Type":"ContainerStarted","Data":"9d3d21420e348ab0d1d213d15cce0d8895f508bdbe3359e46797b0905d8610c7"}
May 20 13:52:45.181508 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:45.181476    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-b64ll"
May 20 13:52:45.209049 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:45.209014    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-kpkch" event={"ID":"eef4416c-0eb6-4fa0-a5f4-c1237fdeadec","Type":"ContainerStarted","Data":"3bddea621ec12b5e8d49dcf0107b22a02beea87136f7783706be2d6839d2bbbb"}
May 20 13:52:45.209239 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:45.209056    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-kpkch" event={"ID":"eef4416c-0eb6-4fa0-a5f4-c1237fdeadec","Type":"ContainerStarted","Data":"aa44394eae9a2b41c18c4ff7b45b895a433c7c92adf67ef01935f102c7833b45"}
May 20 13:52:45.210702 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:45.210671    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9lhwc" event={"ID":"2605e754-d0c5-49d1-87e4-d0d4b0f4088e","Type":"ContainerStarted","Data":"020da09d06b2fcf46bfb1ad41bf67cc9ff310746f9c179c81adb7800e24b20ea"}
May 20 13:52:45.225110 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:45.225054    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-kpkch" podStartSLOduration=1.636847107 podStartE2EDuration="3.225035964s" podCreationTimestamp="2026-05-20 13:52:42 +0000 UTC" firstStartedPulling="2026-05-20 13:52:43.089134915 +0000 UTC m=+172.961922050" lastFinishedPulling="2026-05-20 13:52:44.677323773 +0000 UTC m=+174.550110907" observedRunningTime="2026-05-20 13:52:45.224417025 +0000 UTC m=+175.097204183" watchObservedRunningTime="2026-05-20 13:52:45.225035964 +0000 UTC m=+175.097823122"
May 20 13:52:45.239887 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:45.239848    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9lhwc" podStartSLOduration=139.357902576 podStartE2EDuration="2m21.239836002s" podCreationTimestamp="2026-05-20 13:50:24 +0000 UTC" firstStartedPulling="2026-05-20 13:52:42.795445024 +0000 UTC m=+172.668232159" lastFinishedPulling="2026-05-20 13:52:44.677378451 +0000 UTC m=+174.550165585" observedRunningTime="2026-05-20 13:52:45.238126479 +0000 UTC m=+175.110913638" watchObservedRunningTime="2026-05-20 13:52:45.239836002 +0000 UTC m=+175.112623158"
May 20 13:52:47.492106 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:47.492073    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dd58g"]
May 20 13:52:47.495276 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:47.495258    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dd58g"
May 20 13:52:47.504331 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:47.504312    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 20 13:52:47.506905 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:47.506887    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 20 13:52:47.507007 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:47.506943    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-78qbf\""
May 20 13:52:47.507283 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:47.507269    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 20 13:52:47.616621 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:47.616594    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b246995-b0aa-4a0d-9d5e-85bf2ee4359d-metrics-client-ca\") pod \"node-exporter-dd58g\" (UID: \"1b246995-b0aa-4a0d-9d5e-85bf2ee4359d\") " pod="openshift-monitoring/node-exporter-dd58g"
May 20 13:52:47.616735 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:47.616653    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhj5z\" (UniqueName: \"kubernetes.io/projected/1b246995-b0aa-4a0d-9d5e-85bf2ee4359d-kube-api-access-fhj5z\") pod \"node-exporter-dd58g\" (UID: \"1b246995-b0aa-4a0d-9d5e-85bf2ee4359d\") " pod="openshift-monitoring/node-exporter-dd58g"
May 20 13:52:47.616735 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:47.616691    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1b246995-b0aa-4a0d-9d5e-85bf2ee4359d-node-exporter-textfile\") pod \"node-exporter-dd58g\" (UID: \"1b246995-b0aa-4a0d-9d5e-85bf2ee4359d\") " pod="openshift-monitoring/node-exporter-dd58g"
May 20 13:52:47.616735 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:47.616715    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1b246995-b0aa-4a0d-9d5e-85bf2ee4359d-node-exporter-tls\") pod \"node-exporter-dd58g\" (UID: \"1b246995-b0aa-4a0d-9d5e-85bf2ee4359d\") " pod="openshift-monitoring/node-exporter-dd58g"
May 20 13:52:47.616885 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:47.616745    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1b246995-b0aa-4a0d-9d5e-85bf2ee4359d-node-exporter-accelerators-collector-config\") pod \"node-exporter-dd58g\" (UID: \"1b246995-b0aa-4a0d-9d5e-85bf2ee4359d\") " pod="openshift-monitoring/node-exporter-dd58g"
May 20 13:52:47.616885 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:47.616769    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b246995-b0aa-4a0d-9d5e-85bf2ee4359d-sys\") pod \"node-exporter-dd58g\" (UID: \"1b246995-b0aa-4a0d-9d5e-85bf2ee4359d\") " pod="openshift-monitoring/node-exporter-dd58g"
May 20 13:52:47.616885 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:47.616798    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1b246995-b0aa-4a0d-9d5e-85bf2ee4359d-root\") pod \"node-exporter-dd58g\" (UID: \"1b246995-b0aa-4a0d-9d5e-85bf2ee4359d\") " pod="openshift-monitoring/node-exporter-dd58g"
May 20 13:52:47.616885 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:47.616819    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1b246995-b0aa-4a0d-9d5e-85bf2ee4359d-node-exporter-wtmp\") pod \"node-exporter-dd58g\" (UID: \"1b246995-b0aa-4a0d-9d5e-85bf2ee4359d\") " pod="openshift-monitoring/node-exporter-dd58g"
May 20 13:52:47.616885 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:47.616846    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b246995-b0aa-4a0d-9d5e-85bf2ee4359d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dd58g\" (UID: \"1b246995-b0aa-4a0d-9d5e-85bf2ee4359d\") " pod="openshift-monitoring/node-exporter-dd58g"
May 20 13:52:47.717877 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:47.717845    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1b246995-b0aa-4a0d-9d5e-85bf2ee4359d-node-exporter-textfile\") pod \"node-exporter-dd58g\" (UID: \"1b246995-b0aa-4a0d-9d5e-85bf2ee4359d\") " pod="openshift-monitoring/node-exporter-dd58g"
May 20 13:52:47.717995 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:47.717884    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1b246995-b0aa-4a0d-9d5e-85bf2ee4359d-node-exporter-tls\") pod \"node-exporter-dd58g\" (UID: \"1b246995-b0aa-4a0d-9d5e-85bf2ee4359d\") " pod="openshift-monitoring/node-exporter-dd58g"
May 20 13:52:47.717995 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:47.717914    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1b246995-b0aa-4a0d-9d5e-85bf2ee4359d-node-exporter-accelerators-collector-config\") pod \"node-exporter-dd58g\" (UID: \"1b246995-b0aa-4a0d-9d5e-85bf2ee4359d\") " pod="openshift-monitoring/node-exporter-dd58g"
May 20 13:52:47.717995 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:47.717959    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b246995-b0aa-4a0d-9d5e-85bf2ee4359d-sys\") pod \"node-exporter-dd58g\" (UID: \"1b246995-b0aa-4a0d-9d5e-85bf2ee4359d\") " pod="openshift-monitoring/node-exporter-dd58g"
May 20 13:52:47.718148 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:47.718021    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1b246995-b0aa-4a0d-9d5e-85bf2ee4359d-root\") pod \"node-exporter-dd58g\" (UID: \"1b246995-b0aa-4a0d-9d5e-85bf2ee4359d\") " pod="openshift-monitoring/node-exporter-dd58g"
May 20 13:52:47.718148 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:47.718092    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1b246995-b0aa-4a0d-9d5e-85bf2ee4359d-root\") pod \"node-exporter-dd58g\" (UID: \"1b246995-b0aa-4a0d-9d5e-85bf2ee4359d\") " pod="openshift-monitoring/node-exporter-dd58g"
May 20 13:52:47.718243 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:47.718143    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b246995-b0aa-4a0d-9d5e-85bf2ee4359d-sys\") pod \"node-exporter-dd58g\" (UID: \"1b246995-b0aa-4a0d-9d5e-85bf2ee4359d\") " pod="openshift-monitoring/node-exporter-dd58g"
May 20 13:52:47.718243 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:47.718086    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1b246995-b0aa-4a0d-9d5e-85bf2ee4359d-node-exporter-wtmp\") pod \"node-exporter-dd58g\" (UID: \"1b246995-b0aa-4a0d-9d5e-85bf2ee4359d\") " pod="openshift-monitoring/node-exporter-dd58g"
May 20 13:52:47.718243 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:47.718213    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1b246995-b0aa-4a0d-9d5e-85bf2ee4359d-node-exporter-textfile\") pod \"node-exporter-dd58g\" (UID: \"1b246995-b0aa-4a0d-9d5e-85bf2ee4359d\") " pod="openshift-monitoring/node-exporter-dd58g"
May 20 13:52:47.718243 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:47.718236    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b246995-b0aa-4a0d-9d5e-85bf2ee4359d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dd58g\" (UID: \"1b246995-b0aa-4a0d-9d5e-85bf2ee4359d\") " pod="openshift-monitoring/node-exporter-dd58g"
May 20 13:52:47.718430 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:47.718280    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1b246995-b0aa-4a0d-9d5e-85bf2ee4359d-node-exporter-wtmp\") pod \"node-exporter-dd58g\" (UID: \"1b246995-b0aa-4a0d-9d5e-85bf2ee4359d\") " pod="openshift-monitoring/node-exporter-dd58g"
May 20 13:52:47.718430 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:47.718310    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b246995-b0aa-4a0d-9d5e-85bf2ee4359d-metrics-client-ca\") pod \"node-exporter-dd58g\" (UID: \"1b246995-b0aa-4a0d-9d5e-85bf2ee4359d\") " pod="openshift-monitoring/node-exporter-dd58g"
May 20 13:52:47.718430 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:47.718374    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fhj5z\" (UniqueName: \"kubernetes.io/projected/1b246995-b0aa-4a0d-9d5e-85bf2ee4359d-kube-api-access-fhj5z\") pod \"node-exporter-dd58g\" (UID: \"1b246995-b0aa-4a0d-9d5e-85bf2ee4359d\") " pod="openshift-monitoring/node-exporter-dd58g"
May 20 13:52:47.718852 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:47.718815    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b246995-b0aa-4a0d-9d5e-85bf2ee4359d-metrics-client-ca\") pod \"node-exporter-dd58g\" (UID: \"1b246995-b0aa-4a0d-9d5e-85bf2ee4359d\") " pod="openshift-monitoring/node-exporter-dd58g"
May 20 13:52:47.718969 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:47.718880    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1b246995-b0aa-4a0d-9d5e-85bf2ee4359d-node-exporter-accelerators-collector-config\") pod \"node-exporter-dd58g\" (UID: \"1b246995-b0aa-4a0d-9d5e-85bf2ee4359d\") " pod="openshift-monitoring/node-exporter-dd58g"
May 20 13:52:47.721997 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:47.721683    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1b246995-b0aa-4a0d-9d5e-85bf2ee4359d-node-exporter-tls\") pod \"node-exporter-dd58g\" (UID: \"1b246995-b0aa-4a0d-9d5e-85bf2ee4359d\") " pod="openshift-monitoring/node-exporter-dd58g"
May 20 13:52:47.721997 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:47.721958    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b246995-b0aa-4a0d-9d5e-85bf2ee4359d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dd58g\" (UID: \"1b246995-b0aa-4a0d-9d5e-85bf2ee4359d\") " pod="openshift-monitoring/node-exporter-dd58g"
May 20 13:52:47.731643 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:47.731622    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhj5z\" (UniqueName: \"kubernetes.io/projected/1b246995-b0aa-4a0d-9d5e-85bf2ee4359d-kube-api-access-fhj5z\") pod \"node-exporter-dd58g\" (UID: \"1b246995-b0aa-4a0d-9d5e-85bf2ee4359d\") " pod="openshift-monitoring/node-exporter-dd58g"
May 20 13:52:47.803724 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:47.803676    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dd58g"
May 20 13:52:47.813824 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:52:47.813794    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b246995_b0aa_4a0d_9d5e_85bf2ee4359d.slice/crio-1ad462540983b0e6c8d8893b76809e443f5b994cdd506a67a50a764ef78a7408 WatchSource:0}: Error finding container 1ad462540983b0e6c8d8893b76809e443f5b994cdd506a67a50a764ef78a7408: Status 404 returned error can't find the container with id 1ad462540983b0e6c8d8893b76809e443f5b994cdd506a67a50a764ef78a7408
May 20 13:52:48.222902 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:48.222875    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dd58g" event={"ID":"1b246995-b0aa-4a0d-9d5e-85bf2ee4359d","Type":"ContainerStarted","Data":"1ad462540983b0e6c8d8893b76809e443f5b994cdd506a67a50a764ef78a7408"}
May 20 13:52:49.226234 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:49.226202    2571 generic.go:358] "Generic (PLEG): container finished" podID="1b246995-b0aa-4a0d-9d5e-85bf2ee4359d" containerID="7cc5060b7e6152c704c4853636ad4e8d16e9a570f09cd279dbf594d688f99b73" exitCode=0
May 20 13:52:49.226668 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:49.226284    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dd58g" event={"ID":"1b246995-b0aa-4a0d-9d5e-85bf2ee4359d","Type":"ContainerDied","Data":"7cc5060b7e6152c704c4853636ad4e8d16e9a570f09cd279dbf594d688f99b73"}
May 20 13:52:50.230761 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:50.230724    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dd58g" event={"ID":"1b246995-b0aa-4a0d-9d5e-85bf2ee4359d","Type":"ContainerStarted","Data":"7c791650320c59ac4d084e49e08c9ab86f3b07e508bbf74ef0ce265b96bd03e4"}
May 20 13:52:50.230761 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:50.230764    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dd58g" event={"ID":"1b246995-b0aa-4a0d-9d5e-85bf2ee4359d","Type":"ContainerStarted","Data":"5bcf91e9c8ea7b49ba546ea160f96a3d79ab8deb867bd8fe2ef8f4f613c63d5e"}
May 20 13:52:51.243917 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:51.243890    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-65965b4c78-z2crt"
May 20 13:52:51.268188 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:51.268099    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dd58g" podStartSLOduration=3.391213023 podStartE2EDuration="4.268084321s" podCreationTimestamp="2026-05-20 13:52:47 +0000 UTC" firstStartedPulling="2026-05-20 13:52:47.815918978 +0000 UTC m=+177.688706127" lastFinishedPulling="2026-05-20 13:52:48.692790285 +0000 UTC m=+178.565577425" observedRunningTime="2026-05-20 13:52:50.254803778 +0000 UTC m=+180.127590934" watchObservedRunningTime="2026-05-20 13:52:51.268084321 +0000 UTC m=+181.140871481"
May 20 13:52:51.896973 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:51.896926    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6c9cc46c9f-mzh8v"]
May 20 13:52:51.901186 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:51.901171    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6c9cc46c9f-mzh8v"
May 20 13:52:51.903711 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:51.903681    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
May 20 13:52:51.903834 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:51.903743    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8mbarlvr4bdte\""
May 20 13:52:51.904845 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:51.904829    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-dqjfw\""
May 20 13:52:51.904950 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:51.904875    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
May 20 13:52:51.904950 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:51.904891    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
May 20 13:52:51.904950 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:51.904875    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 20 13:52:51.910945 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:51.910909    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6c9cc46c9f-mzh8v"]
May 20 13:52:51.947835 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:51.947811    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/dc38a275-91cc-43d2-8472-3e1e3451a991-metrics-server-audit-profiles\") pod \"metrics-server-6c9cc46c9f-mzh8v\" (UID: \"dc38a275-91cc-43d2-8472-3e1e3451a991\") " pod="openshift-monitoring/metrics-server-6c9cc46c9f-mzh8v"
May 20 13:52:51.947916 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:51.947841    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc38a275-91cc-43d2-8472-3e1e3451a991-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c9cc46c9f-mzh8v\" (UID: \"dc38a275-91cc-43d2-8472-3e1e3451a991\") " pod="openshift-monitoring/metrics-server-6c9cc46c9f-mzh8v"
May 20 13:52:51.947916 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:51.947859    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc38a275-91cc-43d2-8472-3e1e3451a991-client-ca-bundle\") pod \"metrics-server-6c9cc46c9f-mzh8v\" (UID: \"dc38a275-91cc-43d2-8472-3e1e3451a991\") " pod="openshift-monitoring/metrics-server-6c9cc46c9f-mzh8v"
May 20 13:52:51.948015 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:51.947959    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/dc38a275-91cc-43d2-8472-3e1e3451a991-secret-metrics-server-client-certs\") pod \"metrics-server-6c9cc46c9f-mzh8v\" (UID: \"dc38a275-91cc-43d2-8472-3e1e3451a991\") " pod="openshift-monitoring/metrics-server-6c9cc46c9f-mzh8v"
May 20 13:52:51.948015 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:51.947999    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/dc38a275-91cc-43d2-8472-3e1e3451a991-secret-metrics-server-tls\") pod \"metrics-server-6c9cc46c9f-mzh8v\" (UID: \"dc38a275-91cc-43d2-8472-3e1e3451a991\") " pod="openshift-monitoring/metrics-server-6c9cc46c9f-mzh8v"
May 20 13:52:51.948113 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:51.948018    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/dc38a275-91cc-43d2-8472-3e1e3451a991-audit-log\") pod \"metrics-server-6c9cc46c9f-mzh8v\" (UID: \"dc38a275-91cc-43d2-8472-3e1e3451a991\") " pod="openshift-monitoring/metrics-server-6c9cc46c9f-mzh8v"
May 20 13:52:51.948113 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:51.948083    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg2gj\" (UniqueName: \"kubernetes.io/projected/dc38a275-91cc-43d2-8472-3e1e3451a991-kube-api-access-sg2gj\") pod \"metrics-server-6c9cc46c9f-mzh8v\" (UID: \"dc38a275-91cc-43d2-8472-3e1e3451a991\") " pod="openshift-monitoring/metrics-server-6c9cc46c9f-mzh8v"
May 20 13:52:52.048465 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:52.048443    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/dc38a275-91cc-43d2-8472-3e1e3451a991-secret-metrics-server-tls\") pod \"metrics-server-6c9cc46c9f-mzh8v\" (UID: \"dc38a275-91cc-43d2-8472-3e1e3451a991\") " pod="openshift-monitoring/metrics-server-6c9cc46c9f-mzh8v"
May 20 13:52:52.048563 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:52.048469    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/dc38a275-91cc-43d2-8472-3e1e3451a991-audit-log\") pod \"metrics-server-6c9cc46c9f-mzh8v\" (UID: \"dc38a275-91cc-43d2-8472-3e1e3451a991\") " pod="openshift-monitoring/metrics-server-6c9cc46c9f-mzh8v"
May 20 13:52:52.048563 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:52.048501    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sg2gj\" (UniqueName: \"kubernetes.io/projected/dc38a275-91cc-43d2-8472-3e1e3451a991-kube-api-access-sg2gj\") pod \"metrics-server-6c9cc46c9f-mzh8v\" (UID: \"dc38a275-91cc-43d2-8472-3e1e3451a991\") " pod="openshift-monitoring/metrics-server-6c9cc46c9f-mzh8v"
May 20 13:52:52.048563 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:52.048532    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/dc38a275-91cc-43d2-8472-3e1e3451a991-metrics-server-audit-profiles\") pod \"metrics-server-6c9cc46c9f-mzh8v\" (UID: \"dc38a275-91cc-43d2-8472-3e1e3451a991\") " pod="openshift-monitoring/metrics-server-6c9cc46c9f-mzh8v"
May 20 13:52:52.048695 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:52.048562    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc38a275-91cc-43d2-8472-3e1e3451a991-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c9cc46c9f-mzh8v\" (UID: \"dc38a275-91cc-43d2-8472-3e1e3451a991\") " pod="openshift-monitoring/metrics-server-6c9cc46c9f-mzh8v"
May 20 13:52:52.048695 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:52.048591    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc38a275-91cc-43d2-8472-3e1e3451a991-client-ca-bundle\") pod \"metrics-server-6c9cc46c9f-mzh8v\" (UID: \"dc38a275-91cc-43d2-8472-3e1e3451a991\") " pod="openshift-monitoring/metrics-server-6c9cc46c9f-mzh8v"
May 20 13:52:52.048695 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:52.048646    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/dc38a275-91cc-43d2-8472-3e1e3451a991-secret-metrics-server-client-certs\") pod \"metrics-server-6c9cc46c9f-mzh8v\" (UID: \"dc38a275-91cc-43d2-8472-3e1e3451a991\") " pod="openshift-monitoring/metrics-server-6c9cc46c9f-mzh8v"
May 20 13:52:52.049301 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:52.049271    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/dc38a275-91cc-43d2-8472-3e1e3451a991-audit-log\") pod \"metrics-server-6c9cc46c9f-mzh8v\" (UID: \"dc38a275-91cc-43d2-8472-3e1e3451a991\") " pod="openshift-monitoring/metrics-server-6c9cc46c9f-mzh8v"
May 20 13:52:52.049398 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:52.049312    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc38a275-91cc-43d2-8472-3e1e3451a991-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c9cc46c9f-mzh8v\" (UID: \"dc38a275-91cc-43d2-8472-3e1e3451a991\") " pod="openshift-monitoring/metrics-server-6c9cc46c9f-mzh8v"
May 20 13:52:52.049759 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:52.049733    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/dc38a275-91cc-43d2-8472-3e1e3451a991-metrics-server-audit-profiles\") pod \"metrics-server-6c9cc46c9f-mzh8v\" (UID: \"dc38a275-91cc-43d2-8472-3e1e3451a991\") " pod="openshift-monitoring/metrics-server-6c9cc46c9f-mzh8v"
May 20 13:52:52.051059 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:52.051039    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/dc38a275-91cc-43d2-8472-3e1e3451a991-secret-metrics-server-tls\") pod \"metrics-server-6c9cc46c9f-mzh8v\" (UID: \"dc38a275-91cc-43d2-8472-3e1e3451a991\") " pod="openshift-monitoring/metrics-server-6c9cc46c9f-mzh8v"
May 20 13:52:52.051263 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:52.051243    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/dc38a275-91cc-43d2-8472-3e1e3451a991-secret-metrics-server-client-certs\") pod \"metrics-server-6c9cc46c9f-mzh8v\" (UID: \"dc38a275-91cc-43d2-8472-3e1e3451a991\") " pod="openshift-monitoring/metrics-server-6c9cc46c9f-mzh8v"
May 20 13:52:52.051327 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:52.051249    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc38a275-91cc-43d2-8472-3e1e3451a991-client-ca-bundle\") pod \"metrics-server-6c9cc46c9f-mzh8v\" (UID: \"dc38a275-91cc-43d2-8472-3e1e3451a991\") " pod="openshift-monitoring/metrics-server-6c9cc46c9f-mzh8v"
May 20 13:52:52.056544 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:52.056522    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg2gj\" (UniqueName: \"kubernetes.io/projected/dc38a275-91cc-43d2-8472-3e1e3451a991-kube-api-access-sg2gj\") pod \"metrics-server-6c9cc46c9f-mzh8v\" (UID: \"dc38a275-91cc-43d2-8472-3e1e3451a991\") " pod="openshift-monitoring/metrics-server-6c9cc46c9f-mzh8v"
May 20 13:52:52.204482 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:52.204454    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-gxznb"]
May 20 13:52:52.208412 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:52.208399    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-gxznb"
May 20 13:52:52.210464 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:52.210442    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6c9cc46c9f-mzh8v"
May 20 13:52:52.211378 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:52.211027    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-mdqzv\""
May 20 13:52:52.211378 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:52.211029    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
May 20 13:52:52.236108 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:52.234613    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-gxznb"]
May 20 13:52:52.250429 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:52.250345    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eaf33819-3641-4939-88ed-3cb13d582565-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-gxznb\" (UID: \"eaf33819-3641-4939-88ed-3cb13d582565\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-gxznb"
May 20 13:52:52.338909 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:52.338779    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6c9cc46c9f-mzh8v"]
May 20 13:52:52.341377 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:52:52.341349    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc38a275_91cc_43d2_8472_3e1e3451a991.slice/crio-66b2346bb5c28e0f7cc5699b0c6416bb41c8e3a546f56524a07661df28e3ea74 WatchSource:0}: Error finding container 66b2346bb5c28e0f7cc5699b0c6416bb41c8e3a546f56524a07661df28e3ea74: Status 404 returned error can't find the container with id 66b2346bb5c28e0f7cc5699b0c6416bb41c8e3a546f56524a07661df28e3ea74
May 20 13:52:52.351643 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:52.351621    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eaf33819-3641-4939-88ed-3cb13d582565-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-gxznb\" (UID: \"eaf33819-3641-4939-88ed-3cb13d582565\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-gxznb"
May 20 13:52:52.353778 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:52.353753    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eaf33819-3641-4939-88ed-3cb13d582565-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-gxznb\" (UID: \"eaf33819-3641-4939-88ed-3cb13d582565\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-gxznb"
May 20 13:52:52.528301 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:52.528243    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-gxznb"
May 20 13:52:52.646057 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:52.646021    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-gxznb"]
May 20 13:52:52.648632 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:52:52.648602    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaf33819_3641_4939_88ed_3cb13d582565.slice/crio-2b9f4671912b401dd9605a91dc81da5623c1ffeb3f791a301d77539dfe0c9d13 WatchSource:0}: Error finding container 2b9f4671912b401dd9605a91dc81da5623c1ffeb3f791a301d77539dfe0c9d13: Status 404 returned error can't find the container with id 2b9f4671912b401dd9605a91dc81da5623c1ffeb3f791a301d77539dfe0c9d13
May 20 13:52:53.169692 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:53.169656    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8cdb97686-22vqz"
May 20 13:52:53.244747 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:53.244703    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-gxznb" event={"ID":"eaf33819-3641-4939-88ed-3cb13d582565","Type":"ContainerStarted","Data":"2b9f4671912b401dd9605a91dc81da5623c1ffeb3f791a301d77539dfe0c9d13"}
May 20 13:52:53.246063 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:53.246023    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6c9cc46c9f-mzh8v" event={"ID":"dc38a275-91cc-43d2-8472-3e1e3451a991","Type":"ContainerStarted","Data":"66b2346bb5c28e0f7cc5699b0c6416bb41c8e3a546f56524a07661df28e3ea74"}
May 20 13:52:54.250762 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:54.250727    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-gxznb" event={"ID":"eaf33819-3641-4939-88ed-3cb13d582565","Type":"ContainerStarted","Data":"04f7f6e7f7306aa73a63dc78d80ae89977fbee5ebb585ebd3b5e1d431c4c8ada"}
May 20 13:52:54.251287 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:54.250904    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-gxznb"
May 20 13:52:54.252821 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:54.252343    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6c9cc46c9f-mzh8v" event={"ID":"dc38a275-91cc-43d2-8472-3e1e3451a991","Type":"ContainerStarted","Data":"3978ec39a4283f3cee1fe7309881ba8ea0c36df6e676d0004bd6096c4dd4f940"}
May 20 13:52:54.256558 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:54.256542    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-gxznb"
May 20 13:52:54.270053 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:54.270006    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-gxznb" podStartSLOduration=0.805764424 podStartE2EDuration="2.269992304s" podCreationTimestamp="2026-05-20 13:52:52 +0000 UTC" firstStartedPulling="2026-05-20 13:52:52.650398941 +0000 UTC m=+182.523186076" lastFinishedPulling="2026-05-20 13:52:54.114626806 +0000 UTC m=+183.987413956" observedRunningTime="2026-05-20 13:52:54.26897418 +0000 UTC m=+184.141761336" watchObservedRunningTime="2026-05-20 13:52:54.269992304 +0000 UTC m=+184.142779463"
May 20 13:52:54.296402 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:54.296363    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6c9cc46c9f-mzh8v" podStartSLOduration=1.527474496 podStartE2EDuration="3.296353442s" podCreationTimestamp="2026-05-20 13:52:51 +0000 UTC" firstStartedPulling="2026-05-20 13:52:52.343302331 +0000 UTC m=+182.216089465" lastFinishedPulling="2026-05-20 13:52:54.112181272 +0000 UTC m=+183.984968411" observedRunningTime="2026-05-20 13:52:54.295846501 +0000 UTC m=+184.168633654" watchObservedRunningTime="2026-05-20 13:52:54.296353442 +0000 UTC m=+184.169140598"
May 20 13:52:56.257697 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:56.257621    2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-65965b4c78-z2crt" podUID="f7493ea8-da00-412d-9904-69f5291dabaf" containerName="registry" containerID="cri-o://3419bba894180f8207faecf5aea10427ee365a21ee7cc5f41b03949002ed95ae" gracePeriod=30
May 20 13:52:56.489383 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:56.489364    2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65965b4c78-z2crt"
May 20 13:52:56.587756 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:56.587703    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f7493ea8-da00-412d-9904-69f5291dabaf-bound-sa-token\") pod \"f7493ea8-da00-412d-9904-69f5291dabaf\" (UID: \"f7493ea8-da00-412d-9904-69f5291dabaf\") "
May 20 13:52:56.587756 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:56.587741    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f7493ea8-da00-412d-9904-69f5291dabaf-ca-trust-extracted\") pod \"f7493ea8-da00-412d-9904-69f5291dabaf\" (UID: \"f7493ea8-da00-412d-9904-69f5291dabaf\") "
May 20 13:52:56.587922 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:56.587764    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f7493ea8-da00-412d-9904-69f5291dabaf-image-registry-private-configuration\") pod \"f7493ea8-da00-412d-9904-69f5291dabaf\" (UID: \"f7493ea8-da00-412d-9904-69f5291dabaf\") "
May 20 13:52:56.587922 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:56.587798    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f7493ea8-da00-412d-9904-69f5291dabaf-registry-tls\") pod \"f7493ea8-da00-412d-9904-69f5291dabaf\" (UID: \"f7493ea8-da00-412d-9904-69f5291dabaf\") "
May 20 13:52:56.587922 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:56.587819    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f7493ea8-da00-412d-9904-69f5291dabaf-installation-pull-secrets\") pod \"f7493ea8-da00-412d-9904-69f5291dabaf\" (UID: \"f7493ea8-da00-412d-9904-69f5291dabaf\") "
May 20 13:52:56.587922 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:56.587842    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f7493ea8-da00-412d-9904-69f5291dabaf-trusted-ca\") pod \"f7493ea8-da00-412d-9904-69f5291dabaf\" (UID: \"f7493ea8-da00-412d-9904-69f5291dabaf\") "
May 20 13:52:56.588136 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:56.588004    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmrvt\" (UniqueName: \"kubernetes.io/projected/f7493ea8-da00-412d-9904-69f5291dabaf-kube-api-access-jmrvt\") pod \"f7493ea8-da00-412d-9904-69f5291dabaf\" (UID: \"f7493ea8-da00-412d-9904-69f5291dabaf\") "
May 20 13:52:56.588136 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:56.588072    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f7493ea8-da00-412d-9904-69f5291dabaf-registry-certificates\") pod \"f7493ea8-da00-412d-9904-69f5291dabaf\" (UID: \"f7493ea8-da00-412d-9904-69f5291dabaf\") "
May 20 13:52:56.588722 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:56.588672    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7493ea8-da00-412d-9904-69f5291dabaf-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f7493ea8-da00-412d-9904-69f5291dabaf" (UID: "f7493ea8-da00-412d-9904-69f5291dabaf"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 13:52:56.588819 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:56.588749    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7493ea8-da00-412d-9904-69f5291dabaf-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f7493ea8-da00-412d-9904-69f5291dabaf" (UID: "f7493ea8-da00-412d-9904-69f5291dabaf"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 13:52:56.590572 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:56.590545    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7493ea8-da00-412d-9904-69f5291dabaf-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f7493ea8-da00-412d-9904-69f5291dabaf" (UID: "f7493ea8-da00-412d-9904-69f5291dabaf"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 13:52:56.590682 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:56.590571    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7493ea8-da00-412d-9904-69f5291dabaf-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f7493ea8-da00-412d-9904-69f5291dabaf" (UID: "f7493ea8-da00-412d-9904-69f5291dabaf"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 13:52:56.590682 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:56.590617    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7493ea8-da00-412d-9904-69f5291dabaf-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f7493ea8-da00-412d-9904-69f5291dabaf" (UID: "f7493ea8-da00-412d-9904-69f5291dabaf"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 13:52:56.590780 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:56.590712    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7493ea8-da00-412d-9904-69f5291dabaf-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f7493ea8-da00-412d-9904-69f5291dabaf" (UID: "f7493ea8-da00-412d-9904-69f5291dabaf"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 13:52:56.590780 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:56.590762    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7493ea8-da00-412d-9904-69f5291dabaf-kube-api-access-jmrvt" (OuterVolumeSpecName: "kube-api-access-jmrvt") pod "f7493ea8-da00-412d-9904-69f5291dabaf" (UID: "f7493ea8-da00-412d-9904-69f5291dabaf"). InnerVolumeSpecName "kube-api-access-jmrvt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 13:52:56.596725 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:56.596702    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7493ea8-da00-412d-9904-69f5291dabaf-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f7493ea8-da00-412d-9904-69f5291dabaf" (UID: "f7493ea8-da00-412d-9904-69f5291dabaf"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 13:52:56.689132 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:56.689097    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmrvt\" (UniqueName: \"kubernetes.io/projected/f7493ea8-da00-412d-9904-69f5291dabaf-kube-api-access-jmrvt\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:52:56.689132 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:56.689131    2571 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f7493ea8-da00-412d-9904-69f5291dabaf-registry-certificates\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:52:56.689250 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:56.689141    2571 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f7493ea8-da00-412d-9904-69f5291dabaf-bound-sa-token\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:52:56.689250 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:56.689150    2571 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f7493ea8-da00-412d-9904-69f5291dabaf-ca-trust-extracted\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:52:56.689250 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:56.689159    2571 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f7493ea8-da00-412d-9904-69f5291dabaf-image-registry-private-configuration\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:52:56.689250 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:56.689168    2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f7493ea8-da00-412d-9904-69f5291dabaf-registry-tls\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:52:56.689250 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:56.689176    2571 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f7493ea8-da00-412d-9904-69f5291dabaf-installation-pull-secrets\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:52:56.689250 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:56.689188    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f7493ea8-da00-412d-9904-69f5291dabaf-trusted-ca\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:52:57.260647 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:57.260609    2571 generic.go:358] "Generic (PLEG): container finished" podID="f7493ea8-da00-412d-9904-69f5291dabaf" containerID="3419bba894180f8207faecf5aea10427ee365a21ee7cc5f41b03949002ed95ae" exitCode=0
May 20 13:52:57.261048 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:57.260688    2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65965b4c78-z2crt"
May 20 13:52:57.261048 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:57.260707    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65965b4c78-z2crt" event={"ID":"f7493ea8-da00-412d-9904-69f5291dabaf","Type":"ContainerDied","Data":"3419bba894180f8207faecf5aea10427ee365a21ee7cc5f41b03949002ed95ae"}
May 20 13:52:57.261048 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:57.260765    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65965b4c78-z2crt" event={"ID":"f7493ea8-da00-412d-9904-69f5291dabaf","Type":"ContainerDied","Data":"374a2ef343c137b81bd8deeb6c23e3b26ab208a7d08c91bbdefe8ab7b09ceda5"}
May 20 13:52:57.261048 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:57.260789    2571 scope.go:117] "RemoveContainer" containerID="3419bba894180f8207faecf5aea10427ee365a21ee7cc5f41b03949002ed95ae"
May 20 13:52:57.269023 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:57.268992    2571 scope.go:117] "RemoveContainer" containerID="3419bba894180f8207faecf5aea10427ee365a21ee7cc5f41b03949002ed95ae"
May 20 13:52:57.269345 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:52:57.269316    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3419bba894180f8207faecf5aea10427ee365a21ee7cc5f41b03949002ed95ae\": container with ID starting with 3419bba894180f8207faecf5aea10427ee365a21ee7cc5f41b03949002ed95ae not found: ID does not exist" containerID="3419bba894180f8207faecf5aea10427ee365a21ee7cc5f41b03949002ed95ae"
May 20 13:52:57.269416 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:57.269357    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3419bba894180f8207faecf5aea10427ee365a21ee7cc5f41b03949002ed95ae"} err="failed to get container status \"3419bba894180f8207faecf5aea10427ee365a21ee7cc5f41b03949002ed95ae\": rpc error: code = NotFound desc = could not find container \"3419bba894180f8207faecf5aea10427ee365a21ee7cc5f41b03949002ed95ae\": container with ID starting with 3419bba894180f8207faecf5aea10427ee365a21ee7cc5f41b03949002ed95ae not found: ID does not exist"
May 20 13:52:57.278497 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:57.278472    2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65965b4c78-z2crt"]
May 20 13:52:57.282729 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:57.282705    2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-65965b4c78-z2crt"]
May 20 13:52:58.219474 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:58.219430    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-sm8lq"]
May 20 13:52:58.219796 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:58.219779    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7493ea8-da00-412d-9904-69f5291dabaf" containerName="registry"
May 20 13:52:58.219841 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:58.219798    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7493ea8-da00-412d-9904-69f5291dabaf" containerName="registry"
May 20 13:52:58.219878 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:58.219859    2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="f7493ea8-da00-412d-9904-69f5291dabaf" containerName="registry"
May 20 13:52:58.224596 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:58.224576    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-sm8lq"
May 20 13:52:58.227177 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:58.227151    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 20 13:52:58.227269 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:58.227188    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 20 13:52:58.227500 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:58.227484    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-5wn28\""
May 20 13:52:58.234141 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:58.234115    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-sm8lq"]
May 20 13:52:58.301740 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:58.301719    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kdlq\" (UniqueName: \"kubernetes.io/projected/eeb5e81d-0e68-45db-af61-45030f64213c-kube-api-access-4kdlq\") pod \"downloads-57bd96b888-sm8lq\" (UID: \"eeb5e81d-0e68-45db-af61-45030f64213c\") " pod="openshift-console/downloads-57bd96b888-sm8lq"
May 20 13:52:58.402203 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:58.402169    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4kdlq\" (UniqueName: \"kubernetes.io/projected/eeb5e81d-0e68-45db-af61-45030f64213c-kube-api-access-4kdlq\") pod \"downloads-57bd96b888-sm8lq\" (UID: \"eeb5e81d-0e68-45db-af61-45030f64213c\") " pod="openshift-console/downloads-57bd96b888-sm8lq"
May 20 13:52:58.419237 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:58.419214    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kdlq\" (UniqueName: \"kubernetes.io/projected/eeb5e81d-0e68-45db-af61-45030f64213c-kube-api-access-4kdlq\") pod \"downloads-57bd96b888-sm8lq\" (UID: \"eeb5e81d-0e68-45db-af61-45030f64213c\") " pod="openshift-console/downloads-57bd96b888-sm8lq"
May 20 13:52:58.534387 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:58.534325    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-sm8lq"
May 20 13:52:58.657535 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:58.657504    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-sm8lq"]
May 20 13:52:58.661500 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:52:58.661471    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeb5e81d_0e68_45db_af61_45030f64213c.slice/crio-aebd672260924d031314b546d0dbf8ff3f38aa00603bb0abab6bb1628ad1f323 WatchSource:0}: Error finding container aebd672260924d031314b546d0dbf8ff3f38aa00603bb0abab6bb1628ad1f323: Status 404 returned error can't find the container with id aebd672260924d031314b546d0dbf8ff3f38aa00603bb0abab6bb1628ad1f323
May 20 13:52:58.668238 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:58.668192    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7493ea8-da00-412d-9904-69f5291dabaf" path="/var/lib/kubelet/pods/f7493ea8-da00-412d-9904-69f5291dabaf/volumes"
May 20 13:52:59.269278 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:52:59.269221    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-sm8lq" event={"ID":"eeb5e81d-0e68-45db-af61-45030f64213c","Type":"ContainerStarted","Data":"aebd672260924d031314b546d0dbf8ff3f38aa00603bb0abab6bb1628ad1f323"}
May 20 13:53:08.566645 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:08.566608    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-55ffd77d89-5lpfc"]
May 20 13:53:08.593994 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:08.593955    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55ffd77d89-5lpfc"]
May 20 13:53:08.594135 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:08.593997    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55ffd77d89-5lpfc"
May 20 13:53:08.596543 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:08.596508    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 20 13:53:08.597321 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:08.597288    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 20 13:53:08.597321 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:08.597310    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zqpgn\""
May 20 13:53:08.597321 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:08.597317    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 20 13:53:08.597541 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:08.597310    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 20 13:53:08.597541 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:08.597401    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 20 13:53:08.687131 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:08.687102    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c486276-3363-486a-a9a5-4f5fa0809e48-console-serving-cert\") pod \"console-55ffd77d89-5lpfc\" (UID: \"4c486276-3363-486a-a9a5-4f5fa0809e48\") " pod="openshift-console/console-55ffd77d89-5lpfc"
May 20 13:53:08.687340 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:08.687135    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c486276-3363-486a-a9a5-4f5fa0809e48-service-ca\") pod \"console-55ffd77d89-5lpfc\" (UID: \"4c486276-3363-486a-a9a5-4f5fa0809e48\") " pod="openshift-console/console-55ffd77d89-5lpfc"
May 20 13:53:08.687340 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:08.687177    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c486276-3363-486a-a9a5-4f5fa0809e48-console-oauth-config\") pod \"console-55ffd77d89-5lpfc\" (UID: \"4c486276-3363-486a-a9a5-4f5fa0809e48\") " pod="openshift-console/console-55ffd77d89-5lpfc"
May 20 13:53:08.687340 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:08.687204    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c486276-3363-486a-a9a5-4f5fa0809e48-oauth-serving-cert\") pod \"console-55ffd77d89-5lpfc\" (UID: \"4c486276-3363-486a-a9a5-4f5fa0809e48\") " pod="openshift-console/console-55ffd77d89-5lpfc"
May 20 13:53:08.687340 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:08.687249    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c486276-3363-486a-a9a5-4f5fa0809e48-console-config\") pod \"console-55ffd77d89-5lpfc\" (UID: \"4c486276-3363-486a-a9a5-4f5fa0809e48\") " pod="openshift-console/console-55ffd77d89-5lpfc"
May 20 13:53:08.687340 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:08.687268    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c89rk\" (UniqueName: \"kubernetes.io/projected/4c486276-3363-486a-a9a5-4f5fa0809e48-kube-api-access-c89rk\") pod \"console-55ffd77d89-5lpfc\" (UID: \"4c486276-3363-486a-a9a5-4f5fa0809e48\") " pod="openshift-console/console-55ffd77d89-5lpfc"
May 20 13:53:08.787791 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:08.787757    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c486276-3363-486a-a9a5-4f5fa0809e48-console-oauth-config\") pod \"console-55ffd77d89-5lpfc\" (UID: \"4c486276-3363-486a-a9a5-4f5fa0809e48\") " pod="openshift-console/console-55ffd77d89-5lpfc"
May 20 13:53:08.787946 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:08.787803    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c486276-3363-486a-a9a5-4f5fa0809e48-oauth-serving-cert\") pod \"console-55ffd77d89-5lpfc\" (UID: \"4c486276-3363-486a-a9a5-4f5fa0809e48\") " pod="openshift-console/console-55ffd77d89-5lpfc"
May 20 13:53:08.787946 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:08.787851    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c486276-3363-486a-a9a5-4f5fa0809e48-console-config\") pod \"console-55ffd77d89-5lpfc\" (UID: \"4c486276-3363-486a-a9a5-4f5fa0809e48\") " pod="openshift-console/console-55ffd77d89-5lpfc"
May 20 13:53:08.787946 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:08.787875    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c89rk\" (UniqueName: \"kubernetes.io/projected/4c486276-3363-486a-a9a5-4f5fa0809e48-kube-api-access-c89rk\") pod \"console-55ffd77d89-5lpfc\" (UID: \"4c486276-3363-486a-a9a5-4f5fa0809e48\") " pod="openshift-console/console-55ffd77d89-5lpfc"
May 20 13:53:08.788112 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:08.787992    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c486276-3363-486a-a9a5-4f5fa0809e48-console-serving-cert\") pod \"console-55ffd77d89-5lpfc\" (UID: \"4c486276-3363-486a-a9a5-4f5fa0809e48\") " pod="openshift-console/console-55ffd77d89-5lpfc"
May 20 13:53:08.788112 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:08.788016    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c486276-3363-486a-a9a5-4f5fa0809e48-service-ca\") pod \"console-55ffd77d89-5lpfc\" (UID: \"4c486276-3363-486a-a9a5-4f5fa0809e48\") " pod="openshift-console/console-55ffd77d89-5lpfc"
May 20 13:53:08.788723 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:08.788563    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c486276-3363-486a-a9a5-4f5fa0809e48-console-config\") pod \"console-55ffd77d89-5lpfc\" (UID: \"4c486276-3363-486a-a9a5-4f5fa0809e48\") " pod="openshift-console/console-55ffd77d89-5lpfc"
May 20 13:53:08.788723 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:08.788684    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c486276-3363-486a-a9a5-4f5fa0809e48-oauth-serving-cert\") pod \"console-55ffd77d89-5lpfc\" (UID: \"4c486276-3363-486a-a9a5-4f5fa0809e48\") " pod="openshift-console/console-55ffd77d89-5lpfc"
May 20 13:53:08.788897 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:08.788876    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c486276-3363-486a-a9a5-4f5fa0809e48-service-ca\") pod \"console-55ffd77d89-5lpfc\" (UID: \"4c486276-3363-486a-a9a5-4f5fa0809e48\") " pod="openshift-console/console-55ffd77d89-5lpfc"
May 20 13:53:08.790741 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:08.790718    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c486276-3363-486a-a9a5-4f5fa0809e48-console-oauth-config\") pod \"console-55ffd77d89-5lpfc\" (UID: \"4c486276-3363-486a-a9a5-4f5fa0809e48\") " pod="openshift-console/console-55ffd77d89-5lpfc"
May 20 13:53:08.791351 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:08.791329    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c486276-3363-486a-a9a5-4f5fa0809e48-console-serving-cert\") pod \"console-55ffd77d89-5lpfc\" (UID: \"4c486276-3363-486a-a9a5-4f5fa0809e48\") " pod="openshift-console/console-55ffd77d89-5lpfc"
May 20 13:53:08.801912 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:08.801881    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c89rk\" (UniqueName: \"kubernetes.io/projected/4c486276-3363-486a-a9a5-4f5fa0809e48-kube-api-access-c89rk\") pod \"console-55ffd77d89-5lpfc\" (UID: \"4c486276-3363-486a-a9a5-4f5fa0809e48\") " pod="openshift-console/console-55ffd77d89-5lpfc"
May 20 13:53:08.905459 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:08.905349    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55ffd77d89-5lpfc"
May 20 13:53:12.211462 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:12.211425    2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6c9cc46c9f-mzh8v"
May 20 13:53:12.211909 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:12.211479    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6c9cc46c9f-mzh8v"
May 20 13:53:14.448546 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:14.448524    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55ffd77d89-5lpfc"]
May 20 13:53:14.450713 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:53:14.450691    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c486276_3363_486a_a9a5_4f5fa0809e48.slice/crio-1789ec4c58ff1348e40f6500d891b7d1b04ae554587f512c7513097785bb5e08 WatchSource:0}: Error finding container 1789ec4c58ff1348e40f6500d891b7d1b04ae554587f512c7513097785bb5e08: Status 404 returned error can't find the container with id 1789ec4c58ff1348e40f6500d891b7d1b04ae554587f512c7513097785bb5e08
May 20 13:53:15.316771 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:15.316710    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-sm8lq" event={"ID":"eeb5e81d-0e68-45db-af61-45030f64213c","Type":"ContainerStarted","Data":"c9f6bd5fa85d6d6c23d1774b9efe8440f4fcb20326b1b06e26f8107a012d74be"}
May 20 13:53:15.317643 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:15.317348    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-sm8lq"
May 20 13:53:15.318886 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:15.318863    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55ffd77d89-5lpfc" event={"ID":"4c486276-3363-486a-a9a5-4f5fa0809e48","Type":"ContainerStarted","Data":"1789ec4c58ff1348e40f6500d891b7d1b04ae554587f512c7513097785bb5e08"}
May 20 13:53:15.332459 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:15.332426    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-sm8lq"
May 20 13:53:15.336083 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:15.335971    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-sm8lq" podStartSLOduration=1.562879191 podStartE2EDuration="17.335955168s" podCreationTimestamp="2026-05-20 13:52:58 +0000 UTC" firstStartedPulling="2026-05-20 13:52:58.663509897 +0000 UTC m=+188.536297045" lastFinishedPulling="2026-05-20 13:53:14.436585883 +0000 UTC m=+204.309373022" observedRunningTime="2026-05-20 13:53:15.334427037 +0000 UTC m=+205.207214191" watchObservedRunningTime="2026-05-20 13:53:15.335955168 +0000 UTC m=+205.208742322"
May 20 13:53:16.327305 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:16.327271    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-797df8b685-wxn42"]
May 20 13:53:16.358577 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:16.358463    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-797df8b685-wxn42"]
May 20 13:53:16.359341 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:16.358795    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797df8b685-wxn42"
May 20 13:53:16.371806 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:16.370672    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 20 13:53:16.454832 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:16.454795    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3954df05-e997-489f-861e-25879e3e214d-console-oauth-config\") pod \"console-797df8b685-wxn42\" (UID: \"3954df05-e997-489f-861e-25879e3e214d\") " pod="openshift-console/console-797df8b685-wxn42"
May 20 13:53:16.455068 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:16.454844    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3954df05-e997-489f-861e-25879e3e214d-console-config\") pod \"console-797df8b685-wxn42\" (UID: \"3954df05-e997-489f-861e-25879e3e214d\") " pod="openshift-console/console-797df8b685-wxn42"
May 20 13:53:16.455068 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:16.454978    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3954df05-e997-489f-861e-25879e3e214d-service-ca\") pod \"console-797df8b685-wxn42\" (UID: \"3954df05-e997-489f-861e-25879e3e214d\") " pod="openshift-console/console-797df8b685-wxn42"
May 20 13:53:16.455068 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:16.455016    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3954df05-e997-489f-861e-25879e3e214d-console-serving-cert\") pod \"console-797df8b685-wxn42\" (UID: \"3954df05-e997-489f-861e-25879e3e214d\") " pod="openshift-console/console-797df8b685-wxn42"
May 20 13:53:16.455068 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:16.455052    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3954df05-e997-489f-861e-25879e3e214d-trusted-ca-bundle\") pod \"console-797df8b685-wxn42\" (UID: \"3954df05-e997-489f-861e-25879e3e214d\") " pod="openshift-console/console-797df8b685-wxn42"
May 20 13:53:16.455275 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:16.455093    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3954df05-e997-489f-861e-25879e3e214d-oauth-serving-cert\") pod \"console-797df8b685-wxn42\" (UID: \"3954df05-e997-489f-861e-25879e3e214d\") " pod="openshift-console/console-797df8b685-wxn42"
May 20 13:53:16.455275 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:16.455161    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz7cf\" (UniqueName: \"kubernetes.io/projected/3954df05-e997-489f-861e-25879e3e214d-kube-api-access-zz7cf\") pod \"console-797df8b685-wxn42\" (UID: \"3954df05-e997-489f-861e-25879e3e214d\") " pod="openshift-console/console-797df8b685-wxn42"
May 20 13:53:16.558251 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:16.556173    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zz7cf\" (UniqueName: \"kubernetes.io/projected/3954df05-e997-489f-861e-25879e3e214d-kube-api-access-zz7cf\") pod \"console-797df8b685-wxn42\" (UID: \"3954df05-e997-489f-861e-25879e3e214d\") " pod="openshift-console/console-797df8b685-wxn42"
May 20 13:53:16.558251 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:16.556232    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3954df05-e997-489f-861e-25879e3e214d-console-oauth-config\") pod \"console-797df8b685-wxn42\" (UID: \"3954df05-e997-489f-861e-25879e3e214d\") " pod="openshift-console/console-797df8b685-wxn42"
May 20 13:53:16.558251 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:16.556268    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3954df05-e997-489f-861e-25879e3e214d-console-config\") pod \"console-797df8b685-wxn42\" (UID: \"3954df05-e997-489f-861e-25879e3e214d\") " pod="openshift-console/console-797df8b685-wxn42"
May 20 13:53:16.558251 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:16.556344    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3954df05-e997-489f-861e-25879e3e214d-service-ca\") pod \"console-797df8b685-wxn42\" (UID: \"3954df05-e997-489f-861e-25879e3e214d\") " pod="openshift-console/console-797df8b685-wxn42"
May 20 13:53:16.558251 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:16.556376    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3954df05-e997-489f-861e-25879e3e214d-console-serving-cert\") pod \"console-797df8b685-wxn42\" (UID: \"3954df05-e997-489f-861e-25879e3e214d\") " pod="openshift-console/console-797df8b685-wxn42"
May 20 13:53:16.558251 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:16.556405    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3954df05-e997-489f-861e-25879e3e214d-trusted-ca-bundle\") pod \"console-797df8b685-wxn42\" (UID: \"3954df05-e997-489f-861e-25879e3e214d\") " pod="openshift-console/console-797df8b685-wxn42"
May 20 13:53:16.558251 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:16.556426    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3954df05-e997-489f-861e-25879e3e214d-oauth-serving-cert\") pod \"console-797df8b685-wxn42\" (UID: \"3954df05-e997-489f-861e-25879e3e214d\") " pod="openshift-console/console-797df8b685-wxn42"
May 20 13:53:16.558251 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:16.557596    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3954df05-e997-489f-861e-25879e3e214d-console-config\") pod \"console-797df8b685-wxn42\" (UID: \"3954df05-e997-489f-861e-25879e3e214d\") " pod="openshift-console/console-797df8b685-wxn42"
May 20 13:53:16.558251 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:16.557790    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3954df05-e997-489f-861e-25879e3e214d-oauth-serving-cert\") pod \"console-797df8b685-wxn42\" (UID: \"3954df05-e997-489f-861e-25879e3e214d\") " pod="openshift-console/console-797df8b685-wxn42"
May 20 13:53:16.558808 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:16.558392    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3954df05-e997-489f-861e-25879e3e214d-service-ca\") pod \"console-797df8b685-wxn42\" (UID: \"3954df05-e997-489f-861e-25879e3e214d\") " pod="openshift-console/console-797df8b685-wxn42"
May 20 13:53:16.559101 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:16.559075    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3954df05-e997-489f-861e-25879e3e214d-trusted-ca-bundle\") pod \"console-797df8b685-wxn42\" (UID: \"3954df05-e997-489f-861e-25879e3e214d\") " pod="openshift-console/console-797df8b685-wxn42"
May 20 13:53:16.561197 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:16.561156    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3954df05-e997-489f-861e-25879e3e214d-console-oauth-config\") pod \"console-797df8b685-wxn42\" (UID: \"3954df05-e997-489f-861e-25879e3e214d\") " pod="openshift-console/console-797df8b685-wxn42"
May 20 13:53:16.563654 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:16.563618    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3954df05-e997-489f-861e-25879e3e214d-console-serving-cert\") pod \"console-797df8b685-wxn42\" (UID: \"3954df05-e997-489f-861e-25879e3e214d\") " pod="openshift-console/console-797df8b685-wxn42"
May 20 13:53:16.568537 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:16.568498    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz7cf\" (UniqueName: \"kubernetes.io/projected/3954df05-e997-489f-861e-25879e3e214d-kube-api-access-zz7cf\") pod \"console-797df8b685-wxn42\" (UID: \"3954df05-e997-489f-861e-25879e3e214d\") " pod="openshift-console/console-797df8b685-wxn42"
May 20 13:53:16.673143 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:16.673067    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797df8b685-wxn42"
May 20 13:53:16.836173 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:16.836137    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-797df8b685-wxn42"]
May 20 13:53:18.020753 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:53:18.020714    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3954df05_e997_489f_861e_25879e3e214d.slice/crio-7d53dd9c401902ecb99ff154740fdbeede2eae0b01e50751522bb6fe25064567 WatchSource:0}: Error finding container 7d53dd9c401902ecb99ff154740fdbeede2eae0b01e50751522bb6fe25064567: Status 404 returned error can't find the container with id 7d53dd9c401902ecb99ff154740fdbeede2eae0b01e50751522bb6fe25064567
May 20 13:53:18.329816 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:18.329741    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797df8b685-wxn42" event={"ID":"3954df05-e997-489f-861e-25879e3e214d","Type":"ContainerStarted","Data":"7d53dd9c401902ecb99ff154740fdbeede2eae0b01e50751522bb6fe25064567"}
May 20 13:53:19.334069 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:19.334032    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55ffd77d89-5lpfc" event={"ID":"4c486276-3363-486a-a9a5-4f5fa0809e48","Type":"ContainerStarted","Data":"d7426a629c2560f7e6b820eba7dade021273cfeb4b7a783c28c7eae68c9b6624"}
May 20 13:53:19.335506 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:19.335477    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797df8b685-wxn42" event={"ID":"3954df05-e997-489f-861e-25879e3e214d","Type":"ContainerStarted","Data":"2092b8b9a2e0abc74d607cb5d66fe78f09e0bc87a3a5cb662d08db9249eb6a62"}
May 20 13:53:19.355294 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:19.355246    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-55ffd77d89-5lpfc" podStartSLOduration=7.338402853 podStartE2EDuration="11.355230016s" podCreationTimestamp="2026-05-20 13:53:08 +0000 UTC" firstStartedPulling="2026-05-20 13:53:14.452743643 +0000 UTC m=+204.325530777" lastFinishedPulling="2026-05-20 13:53:18.469570802 +0000 UTC m=+208.342357940" observedRunningTime="2026-05-20 13:53:19.353622025 +0000 UTC m=+209.226409182" watchObservedRunningTime="2026-05-20 13:53:19.355230016 +0000 UTC m=+209.228017173"
May 20 13:53:19.375011 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:19.374963    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-797df8b685-wxn42" podStartSLOduration=2.720174763 podStartE2EDuration="3.374951293s" podCreationTimestamp="2026-05-20 13:53:16 +0000 UTC" firstStartedPulling="2026-05-20 13:53:18.023021703 +0000 UTC m=+207.895808839" lastFinishedPulling="2026-05-20 13:53:18.677798218 +0000 UTC m=+208.550585369" observedRunningTime="2026-05-20 13:53:19.373432732 +0000 UTC m=+209.246219891" watchObservedRunningTime="2026-05-20 13:53:19.374951293 +0000 UTC m=+209.247738449"
May 20 13:53:26.673788 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:26.673749    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-797df8b685-wxn42"
May 20 13:53:26.674322 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:26.673843    2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-797df8b685-wxn42"
May 20 13:53:26.678672 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:26.678644    2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-797df8b685-wxn42"
May 20 13:53:27.361672 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:27.361648    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-797df8b685-wxn42"
May 20 13:53:27.409324 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:27.409299    2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55ffd77d89-5lpfc"]
May 20 13:53:28.905477 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:28.905441    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55ffd77d89-5lpfc"
May 20 13:53:32.216261 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:32.216233    2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6c9cc46c9f-mzh8v"
May 20 13:53:32.220049 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:32.220020    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6c9cc46c9f-mzh8v"
May 20 13:53:33.377562 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:33.377529    2571 generic.go:358] "Generic (PLEG): container finished" podID="abb85415-7414-4df7-ace3-58550a8d0d19" containerID="d3c9e0e55ae973d9dd013d6da096571be3f4d357d5f120a66965c6aa74fb5444" exitCode=0
May 20 13:53:33.377903 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:33.377607    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-hhgs4" event={"ID":"abb85415-7414-4df7-ace3-58550a8d0d19","Type":"ContainerDied","Data":"d3c9e0e55ae973d9dd013d6da096571be3f4d357d5f120a66965c6aa74fb5444"}
May 20 13:53:33.377976 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:33.377922    2571 scope.go:117] "RemoveContainer" containerID="d3c9e0e55ae973d9dd013d6da096571be3f4d357d5f120a66965c6aa74fb5444"
May 20 13:53:34.381943 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:34.381900    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-hhgs4" event={"ID":"abb85415-7414-4df7-ace3-58550a8d0d19","Type":"ContainerStarted","Data":"742c933337021248959a6aa7babcd4539829df8488147ad027f4db9c22afe8bb"}
May 20 13:53:42.406608 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:42.406563    2571 generic.go:358] "Generic (PLEG): container finished" podID="496f0332-8b87-4f2e-b275-af4f3b0529fa" containerID="722e6aee14f6821b956aecf2e958bfcfc57c8e499c7e01ea494f1ae21d6908dd" exitCode=0
May 20 13:53:42.407057 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:42.406639    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-ppgpb" event={"ID":"496f0332-8b87-4f2e-b275-af4f3b0529fa","Type":"ContainerDied","Data":"722e6aee14f6821b956aecf2e958bfcfc57c8e499c7e01ea494f1ae21d6908dd"}
May 20 13:53:42.407057 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:42.407024    2571 scope.go:117] "RemoveContainer" containerID="722e6aee14f6821b956aecf2e958bfcfc57c8e499c7e01ea494f1ae21d6908dd"
May 20 13:53:43.411532 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:43.411500    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-ppgpb" event={"ID":"496f0332-8b87-4f2e-b275-af4f3b0529fa","Type":"ContainerStarted","Data":"2f4fc22b2e04d35ed497def91d3dd6670bbe7129279f897f780a4e77466f5606"}
May 20 13:53:52.427458 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:52.427392    2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-55ffd77d89-5lpfc" podUID="4c486276-3363-486a-a9a5-4f5fa0809e48" containerName="console" containerID="cri-o://d7426a629c2560f7e6b820eba7dade021273cfeb4b7a783c28c7eae68c9b6624" gracePeriod=15
May 20 13:53:52.703890 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:52.703869    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-55ffd77d89-5lpfc_4c486276-3363-486a-a9a5-4f5fa0809e48/console/0.log"
May 20 13:53:52.704015 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:52.703950    2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55ffd77d89-5lpfc"
May 20 13:53:52.818507 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:52.818483    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c89rk\" (UniqueName: \"kubernetes.io/projected/4c486276-3363-486a-a9a5-4f5fa0809e48-kube-api-access-c89rk\") pod \"4c486276-3363-486a-a9a5-4f5fa0809e48\" (UID: \"4c486276-3363-486a-a9a5-4f5fa0809e48\") "
May 20 13:53:52.818624 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:52.818517    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c486276-3363-486a-a9a5-4f5fa0809e48-console-oauth-config\") pod \"4c486276-3363-486a-a9a5-4f5fa0809e48\" (UID: \"4c486276-3363-486a-a9a5-4f5fa0809e48\") "
May 20 13:53:52.818624 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:52.818544    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c486276-3363-486a-a9a5-4f5fa0809e48-console-serving-cert\") pod \"4c486276-3363-486a-a9a5-4f5fa0809e48\" (UID: \"4c486276-3363-486a-a9a5-4f5fa0809e48\") "
May 20 13:53:52.818624 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:52.818569    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c486276-3363-486a-a9a5-4f5fa0809e48-oauth-serving-cert\") pod \"4c486276-3363-486a-a9a5-4f5fa0809e48\" (UID: \"4c486276-3363-486a-a9a5-4f5fa0809e48\") "
May 20 13:53:52.818624 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:52.818607    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c486276-3363-486a-a9a5-4f5fa0809e48-service-ca\") pod \"4c486276-3363-486a-a9a5-4f5fa0809e48\" (UID: \"4c486276-3363-486a-a9a5-4f5fa0809e48\") "
May 20 13:53:52.818850 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:52.818633    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c486276-3363-486a-a9a5-4f5fa0809e48-console-config\") pod \"4c486276-3363-486a-a9a5-4f5fa0809e48\" (UID: \"4c486276-3363-486a-a9a5-4f5fa0809e48\") "
May 20 13:53:52.819047 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:52.819017    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c486276-3363-486a-a9a5-4f5fa0809e48-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4c486276-3363-486a-a9a5-4f5fa0809e48" (UID: "4c486276-3363-486a-a9a5-4f5fa0809e48"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 13:53:52.819142 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:52.819028    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c486276-3363-486a-a9a5-4f5fa0809e48-console-config" (OuterVolumeSpecName: "console-config") pod "4c486276-3363-486a-a9a5-4f5fa0809e48" (UID: "4c486276-3363-486a-a9a5-4f5fa0809e48"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 13:53:52.819142 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:52.819025    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c486276-3363-486a-a9a5-4f5fa0809e48-service-ca" (OuterVolumeSpecName: "service-ca") pod "4c486276-3363-486a-a9a5-4f5fa0809e48" (UID: "4c486276-3363-486a-a9a5-4f5fa0809e48"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 13:53:52.820816 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:52.820792    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c486276-3363-486a-a9a5-4f5fa0809e48-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4c486276-3363-486a-a9a5-4f5fa0809e48" (UID: "4c486276-3363-486a-a9a5-4f5fa0809e48"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 13:53:52.820897 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:52.820794    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c486276-3363-486a-a9a5-4f5fa0809e48-kube-api-access-c89rk" (OuterVolumeSpecName: "kube-api-access-c89rk") pod "4c486276-3363-486a-a9a5-4f5fa0809e48" (UID: "4c486276-3363-486a-a9a5-4f5fa0809e48"). InnerVolumeSpecName "kube-api-access-c89rk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 13:53:52.820897 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:52.820819    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c486276-3363-486a-a9a5-4f5fa0809e48-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4c486276-3363-486a-a9a5-4f5fa0809e48" (UID: "4c486276-3363-486a-a9a5-4f5fa0809e48"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 13:53:52.919333 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:52.919307    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c486276-3363-486a-a9a5-4f5fa0809e48-console-oauth-config\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:53:52.919333 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:52.919331    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c486276-3363-486a-a9a5-4f5fa0809e48-console-serving-cert\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:53:52.919450 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:52.919341    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c486276-3363-486a-a9a5-4f5fa0809e48-oauth-serving-cert\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:53:52.919450 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:52.919350    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c486276-3363-486a-a9a5-4f5fa0809e48-service-ca\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:53:52.919450 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:52.919359    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c486276-3363-486a-a9a5-4f5fa0809e48-console-config\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:53:52.919450 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:52.919367    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c89rk\" (UniqueName: \"kubernetes.io/projected/4c486276-3363-486a-a9a5-4f5fa0809e48-kube-api-access-c89rk\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:53:53.439685 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:53.439659    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-55ffd77d89-5lpfc_4c486276-3363-486a-a9a5-4f5fa0809e48/console/0.log"
May 20 13:53:53.440128 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:53.439702    2571 generic.go:358] "Generic (PLEG): container finished" podID="4c486276-3363-486a-a9a5-4f5fa0809e48" containerID="d7426a629c2560f7e6b820eba7dade021273cfeb4b7a783c28c7eae68c9b6624" exitCode=2
May 20 13:53:53.440128 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:53.439767    2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55ffd77d89-5lpfc"
May 20 13:53:53.440128 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:53.439787    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55ffd77d89-5lpfc" event={"ID":"4c486276-3363-486a-a9a5-4f5fa0809e48","Type":"ContainerDied","Data":"d7426a629c2560f7e6b820eba7dade021273cfeb4b7a783c28c7eae68c9b6624"}
May 20 13:53:53.440128 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:53.439827    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55ffd77d89-5lpfc" event={"ID":"4c486276-3363-486a-a9a5-4f5fa0809e48","Type":"ContainerDied","Data":"1789ec4c58ff1348e40f6500d891b7d1b04ae554587f512c7513097785bb5e08"}
May 20 13:53:53.440128 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:53.439842    2571 scope.go:117] "RemoveContainer" containerID="d7426a629c2560f7e6b820eba7dade021273cfeb4b7a783c28c7eae68c9b6624"
May 20 13:53:53.450422 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:53.450177    2571 scope.go:117] "RemoveContainer" containerID="d7426a629c2560f7e6b820eba7dade021273cfeb4b7a783c28c7eae68c9b6624"
May 20 13:53:53.450884 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:53:53.450856    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7426a629c2560f7e6b820eba7dade021273cfeb4b7a783c28c7eae68c9b6624\": container with ID starting with d7426a629c2560f7e6b820eba7dade021273cfeb4b7a783c28c7eae68c9b6624 not found: ID does not exist" containerID="d7426a629c2560f7e6b820eba7dade021273cfeb4b7a783c28c7eae68c9b6624"
May 20 13:53:53.451013 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:53.450890    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7426a629c2560f7e6b820eba7dade021273cfeb4b7a783c28c7eae68c9b6624"} err="failed to get container status \"d7426a629c2560f7e6b820eba7dade021273cfeb4b7a783c28c7eae68c9b6624\": rpc error: code = NotFound desc = could not find container \"d7426a629c2560f7e6b820eba7dade021273cfeb4b7a783c28c7eae68c9b6624\": container with ID starting with d7426a629c2560f7e6b820eba7dade021273cfeb4b7a783c28c7eae68c9b6624 not found: ID does not exist"
May 20 13:53:53.463920 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:53.463898    2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55ffd77d89-5lpfc"]
May 20 13:53:53.467335 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:53.467314    2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55ffd77d89-5lpfc"]
May 20 13:53:54.666504 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:53:54.666467    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c486276-3363-486a-a9a5-4f5fa0809e48" path="/var/lib/kubelet/pods/4c486276-3363-486a-a9a5-4f5fa0809e48/volumes"
May 20 13:54:01.388547 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:01.388498    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96bd478e-69c0-43e6-8df1-d6f775d6c864-metrics-certs\") pod \"network-metrics-daemon-zhqmq\" (UID: \"96bd478e-69c0-43e6-8df1-d6f775d6c864\") " pod="openshift-multus/network-metrics-daemon-zhqmq"
May 20 13:54:01.391024 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:01.390993    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96bd478e-69c0-43e6-8df1-d6f775d6c864-metrics-certs\") pod \"network-metrics-daemon-zhqmq\" (UID: \"96bd478e-69c0-43e6-8df1-d6f775d6c864\") " pod="openshift-multus/network-metrics-daemon-zhqmq"
May 20 13:54:01.565050 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:01.565024    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d6bxt\""
May 20 13:54:01.572915 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:01.572895    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhqmq"
May 20 13:54:01.695383 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:01.695359    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zhqmq"]
May 20 13:54:01.697732 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:54:01.697708    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96bd478e_69c0_43e6_8df1_d6f775d6c864.slice/crio-6fd9a50f2c158ef02fbcb4f9e43b4b314fcd714ce5bcee874d3b51c3a7290e39 WatchSource:0}: Error finding container 6fd9a50f2c158ef02fbcb4f9e43b4b314fcd714ce5bcee874d3b51c3a7290e39: Status 404 returned error can't find the container with id 6fd9a50f2c158ef02fbcb4f9e43b4b314fcd714ce5bcee874d3b51c3a7290e39
May 20 13:54:02.471759 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:02.471722    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zhqmq" event={"ID":"96bd478e-69c0-43e6-8df1-d6f775d6c864","Type":"ContainerStarted","Data":"6fd9a50f2c158ef02fbcb4f9e43b4b314fcd714ce5bcee874d3b51c3a7290e39"}
May 20 13:54:03.475861 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:03.475824    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zhqmq" event={"ID":"96bd478e-69c0-43e6-8df1-d6f775d6c864","Type":"ContainerStarted","Data":"cc8b9f499ab769ef8d18597d9290d7386ced8decc4d487e312969e0283f2d5d2"}
May 20 13:54:03.476231 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:03.475867    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zhqmq" event={"ID":"96bd478e-69c0-43e6-8df1-d6f775d6c864","Type":"ContainerStarted","Data":"11868413f710501ca28c3a05359e8d0c8fa61c8a3bba290a383f6bad138e7c71"}
May 20 13:54:03.492636 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:03.492594    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zhqmq" podStartSLOduration=252.573989901 podStartE2EDuration="4m13.492579938s" podCreationTimestamp="2026-05-20 13:49:50 +0000 UTC" firstStartedPulling="2026-05-20 13:54:01.69943726 +0000 UTC m=+251.572224395" lastFinishedPulling="2026-05-20 13:54:02.618027284 +0000 UTC m=+252.490814432" observedRunningTime="2026-05-20 13:54:03.491515723 +0000 UTC m=+253.364302880" watchObservedRunningTime="2026-05-20 13:54:03.492579938 +0000 UTC m=+253.365367093"
May 20 13:54:12.163367 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.163293    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-67cf6b7785-xbtqg"]
May 20 13:54:12.163715 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.163610    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c486276-3363-486a-a9a5-4f5fa0809e48" containerName="console"
May 20 13:54:12.163715 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.163622    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c486276-3363-486a-a9a5-4f5fa0809e48" containerName="console"
May 20 13:54:12.163715 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.163684    2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="4c486276-3363-486a-a9a5-4f5fa0809e48" containerName="console"
May 20 13:54:12.165896 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.165869    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67cf6b7785-xbtqg"
May 20 13:54:12.168798 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.168776    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
May 20 13:54:12.168979 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.168776    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
May 20 13:54:12.169119 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.168794    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
May 20 13:54:12.169119 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.168794    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
May 20 13:54:12.169119 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.168832    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-r2qxq\""
May 20 13:54:12.169119 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.168840    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
May 20 13:54:12.174063 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.174045    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
May 20 13:54:12.179127 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.179108    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67cf6b7785-xbtqg"]
May 20 13:54:12.267680 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.267649    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3a179ddd-c533-421f-b137-1e8b18e61622-federate-client-tls\") pod \"telemeter-client-67cf6b7785-xbtqg\" (UID: \"3a179ddd-c533-421f-b137-1e8b18e61622\") " pod="openshift-monitoring/telemeter-client-67cf6b7785-xbtqg"
May 20 13:54:12.267821 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.267703    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a179ddd-c533-421f-b137-1e8b18e61622-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67cf6b7785-xbtqg\" (UID: \"3a179ddd-c533-421f-b137-1e8b18e61622\") " pod="openshift-monitoring/telemeter-client-67cf6b7785-xbtqg"
May 20 13:54:12.267821 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.267765    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3a179ddd-c533-421f-b137-1e8b18e61622-secret-telemeter-client\") pod \"telemeter-client-67cf6b7785-xbtqg\" (UID: \"3a179ddd-c533-421f-b137-1e8b18e61622\") " pod="openshift-monitoring/telemeter-client-67cf6b7785-xbtqg"
May 20 13:54:12.267915 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.267832    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3a179ddd-c533-421f-b137-1e8b18e61622-telemeter-client-tls\") pod \"telemeter-client-67cf6b7785-xbtqg\" (UID: \"3a179ddd-c533-421f-b137-1e8b18e61622\") " pod="openshift-monitoring/telemeter-client-67cf6b7785-xbtqg"
May 20 13:54:12.267915 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.267879    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a179ddd-c533-421f-b137-1e8b18e61622-serving-certs-ca-bundle\") pod \"telemeter-client-67cf6b7785-xbtqg\" (UID: \"3a179ddd-c533-421f-b137-1e8b18e61622\") " pod="openshift-monitoring/telemeter-client-67cf6b7785-xbtqg"
May 20 13:54:12.268020 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.267913    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a179ddd-c533-421f-b137-1e8b18e61622-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67cf6b7785-xbtqg\" (UID: \"3a179ddd-c533-421f-b137-1e8b18e61622\") " pod="openshift-monitoring/telemeter-client-67cf6b7785-xbtqg"
May 20 13:54:12.268020 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.267962    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a179ddd-c533-421f-b137-1e8b18e61622-metrics-client-ca\") pod \"telemeter-client-67cf6b7785-xbtqg\" (UID: \"3a179ddd-c533-421f-b137-1e8b18e61622\") " pod="openshift-monitoring/telemeter-client-67cf6b7785-xbtqg"
May 20 13:54:12.268020 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.267982    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gktf9\" (UniqueName: \"kubernetes.io/projected/3a179ddd-c533-421f-b137-1e8b18e61622-kube-api-access-gktf9\") pod \"telemeter-client-67cf6b7785-xbtqg\" (UID: \"3a179ddd-c533-421f-b137-1e8b18e61622\") " pod="openshift-monitoring/telemeter-client-67cf6b7785-xbtqg"
May 20 13:54:12.369139 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.369109    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3a179ddd-c533-421f-b137-1e8b18e61622-federate-client-tls\") pod \"telemeter-client-67cf6b7785-xbtqg\" (UID: \"3a179ddd-c533-421f-b137-1e8b18e61622\") " pod="openshift-monitoring/telemeter-client-67cf6b7785-xbtqg"
May 20 13:54:12.369353 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.369335    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a179ddd-c533-421f-b137-1e8b18e61622-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67cf6b7785-xbtqg\" (UID: \"3a179ddd-c533-421f-b137-1e8b18e61622\") " pod="openshift-monitoring/telemeter-client-67cf6b7785-xbtqg"
May 20 13:54:12.369477 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.369462    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3a179ddd-c533-421f-b137-1e8b18e61622-secret-telemeter-client\") pod \"telemeter-client-67cf6b7785-xbtqg\" (UID: \"3a179ddd-c533-421f-b137-1e8b18e61622\") " pod="openshift-monitoring/telemeter-client-67cf6b7785-xbtqg"
May 20 13:54:12.369611 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.369594    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3a179ddd-c533-421f-b137-1e8b18e61622-telemeter-client-tls\") pod \"telemeter-client-67cf6b7785-xbtqg\" (UID: \"3a179ddd-c533-421f-b137-1e8b18e61622\") " pod="openshift-monitoring/telemeter-client-67cf6b7785-xbtqg"
May 20 13:54:12.369722 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.369706    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a179ddd-c533-421f-b137-1e8b18e61622-serving-certs-ca-bundle\") pod \"telemeter-client-67cf6b7785-xbtqg\" (UID: \"3a179ddd-c533-421f-b137-1e8b18e61622\") " pod="openshift-monitoring/telemeter-client-67cf6b7785-xbtqg"
May 20 13:54:12.370189 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.370170    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a179ddd-c533-421f-b137-1e8b18e61622-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67cf6b7785-xbtqg\" (UID: \"3a179ddd-c533-421f-b137-1e8b18e61622\") " pod="openshift-monitoring/telemeter-client-67cf6b7785-xbtqg"
May 20 13:54:12.370337 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.370318    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a179ddd-c533-421f-b137-1e8b18e61622-metrics-client-ca\") pod \"telemeter-client-67cf6b7785-xbtqg\" (UID: \"3a179ddd-c533-421f-b137-1e8b18e61622\") " pod="openshift-monitoring/telemeter-client-67cf6b7785-xbtqg"
May 20 13:54:12.370440 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.370414    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a179ddd-c533-421f-b137-1e8b18e61622-serving-certs-ca-bundle\") pod \"telemeter-client-67cf6b7785-xbtqg\" (UID: \"3a179ddd-c533-421f-b137-1e8b18e61622\") " pod="openshift-monitoring/telemeter-client-67cf6b7785-xbtqg"
May 20 13:54:12.370596 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.370427    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gktf9\" (UniqueName: \"kubernetes.io/projected/3a179ddd-c533-421f-b137-1e8b18e61622-kube-api-access-gktf9\") pod \"telemeter-client-67cf6b7785-xbtqg\" (UID: \"3a179ddd-c533-421f-b137-1e8b18e61622\") " pod="openshift-monitoring/telemeter-client-67cf6b7785-xbtqg"
May 20 13:54:12.370695 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.370507    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a179ddd-c533-421f-b137-1e8b18e61622-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67cf6b7785-xbtqg\" (UID: \"3a179ddd-c533-421f-b137-1e8b18e61622\") " pod="openshift-monitoring/telemeter-client-67cf6b7785-xbtqg"
May 20 13:54:12.371148 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.371127    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a179ddd-c533-421f-b137-1e8b18e61622-metrics-client-ca\") pod \"telemeter-client-67cf6b7785-xbtqg\" (UID: \"3a179ddd-c533-421f-b137-1e8b18e61622\") " pod="openshift-monitoring/telemeter-client-67cf6b7785-xbtqg"
May 20 13:54:12.372675 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.372652    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3a179ddd-c533-421f-b137-1e8b18e61622-federate-client-tls\") pod \"telemeter-client-67cf6b7785-xbtqg\" (UID: \"3a179ddd-c533-421f-b137-1e8b18e61622\") " pod="openshift-monitoring/telemeter-client-67cf6b7785-xbtqg"
May 20 13:54:12.373121 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.373092    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a179ddd-c533-421f-b137-1e8b18e61622-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67cf6b7785-xbtqg\" (UID: \"3a179ddd-c533-421f-b137-1e8b18e61622\") " pod="openshift-monitoring/telemeter-client-67cf6b7785-xbtqg"
May 20 13:54:12.373444 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.373427    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3a179ddd-c533-421f-b137-1e8b18e61622-telemeter-client-tls\") pod \"telemeter-client-67cf6b7785-xbtqg\" (UID: \"3a179ddd-c533-421f-b137-1e8b18e61622\") " pod="openshift-monitoring/telemeter-client-67cf6b7785-xbtqg"
May 20 13:54:12.373571 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.373553    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3a179ddd-c533-421f-b137-1e8b18e61622-secret-telemeter-client\") pod \"telemeter-client-67cf6b7785-xbtqg\" (UID: \"3a179ddd-c533-421f-b137-1e8b18e61622\") " pod="openshift-monitoring/telemeter-client-67cf6b7785-xbtqg"
May 20 13:54:12.378594 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.378574    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gktf9\" (UniqueName: \"kubernetes.io/projected/3a179ddd-c533-421f-b137-1e8b18e61622-kube-api-access-gktf9\") pod \"telemeter-client-67cf6b7785-xbtqg\" (UID: \"3a179ddd-c533-421f-b137-1e8b18e61622\") " pod="openshift-monitoring/telemeter-client-67cf6b7785-xbtqg"
May 20 13:54:12.478659 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.478632    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67cf6b7785-xbtqg"
May 20 13:54:12.618066 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:12.618009    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67cf6b7785-xbtqg"]
May 20 13:54:12.620517 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:54:12.620491    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a179ddd_c533_421f_b137_1e8b18e61622.slice/crio-c1c510f9e60dffba413bd6d08260134b8d5a4b8a69296cf6d683b275d8f7a3f1 WatchSource:0}: Error finding container c1c510f9e60dffba413bd6d08260134b8d5a4b8a69296cf6d683b275d8f7a3f1: Status 404 returned error can't find the container with id c1c510f9e60dffba413bd6d08260134b8d5a4b8a69296cf6d683b275d8f7a3f1
May 20 13:54:13.509894 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:13.509858    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67cf6b7785-xbtqg" event={"ID":"3a179ddd-c533-421f-b137-1e8b18e61622","Type":"ContainerStarted","Data":"c1c510f9e60dffba413bd6d08260134b8d5a4b8a69296cf6d683b275d8f7a3f1"}
May 20 13:54:14.513675 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:14.513645    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67cf6b7785-xbtqg" event={"ID":"3a179ddd-c533-421f-b137-1e8b18e61622","Type":"ContainerStarted","Data":"bba9070a956667f50563bad86e2d063a4e66bcf9fd898ad1912049c84e1d5be3"}
May 20 13:54:15.517040 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:15.517016    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67cf6b7785-xbtqg" event={"ID":"3a179ddd-c533-421f-b137-1e8b18e61622","Type":"ContainerStarted","Data":"90ca264c5e22425386ca77943e744f4740221d7a7944f96382fee23e6362f8ec"}
May 20 13:54:16.523277 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:16.523237    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67cf6b7785-xbtqg" event={"ID":"3a179ddd-c533-421f-b137-1e8b18e61622","Type":"ContainerStarted","Data":"9fa3b4021367e63293f37b07d9c249f06933ff1e30509ae87b92707383f611e5"}
May 20 13:54:16.545303 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:16.545252    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-67cf6b7785-xbtqg" podStartSLOduration=1.730216499 podStartE2EDuration="4.545236964s" podCreationTimestamp="2026-05-20 13:54:12 +0000 UTC" firstStartedPulling="2026-05-20 13:54:12.622276813 +0000 UTC m=+262.495063948" lastFinishedPulling="2026-05-20 13:54:15.437297275 +0000 UTC m=+265.310084413" observedRunningTime="2026-05-20 13:54:16.544336224 +0000 UTC m=+266.417123381" watchObservedRunningTime="2026-05-20 13:54:16.545236964 +0000 UTC m=+266.418024120"
May 20 13:54:17.256343 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:17.256310    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-76c69b466-cdtrs"]
May 20 13:54:17.258355 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:17.258337    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76c69b466-cdtrs"
May 20 13:54:17.270732 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:17.270705    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76c69b466-cdtrs"]
May 20 13:54:17.308016 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:17.307988    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/310d8067-a4c0-463d-b5f8-c1fc26c3192d-oauth-serving-cert\") pod \"console-76c69b466-cdtrs\" (UID: \"310d8067-a4c0-463d-b5f8-c1fc26c3192d\") " pod="openshift-console/console-76c69b466-cdtrs"
May 20 13:54:17.308163 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:17.308024    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k46q4\" (UniqueName: \"kubernetes.io/projected/310d8067-a4c0-463d-b5f8-c1fc26c3192d-kube-api-access-k46q4\") pod \"console-76c69b466-cdtrs\" (UID: \"310d8067-a4c0-463d-b5f8-c1fc26c3192d\") " pod="openshift-console/console-76c69b466-cdtrs"
May 20 13:54:17.308163 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:17.308043    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/310d8067-a4c0-463d-b5f8-c1fc26c3192d-trusted-ca-bundle\") pod \"console-76c69b466-cdtrs\" (UID: \"310d8067-a4c0-463d-b5f8-c1fc26c3192d\") " pod="openshift-console/console-76c69b466-cdtrs"
May 20 13:54:17.308163 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:17.308064    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/310d8067-a4c0-463d-b5f8-c1fc26c3192d-service-ca\") pod \"console-76c69b466-cdtrs\" (UID: \"310d8067-a4c0-463d-b5f8-c1fc26c3192d\") " pod="openshift-console/console-76c69b466-cdtrs"
May 20 13:54:17.308288 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:17.308160    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/310d8067-a4c0-463d-b5f8-c1fc26c3192d-console-config\") pod \"console-76c69b466-cdtrs\" (UID: \"310d8067-a4c0-463d-b5f8-c1fc26c3192d\") " pod="openshift-console/console-76c69b466-cdtrs"
May 20 13:54:17.308288 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:17.308207    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/310d8067-a4c0-463d-b5f8-c1fc26c3192d-console-oauth-config\") pod \"console-76c69b466-cdtrs\" (UID: \"310d8067-a4c0-463d-b5f8-c1fc26c3192d\") " pod="openshift-console/console-76c69b466-cdtrs"
May 20 13:54:17.308288 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:17.308274    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/310d8067-a4c0-463d-b5f8-c1fc26c3192d-console-serving-cert\") pod \"console-76c69b466-cdtrs\" (UID: \"310d8067-a4c0-463d-b5f8-c1fc26c3192d\") " pod="openshift-console/console-76c69b466-cdtrs"
May 20 13:54:17.409475 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:17.409439    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/310d8067-a4c0-463d-b5f8-c1fc26c3192d-oauth-serving-cert\") pod \"console-76c69b466-cdtrs\" (UID: \"310d8067-a4c0-463d-b5f8-c1fc26c3192d\") " pod="openshift-console/console-76c69b466-cdtrs"
May 20 13:54:17.409620 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:17.409492    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k46q4\" (UniqueName: \"kubernetes.io/projected/310d8067-a4c0-463d-b5f8-c1fc26c3192d-kube-api-access-k46q4\") pod \"console-76c69b466-cdtrs\" (UID: \"310d8067-a4c0-463d-b5f8-c1fc26c3192d\") " pod="openshift-console/console-76c69b466-cdtrs"
May 20 13:54:17.409620 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:17.409521    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/310d8067-a4c0-463d-b5f8-c1fc26c3192d-trusted-ca-bundle\") pod \"console-76c69b466-cdtrs\" (UID: \"310d8067-a4c0-463d-b5f8-c1fc26c3192d\") " pod="openshift-console/console-76c69b466-cdtrs"
May 20 13:54:17.409620 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:17.409545    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/310d8067-a4c0-463d-b5f8-c1fc26c3192d-service-ca\") pod \"console-76c69b466-cdtrs\" (UID: \"310d8067-a4c0-463d-b5f8-c1fc26c3192d\") " pod="openshift-console/console-76c69b466-cdtrs"
May 20 13:54:17.409620 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:17.409579    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/310d8067-a4c0-463d-b5f8-c1fc26c3192d-console-config\") pod \"console-76c69b466-cdtrs\" (UID: \"310d8067-a4c0-463d-b5f8-c1fc26c3192d\") " pod="openshift-console/console-76c69b466-cdtrs"
May 20 13:54:17.409620 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:17.409608    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/310d8067-a4c0-463d-b5f8-c1fc26c3192d-console-oauth-config\") pod \"console-76c69b466-cdtrs\" (UID: \"310d8067-a4c0-463d-b5f8-c1fc26c3192d\") " pod="openshift-console/console-76c69b466-cdtrs"
May 20 13:54:17.409914 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:17.409674    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/310d8067-a4c0-463d-b5f8-c1fc26c3192d-console-serving-cert\") pod \"console-76c69b466-cdtrs\" (UID: \"310d8067-a4c0-463d-b5f8-c1fc26c3192d\") " pod="openshift-console/console-76c69b466-cdtrs"
May 20 13:54:17.410449 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:17.410423    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/310d8067-a4c0-463d-b5f8-c1fc26c3192d-console-config\") pod \"console-76c69b466-cdtrs\" (UID: \"310d8067-a4c0-463d-b5f8-c1fc26c3192d\") " pod="openshift-console/console-76c69b466-cdtrs"
May 20 13:54:17.410583 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:17.410560    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/310d8067-a4c0-463d-b5f8-c1fc26c3192d-trusted-ca-bundle\") pod \"console-76c69b466-cdtrs\" (UID: \"310d8067-a4c0-463d-b5f8-c1fc26c3192d\") " pod="openshift-console/console-76c69b466-cdtrs"
May 20 13:54:17.410583 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:17.410445    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/310d8067-a4c0-463d-b5f8-c1fc26c3192d-oauth-serving-cert\") pod \"console-76c69b466-cdtrs\" (UID: \"310d8067-a4c0-463d-b5f8-c1fc26c3192d\") " pod="openshift-console/console-76c69b466-cdtrs"
May 20 13:54:17.410721 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:17.410628    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/310d8067-a4c0-463d-b5f8-c1fc26c3192d-service-ca\") pod \"console-76c69b466-cdtrs\" (UID: \"310d8067-a4c0-463d-b5f8-c1fc26c3192d\") " pod="openshift-console/console-76c69b466-cdtrs"
May 20 13:54:17.412335 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:17.412317    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/310d8067-a4c0-463d-b5f8-c1fc26c3192d-console-oauth-config\") pod \"console-76c69b466-cdtrs\" (UID: \"310d8067-a4c0-463d-b5f8-c1fc26c3192d\") " pod="openshift-console/console-76c69b466-cdtrs"
May 20 13:54:17.412422 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:17.412402    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/310d8067-a4c0-463d-b5f8-c1fc26c3192d-console-serving-cert\") pod \"console-76c69b466-cdtrs\" (UID: \"310d8067-a4c0-463d-b5f8-c1fc26c3192d\") " pod="openshift-console/console-76c69b466-cdtrs"
May 20 13:54:17.418506 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:17.418476    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k46q4\" (UniqueName: \"kubernetes.io/projected/310d8067-a4c0-463d-b5f8-c1fc26c3192d-kube-api-access-k46q4\") pod \"console-76c69b466-cdtrs\" (UID: \"310d8067-a4c0-463d-b5f8-c1fc26c3192d\") " pod="openshift-console/console-76c69b466-cdtrs"
May 20 13:54:17.569241 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:17.569167    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76c69b466-cdtrs"
May 20 13:54:17.688514 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:17.688489    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76c69b466-cdtrs"]
May 20 13:54:17.690544 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:54:17.690516    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod310d8067_a4c0_463d_b5f8_c1fc26c3192d.slice/crio-2bfea746539fef03ec68e012ba4e86e942d7ef21301c25fe13d328831ebfddf4 WatchSource:0}: Error finding container 2bfea746539fef03ec68e012ba4e86e942d7ef21301c25fe13d328831ebfddf4: Status 404 returned error can't find the container with id 2bfea746539fef03ec68e012ba4e86e942d7ef21301c25fe13d328831ebfddf4
May 20 13:54:18.530597 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:18.530558    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76c69b466-cdtrs" event={"ID":"310d8067-a4c0-463d-b5f8-c1fc26c3192d","Type":"ContainerStarted","Data":"06655cfbe0bbca761fc93aa6897353a2da6eb9e333496d2120bad659a3eedb8f"}
May 20 13:54:18.530758 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:18.530601    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76c69b466-cdtrs" event={"ID":"310d8067-a4c0-463d-b5f8-c1fc26c3192d","Type":"ContainerStarted","Data":"2bfea746539fef03ec68e012ba4e86e942d7ef21301c25fe13d328831ebfddf4"}
May 20 13:54:18.550159 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:18.550102    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-76c69b466-cdtrs" podStartSLOduration=1.550087877 podStartE2EDuration="1.550087877s" podCreationTimestamp="2026-05-20 13:54:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 13:54:18.54838124 +0000 UTC m=+268.421168396" watchObservedRunningTime="2026-05-20 13:54:18.550087877 +0000 UTC m=+268.422875032"
May 20 13:54:27.569913 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:27.569828    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76c69b466-cdtrs"
May 20 13:54:27.569913 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:27.569876    2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76c69b466-cdtrs"
May 20 13:54:27.574636 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:27.574611    2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76c69b466-cdtrs"
May 20 13:54:28.568626 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:28.568594    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76c69b466-cdtrs"
May 20 13:54:28.613147 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:28.613113    2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-797df8b685-wxn42"]
May 20 13:54:50.584960 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:50.584371    2571 kubelet.go:1628] "Image garbage collection succeeded"
May 20 13:54:53.631635 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:53.631594    2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-797df8b685-wxn42" podUID="3954df05-e997-489f-861e-25879e3e214d" containerName="console" containerID="cri-o://2092b8b9a2e0abc74d607cb5d66fe78f09e0bc87a3a5cb662d08db9249eb6a62" gracePeriod=15
May 20 13:54:53.876376 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:53.876354    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-797df8b685-wxn42_3954df05-e997-489f-861e-25879e3e214d/console/0.log"
May 20 13:54:53.876479 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:53.876416    2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797df8b685-wxn42"
May 20 13:54:53.971381 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:53.971351    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zz7cf\" (UniqueName: \"kubernetes.io/projected/3954df05-e997-489f-861e-25879e3e214d-kube-api-access-zz7cf\") pod \"3954df05-e997-489f-861e-25879e3e214d\" (UID: \"3954df05-e997-489f-861e-25879e3e214d\") "
May 20 13:54:53.971537 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:53.971405    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3954df05-e997-489f-861e-25879e3e214d-console-oauth-config\") pod \"3954df05-e997-489f-861e-25879e3e214d\" (UID: \"3954df05-e997-489f-861e-25879e3e214d\") "
May 20 13:54:53.971537 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:53.971526    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3954df05-e997-489f-861e-25879e3e214d-console-config\") pod \"3954df05-e997-489f-861e-25879e3e214d\" (UID: \"3954df05-e997-489f-861e-25879e3e214d\") "
May 20 13:54:53.971628 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:53.971569    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3954df05-e997-489f-861e-25879e3e214d-oauth-serving-cert\") pod \"3954df05-e997-489f-861e-25879e3e214d\" (UID: \"3954df05-e997-489f-861e-25879e3e214d\") "
May 20 13:54:53.971628 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:53.971599    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3954df05-e997-489f-861e-25879e3e214d-console-serving-cert\") pod \"3954df05-e997-489f-861e-25879e3e214d\" (UID: \"3954df05-e997-489f-861e-25879e3e214d\") "
May 20 13:54:53.971729 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:53.971656    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3954df05-e997-489f-861e-25879e3e214d-service-ca\") pod \"3954df05-e997-489f-861e-25879e3e214d\" (UID: \"3954df05-e997-489f-861e-25879e3e214d\") "
May 20 13:54:53.971729 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:53.971686    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3954df05-e997-489f-861e-25879e3e214d-trusted-ca-bundle\") pod \"3954df05-e997-489f-861e-25879e3e214d\" (UID: \"3954df05-e997-489f-861e-25879e3e214d\") "
May 20 13:54:53.972058 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:53.971996    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3954df05-e997-489f-861e-25879e3e214d-console-config" (OuterVolumeSpecName: "console-config") pod "3954df05-e997-489f-861e-25879e3e214d" (UID: "3954df05-e997-489f-861e-25879e3e214d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 13:54:53.972176 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:53.972084    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3954df05-e997-489f-861e-25879e3e214d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3954df05-e997-489f-861e-25879e3e214d" (UID: "3954df05-e997-489f-861e-25879e3e214d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 13:54:53.972176 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:53.972132    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3954df05-e997-489f-861e-25879e3e214d-service-ca" (OuterVolumeSpecName: "service-ca") pod "3954df05-e997-489f-861e-25879e3e214d" (UID: "3954df05-e997-489f-861e-25879e3e214d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 13:54:53.972176 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:53.972139    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3954df05-e997-489f-861e-25879e3e214d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3954df05-e997-489f-861e-25879e3e214d" (UID: "3954df05-e997-489f-861e-25879e3e214d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 13:54:53.973642 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:53.973621    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3954df05-e997-489f-861e-25879e3e214d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3954df05-e997-489f-861e-25879e3e214d" (UID: "3954df05-e997-489f-861e-25879e3e214d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 13:54:53.973871 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:53.973854    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3954df05-e997-489f-861e-25879e3e214d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3954df05-e997-489f-861e-25879e3e214d" (UID: "3954df05-e997-489f-861e-25879e3e214d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 13:54:53.973927 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:53.973869    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3954df05-e997-489f-861e-25879e3e214d-kube-api-access-zz7cf" (OuterVolumeSpecName: "kube-api-access-zz7cf") pod "3954df05-e997-489f-861e-25879e3e214d" (UID: "3954df05-e997-489f-861e-25879e3e214d"). InnerVolumeSpecName "kube-api-access-zz7cf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 13:54:54.072735 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:54.072683    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3954df05-e997-489f-861e-25879e3e214d-service-ca\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:54:54.072735 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:54.072729    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3954df05-e997-489f-861e-25879e3e214d-trusted-ca-bundle\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:54:54.072735 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:54.072742    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zz7cf\" (UniqueName: \"kubernetes.io/projected/3954df05-e997-489f-861e-25879e3e214d-kube-api-access-zz7cf\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:54:54.072987 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:54.072755    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3954df05-e997-489f-861e-25879e3e214d-console-oauth-config\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:54:54.072987 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:54.072767    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3954df05-e997-489f-861e-25879e3e214d-console-config\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:54:54.072987 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:54.072778    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3954df05-e997-489f-861e-25879e3e214d-oauth-serving-cert\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:54:54.072987 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:54.072788    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3954df05-e997-489f-861e-25879e3e214d-console-serving-cert\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:54:54.646278 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:54.646248    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-797df8b685-wxn42_3954df05-e997-489f-861e-25879e3e214d/console/0.log"
May 20 13:54:54.646708 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:54.646295    2571 generic.go:358] "Generic (PLEG): container finished" podID="3954df05-e997-489f-861e-25879e3e214d" containerID="2092b8b9a2e0abc74d607cb5d66fe78f09e0bc87a3a5cb662d08db9249eb6a62" exitCode=2
May 20 13:54:54.646708 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:54.646358    2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797df8b685-wxn42"
May 20 13:54:54.646708 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:54.646362    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797df8b685-wxn42" event={"ID":"3954df05-e997-489f-861e-25879e3e214d","Type":"ContainerDied","Data":"2092b8b9a2e0abc74d607cb5d66fe78f09e0bc87a3a5cb662d08db9249eb6a62"}
May 20 13:54:54.646708 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:54.646398    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797df8b685-wxn42" event={"ID":"3954df05-e997-489f-861e-25879e3e214d","Type":"ContainerDied","Data":"7d53dd9c401902ecb99ff154740fdbeede2eae0b01e50751522bb6fe25064567"}
May 20 13:54:54.646708 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:54.646421    2571 scope.go:117] "RemoveContainer" containerID="2092b8b9a2e0abc74d607cb5d66fe78f09e0bc87a3a5cb662d08db9249eb6a62"
May 20 13:54:54.654733 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:54.654711    2571 scope.go:117] "RemoveContainer" containerID="2092b8b9a2e0abc74d607cb5d66fe78f09e0bc87a3a5cb662d08db9249eb6a62"
May 20 13:54:54.655001 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:54:54.654980    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2092b8b9a2e0abc74d607cb5d66fe78f09e0bc87a3a5cb662d08db9249eb6a62\": container with ID starting with 2092b8b9a2e0abc74d607cb5d66fe78f09e0bc87a3a5cb662d08db9249eb6a62 not found: ID does not exist" containerID="2092b8b9a2e0abc74d607cb5d66fe78f09e0bc87a3a5cb662d08db9249eb6a62"
May 20 13:54:54.655062 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:54.655013    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2092b8b9a2e0abc74d607cb5d66fe78f09e0bc87a3a5cb662d08db9249eb6a62"} err="failed to get container status \"2092b8b9a2e0abc74d607cb5d66fe78f09e0bc87a3a5cb662d08db9249eb6a62\": rpc error: code = NotFound desc = could not find container \"2092b8b9a2e0abc74d607cb5d66fe78f09e0bc87a3a5cb662d08db9249eb6a62\": container with ID starting with 2092b8b9a2e0abc74d607cb5d66fe78f09e0bc87a3a5cb662d08db9249eb6a62 not found: ID does not exist"
May 20 13:54:54.667796 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:54.667768    2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-797df8b685-wxn42"]
May 20 13:54:54.671284 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:54.671263    2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-797df8b685-wxn42"]
May 20 13:54:56.666140 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:54:56.666102    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3954df05-e997-489f-861e-25879e3e214d" path="/var/lib/kubelet/pods/3954df05-e997-489f-861e-25879e3e214d/volumes"
May 20 13:55:26.412559 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:26.412522    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-596c4456db-fbc88"]
May 20 13:55:26.413054 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:26.412809    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3954df05-e997-489f-861e-25879e3e214d" containerName="console"
May 20 13:55:26.413054 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:26.412820    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="3954df05-e997-489f-861e-25879e3e214d" containerName="console"
May 20 13:55:26.413054 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:26.412879    2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="3954df05-e997-489f-861e-25879e3e214d" containerName="console"
May 20 13:55:26.415613 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:26.415593    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-596c4456db-fbc88"
May 20 13:55:26.427382 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:26.427352    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-596c4456db-fbc88"]
May 20 13:55:26.524174 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:26.524144    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-console-oauth-config\") pod \"console-596c4456db-fbc88\" (UID: \"9cbcf156-caaa-44ad-a008-80fd49d0c3b0\") " pod="openshift-console/console-596c4456db-fbc88"
May 20 13:55:26.524299 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:26.524183    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-trusted-ca-bundle\") pod \"console-596c4456db-fbc88\" (UID: \"9cbcf156-caaa-44ad-a008-80fd49d0c3b0\") " pod="openshift-console/console-596c4456db-fbc88"
May 20 13:55:26.524299 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:26.524207    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p7hf\" (UniqueName: \"kubernetes.io/projected/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-kube-api-access-2p7hf\") pod \"console-596c4456db-fbc88\" (UID: \"9cbcf156-caaa-44ad-a008-80fd49d0c3b0\") " pod="openshift-console/console-596c4456db-fbc88"
May 20 13:55:26.524411 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:26.524300    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-service-ca\") pod \"console-596c4456db-fbc88\" (UID: \"9cbcf156-caaa-44ad-a008-80fd49d0c3b0\") " pod="openshift-console/console-596c4456db-fbc88"
May 20 13:55:26.524411 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:26.524360    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-console-serving-cert\") pod \"console-596c4456db-fbc88\" (UID: \"9cbcf156-caaa-44ad-a008-80fd49d0c3b0\") " pod="openshift-console/console-596c4456db-fbc88"
May 20 13:55:26.524411 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:26.524395    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-console-config\") pod \"console-596c4456db-fbc88\" (UID: \"9cbcf156-caaa-44ad-a008-80fd49d0c3b0\") " pod="openshift-console/console-596c4456db-fbc88"
May 20 13:55:26.524545 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:26.524429    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-oauth-serving-cert\") pod \"console-596c4456db-fbc88\" (UID: \"9cbcf156-caaa-44ad-a008-80fd49d0c3b0\") " pod="openshift-console/console-596c4456db-fbc88"
May 20 13:55:26.625187 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:26.625157    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-oauth-serving-cert\") pod \"console-596c4456db-fbc88\" (UID: \"9cbcf156-caaa-44ad-a008-80fd49d0c3b0\") " pod="openshift-console/console-596c4456db-fbc88"
May 20 13:55:26.625289 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:26.625203    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-console-oauth-config\") pod \"console-596c4456db-fbc88\" (UID: \"9cbcf156-caaa-44ad-a008-80fd49d0c3b0\") " pod="openshift-console/console-596c4456db-fbc88"
May 20 13:55:26.625349 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:26.625319    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-trusted-ca-bundle\") pod \"console-596c4456db-fbc88\" (UID: \"9cbcf156-caaa-44ad-a008-80fd49d0c3b0\") " pod="openshift-console/console-596c4456db-fbc88"
May 20 13:55:26.625401 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:26.625361    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2p7hf\" (UniqueName: \"kubernetes.io/projected/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-kube-api-access-2p7hf\") pod \"console-596c4456db-fbc88\" (UID: \"9cbcf156-caaa-44ad-a008-80fd49d0c3b0\") " pod="openshift-console/console-596c4456db-fbc88"
May 20 13:55:26.625452 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:26.625403    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-service-ca\") pod \"console-596c4456db-fbc88\" (UID: \"9cbcf156-caaa-44ad-a008-80fd49d0c3b0\") " pod="openshift-console/console-596c4456db-fbc88"
May 20 13:55:26.625502 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:26.625458    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-console-serving-cert\") pod \"console-596c4456db-fbc88\" (UID: \"9cbcf156-caaa-44ad-a008-80fd49d0c3b0\") " pod="openshift-console/console-596c4456db-fbc88"
May 20 13:55:26.625502 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:26.625490    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-console-config\") pod \"console-596c4456db-fbc88\" (UID: \"9cbcf156-caaa-44ad-a008-80fd49d0c3b0\") " pod="openshift-console/console-596c4456db-fbc88"
May 20 13:55:26.625915 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:26.625896    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-oauth-serving-cert\") pod \"console-596c4456db-fbc88\" (UID: \"9cbcf156-caaa-44ad-a008-80fd49d0c3b0\") " pod="openshift-console/console-596c4456db-fbc88"
May 20 13:55:26.626174 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:26.626156    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-console-config\") pod \"console-596c4456db-fbc88\" (UID: \"9cbcf156-caaa-44ad-a008-80fd49d0c3b0\") " pod="openshift-console/console-596c4456db-fbc88"
May 20 13:55:26.626254 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:26.626215    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-service-ca\") pod \"console-596c4456db-fbc88\" (UID: \"9cbcf156-caaa-44ad-a008-80fd49d0c3b0\") " pod="openshift-console/console-596c4456db-fbc88"
May 20 13:55:26.626291 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:26.626268    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-trusted-ca-bundle\") pod \"console-596c4456db-fbc88\" (UID: \"9cbcf156-caaa-44ad-a008-80fd49d0c3b0\") " pod="openshift-console/console-596c4456db-fbc88"
May 20 13:55:26.627626 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:26.627604    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-console-oauth-config\") pod \"console-596c4456db-fbc88\" (UID: \"9cbcf156-caaa-44ad-a008-80fd49d0c3b0\") " pod="openshift-console/console-596c4456db-fbc88"
May 20 13:55:26.627904 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:26.627885    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-console-serving-cert\") pod \"console-596c4456db-fbc88\" (UID: \"9cbcf156-caaa-44ad-a008-80fd49d0c3b0\") " pod="openshift-console/console-596c4456db-fbc88"
May 20 13:55:26.633189 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:26.633164    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p7hf\" (UniqueName: \"kubernetes.io/projected/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-kube-api-access-2p7hf\") pod \"console-596c4456db-fbc88\" (UID: \"9cbcf156-caaa-44ad-a008-80fd49d0c3b0\") " pod="openshift-console/console-596c4456db-fbc88"
May 20 13:55:26.724509 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:26.724482    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-596c4456db-fbc88"
May 20 13:55:26.842729 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:26.842701    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-596c4456db-fbc88"]
May 20 13:55:26.845312 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:55:26.845286    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cbcf156_caaa_44ad_a008_80fd49d0c3b0.slice/crio-d07d745659336c0d92f9f4937ae09940cf51836cb0b59ed0a4fc3904cce0e396 WatchSource:0}: Error finding container d07d745659336c0d92f9f4937ae09940cf51836cb0b59ed0a4fc3904cce0e396: Status 404 returned error can't find the container with id d07d745659336c0d92f9f4937ae09940cf51836cb0b59ed0a4fc3904cce0e396
May 20 13:55:26.847584 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:26.847560    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 13:55:27.736519 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:27.736488    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-596c4456db-fbc88" event={"ID":"9cbcf156-caaa-44ad-a008-80fd49d0c3b0","Type":"ContainerStarted","Data":"afc49d4dca9c7ec6c5337fde3c477675fddcd4f6fc43a4a283491cbcf7d36014"}
May 20 13:55:27.736519 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:27.736522    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-596c4456db-fbc88" event={"ID":"9cbcf156-caaa-44ad-a008-80fd49d0c3b0","Type":"ContainerStarted","Data":"d07d745659336c0d92f9f4937ae09940cf51836cb0b59ed0a4fc3904cce0e396"}
May 20 13:55:27.765549 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:27.765499    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-596c4456db-fbc88" podStartSLOduration=1.765483862 podStartE2EDuration="1.765483862s" podCreationTimestamp="2026-05-20 13:55:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 13:55:27.765234987 +0000 UTC m=+337.638022141" watchObservedRunningTime="2026-05-20 13:55:27.765483862 +0000 UTC m=+337.638271018"
May 20 13:55:36.724852 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:36.724811    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-596c4456db-fbc88"
May 20 13:55:36.725289 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:36.724888    2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-596c4456db-fbc88"
May 20 13:55:36.729723 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:36.729701    2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-596c4456db-fbc88"
May 20 13:55:36.763643 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:36.763616    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-596c4456db-fbc88"
May 20 13:55:36.826503 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:55:36.826478    2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76c69b466-cdtrs"]
May 20 13:56:01.845107 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:01.845062    2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-76c69b466-cdtrs" podUID="310d8067-a4c0-463d-b5f8-c1fc26c3192d" containerName="console" containerID="cri-o://06655cfbe0bbca761fc93aa6897353a2da6eb9e333496d2120bad659a3eedb8f" gracePeriod=15
May 20 13:56:02.080829 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:02.080803    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-76c69b466-cdtrs_310d8067-a4c0-463d-b5f8-c1fc26c3192d/console/0.log"
May 20 13:56:02.080954 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:02.080880    2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76c69b466-cdtrs"
May 20 13:56:02.181491 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:02.181432    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/310d8067-a4c0-463d-b5f8-c1fc26c3192d-console-config\") pod \"310d8067-a4c0-463d-b5f8-c1fc26c3192d\" (UID: \"310d8067-a4c0-463d-b5f8-c1fc26c3192d\") "
May 20 13:56:02.181491 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:02.181467    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/310d8067-a4c0-463d-b5f8-c1fc26c3192d-console-serving-cert\") pod \"310d8067-a4c0-463d-b5f8-c1fc26c3192d\" (UID: \"310d8067-a4c0-463d-b5f8-c1fc26c3192d\") "
May 20 13:56:02.181667 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:02.181497    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/310d8067-a4c0-463d-b5f8-c1fc26c3192d-service-ca\") pod \"310d8067-a4c0-463d-b5f8-c1fc26c3192d\" (UID: \"310d8067-a4c0-463d-b5f8-c1fc26c3192d\") "
May 20 13:56:02.181667 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:02.181598    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/310d8067-a4c0-463d-b5f8-c1fc26c3192d-trusted-ca-bundle\") pod \"310d8067-a4c0-463d-b5f8-c1fc26c3192d\" (UID: \"310d8067-a4c0-463d-b5f8-c1fc26c3192d\") "
May 20 13:56:02.181667 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:02.181649    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/310d8067-a4c0-463d-b5f8-c1fc26c3192d-oauth-serving-cert\") pod \"310d8067-a4c0-463d-b5f8-c1fc26c3192d\" (UID: \"310d8067-a4c0-463d-b5f8-c1fc26c3192d\") "
May 20 13:56:02.181808 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:02.181671    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k46q4\" (UniqueName: \"kubernetes.io/projected/310d8067-a4c0-463d-b5f8-c1fc26c3192d-kube-api-access-k46q4\") pod \"310d8067-a4c0-463d-b5f8-c1fc26c3192d\" (UID: \"310d8067-a4c0-463d-b5f8-c1fc26c3192d\") "
May 20 13:56:02.181808 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:02.181772    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/310d8067-a4c0-463d-b5f8-c1fc26c3192d-console-oauth-config\") pod \"310d8067-a4c0-463d-b5f8-c1fc26c3192d\" (UID: \"310d8067-a4c0-463d-b5f8-c1fc26c3192d\") "
May 20 13:56:02.182014 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:02.181962    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/310d8067-a4c0-463d-b5f8-c1fc26c3192d-console-config" (OuterVolumeSpecName: "console-config") pod "310d8067-a4c0-463d-b5f8-c1fc26c3192d" (UID: "310d8067-a4c0-463d-b5f8-c1fc26c3192d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 13:56:02.182072 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:02.182056    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/310d8067-a4c0-463d-b5f8-c1fc26c3192d-service-ca" (OuterVolumeSpecName: "service-ca") pod "310d8067-a4c0-463d-b5f8-c1fc26c3192d" (UID: "310d8067-a4c0-463d-b5f8-c1fc26c3192d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 13:56:02.182122 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:02.182079    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/310d8067-a4c0-463d-b5f8-c1fc26c3192d-console-config\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:56:02.182158 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:02.182108    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/310d8067-a4c0-463d-b5f8-c1fc26c3192d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "310d8067-a4c0-463d-b5f8-c1fc26c3192d" (UID: "310d8067-a4c0-463d-b5f8-c1fc26c3192d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 13:56:02.182193 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:02.182158    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/310d8067-a4c0-463d-b5f8-c1fc26c3192d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "310d8067-a4c0-463d-b5f8-c1fc26c3192d" (UID: "310d8067-a4c0-463d-b5f8-c1fc26c3192d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 13:56:02.183724 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:02.183697    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/310d8067-a4c0-463d-b5f8-c1fc26c3192d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "310d8067-a4c0-463d-b5f8-c1fc26c3192d" (UID: "310d8067-a4c0-463d-b5f8-c1fc26c3192d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 13:56:02.184158 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:02.184130    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/310d8067-a4c0-463d-b5f8-c1fc26c3192d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "310d8067-a4c0-463d-b5f8-c1fc26c3192d" (UID: "310d8067-a4c0-463d-b5f8-c1fc26c3192d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 13:56:02.184252 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:02.184162    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/310d8067-a4c0-463d-b5f8-c1fc26c3192d-kube-api-access-k46q4" (OuterVolumeSpecName: "kube-api-access-k46q4") pod "310d8067-a4c0-463d-b5f8-c1fc26c3192d" (UID: "310d8067-a4c0-463d-b5f8-c1fc26c3192d"). InnerVolumeSpecName "kube-api-access-k46q4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 13:56:02.283304 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:02.283278    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/310d8067-a4c0-463d-b5f8-c1fc26c3192d-console-oauth-config\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:56:02.283304 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:02.283301    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/310d8067-a4c0-463d-b5f8-c1fc26c3192d-console-serving-cert\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:56:02.283427 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:02.283311    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/310d8067-a4c0-463d-b5f8-c1fc26c3192d-service-ca\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:56:02.283427 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:02.283320    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/310d8067-a4c0-463d-b5f8-c1fc26c3192d-trusted-ca-bundle\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:56:02.283427 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:02.283329    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/310d8067-a4c0-463d-b5f8-c1fc26c3192d-oauth-serving-cert\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:56:02.283427 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:02.283338    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k46q4\" (UniqueName: \"kubernetes.io/projected/310d8067-a4c0-463d-b5f8-c1fc26c3192d-kube-api-access-k46q4\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:56:02.833795 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:02.833769    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-76c69b466-cdtrs_310d8067-a4c0-463d-b5f8-c1fc26c3192d/console/0.log"
May 20 13:56:02.833945 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:02.833816    2571 generic.go:358] "Generic (PLEG): container finished" podID="310d8067-a4c0-463d-b5f8-c1fc26c3192d" containerID="06655cfbe0bbca761fc93aa6897353a2da6eb9e333496d2120bad659a3eedb8f" exitCode=2
May 20 13:56:02.833945 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:02.833882    2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76c69b466-cdtrs"
May 20 13:56:02.833945 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:02.833905    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76c69b466-cdtrs" event={"ID":"310d8067-a4c0-463d-b5f8-c1fc26c3192d","Type":"ContainerDied","Data":"06655cfbe0bbca761fc93aa6897353a2da6eb9e333496d2120bad659a3eedb8f"}
May 20 13:56:02.834059 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:02.833964    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76c69b466-cdtrs" event={"ID":"310d8067-a4c0-463d-b5f8-c1fc26c3192d","Type":"ContainerDied","Data":"2bfea746539fef03ec68e012ba4e86e942d7ef21301c25fe13d328831ebfddf4"}
May 20 13:56:02.834059 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:02.833980    2571 scope.go:117] "RemoveContainer" containerID="06655cfbe0bbca761fc93aa6897353a2da6eb9e333496d2120bad659a3eedb8f"
May 20 13:56:02.842012 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:02.841994    2571 scope.go:117] "RemoveContainer" containerID="06655cfbe0bbca761fc93aa6897353a2da6eb9e333496d2120bad659a3eedb8f"
May 20 13:56:02.842302 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:56:02.842280    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06655cfbe0bbca761fc93aa6897353a2da6eb9e333496d2120bad659a3eedb8f\": container with ID starting with 06655cfbe0bbca761fc93aa6897353a2da6eb9e333496d2120bad659a3eedb8f not found: ID does not exist" containerID="06655cfbe0bbca761fc93aa6897353a2da6eb9e333496d2120bad659a3eedb8f"
May 20 13:56:02.842355 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:02.842309    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06655cfbe0bbca761fc93aa6897353a2da6eb9e333496d2120bad659a3eedb8f"} err="failed to get container status \"06655cfbe0bbca761fc93aa6897353a2da6eb9e333496d2120bad659a3eedb8f\": rpc error: code = NotFound desc = could not find container \"06655cfbe0bbca761fc93aa6897353a2da6eb9e333496d2120bad659a3eedb8f\": container with ID starting with 06655cfbe0bbca761fc93aa6897353a2da6eb9e333496d2120bad659a3eedb8f not found: ID does not exist"
May 20 13:56:02.851420 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:02.851398    2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76c69b466-cdtrs"]
May 20 13:56:02.855060 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:02.855038    2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76c69b466-cdtrs"]
May 20 13:56:04.665733 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:04.665693    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="310d8067-a4c0-463d-b5f8-c1fc26c3192d" path="/var/lib/kubelet/pods/310d8067-a4c0-463d-b5f8-c1fc26c3192d/volumes"
May 20 13:56:20.521546 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:20.521504    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cnn862"]
May 20 13:56:20.522002 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:20.521843    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="310d8067-a4c0-463d-b5f8-c1fc26c3192d" containerName="console"
May 20 13:56:20.522002 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:20.521857    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="310d8067-a4c0-463d-b5f8-c1fc26c3192d" containerName="console"
May 20 13:56:20.522002 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:20.521919    2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="310d8067-a4c0-463d-b5f8-c1fc26c3192d" containerName="console"
May 20 13:56:20.524943 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:20.524912    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cnn862"
May 20 13:56:20.527441 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:20.527414    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 20 13:56:20.527689 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:20.527672    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9vxvg\""
May 20 13:56:20.528249 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:20.528231    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 20 13:56:20.533732 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:20.533706    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cnn862"]
May 20 13:56:20.603429 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:20.603404    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fc05bb1-56e5-48d6-ace5-3bbf31dddb09-bundle\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cnn862\" (UID: \"2fc05bb1-56e5-48d6-ace5-3bbf31dddb09\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cnn862"
May 20 13:56:20.603544 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:20.603450    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxddb\" (UniqueName: \"kubernetes.io/projected/2fc05bb1-56e5-48d6-ace5-3bbf31dddb09-kube-api-access-qxddb\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cnn862\" (UID: \"2fc05bb1-56e5-48d6-ace5-3bbf31dddb09\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cnn862"
May 20 13:56:20.603544 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:20.603473    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fc05bb1-56e5-48d6-ace5-3bbf31dddb09-util\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cnn862\" (UID: \"2fc05bb1-56e5-48d6-ace5-3bbf31dddb09\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cnn862"
May 20 13:56:20.703813 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:20.703789    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qxddb\" (UniqueName: \"kubernetes.io/projected/2fc05bb1-56e5-48d6-ace5-3bbf31dddb09-kube-api-access-qxddb\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cnn862\" (UID: \"2fc05bb1-56e5-48d6-ace5-3bbf31dddb09\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cnn862"
May 20 13:56:20.703908 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:20.703823    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fc05bb1-56e5-48d6-ace5-3bbf31dddb09-util\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cnn862\" (UID: \"2fc05bb1-56e5-48d6-ace5-3bbf31dddb09\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cnn862"
May 20 13:56:20.703908 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:20.703870    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fc05bb1-56e5-48d6-ace5-3bbf31dddb09-bundle\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cnn862\" (UID: \"2fc05bb1-56e5-48d6-ace5-3bbf31dddb09\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cnn862"
May 20 13:56:20.704241 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:20.704221    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fc05bb1-56e5-48d6-ace5-3bbf31dddb09-util\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cnn862\" (UID: \"2fc05bb1-56e5-48d6-ace5-3bbf31dddb09\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cnn862"
May 20 13:56:20.704318 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:20.704257    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fc05bb1-56e5-48d6-ace5-3bbf31dddb09-bundle\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cnn862\" (UID: \"2fc05bb1-56e5-48d6-ace5-3bbf31dddb09\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cnn862"
May 20 13:56:20.712411 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:20.712389    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxddb\" (UniqueName: \"kubernetes.io/projected/2fc05bb1-56e5-48d6-ace5-3bbf31dddb09-kube-api-access-qxddb\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cnn862\" (UID: \"2fc05bb1-56e5-48d6-ace5-3bbf31dddb09\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cnn862"
May 20 13:56:20.835638 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:20.835586    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cnn862"
May 20 13:56:20.968141 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:20.968113    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cnn862"]
May 20 13:56:20.971435 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:56:20.971412    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fc05bb1_56e5_48d6_ace5_3bbf31dddb09.slice/crio-73634b43a46191ca1e3191a2f836715ec6bf35baf34066b6088c436ee846a784 WatchSource:0}: Error finding container 73634b43a46191ca1e3191a2f836715ec6bf35baf34066b6088c436ee846a784: Status 404 returned error can't find the container with id 73634b43a46191ca1e3191a2f836715ec6bf35baf34066b6088c436ee846a784
May 20 13:56:21.893922 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:21.893884    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cnn862" event={"ID":"2fc05bb1-56e5-48d6-ace5-3bbf31dddb09","Type":"ContainerStarted","Data":"73634b43a46191ca1e3191a2f836715ec6bf35baf34066b6088c436ee846a784"}
May 20 13:56:27.911554 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:27.911509    2571 generic.go:358] "Generic (PLEG): container finished" podID="2fc05bb1-56e5-48d6-ace5-3bbf31dddb09" containerID="fe45a07b6a5093b5192cecf43f9b41bd28d1be5a99bdd03a5aae5832fed3bfd4" exitCode=0
May 20 13:56:27.911908 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:27.911596    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cnn862" event={"ID":"2fc05bb1-56e5-48d6-ace5-3bbf31dddb09","Type":"ContainerDied","Data":"fe45a07b6a5093b5192cecf43f9b41bd28d1be5a99bdd03a5aae5832fed3bfd4"}
May 20 13:56:30.921315 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:30.921278    2571 generic.go:358] "Generic (PLEG): container finished" podID="2fc05bb1-56e5-48d6-ace5-3bbf31dddb09" containerID="1b3fd9ebc14a54f508173491a0209fbd3da699b1d0c9deaf2a7f90e48d82200b" exitCode=0
May 20 13:56:30.921673 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:30.921372    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cnn862" event={"ID":"2fc05bb1-56e5-48d6-ace5-3bbf31dddb09","Type":"ContainerDied","Data":"1b3fd9ebc14a54f508173491a0209fbd3da699b1d0c9deaf2a7f90e48d82200b"}
May 20 13:56:36.939487 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:36.939423    2571 generic.go:358] "Generic (PLEG): container finished" podID="2fc05bb1-56e5-48d6-ace5-3bbf31dddb09" containerID="537b3b661ae31bcc5d7273f3dcd197d4ccfa3b0d72858fa3171bf29ea0acfe28" exitCode=0
May 20 13:56:36.939487 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:36.939468    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cnn862" event={"ID":"2fc05bb1-56e5-48d6-ace5-3bbf31dddb09","Type":"ContainerDied","Data":"537b3b661ae31bcc5d7273f3dcd197d4ccfa3b0d72858fa3171bf29ea0acfe28"}
May 20 13:56:38.061574 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:38.061551    2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cnn862"
May 20 13:56:38.145577 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:38.145548    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxddb\" (UniqueName: \"kubernetes.io/projected/2fc05bb1-56e5-48d6-ace5-3bbf31dddb09-kube-api-access-qxddb\") pod \"2fc05bb1-56e5-48d6-ace5-3bbf31dddb09\" (UID: \"2fc05bb1-56e5-48d6-ace5-3bbf31dddb09\") "
May 20 13:56:38.145746 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:38.145616    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fc05bb1-56e5-48d6-ace5-3bbf31dddb09-util\") pod \"2fc05bb1-56e5-48d6-ace5-3bbf31dddb09\" (UID: \"2fc05bb1-56e5-48d6-ace5-3bbf31dddb09\") "
May 20 13:56:38.145746 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:38.145642    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fc05bb1-56e5-48d6-ace5-3bbf31dddb09-bundle\") pod \"2fc05bb1-56e5-48d6-ace5-3bbf31dddb09\" (UID: \"2fc05bb1-56e5-48d6-ace5-3bbf31dddb09\") "
May 20 13:56:38.146323 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:38.146298    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fc05bb1-56e5-48d6-ace5-3bbf31dddb09-bundle" (OuterVolumeSpecName: "bundle") pod "2fc05bb1-56e5-48d6-ace5-3bbf31dddb09" (UID: "2fc05bb1-56e5-48d6-ace5-3bbf31dddb09"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 13:56:38.147481 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:38.147458    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fc05bb1-56e5-48d6-ace5-3bbf31dddb09-kube-api-access-qxddb" (OuterVolumeSpecName: "kube-api-access-qxddb") pod "2fc05bb1-56e5-48d6-ace5-3bbf31dddb09" (UID: "2fc05bb1-56e5-48d6-ace5-3bbf31dddb09"). InnerVolumeSpecName "kube-api-access-qxddb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 13:56:38.151569 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:38.151547    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fc05bb1-56e5-48d6-ace5-3bbf31dddb09-util" (OuterVolumeSpecName: "util") pod "2fc05bb1-56e5-48d6-ace5-3bbf31dddb09" (UID: "2fc05bb1-56e5-48d6-ace5-3bbf31dddb09"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 13:56:38.246962 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:38.246923    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxddb\" (UniqueName: \"kubernetes.io/projected/2fc05bb1-56e5-48d6-ace5-3bbf31dddb09-kube-api-access-qxddb\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:56:38.247045 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:38.246964    2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fc05bb1-56e5-48d6-ace5-3bbf31dddb09-util\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:56:38.247045 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:38.246975    2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fc05bb1-56e5-48d6-ace5-3bbf31dddb09-bundle\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:56:38.946726 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:38.946707    2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cnn862"
May 20 13:56:38.946726 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:38.946718    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cnn862" event={"ID":"2fc05bb1-56e5-48d6-ace5-3bbf31dddb09","Type":"ContainerDied","Data":"73634b43a46191ca1e3191a2f836715ec6bf35baf34066b6088c436ee846a784"}
May 20 13:56:38.946893 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:38.946741    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="73634b43a46191ca1e3191a2f836715ec6bf35baf34066b6088c436ee846a784"
May 20 13:56:42.393185 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:42.393130    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-gfz9v"]
May 20 13:56:42.393618 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:42.393494    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fc05bb1-56e5-48d6-ace5-3bbf31dddb09" containerName="util"
May 20 13:56:42.393618 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:42.393528    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fc05bb1-56e5-48d6-ace5-3bbf31dddb09" containerName="util"
May 20 13:56:42.393618 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:42.393539    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fc05bb1-56e5-48d6-ace5-3bbf31dddb09" containerName="pull"
May 20 13:56:42.393618 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:42.393545    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fc05bb1-56e5-48d6-ace5-3bbf31dddb09" containerName="pull"
May 20 13:56:42.393618 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:42.393561    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fc05bb1-56e5-48d6-ace5-3bbf31dddb09" containerName="extract"
May 20 13:56:42.393618 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:42.393567    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fc05bb1-56e5-48d6-ace5-3bbf31dddb09" containerName="extract"
May 20 13:56:42.393800 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:42.393636    2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="2fc05bb1-56e5-48d6-ace5-3bbf31dddb09" containerName="extract"
May 20 13:56:42.395993 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:42.395972    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-gfz9v"
May 20 13:56:42.398947 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:42.398902    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
May 20 13:56:42.399069 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:42.398908    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
May 20 13:56:42.399128 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:42.399081    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
May 20 13:56:42.399254 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:42.399225    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-9rvpv\""
May 20 13:56:42.413362 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:42.413329    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-gfz9v"]
May 20 13:56:42.470852 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:42.470822    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/9e998a0c-ff7e-40a5-bfaa-420a274c7140-certificates\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-gfz9v\" (UID: \"9e998a0c-ff7e-40a5-bfaa-420a274c7140\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-gfz9v"
May 20 13:56:42.470996 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:42.470964    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wgq4\" (UniqueName: \"kubernetes.io/projected/9e998a0c-ff7e-40a5-bfaa-420a274c7140-kube-api-access-9wgq4\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-gfz9v\" (UID: \"9e998a0c-ff7e-40a5-bfaa-420a274c7140\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-gfz9v"
May 20 13:56:42.571460 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:42.571430    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9wgq4\" (UniqueName: \"kubernetes.io/projected/9e998a0c-ff7e-40a5-bfaa-420a274c7140-kube-api-access-9wgq4\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-gfz9v\" (UID: \"9e998a0c-ff7e-40a5-bfaa-420a274c7140\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-gfz9v"
May 20 13:56:42.571603 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:42.571488    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/9e998a0c-ff7e-40a5-bfaa-420a274c7140-certificates\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-gfz9v\" (UID: \"9e998a0c-ff7e-40a5-bfaa-420a274c7140\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-gfz9v"
May 20 13:56:42.573879 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:42.573851    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/9e998a0c-ff7e-40a5-bfaa-420a274c7140-certificates\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-gfz9v\" (UID: \"9e998a0c-ff7e-40a5-bfaa-420a274c7140\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-gfz9v"
May 20 13:56:42.590304 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:42.590277    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wgq4\" (UniqueName: \"kubernetes.io/projected/9e998a0c-ff7e-40a5-bfaa-420a274c7140-kube-api-access-9wgq4\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-gfz9v\" (UID: \"9e998a0c-ff7e-40a5-bfaa-420a274c7140\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-gfz9v"
May 20 13:56:42.707905 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:42.707883    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-gfz9v"
May 20 13:56:42.845967 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:42.845944    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-gfz9v"]
May 20 13:56:42.847614 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:56:42.847585    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e998a0c_ff7e_40a5_bfaa_420a274c7140.slice/crio-096d2c1142bcb6c5452bebdde45af88550b7393de4d63de68547c0fcf601c1ee WatchSource:0}: Error finding container 096d2c1142bcb6c5452bebdde45af88550b7393de4d63de68547c0fcf601c1ee: Status 404 returned error can't find the container with id 096d2c1142bcb6c5452bebdde45af88550b7393de4d63de68547c0fcf601c1ee
May 20 13:56:42.961041 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:42.960980    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-gfz9v" event={"ID":"9e998a0c-ff7e-40a5-bfaa-420a274c7140","Type":"ContainerStarted","Data":"096d2c1142bcb6c5452bebdde45af88550b7393de4d63de68547c0fcf601c1ee"}
May 20 13:56:46.437560 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:46.437482    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-ffbb595cb-hhl2z"]
May 20 13:56:46.439588 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:46.439572    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-ffbb595cb-hhl2z"
May 20 13:56:46.442069 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:46.442048    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\""
May 20 13:56:46.442174 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:46.442052    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
May 20 13:56:46.442410 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:46.442392    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-n5mdt\""
May 20 13:56:46.449965 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:46.449928    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-ffbb595cb-hhl2z"]
May 20 13:56:46.503305 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:46.503284    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4l2j\" (UniqueName: \"kubernetes.io/projected/0bb57bef-71d4-4cc7-9719-15382d4618e3-kube-api-access-z4l2j\") pod \"keda-operator-ffbb595cb-hhl2z\" (UID: \"0bb57bef-71d4-4cc7-9719-15382d4618e3\") " pod="openshift-keda/keda-operator-ffbb595cb-hhl2z"
May 20 13:56:46.503389 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:46.503331    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/0bb57bef-71d4-4cc7-9719-15382d4618e3-cabundle0\") pod \"keda-operator-ffbb595cb-hhl2z\" (UID: \"0bb57bef-71d4-4cc7-9719-15382d4618e3\") " pod="openshift-keda/keda-operator-ffbb595cb-hhl2z"
May 20 13:56:46.503449 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:46.503430    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0bb57bef-71d4-4cc7-9719-15382d4618e3-certificates\") pod \"keda-operator-ffbb595cb-hhl2z\" (UID: \"0bb57bef-71d4-4cc7-9719-15382d4618e3\") " pod="openshift-keda/keda-operator-ffbb595cb-hhl2z"
May 20 13:56:46.603810 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:46.603786    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/0bb57bef-71d4-4cc7-9719-15382d4618e3-cabundle0\") pod \"keda-operator-ffbb595cb-hhl2z\" (UID: \"0bb57bef-71d4-4cc7-9719-15382d4618e3\") " pod="openshift-keda/keda-operator-ffbb595cb-hhl2z"
May 20 13:56:46.603903 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:46.603848    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0bb57bef-71d4-4cc7-9719-15382d4618e3-certificates\") pod \"keda-operator-ffbb595cb-hhl2z\" (UID: \"0bb57bef-71d4-4cc7-9719-15382d4618e3\") " pod="openshift-keda/keda-operator-ffbb595cb-hhl2z"
May 20 13:56:46.603903 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:46.603888    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z4l2j\" (UniqueName: \"kubernetes.io/projected/0bb57bef-71d4-4cc7-9719-15382d4618e3-kube-api-access-z4l2j\") pod \"keda-operator-ffbb595cb-hhl2z\" (UID: \"0bb57bef-71d4-4cc7-9719-15382d4618e3\") " pod="openshift-keda/keda-operator-ffbb595cb-hhl2z"
May 20 13:56:46.604017 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:56:46.604000    2571 projected.go:264] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found
May 20 13:56:46.604049 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:56:46.604022    2571 secret.go:281] references non-existent secret key: ca.crt
May 20 13:56:46.604049 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:56:46.604029    2571 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
May 20 13:56:46.604049 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:56:46.604040    2571 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-ffbb595cb-hhl2z: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
May 20 13:56:46.604145 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:56:46.604080    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0bb57bef-71d4-4cc7-9719-15382d4618e3-certificates podName:0bb57bef-71d4-4cc7-9719-15382d4618e3 nodeName:}" failed. No retries permitted until 2026-05-20 13:56:47.104067525 +0000 UTC m=+416.976854672 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/0bb57bef-71d4-4cc7-9719-15382d4618e3-certificates") pod "keda-operator-ffbb595cb-hhl2z" (UID: "0bb57bef-71d4-4cc7-9719-15382d4618e3") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
May 20 13:56:46.604373 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:46.604357    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/0bb57bef-71d4-4cc7-9719-15382d4618e3-cabundle0\") pod \"keda-operator-ffbb595cb-hhl2z\" (UID: \"0bb57bef-71d4-4cc7-9719-15382d4618e3\") " pod="openshift-keda/keda-operator-ffbb595cb-hhl2z"
May 20 13:56:46.612680 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:46.612653    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4l2j\" (UniqueName: \"kubernetes.io/projected/0bb57bef-71d4-4cc7-9719-15382d4618e3-kube-api-access-z4l2j\") pod \"keda-operator-ffbb595cb-hhl2z\" (UID: \"0bb57bef-71d4-4cc7-9719-15382d4618e3\") " pod="openshift-keda/keda-operator-ffbb595cb-hhl2z"
May 20 13:56:46.721348 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:46.721320    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-7c9f485588-5fw66"]
May 20 13:56:46.723460 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:46.723441    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-5fw66"
May 20 13:56:46.729675 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:46.729634    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\""
May 20 13:56:46.733439 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:46.733407    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-7c9f485588-5fw66"]
May 20 13:56:46.805481 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:46.805460    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/26ab6d6e-b95b-4f94-a485-0cda536b3e71-certificates\") pod \"keda-metrics-apiserver-7c9f485588-5fw66\" (UID: \"26ab6d6e-b95b-4f94-a485-0cda536b3e71\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-5fw66"
May 20 13:56:46.805590 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:46.805500    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/26ab6d6e-b95b-4f94-a485-0cda536b3e71-temp-vol\") pod \"keda-metrics-apiserver-7c9f485588-5fw66\" (UID: \"26ab6d6e-b95b-4f94-a485-0cda536b3e71\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-5fw66"
May 20 13:56:46.805590 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:46.805528    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5fqk\" (UniqueName: \"kubernetes.io/projected/26ab6d6e-b95b-4f94-a485-0cda536b3e71-kube-api-access-v5fqk\") pod \"keda-metrics-apiserver-7c9f485588-5fw66\" (UID: \"26ab6d6e-b95b-4f94-a485-0cda536b3e71\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-5fw66"
May 20 13:56:46.906641 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:46.906611    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/26ab6d6e-b95b-4f94-a485-0cda536b3e71-temp-vol\") pod \"keda-metrics-apiserver-7c9f485588-5fw66\" (UID: \"26ab6d6e-b95b-4f94-a485-0cda536b3e71\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-5fw66"
May 20 13:56:46.906762 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:46.906741    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v5fqk\" (UniqueName: \"kubernetes.io/projected/26ab6d6e-b95b-4f94-a485-0cda536b3e71-kube-api-access-v5fqk\") pod \"keda-metrics-apiserver-7c9f485588-5fw66\" (UID: \"26ab6d6e-b95b-4f94-a485-0cda536b3e71\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-5fw66"
May 20 13:56:46.906844 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:46.906830    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/26ab6d6e-b95b-4f94-a485-0cda536b3e71-certificates\") pod \"keda-metrics-apiserver-7c9f485588-5fw66\" (UID: \"26ab6d6e-b95b-4f94-a485-0cda536b3e71\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-5fw66"
May 20 13:56:46.906921 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:56:46.906909    2571 secret.go:281] references non-existent secret key: tls.crt
May 20 13:56:46.907006 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:56:46.906923    2571 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
May 20 13:56:46.907006 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:56:46.906951    2571 projected.go:264] Couldn't get secret openshift-keda/keda-metrics-apiserver-certs: secret "keda-metrics-apiserver-certs" not found
May 20 13:56:46.907006 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:56:46.906967    2571 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-7c9f485588-5fw66: [references non-existent secret key: tls.crt, secret "keda-metrics-apiserver-certs" not found]
May 20 13:56:46.907006 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:46.906971    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/26ab6d6e-b95b-4f94-a485-0cda536b3e71-temp-vol\") pod \"keda-metrics-apiserver-7c9f485588-5fw66\" (UID: \"26ab6d6e-b95b-4f94-a485-0cda536b3e71\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-5fw66"
May 20 13:56:46.907132 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:56:46.907010    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26ab6d6e-b95b-4f94-a485-0cda536b3e71-certificates podName:26ab6d6e-b95b-4f94-a485-0cda536b3e71 nodeName:}" failed. No retries permitted until 2026-05-20 13:56:47.406999039 +0000 UTC m=+417.279786174 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/26ab6d6e-b95b-4f94-a485-0cda536b3e71-certificates") pod "keda-metrics-apiserver-7c9f485588-5fw66" (UID: "26ab6d6e-b95b-4f94-a485-0cda536b3e71") : [references non-existent secret key: tls.crt, secret "keda-metrics-apiserver-certs" not found]
May 20 13:56:46.914992 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:46.914970    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5fqk\" (UniqueName: \"kubernetes.io/projected/26ab6d6e-b95b-4f94-a485-0cda536b3e71-kube-api-access-v5fqk\") pod \"keda-metrics-apiserver-7c9f485588-5fw66\" (UID: \"26ab6d6e-b95b-4f94-a485-0cda536b3e71\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-5fw66"
May 20 13:56:46.975502 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:46.975433    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-gfz9v" event={"ID":"9e998a0c-ff7e-40a5-bfaa-420a274c7140","Type":"ContainerStarted","Data":"fbfa1ab2dc05cab0cd34b79b61fde6abc5ea8cb890635c5d2e203794bc795752"}
May 20 13:56:46.975612 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:46.975594    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-gfz9v"
May 20 13:56:47.000822 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:47.000771    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-gfz9v" podStartSLOduration=1.886373222 podStartE2EDuration="5.000755402s" podCreationTimestamp="2026-05-20 13:56:42 +0000 UTC" firstStartedPulling="2026-05-20 13:56:42.849462061 +0000 UTC m=+412.722249201" lastFinishedPulling="2026-05-20 13:56:45.963844233 +0000 UTC m=+415.836631381" observedRunningTime="2026-05-20 13:56:46.996649018 +0000 UTC m=+416.869436173" watchObservedRunningTime="2026-05-20 13:56:47.000755402 +0000 UTC m=+416.873542561"
May 20 13:56:47.052172 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:47.052145    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-cf49989db-b6q6w"]
May 20 13:56:47.054729 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:47.054714    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-cf49989db-b6q6w"
May 20 13:56:47.057381 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:47.057363    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\""
May 20 13:56:47.065257 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:47.065233    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-cf49989db-b6q6w"]
May 20 13:56:47.108467 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:47.108443    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr6sk\" (UniqueName: \"kubernetes.io/projected/52fb9c21-cdba-4013-855e-214cea909ea3-kube-api-access-qr6sk\") pod \"keda-admission-cf49989db-b6q6w\" (UID: \"52fb9c21-cdba-4013-855e-214cea909ea3\") " pod="openshift-keda/keda-admission-cf49989db-b6q6w"
May 20 13:56:47.108564 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:47.108491    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/52fb9c21-cdba-4013-855e-214cea909ea3-certificates\") pod \"keda-admission-cf49989db-b6q6w\" (UID: \"52fb9c21-cdba-4013-855e-214cea909ea3\") " pod="openshift-keda/keda-admission-cf49989db-b6q6w"
May 20 13:56:47.108564 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:47.108544    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0bb57bef-71d4-4cc7-9719-15382d4618e3-certificates\") pod \"keda-operator-ffbb595cb-hhl2z\" (UID: \"0bb57bef-71d4-4cc7-9719-15382d4618e3\") " pod="openshift-keda/keda-operator-ffbb595cb-hhl2z"
May 20 13:56:47.108660 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:56:47.108648    2571 secret.go:281] references non-existent secret key: ca.crt
May 20 13:56:47.108692 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:56:47.108663    2571 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
May 20 13:56:47.108692 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:56:47.108672    2571 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-ffbb595cb-hhl2z: references non-existent secret key: ca.crt
May 20 13:56:47.108749 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:56:47.108724    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0bb57bef-71d4-4cc7-9719-15382d4618e3-certificates podName:0bb57bef-71d4-4cc7-9719-15382d4618e3 nodeName:}" failed. No retries permitted until 2026-05-20 13:56:48.108711312 +0000 UTC m=+417.981498446 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/0bb57bef-71d4-4cc7-9719-15382d4618e3-certificates") pod "keda-operator-ffbb595cb-hhl2z" (UID: "0bb57bef-71d4-4cc7-9719-15382d4618e3") : references non-existent secret key: ca.crt
May 20 13:56:47.209477 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:47.209443    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qr6sk\" (UniqueName: \"kubernetes.io/projected/52fb9c21-cdba-4013-855e-214cea909ea3-kube-api-access-qr6sk\") pod \"keda-admission-cf49989db-b6q6w\" (UID: \"52fb9c21-cdba-4013-855e-214cea909ea3\") " pod="openshift-keda/keda-admission-cf49989db-b6q6w"
May 20 13:56:47.209702 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:47.209682    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/52fb9c21-cdba-4013-855e-214cea909ea3-certificates\") pod \"keda-admission-cf49989db-b6q6w\" (UID: \"52fb9c21-cdba-4013-855e-214cea909ea3\") " pod="openshift-keda/keda-admission-cf49989db-b6q6w"
May 20 13:56:47.212195 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:47.212176    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/52fb9c21-cdba-4013-855e-214cea909ea3-certificates\") pod \"keda-admission-cf49989db-b6q6w\" (UID: \"52fb9c21-cdba-4013-855e-214cea909ea3\") " pod="openshift-keda/keda-admission-cf49989db-b6q6w"
May 20 13:56:47.220499 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:47.220479    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr6sk\" (UniqueName: \"kubernetes.io/projected/52fb9c21-cdba-4013-855e-214cea909ea3-kube-api-access-qr6sk\") pod \"keda-admission-cf49989db-b6q6w\" (UID: \"52fb9c21-cdba-4013-855e-214cea909ea3\") " pod="openshift-keda/keda-admission-cf49989db-b6q6w"
May 20 13:56:47.367090 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:47.367019    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-cf49989db-b6q6w"
May 20 13:56:47.412456 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:47.412411    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/26ab6d6e-b95b-4f94-a485-0cda536b3e71-certificates\") pod \"keda-metrics-apiserver-7c9f485588-5fw66\" (UID: \"26ab6d6e-b95b-4f94-a485-0cda536b3e71\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-5fw66"
May 20 13:56:47.412616 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:56:47.412594    2571 secret.go:281] references non-existent secret key: tls.crt
May 20 13:56:47.412616 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:56:47.412613    2571 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
May 20 13:56:47.412721 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:56:47.412635    2571 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-7c9f485588-5fw66: references non-existent secret key: tls.crt
May 20 13:56:47.412721 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:56:47.412702    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26ab6d6e-b95b-4f94-a485-0cda536b3e71-certificates podName:26ab6d6e-b95b-4f94-a485-0cda536b3e71 nodeName:}" failed. No retries permitted until 2026-05-20 13:56:48.412681249 +0000 UTC m=+418.285468399 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/26ab6d6e-b95b-4f94-a485-0cda536b3e71-certificates") pod "keda-metrics-apiserver-7c9f485588-5fw66" (UID: "26ab6d6e-b95b-4f94-a485-0cda536b3e71") : references non-existent secret key: tls.crt
May 20 13:56:47.507525 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:47.507445    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-cf49989db-b6q6w"]
May 20 13:56:47.509916 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:56:47.509892    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52fb9c21_cdba_4013_855e_214cea909ea3.slice/crio-2d692370abf0d33266cb6900ebd2ec16e5f9753b37664f48eb6d90e844c6ec11 WatchSource:0}: Error finding container 2d692370abf0d33266cb6900ebd2ec16e5f9753b37664f48eb6d90e844c6ec11: Status 404 returned error can't find the container with id 2d692370abf0d33266cb6900ebd2ec16e5f9753b37664f48eb6d90e844c6ec11
May 20 13:56:47.979418 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:47.979391    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-cf49989db-b6q6w" event={"ID":"52fb9c21-cdba-4013-855e-214cea909ea3","Type":"ContainerStarted","Data":"2d692370abf0d33266cb6900ebd2ec16e5f9753b37664f48eb6d90e844c6ec11"}
May 20 13:56:48.117626 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:48.117597    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0bb57bef-71d4-4cc7-9719-15382d4618e3-certificates\") pod \"keda-operator-ffbb595cb-hhl2z\" (UID: \"0bb57bef-71d4-4cc7-9719-15382d4618e3\") " pod="openshift-keda/keda-operator-ffbb595cb-hhl2z"
May 20 13:56:48.117745 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:56:48.117717    2571 secret.go:281] references non-existent secret key: ca.crt
May 20 13:56:48.117745 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:56:48.117735    2571 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
May 20 13:56:48.117745 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:56:48.117744    2571 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-ffbb595cb-hhl2z: references non-existent secret key: ca.crt
May 20 13:56:48.117836 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:56:48.117789    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0bb57bef-71d4-4cc7-9719-15382d4618e3-certificates podName:0bb57bef-71d4-4cc7-9719-15382d4618e3 nodeName:}" failed. No retries permitted until 2026-05-20 13:56:50.117775806 +0000 UTC m=+419.990562956 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/0bb57bef-71d4-4cc7-9719-15382d4618e3-certificates") pod "keda-operator-ffbb595cb-hhl2z" (UID: "0bb57bef-71d4-4cc7-9719-15382d4618e3") : references non-existent secret key: ca.crt
May 20 13:56:48.420632 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:48.420564    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/26ab6d6e-b95b-4f94-a485-0cda536b3e71-certificates\") pod \"keda-metrics-apiserver-7c9f485588-5fw66\" (UID: \"26ab6d6e-b95b-4f94-a485-0cda536b3e71\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-5fw66"
May 20 13:56:48.420768 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:56:48.420672    2571 secret.go:281] references non-existent secret key: tls.crt
May 20 13:56:48.420768 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:56:48.420689    2571 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
May 20 13:56:48.420768 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:56:48.420713    2571 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-7c9f485588-5fw66: references non-existent secret key: tls.crt
May 20 13:56:48.420883 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:56:48.420768    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26ab6d6e-b95b-4f94-a485-0cda536b3e71-certificates podName:26ab6d6e-b95b-4f94-a485-0cda536b3e71 nodeName:}" failed. No retries permitted until 2026-05-20 13:56:50.420750437 +0000 UTC m=+420.293537571 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/26ab6d6e-b95b-4f94-a485-0cda536b3e71-certificates") pod "keda-metrics-apiserver-7c9f485588-5fw66" (UID: "26ab6d6e-b95b-4f94-a485-0cda536b3e71") : references non-existent secret key: tls.crt
May 20 13:56:48.983856 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:48.983828    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-cf49989db-b6q6w" event={"ID":"52fb9c21-cdba-4013-855e-214cea909ea3","Type":"ContainerStarted","Data":"690dcaf9ce08a2a2bb1e619faef3aabb7d62ea2ac9b6ff3f435ba6a2f9f63cee"}
May 20 13:56:48.984194 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:48.983874    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-cf49989db-b6q6w"
May 20 13:56:49.001477 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:49.001434    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-keda/keda-admission-cf49989db-b6q6w" podStartSLOduration=0.692789513 podStartE2EDuration="2.001422283s" podCreationTimestamp="2026-05-20 13:56:47 +0000 UTC" firstStartedPulling="2026-05-20 13:56:47.511251457 +0000 UTC m=+417.384038592" lastFinishedPulling="2026-05-20 13:56:48.819884225 +0000 UTC m=+418.692671362" observedRunningTime="2026-05-20 13:56:48.999177522 +0000 UTC m=+418.871964676" watchObservedRunningTime="2026-05-20 13:56:49.001422283 +0000 UTC m=+418.874209447"
May 20 13:56:50.132458 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:50.132431    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0bb57bef-71d4-4cc7-9719-15382d4618e3-certificates\") pod \"keda-operator-ffbb595cb-hhl2z\" (UID: \"0bb57bef-71d4-4cc7-9719-15382d4618e3\") " pod="openshift-keda/keda-operator-ffbb595cb-hhl2z"
May 20 13:56:50.132786 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:56:50.132551    2571 secret.go:281] references non-existent secret key: ca.crt
May 20 13:56:50.132786 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:56:50.132570    2571 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
May 20 13:56:50.132786 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:56:50.132579    2571 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-ffbb595cb-hhl2z: references non-existent secret key: ca.crt
May 20 13:56:50.132786 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:56:50.132626    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0bb57bef-71d4-4cc7-9719-15382d4618e3-certificates podName:0bb57bef-71d4-4cc7-9719-15382d4618e3 nodeName:}" failed. No retries permitted until 2026-05-20 13:56:54.132610801 +0000 UTC m=+424.005397936 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/0bb57bef-71d4-4cc7-9719-15382d4618e3-certificates") pod "keda-operator-ffbb595cb-hhl2z" (UID: "0bb57bef-71d4-4cc7-9719-15382d4618e3") : references non-existent secret key: ca.crt
May 20 13:56:50.435733 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:50.435676    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/26ab6d6e-b95b-4f94-a485-0cda536b3e71-certificates\") pod \"keda-metrics-apiserver-7c9f485588-5fw66\" (UID: \"26ab6d6e-b95b-4f94-a485-0cda536b3e71\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-5fw66"
May 20 13:56:50.435833 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:56:50.435769    2571 secret.go:281] references non-existent secret key: tls.crt
May 20 13:56:50.435833 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:56:50.435779    2571 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
May 20 13:56:50.435833 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:56:50.435795    2571 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-7c9f485588-5fw66: references non-existent secret key: tls.crt
May 20 13:56:50.435959 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:56:50.435837    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26ab6d6e-b95b-4f94-a485-0cda536b3e71-certificates podName:26ab6d6e-b95b-4f94-a485-0cda536b3e71 nodeName:}" failed. No retries permitted until 2026-05-20 13:56:54.435825494 +0000 UTC m=+424.308612629 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/26ab6d6e-b95b-4f94-a485-0cda536b3e71-certificates") pod "keda-metrics-apiserver-7c9f485588-5fw66" (UID: "26ab6d6e-b95b-4f94-a485-0cda536b3e71") : references non-existent secret key: tls.crt
May 20 13:56:54.166200 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:54.166150    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0bb57bef-71d4-4cc7-9719-15382d4618e3-certificates\") pod \"keda-operator-ffbb595cb-hhl2z\" (UID: \"0bb57bef-71d4-4cc7-9719-15382d4618e3\") " pod="openshift-keda/keda-operator-ffbb595cb-hhl2z"
May 20 13:56:54.168987 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:54.168954    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0bb57bef-71d4-4cc7-9719-15382d4618e3-certificates\") pod \"keda-operator-ffbb595cb-hhl2z\" (UID: \"0bb57bef-71d4-4cc7-9719-15382d4618e3\") " pod="openshift-keda/keda-operator-ffbb595cb-hhl2z"
May 20 13:56:54.249827 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:54.249795    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-ffbb595cb-hhl2z"
May 20 13:56:54.375951 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:54.375908    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-ffbb595cb-hhl2z"]
May 20 13:56:54.379369 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:56:54.379337    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bb57bef_71d4_4cc7_9719_15382d4618e3.slice/crio-356007dc51230e71c725a83f2a8c0e00b0e65d42a87dfa064f46158f2e967457 WatchSource:0}: Error finding container 356007dc51230e71c725a83f2a8c0e00b0e65d42a87dfa064f46158f2e967457: Status 404 returned error can't find the container with id 356007dc51230e71c725a83f2a8c0e00b0e65d42a87dfa064f46158f2e967457
May 20 13:56:54.470068 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:54.470045    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/26ab6d6e-b95b-4f94-a485-0cda536b3e71-certificates\") pod \"keda-metrics-apiserver-7c9f485588-5fw66\" (UID: \"26ab6d6e-b95b-4f94-a485-0cda536b3e71\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-5fw66"
May 20 13:56:54.472363 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:54.472339    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/26ab6d6e-b95b-4f94-a485-0cda536b3e71-certificates\") pod \"keda-metrics-apiserver-7c9f485588-5fw66\" (UID: \"26ab6d6e-b95b-4f94-a485-0cda536b3e71\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-5fw66"
May 20 13:56:54.541385 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:54.541355    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-5fw66"
May 20 13:56:54.655529 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:54.655469    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-7c9f485588-5fw66"]
May 20 13:56:54.657969 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:56:54.657897    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26ab6d6e_b95b_4f94_a485_0cda536b3e71.slice/crio-533c819e711fbf423f511d064bcb1d042a0fd4619589a3a0f71b4989e7e85ac7 WatchSource:0}: Error finding container 533c819e711fbf423f511d064bcb1d042a0fd4619589a3a0f71b4989e7e85ac7: Status 404 returned error can't find the container with id 533c819e711fbf423f511d064bcb1d042a0fd4619589a3a0f71b4989e7e85ac7
May 20 13:56:55.001842 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:55.001810    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-5fw66" event={"ID":"26ab6d6e-b95b-4f94-a485-0cda536b3e71","Type":"ContainerStarted","Data":"533c819e711fbf423f511d064bcb1d042a0fd4619589a3a0f71b4989e7e85ac7"}
May 20 13:56:55.002912 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:55.002884    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-ffbb595cb-hhl2z" event={"ID":"0bb57bef-71d4-4cc7-9719-15382d4618e3","Type":"ContainerStarted","Data":"356007dc51230e71c725a83f2a8c0e00b0e65d42a87dfa064f46158f2e967457"}
May 20 13:56:59.018556 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:59.018513    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-ffbb595cb-hhl2z" event={"ID":"0bb57bef-71d4-4cc7-9719-15382d4618e3","Type":"ContainerStarted","Data":"269781fee0b91fbb6e067281e0a425bf6f2aa6788f808f00a9967eb28cc264f1"}
May 20 13:56:59.018988 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:59.018621    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-ffbb595cb-hhl2z"
May 20 13:56:59.020014 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:59.019988    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-5fw66" event={"ID":"26ab6d6e-b95b-4f94-a485-0cda536b3e71","Type":"ContainerStarted","Data":"b5e0a6efe974a8d51305e7c8582c00f2cce103e73c086ac5931ff3eac82f2bd4"}
May 20 13:56:59.020193 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:59.020173    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-5fw66"
May 20 13:56:59.035215 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:59.035175    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-keda/keda-operator-ffbb595cb-hhl2z" podStartSLOduration=8.5572711 podStartE2EDuration="13.035163734s" podCreationTimestamp="2026-05-20 13:56:46 +0000 UTC" firstStartedPulling="2026-05-20 13:56:54.380740139 +0000 UTC m=+424.253527288" lastFinishedPulling="2026-05-20 13:56:58.858632783 +0000 UTC m=+428.731419922" observedRunningTime="2026-05-20 13:56:59.034076799 +0000 UTC m=+428.906863955" watchObservedRunningTime="2026-05-20 13:56:59.035163734 +0000 UTC m=+428.907950889"
May 20 13:56:59.050488 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:56:59.050443    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-5fw66" podStartSLOduration=8.856026314 podStartE2EDuration="13.05043437s" podCreationTimestamp="2026-05-20 13:56:46 +0000 UTC" firstStartedPulling="2026-05-20 13:56:54.659263826 +0000 UTC m=+424.532050960" lastFinishedPulling="2026-05-20 13:56:58.85367188 +0000 UTC m=+428.726459016" observedRunningTime="2026-05-20 13:56:59.049636708 +0000 UTC m=+428.922423865" watchObservedRunningTime="2026-05-20 13:56:59.05043437 +0000 UTC m=+428.923221526"
May 20 13:57:07.982234 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:57:07.982205    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-gfz9v"
May 20 13:57:09.988345 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:57:09.988310    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-cf49989db-b6q6w"
May 20 13:57:10.027926 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:57:10.027900    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-5fw66"
May 20 13:57:20.026053 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:57:20.026018    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-ffbb595cb-hhl2z"
May 20 13:57:55.218795 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:57:55.218763    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-867cffc775-84ksr"]
May 20 13:57:55.220984 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:57:55.220966    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-867cffc775-84ksr"
May 20 13:57:55.224557 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:57:55.224537    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
May 20 13:57:55.224747 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:57:55.224722    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\""
May 20 13:57:55.224806 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:57:55.224773    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-dd7vl\""
May 20 13:57:55.224855 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:57:55.224816    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
May 20 13:57:55.232783 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:57:55.232756    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-867cffc775-84ksr"]
May 20 13:57:55.246737 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:57:55.246710    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsr7z\" (UniqueName: \"kubernetes.io/projected/c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8-kube-api-access-zsr7z\") pod \"kserve-controller-manager-867cffc775-84ksr\" (UID: \"c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8\") " pod="kserve/kserve-controller-manager-867cffc775-84ksr"
May 20 13:57:55.246851 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:57:55.246773    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8-cert\") pod \"kserve-controller-manager-867cffc775-84ksr\" (UID: \"c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8\") " pod="kserve/kserve-controller-manager-867cffc775-84ksr"
May 20 13:57:55.254495 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:57:55.254474    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-79f457656b-bm8g8"]
May 20 13:57:55.256461 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:57:55.256446    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-79f457656b-bm8g8"
May 20 13:57:55.258806 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:57:55.258788    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
May 20 13:57:55.258900 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:57:55.258808    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-nwmm8\""
May 20 13:57:55.267176 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:57:55.267158    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-79f457656b-bm8g8"]
May 20 13:57:55.347184 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:57:55.347159    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zsr7z\" (UniqueName: \"kubernetes.io/projected/c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8-kube-api-access-zsr7z\") pod \"kserve-controller-manager-867cffc775-84ksr\" (UID: \"c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8\") " pod="kserve/kserve-controller-manager-867cffc775-84ksr"
May 20 13:57:55.347299 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:57:55.347230    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6hcf\" (UniqueName: \"kubernetes.io/projected/ffcd06ab-f4eb-45b0-a620-898bded728e2-kube-api-access-t6hcf\") pod \"seaweedfs-79f457656b-bm8g8\" (UID: \"ffcd06ab-f4eb-45b0-a620-898bded728e2\") " pod="kserve/seaweedfs-79f457656b-bm8g8"
May 20 13:57:55.347299 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:57:55.347261    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8-cert\") pod \"kserve-controller-manager-867cffc775-84ksr\" (UID: \"c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8\") " pod="kserve/kserve-controller-manager-867cffc775-84ksr"
May 20 13:57:55.347421 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:57:55.347315    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ffcd06ab-f4eb-45b0-a620-898bded728e2-data\") pod \"seaweedfs-79f457656b-bm8g8\" (UID: \"ffcd06ab-f4eb-45b0-a620-898bded728e2\") " pod="kserve/seaweedfs-79f457656b-bm8g8"
May 20 13:57:55.347421 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:57:55.347393    2571 secret.go:189] Couldn't get secret kserve/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
May 20 13:57:55.347522 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:57:55.347483    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8-cert podName:c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8 nodeName:}" failed. No retries permitted until 2026-05-20 13:57:55.847462034 +0000 UTC m=+485.720249180 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8-cert") pod "kserve-controller-manager-867cffc775-84ksr" (UID: "c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8") : secret "kserve-webhook-server-cert" not found
May 20 13:57:55.365580 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:57:55.365555    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsr7z\" (UniqueName: \"kubernetes.io/projected/c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8-kube-api-access-zsr7z\") pod \"kserve-controller-manager-867cffc775-84ksr\" (UID: \"c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8\") " pod="kserve/kserve-controller-manager-867cffc775-84ksr"
May 20 13:57:55.448255 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:57:55.448233    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t6hcf\" (UniqueName: \"kubernetes.io/projected/ffcd06ab-f4eb-45b0-a620-898bded728e2-kube-api-access-t6hcf\") pod \"seaweedfs-79f457656b-bm8g8\" (UID: \"ffcd06ab-f4eb-45b0-a620-898bded728e2\") " pod="kserve/seaweedfs-79f457656b-bm8g8"
May 20 13:57:55.448351 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:57:55.448296    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ffcd06ab-f4eb-45b0-a620-898bded728e2-data\") pod \"seaweedfs-79f457656b-bm8g8\" (UID: \"ffcd06ab-f4eb-45b0-a620-898bded728e2\") " pod="kserve/seaweedfs-79f457656b-bm8g8"
May 20 13:57:55.448588 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:57:55.448574    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ffcd06ab-f4eb-45b0-a620-898bded728e2-data\") pod \"seaweedfs-79f457656b-bm8g8\" (UID: \"ffcd06ab-f4eb-45b0-a620-898bded728e2\") " pod="kserve/seaweedfs-79f457656b-bm8g8"
May 20 13:57:55.456149 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:57:55.456125    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6hcf\" (UniqueName: \"kubernetes.io/projected/ffcd06ab-f4eb-45b0-a620-898bded728e2-kube-api-access-t6hcf\") pod \"seaweedfs-79f457656b-bm8g8\" (UID: \"ffcd06ab-f4eb-45b0-a620-898bded728e2\") " pod="kserve/seaweedfs-79f457656b-bm8g8"
May 20 13:57:55.565500 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:57:55.565448    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-79f457656b-bm8g8"
May 20 13:57:55.698005 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:57:55.697982    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-79f457656b-bm8g8"]
May 20 13:57:55.700046 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:57:55.700018    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffcd06ab_f4eb_45b0_a620_898bded728e2.slice/crio-0010e8cbabaabd6da03be8fc84132980f9fff02bf70bcd5573525fe5d5ab78ce WatchSource:0}: Error finding container 0010e8cbabaabd6da03be8fc84132980f9fff02bf70bcd5573525fe5d5ab78ce: Status 404 returned error can't find the container with id 0010e8cbabaabd6da03be8fc84132980f9fff02bf70bcd5573525fe5d5ab78ce
May 20 13:57:55.852462 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:57:55.852404    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8-cert\") pod \"kserve-controller-manager-867cffc775-84ksr\" (UID: \"c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8\") " pod="kserve/kserve-controller-manager-867cffc775-84ksr"
May 20 13:57:55.854580 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:57:55.854554    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8-cert\") pod \"kserve-controller-manager-867cffc775-84ksr\" (UID: \"c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8\") " pod="kserve/kserve-controller-manager-867cffc775-84ksr"
May 20 13:57:56.131164 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:57:56.131095    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-867cffc775-84ksr"
May 20 13:57:56.203808 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:57:56.203763    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-79f457656b-bm8g8" event={"ID":"ffcd06ab-f4eb-45b0-a620-898bded728e2","Type":"ContainerStarted","Data":"0010e8cbabaabd6da03be8fc84132980f9fff02bf70bcd5573525fe5d5ab78ce"}
May 20 13:57:56.273677 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:57:56.273632    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-867cffc775-84ksr"]
May 20 13:57:56.379272 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:57:56.379237    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc143b1ce_2d8d_4e5f_a77b_b1eac3812bf8.slice/crio-4e8aaa42f7bf31e859a1e9f948c3a099983f627afe64ec0d2294d0e44f6652d5 WatchSource:0}: Error finding container 4e8aaa42f7bf31e859a1e9f948c3a099983f627afe64ec0d2294d0e44f6652d5: Status 404 returned error can't find the container with id 4e8aaa42f7bf31e859a1e9f948c3a099983f627afe64ec0d2294d0e44f6652d5
May 20 13:57:57.209595 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:57:57.209549    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-867cffc775-84ksr" event={"ID":"c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8","Type":"ContainerStarted","Data":"4e8aaa42f7bf31e859a1e9f948c3a099983f627afe64ec0d2294d0e44f6652d5"}
May 20 13:58:00.220381 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:00.220352    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-79f457656b-bm8g8" event={"ID":"ffcd06ab-f4eb-45b0-a620-898bded728e2","Type":"ContainerStarted","Data":"befc9d94c4da0c51e1d7f611d29684652e19bfcc6c381710a45c875a70966881"}
May 20 13:58:00.220785 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:00.220406    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-79f457656b-bm8g8"
May 20 13:58:00.221642 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:00.221617    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-867cffc775-84ksr" event={"ID":"c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8","Type":"ContainerStarted","Data":"c91dab4ab2d34268f136fe18e46aa04223e77d90cc17d2315c68b2e9e72cda1b"}
May 20 13:58:00.221760 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:00.221721    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-867cffc775-84ksr"
May 20 13:58:00.237968 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:00.237911    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/seaweedfs-79f457656b-bm8g8" podStartSLOduration=1.113255848 podStartE2EDuration="5.237897714s" podCreationTimestamp="2026-05-20 13:57:55 +0000 UTC" firstStartedPulling="2026-05-20 13:57:55.701192799 +0000 UTC m=+485.573979933" lastFinishedPulling="2026-05-20 13:57:59.825834661 +0000 UTC m=+489.698621799" observedRunningTime="2026-05-20 13:58:00.236641486 +0000 UTC m=+490.109428656" watchObservedRunningTime="2026-05-20 13:58:00.237897714 +0000 UTC m=+490.110684870"
May 20 13:58:00.254471 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:00.254435    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/kserve-controller-manager-867cffc775-84ksr" podStartSLOduration=1.899375331 podStartE2EDuration="5.254424951s" podCreationTimestamp="2026-05-20 13:57:55 +0000 UTC" firstStartedPulling="2026-05-20 13:57:56.381388116 +0000 UTC m=+486.254175250" lastFinishedPulling="2026-05-20 13:57:59.736437732 +0000 UTC m=+489.609224870" observedRunningTime="2026-05-20 13:58:00.253070006 +0000 UTC m=+490.125857186" watchObservedRunningTime="2026-05-20 13:58:00.254424951 +0000 UTC m=+490.127212106"
May 20 13:58:06.227124 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:06.227093    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-79f457656b-bm8g8"
May 20 13:58:30.439550 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:30.439505    2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-867cffc775-84ksr"]
May 20 13:58:30.440130 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:30.439828    2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve/kserve-controller-manager-867cffc775-84ksr" podUID="c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8" containerName="manager" containerID="cri-o://c91dab4ab2d34268f136fe18e46aa04223e77d90cc17d2315c68b2e9e72cda1b" gracePeriod=10
May 20 13:58:30.444585 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:30.444557    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-867cffc775-84ksr"
May 20 13:58:30.459301 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:30.459277    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-867cffc775-ngx2r"]
May 20 13:58:30.462801 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:30.462787    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-867cffc775-ngx2r"
May 20 13:58:30.471986 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:30.471965    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-867cffc775-ngx2r"]
May 20 13:58:30.499597 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:30.499571    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f1f2132-0d7c-4f80-bcd4-2459877a96f2-cert\") pod \"kserve-controller-manager-867cffc775-ngx2r\" (UID: \"0f1f2132-0d7c-4f80-bcd4-2459877a96f2\") " pod="kserve/kserve-controller-manager-867cffc775-ngx2r"
May 20 13:58:30.499727 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:30.499618    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47qhn\" (UniqueName: \"kubernetes.io/projected/0f1f2132-0d7c-4f80-bcd4-2459877a96f2-kube-api-access-47qhn\") pod \"kserve-controller-manager-867cffc775-ngx2r\" (UID: \"0f1f2132-0d7c-4f80-bcd4-2459877a96f2\") " pod="kserve/kserve-controller-manager-867cffc775-ngx2r"
May 20 13:58:30.600734 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:30.600701    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f1f2132-0d7c-4f80-bcd4-2459877a96f2-cert\") pod \"kserve-controller-manager-867cffc775-ngx2r\" (UID: \"0f1f2132-0d7c-4f80-bcd4-2459877a96f2\") " pod="kserve/kserve-controller-manager-867cffc775-ngx2r"
May 20 13:58:30.600881 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:30.600745    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-47qhn\" (UniqueName: \"kubernetes.io/projected/0f1f2132-0d7c-4f80-bcd4-2459877a96f2-kube-api-access-47qhn\") pod \"kserve-controller-manager-867cffc775-ngx2r\" (UID: \"0f1f2132-0d7c-4f80-bcd4-2459877a96f2\") " pod="kserve/kserve-controller-manager-867cffc775-ngx2r"
May 20 13:58:30.603025 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:30.603001    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f1f2132-0d7c-4f80-bcd4-2459877a96f2-cert\") pod \"kserve-controller-manager-867cffc775-ngx2r\" (UID: \"0f1f2132-0d7c-4f80-bcd4-2459877a96f2\") " pod="kserve/kserve-controller-manager-867cffc775-ngx2r"
May 20 13:58:30.609849 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:30.609828    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47qhn\" (UniqueName: \"kubernetes.io/projected/0f1f2132-0d7c-4f80-bcd4-2459877a96f2-kube-api-access-47qhn\") pod \"kserve-controller-manager-867cffc775-ngx2r\" (UID: \"0f1f2132-0d7c-4f80-bcd4-2459877a96f2\") " pod="kserve/kserve-controller-manager-867cffc775-ngx2r"
May 20 13:58:30.677616 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:30.677592    2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-867cffc775-84ksr"
May 20 13:58:30.802038 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:30.802001    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8-cert\") pod \"c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8\" (UID: \"c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8\") "
May 20 13:58:30.802206 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:30.802083    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsr7z\" (UniqueName: \"kubernetes.io/projected/c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8-kube-api-access-zsr7z\") pod \"c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8\" (UID: \"c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8\") "
May 20 13:58:30.804021 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:30.803993    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8-cert" (OuterVolumeSpecName: "cert") pod "c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8" (UID: "c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 13:58:30.804111 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:30.804037    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8-kube-api-access-zsr7z" (OuterVolumeSpecName: "kube-api-access-zsr7z") pod "c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8" (UID: "c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8"). InnerVolumeSpecName "kube-api-access-zsr7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 13:58:30.832175 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:30.832152    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-867cffc775-ngx2r"
May 20 13:58:30.903594 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:30.903557    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsr7z\" (UniqueName: \"kubernetes.io/projected/c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8-kube-api-access-zsr7z\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:58:30.903594 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:30.903585    2571 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8-cert\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:58:30.954394 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:30.954368    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-867cffc775-ngx2r"]
May 20 13:58:30.956581 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:58:30.956554    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f1f2132_0d7c_4f80_bcd4_2459877a96f2.slice/crio-2ae913c8a608c425004c0f2618af30990409adfbae842274344bb6171c97cf18 WatchSource:0}: Error finding container 2ae913c8a608c425004c0f2618af30990409adfbae842274344bb6171c97cf18: Status 404 returned error can't find the container with id 2ae913c8a608c425004c0f2618af30990409adfbae842274344bb6171c97cf18
May 20 13:58:31.315335 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:31.315302    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-867cffc775-ngx2r" event={"ID":"0f1f2132-0d7c-4f80-bcd4-2459877a96f2","Type":"ContainerStarted","Data":"0dba02d640648db3aebd379a0349d371d95fb22f7348f3ba47e34671ba6eaa02"}
May 20 13:58:31.315335 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:31.315347    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-867cffc775-ngx2r" event={"ID":"0f1f2132-0d7c-4f80-bcd4-2459877a96f2","Type":"ContainerStarted","Data":"2ae913c8a608c425004c0f2618af30990409adfbae842274344bb6171c97cf18"}
May 20 13:58:31.315517 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:31.315367    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-867cffc775-ngx2r"
May 20 13:58:31.316427 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:31.316402    2571 generic.go:358] "Generic (PLEG): container finished" podID="c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8" containerID="c91dab4ab2d34268f136fe18e46aa04223e77d90cc17d2315c68b2e9e72cda1b" exitCode=0
May 20 13:58:31.316530 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:31.316439    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-867cffc775-84ksr" event={"ID":"c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8","Type":"ContainerDied","Data":"c91dab4ab2d34268f136fe18e46aa04223e77d90cc17d2315c68b2e9e72cda1b"}
May 20 13:58:31.316530 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:31.316456    2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-867cffc775-84ksr"
May 20 13:58:31.316530 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:31.316474    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-867cffc775-84ksr" event={"ID":"c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8","Type":"ContainerDied","Data":"4e8aaa42f7bf31e859a1e9f948c3a099983f627afe64ec0d2294d0e44f6652d5"}
May 20 13:58:31.316530 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:31.316496    2571 scope.go:117] "RemoveContainer" containerID="c91dab4ab2d34268f136fe18e46aa04223e77d90cc17d2315c68b2e9e72cda1b"
May 20 13:58:31.324155 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:31.324135    2571 scope.go:117] "RemoveContainer" containerID="c91dab4ab2d34268f136fe18e46aa04223e77d90cc17d2315c68b2e9e72cda1b"
May 20 13:58:31.324470 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:58:31.324441    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c91dab4ab2d34268f136fe18e46aa04223e77d90cc17d2315c68b2e9e72cda1b\": container with ID starting with c91dab4ab2d34268f136fe18e46aa04223e77d90cc17d2315c68b2e9e72cda1b not found: ID does not exist" containerID="c91dab4ab2d34268f136fe18e46aa04223e77d90cc17d2315c68b2e9e72cda1b"
May 20 13:58:31.324566 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:31.324480    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c91dab4ab2d34268f136fe18e46aa04223e77d90cc17d2315c68b2e9e72cda1b"} err="failed to get container status \"c91dab4ab2d34268f136fe18e46aa04223e77d90cc17d2315c68b2e9e72cda1b\": rpc error: code = NotFound desc = could not find container \"c91dab4ab2d34268f136fe18e46aa04223e77d90cc17d2315c68b2e9e72cda1b\": container with ID starting with c91dab4ab2d34268f136fe18e46aa04223e77d90cc17d2315c68b2e9e72cda1b not found: ID does not exist"
May 20 13:58:31.332814 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:31.332779    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/kserve-controller-manager-867cffc775-ngx2r" podStartSLOduration=1.041320067 podStartE2EDuration="1.332768848s" podCreationTimestamp="2026-05-20 13:58:30 +0000 UTC" firstStartedPulling="2026-05-20 13:58:30.957684326 +0000 UTC m=+520.830471461" lastFinishedPulling="2026-05-20 13:58:31.249133103 +0000 UTC m=+521.121920242" observedRunningTime="2026-05-20 13:58:31.332703632 +0000 UTC m=+521.205490802" watchObservedRunningTime="2026-05-20 13:58:31.332768848 +0000 UTC m=+521.205556003"
May 20 13:58:31.346952 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:31.346901    2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-867cffc775-84ksr"]
May 20 13:58:31.352108 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:31.352086    2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-867cffc775-84ksr"]
May 20 13:58:32.665566 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:58:32.665535    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8" path="/var/lib/kubelet/pods/c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8/volumes"
May 20 13:59:02.327038 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:02.327009    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-867cffc775-ngx2r"
May 20 13:59:03.456218 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:03.456184    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-86f7b4b499-xfvfr"]
May 20 13:59:03.456645 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:03.456523    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8" containerName="manager"
May 20 13:59:03.456645 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:03.456535    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8" containerName="manager"
May 20 13:59:03.456645 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:03.456584    2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="c143b1ce-2d8d-4e5f-a77b-b1eac3812bf8" containerName="manager"
May 20 13:59:03.458492 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:03.458473    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-86f7b4b499-xfvfr"
May 20 13:59:03.460762 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:03.460746    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\""
May 20 13:59:03.460835 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:03.460746    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-9hpxb\""
May 20 13:59:03.470687 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:03.470666    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-86f7b4b499-xfvfr"]
May 20 13:59:03.535061 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:03.535031    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czwp7\" (UniqueName: \"kubernetes.io/projected/8ed63dce-4f0c-40aa-92c7-2bf81c019b34-kube-api-access-czwp7\") pod \"model-serving-api-86f7b4b499-xfvfr\" (UID: \"8ed63dce-4f0c-40aa-92c7-2bf81c019b34\") " pod="kserve/model-serving-api-86f7b4b499-xfvfr"
May 20 13:59:03.535202 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:03.535084    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ed63dce-4f0c-40aa-92c7-2bf81c019b34-tls-certs\") pod \"model-serving-api-86f7b4b499-xfvfr\" (UID: \"8ed63dce-4f0c-40aa-92c7-2bf81c019b34\") " pod="kserve/model-serving-api-86f7b4b499-xfvfr"
May 20 13:59:03.636511 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:03.636479    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ed63dce-4f0c-40aa-92c7-2bf81c019b34-tls-certs\") pod \"model-serving-api-86f7b4b499-xfvfr\" (UID: \"8ed63dce-4f0c-40aa-92c7-2bf81c019b34\") " pod="kserve/model-serving-api-86f7b4b499-xfvfr"
May 20 13:59:03.636628 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:03.636572    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-czwp7\" (UniqueName: \"kubernetes.io/projected/8ed63dce-4f0c-40aa-92c7-2bf81c019b34-kube-api-access-czwp7\") pod \"model-serving-api-86f7b4b499-xfvfr\" (UID: \"8ed63dce-4f0c-40aa-92c7-2bf81c019b34\") " pod="kserve/model-serving-api-86f7b4b499-xfvfr"
May 20 13:59:03.638874 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:03.638849    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ed63dce-4f0c-40aa-92c7-2bf81c019b34-tls-certs\") pod \"model-serving-api-86f7b4b499-xfvfr\" (UID: \"8ed63dce-4f0c-40aa-92c7-2bf81c019b34\") " pod="kserve/model-serving-api-86f7b4b499-xfvfr"
May 20 13:59:03.644735 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:03.644715    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czwp7\" (UniqueName: \"kubernetes.io/projected/8ed63dce-4f0c-40aa-92c7-2bf81c019b34-kube-api-access-czwp7\") pod \"model-serving-api-86f7b4b499-xfvfr\" (UID: \"8ed63dce-4f0c-40aa-92c7-2bf81c019b34\") " pod="kserve/model-serving-api-86f7b4b499-xfvfr"
May 20 13:59:03.769479 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:03.769431    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-86f7b4b499-xfvfr"
May 20 13:59:03.891084 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:03.891059    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-86f7b4b499-xfvfr"]
May 20 13:59:03.892908 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:59:03.892886    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ed63dce_4f0c_40aa_92c7_2bf81c019b34.slice/crio-9618516032cec6616762281881031f324c7091f9c6be34ec7f4e7cfb1d932e7d WatchSource:0}: Error finding container 9618516032cec6616762281881031f324c7091f9c6be34ec7f4e7cfb1d932e7d: Status 404 returned error can't find the container with id 9618516032cec6616762281881031f324c7091f9c6be34ec7f4e7cfb1d932e7d
May 20 13:59:04.419882 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:04.419842    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-86f7b4b499-xfvfr" event={"ID":"8ed63dce-4f0c-40aa-92c7-2bf81c019b34","Type":"ContainerStarted","Data":"9618516032cec6616762281881031f324c7091f9c6be34ec7f4e7cfb1d932e7d"}
May 20 13:59:06.430647 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:06.430573    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-86f7b4b499-xfvfr" event={"ID":"8ed63dce-4f0c-40aa-92c7-2bf81c019b34","Type":"ContainerStarted","Data":"2972155736b26cc1d1b4d16b0f354bc4ea3117d4b304f0ad0e988ce7685f5945"}
May 20 13:59:06.430647 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:06.430619    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-86f7b4b499-xfvfr"
May 20 13:59:06.447870 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:06.447826    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/model-serving-api-86f7b4b499-xfvfr" podStartSLOduration=1.281516284 podStartE2EDuration="3.447814294s" podCreationTimestamp="2026-05-20 13:59:03 +0000 UTC" firstStartedPulling="2026-05-20 13:59:03.894561599 +0000 UTC m=+553.767348734" lastFinishedPulling="2026-05-20 13:59:06.06085961 +0000 UTC m=+555.933646744" observedRunningTime="2026-05-20 13:59:06.446899829 +0000 UTC m=+556.319686985" watchObservedRunningTime="2026-05-20 13:59:06.447814294 +0000 UTC m=+556.320601449"
May 20 13:59:17.438018 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:17.437990    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-86f7b4b499-xfvfr"
May 20 13:59:22.237261 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:22.237229    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-74b6dc76d4-qrrnr"]
May 20 13:59:22.240339 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:22.240319    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74b6dc76d4-qrrnr"
May 20 13:59:22.252965 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:22.252925    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74b6dc76d4-qrrnr"]
May 20 13:59:22.367103 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:22.367078    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41896de0-f450-42a7-8e4d-3fecc8919a0c-trusted-ca-bundle\") pod \"console-74b6dc76d4-qrrnr\" (UID: \"41896de0-f450-42a7-8e4d-3fecc8919a0c\") " pod="openshift-console/console-74b6dc76d4-qrrnr"
May 20 13:59:22.367205 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:22.367107    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41896de0-f450-42a7-8e4d-3fecc8919a0c-console-serving-cert\") pod \"console-74b6dc76d4-qrrnr\" (UID: \"41896de0-f450-42a7-8e4d-3fecc8919a0c\") " pod="openshift-console/console-74b6dc76d4-qrrnr"
May 20 13:59:22.367205 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:22.367139    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41896de0-f450-42a7-8e4d-3fecc8919a0c-console-oauth-config\") pod \"console-74b6dc76d4-qrrnr\" (UID: \"41896de0-f450-42a7-8e4d-3fecc8919a0c\") " pod="openshift-console/console-74b6dc76d4-qrrnr"
May 20 13:59:22.367285 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:22.367212    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hvcc\" (UniqueName: \"kubernetes.io/projected/41896de0-f450-42a7-8e4d-3fecc8919a0c-kube-api-access-2hvcc\") pod \"console-74b6dc76d4-qrrnr\" (UID: \"41896de0-f450-42a7-8e4d-3fecc8919a0c\") " pod="openshift-console/console-74b6dc76d4-qrrnr"
May 20 13:59:22.367285 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:22.367243    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41896de0-f450-42a7-8e4d-3fecc8919a0c-console-config\") pod \"console-74b6dc76d4-qrrnr\" (UID: \"41896de0-f450-42a7-8e4d-3fecc8919a0c\") " pod="openshift-console/console-74b6dc76d4-qrrnr"
May 20 13:59:22.367285 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:22.367260    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41896de0-f450-42a7-8e4d-3fecc8919a0c-oauth-serving-cert\") pod \"console-74b6dc76d4-qrrnr\" (UID: \"41896de0-f450-42a7-8e4d-3fecc8919a0c\") " pod="openshift-console/console-74b6dc76d4-qrrnr"
May 20 13:59:22.367384 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:22.367294    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41896de0-f450-42a7-8e4d-3fecc8919a0c-service-ca\") pod \"console-74b6dc76d4-qrrnr\" (UID: \"41896de0-f450-42a7-8e4d-3fecc8919a0c\") " pod="openshift-console/console-74b6dc76d4-qrrnr"
May 20 13:59:22.468201 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:22.468164    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41896de0-f450-42a7-8e4d-3fecc8919a0c-service-ca\") pod \"console-74b6dc76d4-qrrnr\" (UID: \"41896de0-f450-42a7-8e4d-3fecc8919a0c\") " pod="openshift-console/console-74b6dc76d4-qrrnr"
May 20 13:59:22.468201 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:22.468209    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41896de0-f450-42a7-8e4d-3fecc8919a0c-trusted-ca-bundle\") pod \"console-74b6dc76d4-qrrnr\" (UID: \"41896de0-f450-42a7-8e4d-3fecc8919a0c\") " pod="openshift-console/console-74b6dc76d4-qrrnr"
May 20 13:59:22.468337 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:22.468227    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41896de0-f450-42a7-8e4d-3fecc8919a0c-console-serving-cert\") pod \"console-74b6dc76d4-qrrnr\" (UID: \"41896de0-f450-42a7-8e4d-3fecc8919a0c\") " pod="openshift-console/console-74b6dc76d4-qrrnr"
May 20 13:59:22.468337 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:22.468258    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41896de0-f450-42a7-8e4d-3fecc8919a0c-console-oauth-config\") pod \"console-74b6dc76d4-qrrnr\" (UID: \"41896de0-f450-42a7-8e4d-3fecc8919a0c\") " pod="openshift-console/console-74b6dc76d4-qrrnr"
May 20 13:59:22.468337 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:22.468284    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2hvcc\" (UniqueName: \"kubernetes.io/projected/41896de0-f450-42a7-8e4d-3fecc8919a0c-kube-api-access-2hvcc\") pod \"console-74b6dc76d4-qrrnr\" (UID: \"41896de0-f450-42a7-8e4d-3fecc8919a0c\") " pod="openshift-console/console-74b6dc76d4-qrrnr"
May 20 13:59:22.468337 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:22.468301    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41896de0-f450-42a7-8e4d-3fecc8919a0c-console-config\") pod \"console-74b6dc76d4-qrrnr\" (UID: \"41896de0-f450-42a7-8e4d-3fecc8919a0c\") " pod="openshift-console/console-74b6dc76d4-qrrnr"
May 20 13:59:22.468337 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:22.468316    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41896de0-f450-42a7-8e4d-3fecc8919a0c-oauth-serving-cert\") pod \"console-74b6dc76d4-qrrnr\" (UID: \"41896de0-f450-42a7-8e4d-3fecc8919a0c\") " pod="openshift-console/console-74b6dc76d4-qrrnr"
May 20 13:59:22.469026 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:22.469002    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41896de0-f450-42a7-8e4d-3fecc8919a0c-service-ca\") pod \"console-74b6dc76d4-qrrnr\" (UID: \"41896de0-f450-42a7-8e4d-3fecc8919a0c\") " pod="openshift-console/console-74b6dc76d4-qrrnr"
May 20 13:59:22.469110 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:22.469030    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41896de0-f450-42a7-8e4d-3fecc8919a0c-console-config\") pod \"console-74b6dc76d4-qrrnr\" (UID: \"41896de0-f450-42a7-8e4d-3fecc8919a0c\") " pod="openshift-console/console-74b6dc76d4-qrrnr"
May 20 13:59:22.469110 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:22.469034    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41896de0-f450-42a7-8e4d-3fecc8919a0c-oauth-serving-cert\") pod \"console-74b6dc76d4-qrrnr\" (UID: \"41896de0-f450-42a7-8e4d-3fecc8919a0c\") " pod="openshift-console/console-74b6dc76d4-qrrnr"
May 20 13:59:22.469185 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:22.469107    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41896de0-f450-42a7-8e4d-3fecc8919a0c-trusted-ca-bundle\") pod \"console-74b6dc76d4-qrrnr\" (UID: \"41896de0-f450-42a7-8e4d-3fecc8919a0c\") " pod="openshift-console/console-74b6dc76d4-qrrnr"
May 20 13:59:22.470612 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:22.470590    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41896de0-f450-42a7-8e4d-3fecc8919a0c-console-serving-cert\") pod \"console-74b6dc76d4-qrrnr\" (UID: \"41896de0-f450-42a7-8e4d-3fecc8919a0c\") " pod="openshift-console/console-74b6dc76d4-qrrnr"
May 20 13:59:22.470688 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:22.470614    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41896de0-f450-42a7-8e4d-3fecc8919a0c-console-oauth-config\") pod \"console-74b6dc76d4-qrrnr\" (UID: \"41896de0-f450-42a7-8e4d-3fecc8919a0c\") " pod="openshift-console/console-74b6dc76d4-qrrnr"
May 20 13:59:22.476724 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:22.476706    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hvcc\" (UniqueName: \"kubernetes.io/projected/41896de0-f450-42a7-8e4d-3fecc8919a0c-kube-api-access-2hvcc\") pod \"console-74b6dc76d4-qrrnr\" (UID: \"41896de0-f450-42a7-8e4d-3fecc8919a0c\") " pod="openshift-console/console-74b6dc76d4-qrrnr"
May 20 13:59:22.549754 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:22.549703    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74b6dc76d4-qrrnr"
May 20 13:59:22.672378 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:22.672350    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74b6dc76d4-qrrnr"]
May 20 13:59:22.675479 ip-10-0-130-144 kubenswrapper[2571]: W0520 13:59:22.675451    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41896de0_f450_42a7_8e4d_3fecc8919a0c.slice/crio-6abb2c163ca4761a577b735f9e7b0b15bb6c7b20c5c59fac314bd7d24c29c5ca WatchSource:0}: Error finding container 6abb2c163ca4761a577b735f9e7b0b15bb6c7b20c5c59fac314bd7d24c29c5ca: Status 404 returned error can't find the container with id 6abb2c163ca4761a577b735f9e7b0b15bb6c7b20c5c59fac314bd7d24c29c5ca
May 20 13:59:23.486063 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:23.486032    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74b6dc76d4-qrrnr" event={"ID":"41896de0-f450-42a7-8e4d-3fecc8919a0c","Type":"ContainerStarted","Data":"1a720e112321ec301b05b6935823d069680f4929c58ec8438ab80abef5d5b589"}
May 20 13:59:23.486063 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:23.486065    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74b6dc76d4-qrrnr" event={"ID":"41896de0-f450-42a7-8e4d-3fecc8919a0c","Type":"ContainerStarted","Data":"6abb2c163ca4761a577b735f9e7b0b15bb6c7b20c5c59fac314bd7d24c29c5ca"}
May 20 13:59:23.503827 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:23.503784    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-74b6dc76d4-qrrnr" podStartSLOduration=1.503772191 podStartE2EDuration="1.503772191s" podCreationTimestamp="2026-05-20 13:59:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 13:59:23.502203333 +0000 UTC m=+573.374990490" watchObservedRunningTime="2026-05-20 13:59:23.503772191 +0000 UTC m=+573.376559347"
May 20 13:59:32.550135 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:32.550104    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74b6dc76d4-qrrnr"
May 20 13:59:32.550559 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:32.550186    2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74b6dc76d4-qrrnr"
May 20 13:59:32.554752 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:32.554731    2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74b6dc76d4-qrrnr"
May 20 13:59:33.532348 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:33.532303    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74b6dc76d4-qrrnr"
May 20 13:59:33.578153 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:33.578116    2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-596c4456db-fbc88"]
May 20 13:59:58.598900 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:58.598837    2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-596c4456db-fbc88" podUID="9cbcf156-caaa-44ad-a008-80fd49d0c3b0" containerName="console" containerID="cri-o://afc49d4dca9c7ec6c5337fde3c477675fddcd4f6fc43a4a283491cbcf7d36014" gracePeriod=15
May 20 13:59:58.830413 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:58.830392    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-596c4456db-fbc88_9cbcf156-caaa-44ad-a008-80fd49d0c3b0/console/0.log"
May 20 13:59:58.830515 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:58.830449    2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-596c4456db-fbc88"
May 20 13:59:58.925245 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:58.925181    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2p7hf\" (UniqueName: \"kubernetes.io/projected/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-kube-api-access-2p7hf\") pod \"9cbcf156-caaa-44ad-a008-80fd49d0c3b0\" (UID: \"9cbcf156-caaa-44ad-a008-80fd49d0c3b0\") "
May 20 13:59:58.925245 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:58.925212    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-oauth-serving-cert\") pod \"9cbcf156-caaa-44ad-a008-80fd49d0c3b0\" (UID: \"9cbcf156-caaa-44ad-a008-80fd49d0c3b0\") "
May 20 13:59:58.925245 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:58.925231    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-console-serving-cert\") pod \"9cbcf156-caaa-44ad-a008-80fd49d0c3b0\" (UID: \"9cbcf156-caaa-44ad-a008-80fd49d0c3b0\") "
May 20 13:59:58.925474 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:58.925308    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-service-ca\") pod \"9cbcf156-caaa-44ad-a008-80fd49d0c3b0\" (UID: \"9cbcf156-caaa-44ad-a008-80fd49d0c3b0\") "
May 20 13:59:58.925474 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:58.925327    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-console-config\") pod \"9cbcf156-caaa-44ad-a008-80fd49d0c3b0\" (UID: \"9cbcf156-caaa-44ad-a008-80fd49d0c3b0\") "
May 20 13:59:58.925474 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:58.925347    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-trusted-ca-bundle\") pod \"9cbcf156-caaa-44ad-a008-80fd49d0c3b0\" (UID: \"9cbcf156-caaa-44ad-a008-80fd49d0c3b0\") "
May 20 13:59:58.925736 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:58.925689    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9cbcf156-caaa-44ad-a008-80fd49d0c3b0" (UID: "9cbcf156-caaa-44ad-a008-80fd49d0c3b0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 13:59:58.925736 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:58.925707    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-console-oauth-config\") pod \"9cbcf156-caaa-44ad-a008-80fd49d0c3b0\" (UID: \"9cbcf156-caaa-44ad-a008-80fd49d0c3b0\") "
May 20 13:59:58.925956 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:58.925711    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-service-ca" (OuterVolumeSpecName: "service-ca") pod "9cbcf156-caaa-44ad-a008-80fd49d0c3b0" (UID: "9cbcf156-caaa-44ad-a008-80fd49d0c3b0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 13:59:58.925956 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:58.925741    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-console-config" (OuterVolumeSpecName: "console-config") pod "9cbcf156-caaa-44ad-a008-80fd49d0c3b0" (UID: "9cbcf156-caaa-44ad-a008-80fd49d0c3b0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 13:59:58.925956 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:58.925752    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9cbcf156-caaa-44ad-a008-80fd49d0c3b0" (UID: "9cbcf156-caaa-44ad-a008-80fd49d0c3b0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 13:59:58.926093 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:58.926039    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-oauth-serving-cert\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:59:58.926093 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:58.926062    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-service-ca\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:59:58.926093 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:58.926077    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-console-config\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:59:58.926093 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:58.926091    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-trusted-ca-bundle\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:59:58.927418 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:58.927387    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-kube-api-access-2p7hf" (OuterVolumeSpecName: "kube-api-access-2p7hf") pod "9cbcf156-caaa-44ad-a008-80fd49d0c3b0" (UID: "9cbcf156-caaa-44ad-a008-80fd49d0c3b0"). InnerVolumeSpecName "kube-api-access-2p7hf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 13:59:58.927418 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:58.927398    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9cbcf156-caaa-44ad-a008-80fd49d0c3b0" (UID: "9cbcf156-caaa-44ad-a008-80fd49d0c3b0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 13:59:58.927540 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:58.927458    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9cbcf156-caaa-44ad-a008-80fd49d0c3b0" (UID: "9cbcf156-caaa-44ad-a008-80fd49d0c3b0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 13:59:59.027370 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:59.027349    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-console-oauth-config\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:59:59.027370 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:59.027370    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2p7hf\" (UniqueName: \"kubernetes.io/projected/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-kube-api-access-2p7hf\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:59:59.027484 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:59.027380    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9cbcf156-caaa-44ad-a008-80fd49d0c3b0-console-serving-cert\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 13:59:59.611168 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:59.611147    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-596c4456db-fbc88_9cbcf156-caaa-44ad-a008-80fd49d0c3b0/console/0.log"
May 20 13:59:59.611490 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:59.611182    2571 generic.go:358] "Generic (PLEG): container finished" podID="9cbcf156-caaa-44ad-a008-80fd49d0c3b0" containerID="afc49d4dca9c7ec6c5337fde3c477675fddcd4f6fc43a4a283491cbcf7d36014" exitCode=2
May 20 13:59:59.611490 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:59.611211    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-596c4456db-fbc88" event={"ID":"9cbcf156-caaa-44ad-a008-80fd49d0c3b0","Type":"ContainerDied","Data":"afc49d4dca9c7ec6c5337fde3c477675fddcd4f6fc43a4a283491cbcf7d36014"}
May 20 13:59:59.611490 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:59.611249    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-596c4456db-fbc88" event={"ID":"9cbcf156-caaa-44ad-a008-80fd49d0c3b0","Type":"ContainerDied","Data":"d07d745659336c0d92f9f4937ae09940cf51836cb0b59ed0a4fc3904cce0e396"}
May 20 13:59:59.611490 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:59.611248    2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-596c4456db-fbc88"
May 20 13:59:59.611490 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:59.611312    2571 scope.go:117] "RemoveContainer" containerID="afc49d4dca9c7ec6c5337fde3c477675fddcd4f6fc43a4a283491cbcf7d36014"
May 20 13:59:59.619543 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:59.619523    2571 scope.go:117] "RemoveContainer" containerID="afc49d4dca9c7ec6c5337fde3c477675fddcd4f6fc43a4a283491cbcf7d36014"
May 20 13:59:59.619764 ip-10-0-130-144 kubenswrapper[2571]: E0520 13:59:59.619748    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afc49d4dca9c7ec6c5337fde3c477675fddcd4f6fc43a4a283491cbcf7d36014\": container with ID starting with afc49d4dca9c7ec6c5337fde3c477675fddcd4f6fc43a4a283491cbcf7d36014 not found: ID does not exist" containerID="afc49d4dca9c7ec6c5337fde3c477675fddcd4f6fc43a4a283491cbcf7d36014"
May 20 13:59:59.619806 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:59.619771    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afc49d4dca9c7ec6c5337fde3c477675fddcd4f6fc43a4a283491cbcf7d36014"} err="failed to get container status \"afc49d4dca9c7ec6c5337fde3c477675fddcd4f6fc43a4a283491cbcf7d36014\": rpc error: code = NotFound desc = could not find container \"afc49d4dca9c7ec6c5337fde3c477675fddcd4f6fc43a4a283491cbcf7d36014\": container with ID starting with afc49d4dca9c7ec6c5337fde3c477675fddcd4f6fc43a4a283491cbcf7d36014 not found: ID does not exist"
May 20 13:59:59.632400 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:59.632377    2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-596c4456db-fbc88"]
May 20 13:59:59.636365 ip-10-0-130-144 kubenswrapper[2571]: I0520 13:59:59.636342    2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-596c4456db-fbc88"]
May 20 14:00:00.665647 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:00:00.665607    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cbcf156-caaa-44ad-a008-80fd49d0c3b0" path="/var/lib/kubelet/pods/9cbcf156-caaa-44ad-a008-80fd49d0c3b0/volumes"
May 20 14:01:12.740975 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:01:12.740943    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-custom-5c88b85bb7-8tz78"]
May 20 14:01:12.741362 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:01:12.741240    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cbcf156-caaa-44ad-a008-80fd49d0c3b0" containerName="console"
May 20 14:01:12.741362 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:01:12.741251    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cbcf156-caaa-44ad-a008-80fd49d0c3b0" containerName="console"
May 20 14:01:12.741362 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:01:12.741303    2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="9cbcf156-caaa-44ad-a008-80fd49d0c3b0" containerName="console"
May 20 14:01:12.745159 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:01:12.745143    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-5c88b85bb7-8tz78"
May 20 14:01:12.748195 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:01:12.748171    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\""
May 20 14:01:12.748882 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:01:12.748866    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom\""
May 20 14:01:12.752850 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:01:12.752830    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-5c88b85bb7-8tz78"]
May 20 14:01:12.859596 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:01:12.859572    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ccce1b27-5dfb-4f90-8b2b-2304a46938eb-data\") pod \"seaweedfs-tls-custom-5c88b85bb7-8tz78\" (UID: \"ccce1b27-5dfb-4f90-8b2b-2304a46938eb\") " pod="kserve/seaweedfs-tls-custom-5c88b85bb7-8tz78"
May 20 14:01:12.859703 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:01:12.859602    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r66ch\" (UniqueName: \"kubernetes.io/projected/ccce1b27-5dfb-4f90-8b2b-2304a46938eb-kube-api-access-r66ch\") pod \"seaweedfs-tls-custom-5c88b85bb7-8tz78\" (UID: \"ccce1b27-5dfb-4f90-8b2b-2304a46938eb\") " pod="kserve/seaweedfs-tls-custom-5c88b85bb7-8tz78"
May 20 14:01:12.859703 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:01:12.859640    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/ccce1b27-5dfb-4f90-8b2b-2304a46938eb-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-5c88b85bb7-8tz78\" (UID: \"ccce1b27-5dfb-4f90-8b2b-2304a46938eb\") " pod="kserve/seaweedfs-tls-custom-5c88b85bb7-8tz78"
May 20 14:01:12.960272 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:01:12.960248    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ccce1b27-5dfb-4f90-8b2b-2304a46938eb-data\") pod \"seaweedfs-tls-custom-5c88b85bb7-8tz78\" (UID: \"ccce1b27-5dfb-4f90-8b2b-2304a46938eb\") " pod="kserve/seaweedfs-tls-custom-5c88b85bb7-8tz78"
May 20 14:01:12.960370 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:01:12.960278    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r66ch\" (UniqueName: \"kubernetes.io/projected/ccce1b27-5dfb-4f90-8b2b-2304a46938eb-kube-api-access-r66ch\") pod \"seaweedfs-tls-custom-5c88b85bb7-8tz78\" (UID: \"ccce1b27-5dfb-4f90-8b2b-2304a46938eb\") " pod="kserve/seaweedfs-tls-custom-5c88b85bb7-8tz78"
May 20 14:01:12.960370 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:01:12.960313    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/ccce1b27-5dfb-4f90-8b2b-2304a46938eb-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-5c88b85bb7-8tz78\" (UID: \"ccce1b27-5dfb-4f90-8b2b-2304a46938eb\") " pod="kserve/seaweedfs-tls-custom-5c88b85bb7-8tz78"
May 20 14:01:12.960687 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:01:12.960669    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ccce1b27-5dfb-4f90-8b2b-2304a46938eb-data\") pod \"seaweedfs-tls-custom-5c88b85bb7-8tz78\" (UID: \"ccce1b27-5dfb-4f90-8b2b-2304a46938eb\") " pod="kserve/seaweedfs-tls-custom-5c88b85bb7-8tz78"
May 20 14:01:12.962551 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:01:12.962534    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/ccce1b27-5dfb-4f90-8b2b-2304a46938eb-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-5c88b85bb7-8tz78\" (UID: \"ccce1b27-5dfb-4f90-8b2b-2304a46938eb\") " pod="kserve/seaweedfs-tls-custom-5c88b85bb7-8tz78"
May 20 14:01:12.969996 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:01:12.969978    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r66ch\" (UniqueName: \"kubernetes.io/projected/ccce1b27-5dfb-4f90-8b2b-2304a46938eb-kube-api-access-r66ch\") pod \"seaweedfs-tls-custom-5c88b85bb7-8tz78\" (UID: \"ccce1b27-5dfb-4f90-8b2b-2304a46938eb\") " pod="kserve/seaweedfs-tls-custom-5c88b85bb7-8tz78"
May 20 14:01:13.054521 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:01:13.054467    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-5c88b85bb7-8tz78"
May 20 14:01:13.181238 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:01:13.181215    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-5c88b85bb7-8tz78"]
May 20 14:01:13.183701 ip-10-0-130-144 kubenswrapper[2571]: W0520 14:01:13.183670    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccce1b27_5dfb_4f90_8b2b_2304a46938eb.slice/crio-447398d164de4c2cb53aa5fac01aa7f0149f26de11a503475195139d5a41f025 WatchSource:0}: Error finding container 447398d164de4c2cb53aa5fac01aa7f0149f26de11a503475195139d5a41f025: Status 404 returned error can't find the container with id 447398d164de4c2cb53aa5fac01aa7f0149f26de11a503475195139d5a41f025
May 20 14:01:13.184928 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:01:13.184908    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 14:01:13.835352 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:01:13.835282    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-5c88b85bb7-8tz78" event={"ID":"ccce1b27-5dfb-4f90-8b2b-2304a46938eb","Type":"ContainerStarted","Data":"006b7a31e1f94fabe2e91f3e7bf2fb93b45205d3d67cb74ce88e0491c6d5e15f"}
May 20 14:01:13.835352 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:01:13.835313    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-5c88b85bb7-8tz78" event={"ID":"ccce1b27-5dfb-4f90-8b2b-2304a46938eb","Type":"ContainerStarted","Data":"447398d164de4c2cb53aa5fac01aa7f0149f26de11a503475195139d5a41f025"}
May 20 14:01:13.857626 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:01:13.857582    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/seaweedfs-tls-custom-5c88b85bb7-8tz78" podStartSLOduration=1.525302484 podStartE2EDuration="1.857568251s" podCreationTimestamp="2026-05-20 14:01:12 +0000 UTC" firstStartedPulling="2026-05-20 14:01:13.185042783 +0000 UTC m=+683.057829918" lastFinishedPulling="2026-05-20 14:01:13.517308547 +0000 UTC m=+683.390095685" observedRunningTime="2026-05-20 14:01:13.855529944 +0000 UTC m=+683.728317095" watchObservedRunningTime="2026-05-20 14:01:13.857568251 +0000 UTC m=+683.730355407"
May 20 14:06:00.618547 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:06:00.618508    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-c7d86bcbd-f85kj"]
May 20 14:06:00.622039 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:06:00.622015    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-c7d86bcbd-f85kj"
May 20 14:06:00.624819 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:06:00.624796    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
May 20 14:06:00.624961 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:06:00.624861    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-2mlds\""
May 20 14:06:00.625544 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:06:00.625525    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"message-dumper-predictor-serving-cert\""
May 20 14:06:00.625624 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:06:00.625540    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"message-dumper-kube-rbac-proxy-sar-config\""
May 20 14:06:00.625624 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:06:00.625610    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
May 20 14:06:00.634488 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:06:00.634465    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-c7d86bcbd-f85kj"]
May 20 14:06:00.811464 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:06:00.811435    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"message-dumper-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/aff645fa-801e-40db-adb5-0744023d6c10-message-dumper-kube-rbac-proxy-sar-config\") pod \"message-dumper-predictor-c7d86bcbd-f85kj\" (UID: \"aff645fa-801e-40db-adb5-0744023d6c10\") " pod="kserve-ci-e2e-test/message-dumper-predictor-c7d86bcbd-f85kj"
May 20 14:06:00.811629 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:06:00.811470    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/aff645fa-801e-40db-adb5-0744023d6c10-proxy-tls\") pod \"message-dumper-predictor-c7d86bcbd-f85kj\" (UID: \"aff645fa-801e-40db-adb5-0744023d6c10\") " pod="kserve-ci-e2e-test/message-dumper-predictor-c7d86bcbd-f85kj"
May 20 14:06:00.811629 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:06:00.811520    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n885b\" (UniqueName: \"kubernetes.io/projected/aff645fa-801e-40db-adb5-0744023d6c10-kube-api-access-n885b\") pod \"message-dumper-predictor-c7d86bcbd-f85kj\" (UID: \"aff645fa-801e-40db-adb5-0744023d6c10\") " pod="kserve-ci-e2e-test/message-dumper-predictor-c7d86bcbd-f85kj"
May 20 14:06:00.912329 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:06:00.912265    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"message-dumper-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/aff645fa-801e-40db-adb5-0744023d6c10-message-dumper-kube-rbac-proxy-sar-config\") pod \"message-dumper-predictor-c7d86bcbd-f85kj\" (UID: \"aff645fa-801e-40db-adb5-0744023d6c10\") " pod="kserve-ci-e2e-test/message-dumper-predictor-c7d86bcbd-f85kj"
May 20 14:06:00.912329 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:06:00.912298    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/aff645fa-801e-40db-adb5-0744023d6c10-proxy-tls\") pod \"message-dumper-predictor-c7d86bcbd-f85kj\" (UID: \"aff645fa-801e-40db-adb5-0744023d6c10\") " pod="kserve-ci-e2e-test/message-dumper-predictor-c7d86bcbd-f85kj"
May 20 14:06:00.912492 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:06:00.912337    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n885b\" (UniqueName: \"kubernetes.io/projected/aff645fa-801e-40db-adb5-0744023d6c10-kube-api-access-n885b\") pod \"message-dumper-predictor-c7d86bcbd-f85kj\" (UID: \"aff645fa-801e-40db-adb5-0744023d6c10\") " pod="kserve-ci-e2e-test/message-dumper-predictor-c7d86bcbd-f85kj"
May 20 14:06:00.912830 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:06:00.912808    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"message-dumper-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/aff645fa-801e-40db-adb5-0744023d6c10-message-dumper-kube-rbac-proxy-sar-config\") pod \"message-dumper-predictor-c7d86bcbd-f85kj\" (UID: \"aff645fa-801e-40db-adb5-0744023d6c10\") " pod="kserve-ci-e2e-test/message-dumper-predictor-c7d86bcbd-f85kj"
May 20 14:06:00.914607 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:06:00.914589    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/aff645fa-801e-40db-adb5-0744023d6c10-proxy-tls\") pod \"message-dumper-predictor-c7d86bcbd-f85kj\" (UID: \"aff645fa-801e-40db-adb5-0744023d6c10\") " pod="kserve-ci-e2e-test/message-dumper-predictor-c7d86bcbd-f85kj"
May 20 14:06:00.921854 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:06:00.921838    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n885b\" (UniqueName: \"kubernetes.io/projected/aff645fa-801e-40db-adb5-0744023d6c10-kube-api-access-n885b\") pod \"message-dumper-predictor-c7d86bcbd-f85kj\" (UID: \"aff645fa-801e-40db-adb5-0744023d6c10\") " pod="kserve-ci-e2e-test/message-dumper-predictor-c7d86bcbd-f85kj"
May 20 14:06:00.934644 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:06:00.934624    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-c7d86bcbd-f85kj"
May 20 14:06:01.059250 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:06:01.059223    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-c7d86bcbd-f85kj"]
May 20 14:06:01.061776 ip-10-0-130-144 kubenswrapper[2571]: W0520 14:06:01.061751    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaff645fa_801e_40db_adb5_0744023d6c10.slice/crio-9df9297e6a861a21bbdb3c46e0fcedb088e3ecb0f888734769b1daeb6903a279 WatchSource:0}: Error finding container 9df9297e6a861a21bbdb3c46e0fcedb088e3ecb0f888734769b1daeb6903a279: Status 404 returned error can't find the container with id 9df9297e6a861a21bbdb3c46e0fcedb088e3ecb0f888734769b1daeb6903a279
May 20 14:06:01.733254 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:06:01.733201    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-c7d86bcbd-f85kj" event={"ID":"aff645fa-801e-40db-adb5-0744023d6c10","Type":"ContainerStarted","Data":"9df9297e6a861a21bbdb3c46e0fcedb088e3ecb0f888734769b1daeb6903a279"}
May 20 14:06:02.738249 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:06:02.738200    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-c7d86bcbd-f85kj" event={"ID":"aff645fa-801e-40db-adb5-0744023d6c10","Type":"ContainerStarted","Data":"c3282b4007ea171606c15009f3657671789f5a31d3fc1dbcd95e23ab2910a190"}
May 20 14:06:04.746419 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:06:04.746382    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-c7d86bcbd-f85kj" event={"ID":"aff645fa-801e-40db-adb5-0744023d6c10","Type":"ContainerStarted","Data":"6e97cc68210a6a4fe5477b8532fff7759e13892f31eb49659818afc44248f5b4"}
May 20 14:06:04.746769 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:06:04.746505    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/message-dumper-predictor-c7d86bcbd-f85kj"
May 20 14:06:04.764292 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:06:04.764252    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/message-dumper-predictor-c7d86bcbd-f85kj" podStartSLOduration=1.531634828 podStartE2EDuration="4.76423885s" podCreationTimestamp="2026-05-20 14:06:00 +0000 UTC" firstStartedPulling="2026-05-20 14:06:01.063612393 +0000 UTC m=+970.936399528" lastFinishedPulling="2026-05-20 14:06:04.296216402 +0000 UTC m=+974.169003550" observedRunningTime="2026-05-20 14:06:04.76286991 +0000 UTC m=+974.635657066" watchObservedRunningTime="2026-05-20 14:06:04.76423885 +0000 UTC m=+974.637026005"
May 20 14:06:05.749767 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:06:05.749742    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/message-dumper-predictor-c7d86bcbd-f85kj"
May 20 14:06:05.751666 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:06:05.751643    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/message-dumper-predictor-c7d86bcbd-f85kj"
May 20 14:06:12.760343 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:06:12.760269    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/message-dumper-predictor-c7d86bcbd-f85kj"
May 20 14:07:45.697567 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:07:45.697471    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-c7d86bcbd-f85kj_aff645fa-801e-40db-adb5-0744023d6c10/kserve-container/0.log"
May 20 14:07:46.037857 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:07:46.037780    2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-c7d86bcbd-f85kj"]
May 20 14:07:46.038170 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:07:46.038143    2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/message-dumper-predictor-c7d86bcbd-f85kj" podUID="aff645fa-801e-40db-adb5-0744023d6c10" containerName="kserve-container" containerID="cri-o://c3282b4007ea171606c15009f3657671789f5a31d3fc1dbcd95e23ab2910a190" gracePeriod=30
May 20 14:07:46.038251 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:07:46.038170    2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/message-dumper-predictor-c7d86bcbd-f85kj" podUID="aff645fa-801e-40db-adb5-0744023d6c10" containerName="kube-rbac-proxy" containerID="cri-o://6e97cc68210a6a4fe5477b8532fff7759e13892f31eb49659818afc44248f5b4" gracePeriod=30
May 20 14:07:46.278866 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:07:46.278842    2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-c7d86bcbd-f85kj"
May 20 14:07:46.371983 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:07:46.371864    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"message-dumper-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/aff645fa-801e-40db-adb5-0744023d6c10-message-dumper-kube-rbac-proxy-sar-config\") pod \"aff645fa-801e-40db-adb5-0744023d6c10\" (UID: \"aff645fa-801e-40db-adb5-0744023d6c10\") "
May 20 14:07:46.371983 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:07:46.371964    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/aff645fa-801e-40db-adb5-0744023d6c10-proxy-tls\") pod \"aff645fa-801e-40db-adb5-0744023d6c10\" (UID: \"aff645fa-801e-40db-adb5-0744023d6c10\") "
May 20 14:07:46.372166 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:07:46.372074    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n885b\" (UniqueName: \"kubernetes.io/projected/aff645fa-801e-40db-adb5-0744023d6c10-kube-api-access-n885b\") pod \"aff645fa-801e-40db-adb5-0744023d6c10\" (UID: \"aff645fa-801e-40db-adb5-0744023d6c10\") "
May 20 14:07:46.372234 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:07:46.372207    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aff645fa-801e-40db-adb5-0744023d6c10-message-dumper-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "message-dumper-kube-rbac-proxy-sar-config") pod "aff645fa-801e-40db-adb5-0744023d6c10" (UID: "aff645fa-801e-40db-adb5-0744023d6c10"). InnerVolumeSpecName "message-dumper-kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 14:07:46.372422 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:07:46.372401    2571 reconciler_common.go:299] "Volume detached for volume \"message-dumper-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/aff645fa-801e-40db-adb5-0744023d6c10-message-dumper-kube-rbac-proxy-sar-config\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 14:07:46.373919 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:07:46.373895    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aff645fa-801e-40db-adb5-0744023d6c10-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "aff645fa-801e-40db-adb5-0744023d6c10" (UID: "aff645fa-801e-40db-adb5-0744023d6c10"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 14:07:46.374076 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:07:46.374056    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aff645fa-801e-40db-adb5-0744023d6c10-kube-api-access-n885b" (OuterVolumeSpecName: "kube-api-access-n885b") pod "aff645fa-801e-40db-adb5-0744023d6c10" (UID: "aff645fa-801e-40db-adb5-0744023d6c10"). InnerVolumeSpecName "kube-api-access-n885b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 14:07:46.473478 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:07:46.473458    2571 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/aff645fa-801e-40db-adb5-0744023d6c10-proxy-tls\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 14:07:46.473478 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:07:46.473478    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n885b\" (UniqueName: \"kubernetes.io/projected/aff645fa-801e-40db-adb5-0744023d6c10-kube-api-access-n885b\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 14:07:47.069426 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:07:47.069393    2571 generic.go:358] "Generic (PLEG): container finished" podID="aff645fa-801e-40db-adb5-0744023d6c10" containerID="6e97cc68210a6a4fe5477b8532fff7759e13892f31eb49659818afc44248f5b4" exitCode=2
May 20 14:07:47.069426 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:07:47.069421    2571 generic.go:358] "Generic (PLEG): container finished" podID="aff645fa-801e-40db-adb5-0744023d6c10" containerID="c3282b4007ea171606c15009f3657671789f5a31d3fc1dbcd95e23ab2910a190" exitCode=2
May 20 14:07:47.069795 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:07:47.069456    2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-c7d86bcbd-f85kj"
May 20 14:07:47.069795 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:07:47.069473    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-c7d86bcbd-f85kj" event={"ID":"aff645fa-801e-40db-adb5-0744023d6c10","Type":"ContainerDied","Data":"6e97cc68210a6a4fe5477b8532fff7759e13892f31eb49659818afc44248f5b4"}
May 20 14:07:47.069795 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:07:47.069505    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-c7d86bcbd-f85kj" event={"ID":"aff645fa-801e-40db-adb5-0744023d6c10","Type":"ContainerDied","Data":"c3282b4007ea171606c15009f3657671789f5a31d3fc1dbcd95e23ab2910a190"}
May 20 14:07:47.069795 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:07:47.069516    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-c7d86bcbd-f85kj" event={"ID":"aff645fa-801e-40db-adb5-0744023d6c10","Type":"ContainerDied","Data":"9df9297e6a861a21bbdb3c46e0fcedb088e3ecb0f888734769b1daeb6903a279"}
May 20 14:07:47.069795 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:07:47.069531    2571 scope.go:117] "RemoveContainer" containerID="6e97cc68210a6a4fe5477b8532fff7759e13892f31eb49659818afc44248f5b4"
May 20 14:07:47.078163 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:07:47.078138    2571 scope.go:117] "RemoveContainer" containerID="c3282b4007ea171606c15009f3657671789f5a31d3fc1dbcd95e23ab2910a190"
May 20 14:07:47.086551 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:07:47.086525    2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-c7d86bcbd-f85kj"]
May 20 14:07:47.087001 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:07:47.086983    2571 scope.go:117] "RemoveContainer" containerID="6e97cc68210a6a4fe5477b8532fff7759e13892f31eb49659818afc44248f5b4"
May 20 14:07:47.087258 ip-10-0-130-144 kubenswrapper[2571]: E0520 14:07:47.087240    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e97cc68210a6a4fe5477b8532fff7759e13892f31eb49659818afc44248f5b4\": container with ID starting with 6e97cc68210a6a4fe5477b8532fff7759e13892f31eb49659818afc44248f5b4 not found: ID does not exist" containerID="6e97cc68210a6a4fe5477b8532fff7759e13892f31eb49659818afc44248f5b4"
May 20 14:07:47.087311 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:07:47.087265    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e97cc68210a6a4fe5477b8532fff7759e13892f31eb49659818afc44248f5b4"} err="failed to get container status \"6e97cc68210a6a4fe5477b8532fff7759e13892f31eb49659818afc44248f5b4\": rpc error: code = NotFound desc = could not find container \"6e97cc68210a6a4fe5477b8532fff7759e13892f31eb49659818afc44248f5b4\": container with ID starting with 6e97cc68210a6a4fe5477b8532fff7759e13892f31eb49659818afc44248f5b4 not found: ID does not exist"
May 20 14:07:47.087311 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:07:47.087284    2571 scope.go:117] "RemoveContainer" containerID="c3282b4007ea171606c15009f3657671789f5a31d3fc1dbcd95e23ab2910a190"
May 20 14:07:47.087514 ip-10-0-130-144 kubenswrapper[2571]: E0520 14:07:47.087488    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3282b4007ea171606c15009f3657671789f5a31d3fc1dbcd95e23ab2910a190\": container with ID starting with c3282b4007ea171606c15009f3657671789f5a31d3fc1dbcd95e23ab2910a190 not found: ID does not exist" containerID="c3282b4007ea171606c15009f3657671789f5a31d3fc1dbcd95e23ab2910a190"
May 20 14:07:47.087596 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:07:47.087522    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3282b4007ea171606c15009f3657671789f5a31d3fc1dbcd95e23ab2910a190"} err="failed to get container status \"c3282b4007ea171606c15009f3657671789f5a31d3fc1dbcd95e23ab2910a190\": rpc error: code = NotFound desc = could not find container \"c3282b4007ea171606c15009f3657671789f5a31d3fc1dbcd95e23ab2910a190\": container with ID starting with c3282b4007ea171606c15009f3657671789f5a31d3fc1dbcd95e23ab2910a190 not found: ID does not exist"
May 20 14:07:47.087596 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:07:47.087543    2571 scope.go:117] "RemoveContainer" containerID="6e97cc68210a6a4fe5477b8532fff7759e13892f31eb49659818afc44248f5b4"
May 20 14:07:47.087810 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:07:47.087791    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e97cc68210a6a4fe5477b8532fff7759e13892f31eb49659818afc44248f5b4"} err="failed to get container status \"6e97cc68210a6a4fe5477b8532fff7759e13892f31eb49659818afc44248f5b4\": rpc error: code = NotFound desc = could not find container \"6e97cc68210a6a4fe5477b8532fff7759e13892f31eb49659818afc44248f5b4\": container with ID starting with 6e97cc68210a6a4fe5477b8532fff7759e13892f31eb49659818afc44248f5b4 not found: ID does not exist"
May 20 14:07:47.087867 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:07:47.087812    2571 scope.go:117] "RemoveContainer" containerID="c3282b4007ea171606c15009f3657671789f5a31d3fc1dbcd95e23ab2910a190"
May 20 14:07:47.088305 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:07:47.088275    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3282b4007ea171606c15009f3657671789f5a31d3fc1dbcd95e23ab2910a190"} err="failed to get container status \"c3282b4007ea171606c15009f3657671789f5a31d3fc1dbcd95e23ab2910a190\": rpc error: code = NotFound desc = could not find container \"c3282b4007ea171606c15009f3657671789f5a31d3fc1dbcd95e23ab2910a190\": container with ID starting with c3282b4007ea171606c15009f3657671789f5a31d3fc1dbcd95e23ab2910a190 not found: ID does not exist"
May 20 14:07:47.090066 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:07:47.090046    2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-c7d86bcbd-f85kj"]
May 20 14:07:48.667733 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:07:48.667700    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aff645fa-801e-40db-adb5-0744023d6c10" path="/var/lib/kubelet/pods/aff645fa-801e-40db-adb5-0744023d6c10/volumes"
May 20 14:42:19.299466 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:19.299378    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h"]
May 20 14:42:19.299915 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:19.299727    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aff645fa-801e-40db-adb5-0744023d6c10" containerName="kserve-container"
May 20 14:42:19.299915 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:19.299738    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="aff645fa-801e-40db-adb5-0744023d6c10" containerName="kserve-container"
May 20 14:42:19.299915 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:19.299761    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aff645fa-801e-40db-adb5-0744023d6c10" containerName="kube-rbac-proxy"
May 20 14:42:19.299915 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:19.299767    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="aff645fa-801e-40db-adb5-0744023d6c10" containerName="kube-rbac-proxy"
May 20 14:42:19.299915 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:19.299854    2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="aff645fa-801e-40db-adb5-0744023d6c10" containerName="kserve-container"
May 20 14:42:19.299915 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:19.299868    2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="aff645fa-801e-40db-adb5-0744023d6c10" containerName="kube-rbac-proxy"
May 20 14:42:19.303205 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:19.303187    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h"
May 20 14:42:19.305797 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:19.305772    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
May 20 14:42:19.305924 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:19.305779    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-2mlds\""
May 20 14:42:19.305924 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:19.305860    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
May 20 14:42:19.305924 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:19.305795    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-tensorflow-runtime-kube-rbac-proxy-sar-config\""
May 20 14:42:19.306583 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:19.306565    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
May 20 14:42:19.306688 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:19.306594    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-tensorflow-runtime-predictor-serving-cert\""
May 20 14:42:19.306688 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:19.306681    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
May 20 14:42:19.315018 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:19.314995    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h"]
May 20 14:42:19.423189 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:19.423153    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/0892c1e5-d1fd-4652-aae2-5971e7bbaae8-cabundle-cert\") pod \"isvc-tensorflow-runtime-predictor-8699d78cf-vc58h\" (UID: \"0892c1e5-d1fd-4652-aae2-5971e7bbaae8\") " pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h"
May 20 14:42:19.423385 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:19.423200    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwzch\" (UniqueName: \"kubernetes.io/projected/0892c1e5-d1fd-4652-aae2-5971e7bbaae8-kube-api-access-wwzch\") pod \"isvc-tensorflow-runtime-predictor-8699d78cf-vc58h\" (UID: \"0892c1e5-d1fd-4652-aae2-5971e7bbaae8\") " pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h"
May 20 14:42:19.423385 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:19.423333    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0892c1e5-d1fd-4652-aae2-5971e7bbaae8-kserve-provision-location\") pod \"isvc-tensorflow-runtime-predictor-8699d78cf-vc58h\" (UID: \"0892c1e5-d1fd-4652-aae2-5971e7bbaae8\") " pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h"
May 20 14:42:19.423515 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:19.423388    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0892c1e5-d1fd-4652-aae2-5971e7bbaae8-proxy-tls\") pod \"isvc-tensorflow-runtime-predictor-8699d78cf-vc58h\" (UID: \"0892c1e5-d1fd-4652-aae2-5971e7bbaae8\") " pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h"
May 20 14:42:19.423515 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:19.423435    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"isvc-tensorflow-runtime-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0892c1e5-d1fd-4652-aae2-5971e7bbaae8-isvc-tensorflow-runtime-kube-rbac-proxy-sar-config\") pod \"isvc-tensorflow-runtime-predictor-8699d78cf-vc58h\" (UID: \"0892c1e5-d1fd-4652-aae2-5971e7bbaae8\") " pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h"
May 20 14:42:19.524553 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:19.524510    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/0892c1e5-d1fd-4652-aae2-5971e7bbaae8-cabundle-cert\") pod \"isvc-tensorflow-runtime-predictor-8699d78cf-vc58h\" (UID: \"0892c1e5-d1fd-4652-aae2-5971e7bbaae8\") " pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h"
May 20 14:42:19.524553 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:19.524559    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wwzch\" (UniqueName: \"kubernetes.io/projected/0892c1e5-d1fd-4652-aae2-5971e7bbaae8-kube-api-access-wwzch\") pod \"isvc-tensorflow-runtime-predictor-8699d78cf-vc58h\" (UID: \"0892c1e5-d1fd-4652-aae2-5971e7bbaae8\") " pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h"
May 20 14:42:19.524773 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:19.524687    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0892c1e5-d1fd-4652-aae2-5971e7bbaae8-kserve-provision-location\") pod \"isvc-tensorflow-runtime-predictor-8699d78cf-vc58h\" (UID: \"0892c1e5-d1fd-4652-aae2-5971e7bbaae8\") " pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h"
May 20 14:42:19.524773 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:19.524746    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0892c1e5-d1fd-4652-aae2-5971e7bbaae8-proxy-tls\") pod \"isvc-tensorflow-runtime-predictor-8699d78cf-vc58h\" (UID: \"0892c1e5-d1fd-4652-aae2-5971e7bbaae8\") " pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h"
May 20 14:42:19.524867 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:19.524787    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"isvc-tensorflow-runtime-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0892c1e5-d1fd-4652-aae2-5971e7bbaae8-isvc-tensorflow-runtime-kube-rbac-proxy-sar-config\") pod \"isvc-tensorflow-runtime-predictor-8699d78cf-vc58h\" (UID: \"0892c1e5-d1fd-4652-aae2-5971e7bbaae8\") " pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h"
May 20 14:42:19.525141 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:19.525117    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0892c1e5-d1fd-4652-aae2-5971e7bbaae8-kserve-provision-location\") pod \"isvc-tensorflow-runtime-predictor-8699d78cf-vc58h\" (UID: \"0892c1e5-d1fd-4652-aae2-5971e7bbaae8\") " pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h"
May 20 14:42:19.525248 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:19.525199    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/0892c1e5-d1fd-4652-aae2-5971e7bbaae8-cabundle-cert\") pod \"isvc-tensorflow-runtime-predictor-8699d78cf-vc58h\" (UID: \"0892c1e5-d1fd-4652-aae2-5971e7bbaae8\") " pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h"
May 20 14:42:19.525400 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:19.525382    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"isvc-tensorflow-runtime-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0892c1e5-d1fd-4652-aae2-5971e7bbaae8-isvc-tensorflow-runtime-kube-rbac-proxy-sar-config\") pod \"isvc-tensorflow-runtime-predictor-8699d78cf-vc58h\" (UID: \"0892c1e5-d1fd-4652-aae2-5971e7bbaae8\") " pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h"
May 20 14:42:19.527299 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:19.527278    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0892c1e5-d1fd-4652-aae2-5971e7bbaae8-proxy-tls\") pod \"isvc-tensorflow-runtime-predictor-8699d78cf-vc58h\" (UID: \"0892c1e5-d1fd-4652-aae2-5971e7bbaae8\") " pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h"
May 20 14:42:19.534230 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:19.534204    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwzch\" (UniqueName: \"kubernetes.io/projected/0892c1e5-d1fd-4652-aae2-5971e7bbaae8-kube-api-access-wwzch\") pod \"isvc-tensorflow-runtime-predictor-8699d78cf-vc58h\" (UID: \"0892c1e5-d1fd-4652-aae2-5971e7bbaae8\") " pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h"
May 20 14:42:19.614801 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:19.614708    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h"
May 20 14:42:19.756490 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:19.756450    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h"]
May 20 14:42:19.761529 ip-10-0-130-144 kubenswrapper[2571]: W0520 14:42:19.761500    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0892c1e5_d1fd_4652_aae2_5971e7bbaae8.slice/crio-ef1e95e1d0cc6c5f0d0d31052055a5b72b0c95e188b31869c902673db47757c8 WatchSource:0}: Error finding container ef1e95e1d0cc6c5f0d0d31052055a5b72b0c95e188b31869c902673db47757c8: Status 404 returned error can't find the container with id ef1e95e1d0cc6c5f0d0d31052055a5b72b0c95e188b31869c902673db47757c8
May 20 14:42:19.763312 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:19.763293    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 14:42:19.802577 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:19.802543    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h" event={"ID":"0892c1e5-d1fd-4652-aae2-5971e7bbaae8","Type":"ContainerStarted","Data":"ef1e95e1d0cc6c5f0d0d31052055a5b72b0c95e188b31869c902673db47757c8"}
May 20 14:42:24.820471 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:24.820436    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h" event={"ID":"0892c1e5-d1fd-4652-aae2-5971e7bbaae8","Type":"ContainerStarted","Data":"f6515f01e5d078779eba89b411664d5dae0c5a644ef3a27b341a9055af6c877d"}
May 20 14:42:28.835807 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:28.835772    2571 generic.go:358] "Generic (PLEG): container finished" podID="0892c1e5-d1fd-4652-aae2-5971e7bbaae8" containerID="f6515f01e5d078779eba89b411664d5dae0c5a644ef3a27b341a9055af6c877d" exitCode=0
May 20 14:42:28.836185 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:28.835823    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h" event={"ID":"0892c1e5-d1fd-4652-aae2-5971e7bbaae8","Type":"ContainerDied","Data":"f6515f01e5d078779eba89b411664d5dae0c5a644ef3a27b341a9055af6c877d"}
May 20 14:42:32.853305 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:32.853268    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h" event={"ID":"0892c1e5-d1fd-4652-aae2-5971e7bbaae8","Type":"ContainerStarted","Data":"3144b535bd136fcf577c5da65872ffb0b4a36a8a8d569120e25a801b387cbadd"}
May 20 14:42:32.853654 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:32.853314    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h" event={"ID":"0892c1e5-d1fd-4652-aae2-5971e7bbaae8","Type":"ContainerStarted","Data":"786303395a098f71b84bf6d0caaf0245dea4edfb9d88fc20b221acdc95ceca97"}
May 20 14:42:32.853654 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:32.853518    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h"
May 20 14:42:32.887440 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:32.887376    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h" podStartSLOduration=1.258611809 podStartE2EDuration="13.887360933s" podCreationTimestamp="2026-05-20 14:42:19 +0000 UTC" firstStartedPulling="2026-05-20 14:42:19.763435692 +0000 UTC m=+3149.636222827" lastFinishedPulling="2026-05-20 14:42:32.392184812 +0000 UTC m=+3162.264971951" observedRunningTime="2026-05-20 14:42:32.887250782 +0000 UTC m=+3162.760037938" watchObservedRunningTime="2026-05-20 14:42:32.887360933 +0000 UTC m=+3162.760148089"
May 20 14:42:33.856708 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:33.856675    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h"
May 20 14:42:33.858145 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:33.858115    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h" podUID="0892c1e5-d1fd-4652-aae2-5971e7bbaae8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused"
May 20 14:42:34.859402 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:34.859364    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h" podUID="0892c1e5-d1fd-4652-aae2-5971e7bbaae8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused"
May 20 14:42:39.865663 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:39.865633    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h"
May 20 14:42:39.866272 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:39.866245    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h" podUID="0892c1e5-d1fd-4652-aae2-5971e7bbaae8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused"
May 20 14:42:49.866459 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:42:49.866426    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h"
May 20 14:43:10.451177 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:10.451145    2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h"]
May 20 14:43:10.451697 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:10.451507    2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h" podUID="0892c1e5-d1fd-4652-aae2-5971e7bbaae8" containerName="kserve-container" containerID="cri-o://786303395a098f71b84bf6d0caaf0245dea4edfb9d88fc20b221acdc95ceca97" gracePeriod=30
May 20 14:43:10.451697 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:10.451556    2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h" podUID="0892c1e5-d1fd-4652-aae2-5971e7bbaae8" containerName="kube-rbac-proxy" containerID="cri-o://3144b535bd136fcf577c5da65872ffb0b4a36a8a8d569120e25a801b387cbadd" gracePeriod=30
May 20 14:43:10.541309 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:10.541274    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb"]
May 20 14:43:10.543843 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:10.543824    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb"
May 20 14:43:10.546160 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:10.546140    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-triton-predictor-serving-cert\""
May 20 14:43:10.546250 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:10.546203    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-triton-kube-rbac-proxy-sar-config\""
May 20 14:43:10.557839 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:10.557809    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb"]
May 20 14:43:10.589652 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:10.589625    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9f35b1cf-23f0-44ef-add7-79148ea5be40-proxy-tls\") pod \"isvc-triton-predictor-84bb65d94b-t6ffb\" (UID: \"9f35b1cf-23f0-44ef-add7-79148ea5be40\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb"
May 20 14:43:10.589778 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:10.589669    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4tr5\" (UniqueName: \"kubernetes.io/projected/9f35b1cf-23f0-44ef-add7-79148ea5be40-kube-api-access-g4tr5\") pod \"isvc-triton-predictor-84bb65d94b-t6ffb\" (UID: \"9f35b1cf-23f0-44ef-add7-79148ea5be40\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb"
May 20 14:43:10.589824 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:10.589779    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"isvc-triton-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9f35b1cf-23f0-44ef-add7-79148ea5be40-isvc-triton-kube-rbac-proxy-sar-config\") pod \"isvc-triton-predictor-84bb65d94b-t6ffb\" (UID: \"9f35b1cf-23f0-44ef-add7-79148ea5be40\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb"
May 20 14:43:10.589866 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:10.589828    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9f35b1cf-23f0-44ef-add7-79148ea5be40-cabundle-cert\") pod \"isvc-triton-predictor-84bb65d94b-t6ffb\" (UID: \"9f35b1cf-23f0-44ef-add7-79148ea5be40\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb"
May 20 14:43:10.589866 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:10.589860    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9f35b1cf-23f0-44ef-add7-79148ea5be40-kserve-provision-location\") pod \"isvc-triton-predictor-84bb65d94b-t6ffb\" (UID: \"9f35b1cf-23f0-44ef-add7-79148ea5be40\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb"
May 20 14:43:10.690828 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:10.690793    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9f35b1cf-23f0-44ef-add7-79148ea5be40-proxy-tls\") pod \"isvc-triton-predictor-84bb65d94b-t6ffb\" (UID: \"9f35b1cf-23f0-44ef-add7-79148ea5be40\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb"
May 20 14:43:10.690828 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:10.690831    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g4tr5\" (UniqueName: \"kubernetes.io/projected/9f35b1cf-23f0-44ef-add7-79148ea5be40-kube-api-access-g4tr5\") pod \"isvc-triton-predictor-84bb65d94b-t6ffb\" (UID: \"9f35b1cf-23f0-44ef-add7-79148ea5be40\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb"
May 20 14:43:10.691057 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:10.690877    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"isvc-triton-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9f35b1cf-23f0-44ef-add7-79148ea5be40-isvc-triton-kube-rbac-proxy-sar-config\") pod \"isvc-triton-predictor-84bb65d94b-t6ffb\" (UID: \"9f35b1cf-23f0-44ef-add7-79148ea5be40\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb"
May 20 14:43:10.691057 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:10.690915    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9f35b1cf-23f0-44ef-add7-79148ea5be40-cabundle-cert\") pod \"isvc-triton-predictor-84bb65d94b-t6ffb\" (UID: \"9f35b1cf-23f0-44ef-add7-79148ea5be40\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb"
May 20 14:43:10.691057 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:10.690969    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9f35b1cf-23f0-44ef-add7-79148ea5be40-kserve-provision-location\") pod \"isvc-triton-predictor-84bb65d94b-t6ffb\" (UID: \"9f35b1cf-23f0-44ef-add7-79148ea5be40\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb"
May 20 14:43:10.691434 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:10.691404    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9f35b1cf-23f0-44ef-add7-79148ea5be40-kserve-provision-location\") pod \"isvc-triton-predictor-84bb65d94b-t6ffb\" (UID: \"9f35b1cf-23f0-44ef-add7-79148ea5be40\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb"
May 20 14:43:10.691748 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:10.691724    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"isvc-triton-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9f35b1cf-23f0-44ef-add7-79148ea5be40-isvc-triton-kube-rbac-proxy-sar-config\") pod \"isvc-triton-predictor-84bb65d94b-t6ffb\" (UID: \"9f35b1cf-23f0-44ef-add7-79148ea5be40\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb"
May 20 14:43:10.691820 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:10.691729    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9f35b1cf-23f0-44ef-add7-79148ea5be40-cabundle-cert\") pod \"isvc-triton-predictor-84bb65d94b-t6ffb\" (UID: \"9f35b1cf-23f0-44ef-add7-79148ea5be40\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb"
May 20 14:43:10.693401 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:10.693376    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9f35b1cf-23f0-44ef-add7-79148ea5be40-proxy-tls\") pod \"isvc-triton-predictor-84bb65d94b-t6ffb\" (UID: \"9f35b1cf-23f0-44ef-add7-79148ea5be40\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb"
May 20 14:43:10.700363 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:10.700342    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4tr5\" (UniqueName: \"kubernetes.io/projected/9f35b1cf-23f0-44ef-add7-79148ea5be40-kube-api-access-g4tr5\") pod \"isvc-triton-predictor-84bb65d94b-t6ffb\" (UID: \"9f35b1cf-23f0-44ef-add7-79148ea5be40\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb"
May 20 14:43:10.854801 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:10.854716    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb"
May 20 14:43:10.978292 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:10.978259    2571 generic.go:358] "Generic (PLEG): container finished" podID="0892c1e5-d1fd-4652-aae2-5971e7bbaae8" containerID="3144b535bd136fcf577c5da65872ffb0b4a36a8a8d569120e25a801b387cbadd" exitCode=2
May 20 14:43:10.978444 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:10.978333    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h" event={"ID":"0892c1e5-d1fd-4652-aae2-5971e7bbaae8","Type":"ContainerDied","Data":"3144b535bd136fcf577c5da65872ffb0b4a36a8a8d569120e25a801b387cbadd"}
May 20 14:43:10.986530 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:10.986506    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb"]
May 20 14:43:10.987998 ip-10-0-130-144 kubenswrapper[2571]: W0520 14:43:10.987970    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f35b1cf_23f0_44ef_add7_79148ea5be40.slice/crio-7f9a084d1208b363b5240053d23aa7353cc2aee0cbfa127a8496c20f77410e6d WatchSource:0}: Error finding container 7f9a084d1208b363b5240053d23aa7353cc2aee0cbfa127a8496c20f77410e6d: Status 404 returned error can't find the container with id 7f9a084d1208b363b5240053d23aa7353cc2aee0cbfa127a8496c20f77410e6d
May 20 14:43:11.983482 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:11.983448    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb" event={"ID":"9f35b1cf-23f0-44ef-add7-79148ea5be40","Type":"ContainerStarted","Data":"99dd3f2ddd6fdf73cf5f838f59e64a33560554d8b1de7a1d42ae3a21027dd7e6"}
May 20 14:43:11.983482 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:11.983483    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb" event={"ID":"9f35b1cf-23f0-44ef-add7-79148ea5be40","Type":"ContainerStarted","Data":"7f9a084d1208b363b5240053d23aa7353cc2aee0cbfa127a8496c20f77410e6d"}
May 20 14:43:14.860585 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:14.860543    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h" podUID="0892c1e5-d1fd-4652-aae2-5971e7bbaae8" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.37:8643/healthz\": dial tcp 10.133.0.37:8643: connect: connection refused"
May 20 14:43:14.993967 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:14.993913    2571 generic.go:358] "Generic (PLEG): container finished" podID="9f35b1cf-23f0-44ef-add7-79148ea5be40" containerID="99dd3f2ddd6fdf73cf5f838f59e64a33560554d8b1de7a1d42ae3a21027dd7e6" exitCode=0
May 20 14:43:14.994114 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:14.993987    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb" event={"ID":"9f35b1cf-23f0-44ef-add7-79148ea5be40","Type":"ContainerDied","Data":"99dd3f2ddd6fdf73cf5f838f59e64a33560554d8b1de7a1d42ae3a21027dd7e6"}
May 20 14:43:19.859953 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:19.859895    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h" podUID="0892c1e5-d1fd-4652-aae2-5971e7bbaae8" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.37:8643/healthz\": dial tcp 10.133.0.37:8643: connect: connection refused"
May 20 14:43:24.860065 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:24.860015    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h" podUID="0892c1e5-d1fd-4652-aae2-5971e7bbaae8" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.37:8643/healthz\": dial tcp 10.133.0.37:8643: connect: connection refused"
May 20 14:43:24.860566 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:24.860227    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h"
May 20 14:43:29.860647 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:29.860580    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h" podUID="0892c1e5-d1fd-4652-aae2-5971e7bbaae8" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.37:8643/healthz\": dial tcp 10.133.0.37:8643: connect: connection refused"
May 20 14:43:34.860130 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:34.860065    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h" podUID="0892c1e5-d1fd-4652-aae2-5971e7bbaae8" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.37:8643/healthz\": dial tcp 10.133.0.37:8643: connect: connection refused"
May 20 14:43:39.859792 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:39.859742    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h" podUID="0892c1e5-d1fd-4652-aae2-5971e7bbaae8" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.37:8643/healthz\": dial tcp 10.133.0.37:8643: connect: connection refused"
May 20 14:43:41.117539 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:41.117454    2571 generic.go:358] "Generic (PLEG): container finished" podID="0892c1e5-d1fd-4652-aae2-5971e7bbaae8" containerID="786303395a098f71b84bf6d0caaf0245dea4edfb9d88fc20b221acdc95ceca97" exitCode=137
May 20 14:43:41.118116 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:41.117531    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h" event={"ID":"0892c1e5-d1fd-4652-aae2-5971e7bbaae8","Type":"ContainerDied","Data":"786303395a098f71b84bf6d0caaf0245dea4edfb9d88fc20b221acdc95ceca97"}
May 20 14:43:41.156899 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:41.156869    2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h"
May 20 14:43:41.203579 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:41.202703    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0892c1e5-d1fd-4652-aae2-5971e7bbaae8-kserve-provision-location\") pod \"0892c1e5-d1fd-4652-aae2-5971e7bbaae8\" (UID: \"0892c1e5-d1fd-4652-aae2-5971e7bbaae8\") "
May 20 14:43:41.203579 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:41.202769    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/0892c1e5-d1fd-4652-aae2-5971e7bbaae8-cabundle-cert\") pod \"0892c1e5-d1fd-4652-aae2-5971e7bbaae8\" (UID: \"0892c1e5-d1fd-4652-aae2-5971e7bbaae8\") "
May 20 14:43:41.203579 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:41.202799    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0892c1e5-d1fd-4652-aae2-5971e7bbaae8-proxy-tls\") pod \"0892c1e5-d1fd-4652-aae2-5971e7bbaae8\" (UID: \"0892c1e5-d1fd-4652-aae2-5971e7bbaae8\") "
May 20 14:43:41.203579 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:41.202824    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"isvc-tensorflow-runtime-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0892c1e5-d1fd-4652-aae2-5971e7bbaae8-isvc-tensorflow-runtime-kube-rbac-proxy-sar-config\") pod \"0892c1e5-d1fd-4652-aae2-5971e7bbaae8\" (UID: \"0892c1e5-d1fd-4652-aae2-5971e7bbaae8\") "
May 20 14:43:41.203579 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:41.202898    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwzch\" (UniqueName: \"kubernetes.io/projected/0892c1e5-d1fd-4652-aae2-5971e7bbaae8-kube-api-access-wwzch\") pod \"0892c1e5-d1fd-4652-aae2-5971e7bbaae8\" (UID: \"0892c1e5-d1fd-4652-aae2-5971e7bbaae8\") "
May 20 14:43:41.204037 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:41.203955    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0892c1e5-d1fd-4652-aae2-5971e7bbaae8-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "0892c1e5-d1fd-4652-aae2-5971e7bbaae8" (UID: "0892c1e5-d1fd-4652-aae2-5971e7bbaae8"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 14:43:41.205312 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:41.205277    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0892c1e5-d1fd-4652-aae2-5971e7bbaae8-isvc-tensorflow-runtime-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "isvc-tensorflow-runtime-kube-rbac-proxy-sar-config") pod "0892c1e5-d1fd-4652-aae2-5971e7bbaae8" (UID: "0892c1e5-d1fd-4652-aae2-5971e7bbaae8"). InnerVolumeSpecName "isvc-tensorflow-runtime-kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 14:43:41.208856 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:41.208798    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0892c1e5-d1fd-4652-aae2-5971e7bbaae8-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "0892c1e5-d1fd-4652-aae2-5971e7bbaae8" (UID: "0892c1e5-d1fd-4652-aae2-5971e7bbaae8"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 14:43:41.209335 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:41.209303    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0892c1e5-d1fd-4652-aae2-5971e7bbaae8-kube-api-access-wwzch" (OuterVolumeSpecName: "kube-api-access-wwzch") pod "0892c1e5-d1fd-4652-aae2-5971e7bbaae8" (UID: "0892c1e5-d1fd-4652-aae2-5971e7bbaae8"). InnerVolumeSpecName "kube-api-access-wwzch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 14:43:41.216229 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:41.215705    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0892c1e5-d1fd-4652-aae2-5971e7bbaae8-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "0892c1e5-d1fd-4652-aae2-5971e7bbaae8" (UID: "0892c1e5-d1fd-4652-aae2-5971e7bbaae8"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 14:43:41.304399 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:41.304314    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwzch\" (UniqueName: \"kubernetes.io/projected/0892c1e5-d1fd-4652-aae2-5971e7bbaae8-kube-api-access-wwzch\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 14:43:41.304399 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:41.304353    2571 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0892c1e5-d1fd-4652-aae2-5971e7bbaae8-kserve-provision-location\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 14:43:41.304399 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:41.304370    2571 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/0892c1e5-d1fd-4652-aae2-5971e7bbaae8-cabundle-cert\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 14:43:41.304399 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:41.304387    2571 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0892c1e5-d1fd-4652-aae2-5971e7bbaae8-proxy-tls\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 14:43:41.304696 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:41.304418    2571 reconciler_common.go:299] "Volume detached for volume \"isvc-tensorflow-runtime-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0892c1e5-d1fd-4652-aae2-5971e7bbaae8-isvc-tensorflow-runtime-kube-rbac-proxy-sar-config\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 14:43:42.124774 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:42.124686    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h" event={"ID":"0892c1e5-d1fd-4652-aae2-5971e7bbaae8","Type":"ContainerDied","Data":"ef1e95e1d0cc6c5f0d0d31052055a5b72b0c95e188b31869c902673db47757c8"}
May 20 14:43:42.124774 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:42.124730    2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h"
May 20 14:43:42.124774 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:42.124746    2571 scope.go:117] "RemoveContainer" containerID="3144b535bd136fcf577c5da65872ffb0b4a36a8a8d569120e25a801b387cbadd"
May 20 14:43:42.136181 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:42.136139    2571 scope.go:117] "RemoveContainer" containerID="786303395a098f71b84bf6d0caaf0245dea4edfb9d88fc20b221acdc95ceca97"
May 20 14:43:42.147063 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:42.147036    2571 scope.go:117] "RemoveContainer" containerID="f6515f01e5d078779eba89b411664d5dae0c5a644ef3a27b341a9055af6c877d"
May 20 14:43:42.157002 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:42.156952    2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h"]
May 20 14:43:42.165709 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:42.165657    2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-8699d78cf-vc58h"]
May 20 14:43:42.668663 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:43:42.668624    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0892c1e5-d1fd-4652-aae2-5971e7bbaae8" path="/var/lib/kubelet/pods/0892c1e5-d1fd-4652-aae2-5971e7bbaae8/volumes"
May 20 14:45:09.452699 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:09.452655    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb" event={"ID":"9f35b1cf-23f0-44ef-add7-79148ea5be40","Type":"ContainerStarted","Data":"0987857d3ede700720be13df6dafb21c9d1c6dd5252c69aaca5080574fca5629"}
May 20 14:45:09.453212 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:09.452707    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb" event={"ID":"9f35b1cf-23f0-44ef-add7-79148ea5be40","Type":"ContainerStarted","Data":"a409bc2209a9e870af09db4d233f7a6e0a785aefa17806e2b579771c7391ba29"}
May 20 14:45:09.453212 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:09.452964    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb"
May 20 14:45:09.453212 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:09.453127    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb"
May 20 14:45:09.454170 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:09.454141    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb" podUID="9f35b1cf-23f0-44ef-add7-79148ea5be40" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.38:8080: connect: connection refused"
May 20 14:45:09.483198 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:09.483139    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb" podStartSLOduration=5.314513474 podStartE2EDuration="1m59.483120203s" podCreationTimestamp="2026-05-20 14:43:10 +0000 UTC" firstStartedPulling="2026-05-20 14:43:14.995072994 +0000 UTC m=+3204.867860130" lastFinishedPulling="2026-05-20 14:45:09.163679724 +0000 UTC m=+3319.036466859" observedRunningTime="2026-05-20 14:45:09.480376988 +0000 UTC m=+3319.353164146" watchObservedRunningTime="2026-05-20 14:45:09.483120203 +0000 UTC m=+3319.355907361"
May 20 14:45:10.455696 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:10.455606    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb" podUID="9f35b1cf-23f0-44ef-add7-79148ea5be40" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.38:8080: connect: connection refused"
May 20 14:45:15.459970 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:15.459919    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb"
May 20 14:45:15.460516 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:15.460483    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb" podUID="9f35b1cf-23f0-44ef-add7-79148ea5be40" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.38:8080: connect: connection refused"
May 20 14:45:25.461591 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:25.461559    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb"
May 20 14:45:32.364143 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:32.364105    2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb"]
May 20 14:45:32.364619 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:32.364421    2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb" podUID="9f35b1cf-23f0-44ef-add7-79148ea5be40" containerName="kserve-container" containerID="cri-o://a409bc2209a9e870af09db4d233f7a6e0a785aefa17806e2b579771c7391ba29" gracePeriod=30
May 20 14:45:32.364619 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:32.364472    2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb" podUID="9f35b1cf-23f0-44ef-add7-79148ea5be40" containerName="kube-rbac-proxy" containerID="cri-o://0987857d3ede700720be13df6dafb21c9d1c6dd5252c69aaca5080574fca5629" gracePeriod=30
May 20 14:45:32.504488 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:32.504455    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7"]
May 20 14:45:32.504856 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:32.504841    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0892c1e5-d1fd-4652-aae2-5971e7bbaae8" containerName="kube-rbac-proxy"
May 20 14:45:32.504856 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:32.504857    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0892c1e5-d1fd-4652-aae2-5971e7bbaae8" containerName="kube-rbac-proxy"
May 20 14:45:32.504950 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:32.504875    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0892c1e5-d1fd-4652-aae2-5971e7bbaae8" containerName="kserve-container"
May 20 14:45:32.504950 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:32.504881    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0892c1e5-d1fd-4652-aae2-5971e7bbaae8" containerName="kserve-container"
May 20 14:45:32.504950 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:32.504889    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0892c1e5-d1fd-4652-aae2-5971e7bbaae8" containerName="storage-initializer"
May 20 14:45:32.504950 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:32.504895    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0892c1e5-d1fd-4652-aae2-5971e7bbaae8" containerName="storage-initializer"
May 20 14:45:32.505117 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:32.504975    2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="0892c1e5-d1fd-4652-aae2-5971e7bbaae8" containerName="kserve-container"
May 20 14:45:32.505117 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:32.504990    2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="0892c1e5-d1fd-4652-aae2-5971e7bbaae8" containerName="kube-rbac-proxy"
May 20 14:45:32.519421 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:32.519378    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7"
May 20 14:45:32.522149 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:32.521885    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-kube-rbac-proxy-sar-config\""
May 20 14:45:32.522431 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:32.522405    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-predictor-serving-cert\""
May 20 14:45:32.524292 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:32.524269    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7"]
May 20 14:45:32.532365 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:32.532339    2571 generic.go:358] "Generic (PLEG): container finished" podID="9f35b1cf-23f0-44ef-add7-79148ea5be40" containerID="0987857d3ede700720be13df6dafb21c9d1c6dd5252c69aaca5080574fca5629" exitCode=2
May 20 14:45:32.532469 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:32.532408    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb" event={"ID":"9f35b1cf-23f0-44ef-add7-79148ea5be40","Type":"ContainerDied","Data":"0987857d3ede700720be13df6dafb21c9d1c6dd5252c69aaca5080574fca5629"}
May 20 14:45:32.652200 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:32.652113    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3c7f0c94-7af1-4149-9238-00fe8daf4d17-kserve-provision-location\") pod \"isvc-xgboost-predictor-8689c4cfcc-8vsc7\" (UID: \"3c7f0c94-7af1-4149-9238-00fe8daf4d17\") " pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7"
May 20 14:45:32.652200 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:32.652157    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3c7f0c94-7af1-4149-9238-00fe8daf4d17-proxy-tls\") pod \"isvc-xgboost-predictor-8689c4cfcc-8vsc7\" (UID: \"3c7f0c94-7af1-4149-9238-00fe8daf4d17\") " pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7"
May 20 14:45:32.652200 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:32.652193    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/3c7f0c94-7af1-4149-9238-00fe8daf4d17-cabundle-cert\") pod \"isvc-xgboost-predictor-8689c4cfcc-8vsc7\" (UID: \"3c7f0c94-7af1-4149-9238-00fe8daf4d17\") " pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7"
May 20 14:45:32.652427 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:32.652233    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"isvc-xgboost-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3c7f0c94-7af1-4149-9238-00fe8daf4d17-isvc-xgboost-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-predictor-8689c4cfcc-8vsc7\" (UID: \"3c7f0c94-7af1-4149-9238-00fe8daf4d17\") " pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7"
May 20 14:45:32.652427 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:32.652262    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crcbf\" (UniqueName: \"kubernetes.io/projected/3c7f0c94-7af1-4149-9238-00fe8daf4d17-kube-api-access-crcbf\") pod \"isvc-xgboost-predictor-8689c4cfcc-8vsc7\" (UID: \"3c7f0c94-7af1-4149-9238-00fe8daf4d17\") " pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7"
May 20 14:45:32.753122 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:32.753083    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3c7f0c94-7af1-4149-9238-00fe8daf4d17-kserve-provision-location\") pod \"isvc-xgboost-predictor-8689c4cfcc-8vsc7\" (UID: \"3c7f0c94-7af1-4149-9238-00fe8daf4d17\") " pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7"
May 20 14:45:32.753291 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:32.753130    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3c7f0c94-7af1-4149-9238-00fe8daf4d17-proxy-tls\") pod \"isvc-xgboost-predictor-8689c4cfcc-8vsc7\" (UID: \"3c7f0c94-7af1-4149-9238-00fe8daf4d17\") " pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7"
May 20 14:45:32.753291 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:32.753157    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/3c7f0c94-7af1-4149-9238-00fe8daf4d17-cabundle-cert\") pod \"isvc-xgboost-predictor-8689c4cfcc-8vsc7\" (UID: \"3c7f0c94-7af1-4149-9238-00fe8daf4d17\") " pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7"
May 20 14:45:32.753291 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:32.753210    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"isvc-xgboost-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3c7f0c94-7af1-4149-9238-00fe8daf4d17-isvc-xgboost-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-predictor-8689c4cfcc-8vsc7\" (UID: \"3c7f0c94-7af1-4149-9238-00fe8daf4d17\") " pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7"
May 20 14:45:32.753291 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:32.753242    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-crcbf\" (UniqueName: \"kubernetes.io/projected/3c7f0c94-7af1-4149-9238-00fe8daf4d17-kube-api-access-crcbf\") pod \"isvc-xgboost-predictor-8689c4cfcc-8vsc7\" (UID: \"3c7f0c94-7af1-4149-9238-00fe8daf4d17\") " pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7"
May 20 14:45:32.753578 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:32.753554    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3c7f0c94-7af1-4149-9238-00fe8daf4d17-kserve-provision-location\") pod \"isvc-xgboost-predictor-8689c4cfcc-8vsc7\" (UID: \"3c7f0c94-7af1-4149-9238-00fe8daf4d17\") " pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7"
May 20 14:45:32.753964 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:32.753917    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/3c7f0c94-7af1-4149-9238-00fe8daf4d17-cabundle-cert\") pod \"isvc-xgboost-predictor-8689c4cfcc-8vsc7\" (UID: \"3c7f0c94-7af1-4149-9238-00fe8daf4d17\") " pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7"
May 20 14:45:32.754058 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:32.753981    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"isvc-xgboost-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3c7f0c94-7af1-4149-9238-00fe8daf4d17-isvc-xgboost-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-predictor-8689c4cfcc-8vsc7\" (UID: \"3c7f0c94-7af1-4149-9238-00fe8daf4d17\") " pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7"
May 20 14:45:32.755628 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:32.755608    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3c7f0c94-7af1-4149-9238-00fe8daf4d17-proxy-tls\") pod \"isvc-xgboost-predictor-8689c4cfcc-8vsc7\" (UID: \"3c7f0c94-7af1-4149-9238-00fe8daf4d17\") " pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7"
May 20 14:45:32.762573 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:32.762544    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crcbf\" (UniqueName: \"kubernetes.io/projected/3c7f0c94-7af1-4149-9238-00fe8daf4d17-kube-api-access-crcbf\") pod \"isvc-xgboost-predictor-8689c4cfcc-8vsc7\" (UID: \"3c7f0c94-7af1-4149-9238-00fe8daf4d17\") " pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7"
May 20 14:45:32.832338 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:32.832295    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7"
May 20 14:45:32.965781 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:32.965737    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7"]
May 20 14:45:32.968755 ip-10-0-130-144 kubenswrapper[2571]: W0520 14:45:32.968725    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c7f0c94_7af1_4149_9238_00fe8daf4d17.slice/crio-6eb1939b79cb844885c05f5f1fc7183cb14e5e0472227a9054ebb016a0670a16 WatchSource:0}: Error finding container 6eb1939b79cb844885c05f5f1fc7183cb14e5e0472227a9054ebb016a0670a16: Status 404 returned error can't find the container with id 6eb1939b79cb844885c05f5f1fc7183cb14e5e0472227a9054ebb016a0670a16
May 20 14:45:33.537595 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:33.537560    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7" event={"ID":"3c7f0c94-7af1-4149-9238-00fe8daf4d17","Type":"ContainerStarted","Data":"6ecc3ecb3ac6398c6bc42d8e67edaebb8feafd0dd40eded8c852ce7c5a48d959"}
May 20 14:45:33.537595 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:33.537597    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7" event={"ID":"3c7f0c94-7af1-4149-9238-00fe8daf4d17","Type":"ContainerStarted","Data":"6eb1939b79cb844885c05f5f1fc7183cb14e5e0472227a9054ebb016a0670a16"}
May 20 14:45:35.131622 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:35.131595    2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb"
May 20 14:45:35.276644 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:35.276573    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9f35b1cf-23f0-44ef-add7-79148ea5be40-proxy-tls\") pod \"9f35b1cf-23f0-44ef-add7-79148ea5be40\" (UID: \"9f35b1cf-23f0-44ef-add7-79148ea5be40\") "
May 20 14:45:35.276793 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:35.276666    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9f35b1cf-23f0-44ef-add7-79148ea5be40-kserve-provision-location\") pod \"9f35b1cf-23f0-44ef-add7-79148ea5be40\" (UID: \"9f35b1cf-23f0-44ef-add7-79148ea5be40\") "
May 20 14:45:35.276793 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:35.276691    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9f35b1cf-23f0-44ef-add7-79148ea5be40-cabundle-cert\") pod \"9f35b1cf-23f0-44ef-add7-79148ea5be40\" (UID: \"9f35b1cf-23f0-44ef-add7-79148ea5be40\") "
May 20 14:45:35.276793 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:35.276711    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4tr5\" (UniqueName: \"kubernetes.io/projected/9f35b1cf-23f0-44ef-add7-79148ea5be40-kube-api-access-g4tr5\") pod \"9f35b1cf-23f0-44ef-add7-79148ea5be40\" (UID: \"9f35b1cf-23f0-44ef-add7-79148ea5be40\") "
May 20 14:45:35.276793 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:35.276730    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"isvc-triton-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9f35b1cf-23f0-44ef-add7-79148ea5be40-isvc-triton-kube-rbac-proxy-sar-config\") pod \"9f35b1cf-23f0-44ef-add7-79148ea5be40\" (UID: \"9f35b1cf-23f0-44ef-add7-79148ea5be40\") "
May 20 14:45:35.277086 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:35.277057    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f35b1cf-23f0-44ef-add7-79148ea5be40-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "9f35b1cf-23f0-44ef-add7-79148ea5be40" (UID: "9f35b1cf-23f0-44ef-add7-79148ea5be40"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 14:45:35.277284 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:35.277260    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f35b1cf-23f0-44ef-add7-79148ea5be40-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "9f35b1cf-23f0-44ef-add7-79148ea5be40" (UID: "9f35b1cf-23f0-44ef-add7-79148ea5be40"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 14:45:35.277332 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:35.277260    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f35b1cf-23f0-44ef-add7-79148ea5be40-isvc-triton-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "isvc-triton-kube-rbac-proxy-sar-config") pod "9f35b1cf-23f0-44ef-add7-79148ea5be40" (UID: "9f35b1cf-23f0-44ef-add7-79148ea5be40"). InnerVolumeSpecName "isvc-triton-kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 14:45:35.278680 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:35.278662    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f35b1cf-23f0-44ef-add7-79148ea5be40-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "9f35b1cf-23f0-44ef-add7-79148ea5be40" (UID: "9f35b1cf-23f0-44ef-add7-79148ea5be40"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 14:45:35.278749 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:35.278723    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f35b1cf-23f0-44ef-add7-79148ea5be40-kube-api-access-g4tr5" (OuterVolumeSpecName: "kube-api-access-g4tr5") pod "9f35b1cf-23f0-44ef-add7-79148ea5be40" (UID: "9f35b1cf-23f0-44ef-add7-79148ea5be40"). InnerVolumeSpecName "kube-api-access-g4tr5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 14:45:35.377906 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:35.377863    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4tr5\" (UniqueName: \"kubernetes.io/projected/9f35b1cf-23f0-44ef-add7-79148ea5be40-kube-api-access-g4tr5\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 14:45:35.377906 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:35.377903    2571 reconciler_common.go:299] "Volume detached for volume \"isvc-triton-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9f35b1cf-23f0-44ef-add7-79148ea5be40-isvc-triton-kube-rbac-proxy-sar-config\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 14:45:35.377906 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:35.377914    2571 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9f35b1cf-23f0-44ef-add7-79148ea5be40-proxy-tls\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 14:45:35.378156 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:35.377925    2571 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9f35b1cf-23f0-44ef-add7-79148ea5be40-kserve-provision-location\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 14:45:35.378156 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:35.377950    2571 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9f35b1cf-23f0-44ef-add7-79148ea5be40-cabundle-cert\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 14:45:35.546948 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:35.546858    2571 generic.go:358] "Generic (PLEG): container finished" podID="9f35b1cf-23f0-44ef-add7-79148ea5be40" containerID="a409bc2209a9e870af09db4d233f7a6e0a785aefa17806e2b579771c7391ba29" exitCode=0
May 20 14:45:35.547080 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:35.546951    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb" event={"ID":"9f35b1cf-23f0-44ef-add7-79148ea5be40","Type":"ContainerDied","Data":"a409bc2209a9e870af09db4d233f7a6e0a785aefa17806e2b579771c7391ba29"}
May 20 14:45:35.547080 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:35.546970    2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb"
May 20 14:45:35.547080 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:35.546981    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb" event={"ID":"9f35b1cf-23f0-44ef-add7-79148ea5be40","Type":"ContainerDied","Data":"7f9a084d1208b363b5240053d23aa7353cc2aee0cbfa127a8496c20f77410e6d"}
May 20 14:45:35.547080 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:35.546999    2571 scope.go:117] "RemoveContainer" containerID="0987857d3ede700720be13df6dafb21c9d1c6dd5252c69aaca5080574fca5629"
May 20 14:45:35.556137 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:35.556117    2571 scope.go:117] "RemoveContainer" containerID="a409bc2209a9e870af09db4d233f7a6e0a785aefa17806e2b579771c7391ba29"
May 20 14:45:35.563401 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:35.563386    2571 scope.go:117] "RemoveContainer" containerID="99dd3f2ddd6fdf73cf5f838f59e64a33560554d8b1de7a1d42ae3a21027dd7e6"
May 20 14:45:35.570735 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:35.570710    2571 scope.go:117] "RemoveContainer" containerID="0987857d3ede700720be13df6dafb21c9d1c6dd5252c69aaca5080574fca5629"
May 20 14:45:35.571024 ip-10-0-130-144 kubenswrapper[2571]: E0520 14:45:35.571005    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0987857d3ede700720be13df6dafb21c9d1c6dd5252c69aaca5080574fca5629\": container with ID starting with 0987857d3ede700720be13df6dafb21c9d1c6dd5252c69aaca5080574fca5629 not found: ID does not exist" containerID="0987857d3ede700720be13df6dafb21c9d1c6dd5252c69aaca5080574fca5629"
May 20 14:45:35.571086 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:35.571041    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0987857d3ede700720be13df6dafb21c9d1c6dd5252c69aaca5080574fca5629"} err="failed to get container status \"0987857d3ede700720be13df6dafb21c9d1c6dd5252c69aaca5080574fca5629\": rpc error: code = NotFound desc = could not find container \"0987857d3ede700720be13df6dafb21c9d1c6dd5252c69aaca5080574fca5629\": container with ID starting with 0987857d3ede700720be13df6dafb21c9d1c6dd5252c69aaca5080574fca5629 not found: ID does not exist"
May 20 14:45:35.571086 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:35.571061    2571 scope.go:117] "RemoveContainer" containerID="a409bc2209a9e870af09db4d233f7a6e0a785aefa17806e2b579771c7391ba29"
May 20 14:45:35.571325 ip-10-0-130-144 kubenswrapper[2571]: E0520 14:45:35.571305    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a409bc2209a9e870af09db4d233f7a6e0a785aefa17806e2b579771c7391ba29\": container with ID starting with a409bc2209a9e870af09db4d233f7a6e0a785aefa17806e2b579771c7391ba29 not found: ID does not exist" containerID="a409bc2209a9e870af09db4d233f7a6e0a785aefa17806e2b579771c7391ba29"
May 20 14:45:35.571381 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:35.571335    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a409bc2209a9e870af09db4d233f7a6e0a785aefa17806e2b579771c7391ba29"} err="failed to get container status \"a409bc2209a9e870af09db4d233f7a6e0a785aefa17806e2b579771c7391ba29\": rpc error: code = NotFound desc = could not find container \"a409bc2209a9e870af09db4d233f7a6e0a785aefa17806e2b579771c7391ba29\": container with ID starting with a409bc2209a9e870af09db4d233f7a6e0a785aefa17806e2b579771c7391ba29 not found: ID does not exist"
May 20 14:45:35.571381 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:35.571360    2571 scope.go:117] "RemoveContainer" containerID="99dd3f2ddd6fdf73cf5f838f59e64a33560554d8b1de7a1d42ae3a21027dd7e6"
May 20 14:45:35.571465 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:35.571384    2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb"]
May 20 14:45:35.571628 ip-10-0-130-144 kubenswrapper[2571]: E0520 14:45:35.571611    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99dd3f2ddd6fdf73cf5f838f59e64a33560554d8b1de7a1d42ae3a21027dd7e6\": container with ID starting with 99dd3f2ddd6fdf73cf5f838f59e64a33560554d8b1de7a1d42ae3a21027dd7e6 not found: ID does not exist" containerID="99dd3f2ddd6fdf73cf5f838f59e64a33560554d8b1de7a1d42ae3a21027dd7e6"
May 20 14:45:35.571681 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:35.571634    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99dd3f2ddd6fdf73cf5f838f59e64a33560554d8b1de7a1d42ae3a21027dd7e6"} err="failed to get container status \"99dd3f2ddd6fdf73cf5f838f59e64a33560554d8b1de7a1d42ae3a21027dd7e6\": rpc error: code = NotFound desc = could not find container \"99dd3f2ddd6fdf73cf5f838f59e64a33560554d8b1de7a1d42ae3a21027dd7e6\": container with ID starting with 99dd3f2ddd6fdf73cf5f838f59e64a33560554d8b1de7a1d42ae3a21027dd7e6 not found: ID does not exist"
May 20 14:45:35.576720 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:35.576700    2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-triton-predictor-84bb65d94b-t6ffb"]
May 20 14:45:36.673354 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:36.673319    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f35b1cf-23f0-44ef-add7-79148ea5be40" path="/var/lib/kubelet/pods/9f35b1cf-23f0-44ef-add7-79148ea5be40/volumes"
May 20 14:45:37.555713 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:37.555676    2571 generic.go:358] "Generic (PLEG): container finished" podID="3c7f0c94-7af1-4149-9238-00fe8daf4d17" containerID="6ecc3ecb3ac6398c6bc42d8e67edaebb8feafd0dd40eded8c852ce7c5a48d959" exitCode=0
May 20 14:45:37.555713 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:37.555717    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7" event={"ID":"3c7f0c94-7af1-4149-9238-00fe8daf4d17","Type":"ContainerDied","Data":"6ecc3ecb3ac6398c6bc42d8e67edaebb8feafd0dd40eded8c852ce7c5a48d959"}
May 20 14:45:58.631874 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:58.631835    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7" event={"ID":"3c7f0c94-7af1-4149-9238-00fe8daf4d17","Type":"ContainerStarted","Data":"ee926145b696a7d17b86e245180677b31a3c45123d16d9dfb688a3d4b68bd684"}
May 20 14:45:58.631874 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:58.631881    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7" event={"ID":"3c7f0c94-7af1-4149-9238-00fe8daf4d17","Type":"ContainerStarted","Data":"dbf069575a7644b647cb8f82bd843120633588ade32a158d6e5c61717f0fce84"}
May 20 14:45:58.632421 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:58.632197    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7"
May 20 14:45:58.632421 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:58.632345    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7"
May 20 14:45:58.633650 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:58.633623    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7" podUID="3c7f0c94-7af1-4149-9238-00fe8daf4d17" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.39:8080: connect: connection refused"
May 20 14:45:58.654765 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:58.654709    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7" podStartSLOduration=6.235298284 podStartE2EDuration="26.654690132s" podCreationTimestamp="2026-05-20 14:45:32 +0000 UTC" firstStartedPulling="2026-05-20 14:45:37.557047791 +0000 UTC m=+3347.429834926" lastFinishedPulling="2026-05-20 14:45:57.976439638 +0000 UTC m=+3367.849226774" observedRunningTime="2026-05-20 14:45:58.651579676 +0000 UTC m=+3368.524366833" watchObservedRunningTime="2026-05-20 14:45:58.654690132 +0000 UTC m=+3368.527477290"
May 20 14:45:59.635716 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:45:59.635674    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7" podUID="3c7f0c94-7af1-4149-9238-00fe8daf4d17" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.39:8080: connect: connection refused"
May 20 14:46:04.639824 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:46:04.639795    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7"
May 20 14:46:04.640453 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:46:04.640420    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7" podUID="3c7f0c94-7af1-4149-9238-00fe8daf4d17" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.39:8080: connect: connection refused"
May 20 14:46:14.641151 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:46:14.641112    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7" podUID="3c7f0c94-7af1-4149-9238-00fe8daf4d17" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.39:8080: connect: connection refused"
May 20 14:46:24.640987 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:46:24.640926    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7" podUID="3c7f0c94-7af1-4149-9238-00fe8daf4d17" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.39:8080: connect: connection refused"
May 20 14:46:34.640578 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:46:34.640532    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7" podUID="3c7f0c94-7af1-4149-9238-00fe8daf4d17" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.39:8080: connect: connection refused"
May 20 14:46:44.640849 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:46:44.640801    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7" podUID="3c7f0c94-7af1-4149-9238-00fe8daf4d17" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.39:8080: connect: connection refused"
May 20 14:46:54.640833 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:46:54.640789    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7" podUID="3c7f0c94-7af1-4149-9238-00fe8daf4d17" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.39:8080: connect: connection refused"
May 20 14:47:04.641377 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:04.641346    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7"
May 20 14:47:12.578898 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:12.578863    2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7"]
May 20 14:47:12.579324 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:12.579207    2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7" podUID="3c7f0c94-7af1-4149-9238-00fe8daf4d17" containerName="kserve-container" containerID="cri-o://dbf069575a7644b647cb8f82bd843120633588ade32a158d6e5c61717f0fce84" gracePeriod=30
May 20 14:47:12.579324 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:12.579267    2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7" podUID="3c7f0c94-7af1-4149-9238-00fe8daf4d17" containerName="kube-rbac-proxy" containerID="cri-o://ee926145b696a7d17b86e245180677b31a3c45123d16d9dfb688a3d4b68bd684" gracePeriod=30
May 20 14:47:12.871171 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:12.871092    2571 generic.go:358] "Generic (PLEG): container finished" podID="3c7f0c94-7af1-4149-9238-00fe8daf4d17" containerID="ee926145b696a7d17b86e245180677b31a3c45123d16d9dfb688a3d4b68bd684" exitCode=2
May 20 14:47:12.871337 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:12.871168    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7" event={"ID":"3c7f0c94-7af1-4149-9238-00fe8daf4d17","Type":"ContainerDied","Data":"ee926145b696a7d17b86e245180677b31a3c45123d16d9dfb688a3d4b68bd684"}
May 20 14:47:14.636461 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:14.636419    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7" podUID="3c7f0c94-7af1-4149-9238-00fe8daf4d17" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.39:8643/healthz\": dial tcp 10.133.0.39:8643: connect: connection refused"
May 20 14:47:14.640742 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:14.640717    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7" podUID="3c7f0c94-7af1-4149-9238-00fe8daf4d17" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.39:8080: connect: connection refused"
May 20 14:47:16.430086 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:16.430056    2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7"
May 20 14:47:16.587246 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:16.587161    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/3c7f0c94-7af1-4149-9238-00fe8daf4d17-cabundle-cert\") pod \"3c7f0c94-7af1-4149-9238-00fe8daf4d17\" (UID: \"3c7f0c94-7af1-4149-9238-00fe8daf4d17\") "
May 20 14:47:16.587246 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:16.587223    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3c7f0c94-7af1-4149-9238-00fe8daf4d17-proxy-tls\") pod \"3c7f0c94-7af1-4149-9238-00fe8daf4d17\" (UID: \"3c7f0c94-7af1-4149-9238-00fe8daf4d17\") "
May 20 14:47:16.587423 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:16.587256    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3c7f0c94-7af1-4149-9238-00fe8daf4d17-kserve-provision-location\") pod \"3c7f0c94-7af1-4149-9238-00fe8daf4d17\" (UID: \"3c7f0c94-7af1-4149-9238-00fe8daf4d17\") "
May 20 14:47:16.587468 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:16.587417    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"isvc-xgboost-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3c7f0c94-7af1-4149-9238-00fe8daf4d17-isvc-xgboost-kube-rbac-proxy-sar-config\") pod \"3c7f0c94-7af1-4149-9238-00fe8daf4d17\" (UID: \"3c7f0c94-7af1-4149-9238-00fe8daf4d17\") "
May 20 14:47:16.587519 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:16.587502    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crcbf\" (UniqueName: \"kubernetes.io/projected/3c7f0c94-7af1-4149-9238-00fe8daf4d17-kube-api-access-crcbf\") pod \"3c7f0c94-7af1-4149-9238-00fe8daf4d17\" (UID: \"3c7f0c94-7af1-4149-9238-00fe8daf4d17\") "
May 20 14:47:16.587569 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:16.587530    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c7f0c94-7af1-4149-9238-00fe8daf4d17-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "3c7f0c94-7af1-4149-9238-00fe8daf4d17" (UID: "3c7f0c94-7af1-4149-9238-00fe8daf4d17"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 14:47:16.587623 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:16.587595    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c7f0c94-7af1-4149-9238-00fe8daf4d17-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "3c7f0c94-7af1-4149-9238-00fe8daf4d17" (UID: "3c7f0c94-7af1-4149-9238-00fe8daf4d17"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 14:47:16.587818 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:16.587786    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c7f0c94-7af1-4149-9238-00fe8daf4d17-isvc-xgboost-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "isvc-xgboost-kube-rbac-proxy-sar-config") pod "3c7f0c94-7af1-4149-9238-00fe8daf4d17" (UID: "3c7f0c94-7af1-4149-9238-00fe8daf4d17"). InnerVolumeSpecName "isvc-xgboost-kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 14:47:16.587818 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:16.587811    2571 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/3c7f0c94-7af1-4149-9238-00fe8daf4d17-cabundle-cert\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 14:47:16.587920 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:16.587828    2571 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3c7f0c94-7af1-4149-9238-00fe8daf4d17-kserve-provision-location\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 14:47:16.589347 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:16.589314    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c7f0c94-7af1-4149-9238-00fe8daf4d17-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "3c7f0c94-7af1-4149-9238-00fe8daf4d17" (UID: "3c7f0c94-7af1-4149-9238-00fe8daf4d17"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 14:47:16.589510 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:16.589482    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c7f0c94-7af1-4149-9238-00fe8daf4d17-kube-api-access-crcbf" (OuterVolumeSpecName: "kube-api-access-crcbf") pod "3c7f0c94-7af1-4149-9238-00fe8daf4d17" (UID: "3c7f0c94-7af1-4149-9238-00fe8daf4d17"). InnerVolumeSpecName "kube-api-access-crcbf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 14:47:16.688949 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:16.688901    2571 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3c7f0c94-7af1-4149-9238-00fe8daf4d17-proxy-tls\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 14:47:16.688949 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:16.688955    2571 reconciler_common.go:299] "Volume detached for volume \"isvc-xgboost-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3c7f0c94-7af1-4149-9238-00fe8daf4d17-isvc-xgboost-kube-rbac-proxy-sar-config\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 14:47:16.689129 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:16.688967    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crcbf\" (UniqueName: \"kubernetes.io/projected/3c7f0c94-7af1-4149-9238-00fe8daf4d17-kube-api-access-crcbf\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 14:47:16.892576 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:16.892496    2571 generic.go:358] "Generic (PLEG): container finished" podID="3c7f0c94-7af1-4149-9238-00fe8daf4d17" containerID="dbf069575a7644b647cb8f82bd843120633588ade32a158d6e5c61717f0fce84" exitCode=0
May 20 14:47:16.892716 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:16.892577    2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7"
May 20 14:47:16.892716 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:16.892577    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7" event={"ID":"3c7f0c94-7af1-4149-9238-00fe8daf4d17","Type":"ContainerDied","Data":"dbf069575a7644b647cb8f82bd843120633588ade32a158d6e5c61717f0fce84"}
May 20 14:47:16.892716 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:16.892622    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7" event={"ID":"3c7f0c94-7af1-4149-9238-00fe8daf4d17","Type":"ContainerDied","Data":"6eb1939b79cb844885c05f5f1fc7183cb14e5e0472227a9054ebb016a0670a16"}
May 20 14:47:16.892716 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:16.892643    2571 scope.go:117] "RemoveContainer" containerID="ee926145b696a7d17b86e245180677b31a3c45123d16d9dfb688a3d4b68bd684"
May 20 14:47:16.900674 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:16.900657    2571 scope.go:117] "RemoveContainer" containerID="dbf069575a7644b647cb8f82bd843120633588ade32a158d6e5c61717f0fce84"
May 20 14:47:16.908005 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:16.907981    2571 scope.go:117] "RemoveContainer" containerID="6ecc3ecb3ac6398c6bc42d8e67edaebb8feafd0dd40eded8c852ce7c5a48d959"
May 20 14:47:16.910711 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:16.910690    2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7"]
May 20 14:47:16.915037 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:16.915014    2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-predictor-8689c4cfcc-8vsc7"]
May 20 14:47:16.916855 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:16.916840    2571 scope.go:117] "RemoveContainer" containerID="ee926145b696a7d17b86e245180677b31a3c45123d16d9dfb688a3d4b68bd684"
May 20 14:47:16.917126 ip-10-0-130-144 kubenswrapper[2571]: E0520 14:47:16.917105    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee926145b696a7d17b86e245180677b31a3c45123d16d9dfb688a3d4b68bd684\": container with ID starting with ee926145b696a7d17b86e245180677b31a3c45123d16d9dfb688a3d4b68bd684 not found: ID does not exist" containerID="ee926145b696a7d17b86e245180677b31a3c45123d16d9dfb688a3d4b68bd684"
May 20 14:47:16.917191 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:16.917135    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee926145b696a7d17b86e245180677b31a3c45123d16d9dfb688a3d4b68bd684"} err="failed to get container status \"ee926145b696a7d17b86e245180677b31a3c45123d16d9dfb688a3d4b68bd684\": rpc error: code = NotFound desc = could not find container \"ee926145b696a7d17b86e245180677b31a3c45123d16d9dfb688a3d4b68bd684\": container with ID starting with ee926145b696a7d17b86e245180677b31a3c45123d16d9dfb688a3d4b68bd684 not found: ID does not exist"
May 20 14:47:16.917191 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:16.917155    2571 scope.go:117] "RemoveContainer" containerID="dbf069575a7644b647cb8f82bd843120633588ade32a158d6e5c61717f0fce84"
May 20 14:47:16.917354 ip-10-0-130-144 kubenswrapper[2571]: E0520 14:47:16.917340    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbf069575a7644b647cb8f82bd843120633588ade32a158d6e5c61717f0fce84\": container with ID starting with dbf069575a7644b647cb8f82bd843120633588ade32a158d6e5c61717f0fce84 not found: ID does not exist" containerID="dbf069575a7644b647cb8f82bd843120633588ade32a158d6e5c61717f0fce84"
May 20 14:47:16.917395 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:16.917357    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbf069575a7644b647cb8f82bd843120633588ade32a158d6e5c61717f0fce84"} err="failed to get container status \"dbf069575a7644b647cb8f82bd843120633588ade32a158d6e5c61717f0fce84\": rpc error: code = NotFound desc = could not find container \"dbf069575a7644b647cb8f82bd843120633588ade32a158d6e5c61717f0fce84\": container with ID starting with dbf069575a7644b647cb8f82bd843120633588ade32a158d6e5c61717f0fce84 not found: ID does not exist"
May 20 14:47:16.917395 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:16.917368    2571 scope.go:117] "RemoveContainer" containerID="6ecc3ecb3ac6398c6bc42d8e67edaebb8feafd0dd40eded8c852ce7c5a48d959"
May 20 14:47:16.917557 ip-10-0-130-144 kubenswrapper[2571]: E0520 14:47:16.917543    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ecc3ecb3ac6398c6bc42d8e67edaebb8feafd0dd40eded8c852ce7c5a48d959\": container with ID starting with 6ecc3ecb3ac6398c6bc42d8e67edaebb8feafd0dd40eded8c852ce7c5a48d959 not found: ID does not exist" containerID="6ecc3ecb3ac6398c6bc42d8e67edaebb8feafd0dd40eded8c852ce7c5a48d959"
May 20 14:47:16.917593 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:16.917558    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ecc3ecb3ac6398c6bc42d8e67edaebb8feafd0dd40eded8c852ce7c5a48d959"} err="failed to get container status \"6ecc3ecb3ac6398c6bc42d8e67edaebb8feafd0dd40eded8c852ce7c5a48d959\": rpc error: code = NotFound desc = could not find container \"6ecc3ecb3ac6398c6bc42d8e67edaebb8feafd0dd40eded8c852ce7c5a48d959\": container with ID starting with 6ecc3ecb3ac6398c6bc42d8e67edaebb8feafd0dd40eded8c852ce7c5a48d959 not found: ID does not exist"
May 20 14:47:18.666910 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:47:18.666878    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c7f0c94-7af1-4149-9238-00fe8daf4d17" path="/var/lib/kubelet/pods/3c7f0c94-7af1-4149-9238-00fe8daf4d17/volumes"
May 20 14:48:53.082494 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.082448    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7"]
May 20 14:48:53.083064 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.082830    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c7f0c94-7af1-4149-9238-00fe8daf4d17" containerName="storage-initializer"
May 20 14:48:53.083064 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.082845    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c7f0c94-7af1-4149-9238-00fe8daf4d17" containerName="storage-initializer"
May 20 14:48:53.083064 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.082854    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c7f0c94-7af1-4149-9238-00fe8daf4d17" containerName="kserve-container"
May 20 14:48:53.083064 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.082860    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c7f0c94-7af1-4149-9238-00fe8daf4d17" containerName="kserve-container"
May 20 14:48:53.083064 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.082871    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f35b1cf-23f0-44ef-add7-79148ea5be40" containerName="storage-initializer"
May 20 14:48:53.083064 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.082877    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f35b1cf-23f0-44ef-add7-79148ea5be40" containerName="storage-initializer"
May 20 14:48:53.083064 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.082884    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f35b1cf-23f0-44ef-add7-79148ea5be40" containerName="kube-rbac-proxy"
May 20 14:48:53.083064 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.082889    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f35b1cf-23f0-44ef-add7-79148ea5be40" containerName="kube-rbac-proxy"
May 20 14:48:53.083064 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.082899    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f35b1cf-23f0-44ef-add7-79148ea5be40" containerName="kserve-container"
May 20 14:48:53.083064 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.082904    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f35b1cf-23f0-44ef-add7-79148ea5be40" containerName="kserve-container"
May 20 14:48:53.083064 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.082913    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c7f0c94-7af1-4149-9238-00fe8daf4d17" containerName="kube-rbac-proxy"
May 20 14:48:53.083064 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.082921    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c7f0c94-7af1-4149-9238-00fe8daf4d17" containerName="kube-rbac-proxy"
May 20 14:48:53.083064 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.082997    2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="3c7f0c94-7af1-4149-9238-00fe8daf4d17" containerName="kserve-container"
May 20 14:48:53.083064 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.083008    2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f35b1cf-23f0-44ef-add7-79148ea5be40" containerName="kserve-container"
May 20 14:48:53.083064 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.083016    2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="3c7f0c94-7af1-4149-9238-00fe8daf4d17" containerName="kube-rbac-proxy"
May 20 14:48:53.083064 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.083023    2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f35b1cf-23f0-44ef-add7-79148ea5be40" containerName="kube-rbac-proxy"
May 20 14:48:53.086213 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.086194    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7"
May 20 14:48:53.088896 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.088871    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-runtime-predictor-serving-cert\""
May 20 14:48:53.089477 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.089455    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
May 20 14:48:53.089717 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.089651    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-runtime-kube-rbac-proxy-sar-config\""
May 20 14:48:53.089717 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.089669    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
May 20 14:48:53.089717 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.089699    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-2mlds\""
May 20 14:48:53.090023 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.089826    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
May 20 14:48:53.090023 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.089924    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
May 20 14:48:53.099991 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.099964    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7"]
May 20 14:48:53.225817 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.225779    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/18d2f27e-478e-4b8c-9868-65f52a62749b-kserve-provision-location\") pod \"isvc-xgboost-runtime-predictor-779db84d9-m4wj7\" (UID: \"18d2f27e-478e-4b8c-9868-65f52a62749b\") " pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7"
May 20 14:48:53.226044 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.225842    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"isvc-xgboost-runtime-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/18d2f27e-478e-4b8c-9868-65f52a62749b-isvc-xgboost-runtime-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-runtime-predictor-779db84d9-m4wj7\" (UID: \"18d2f27e-478e-4b8c-9868-65f52a62749b\") " pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7"
May 20 14:48:53.226044 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.225881    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/18d2f27e-478e-4b8c-9868-65f52a62749b-cabundle-cert\") pod \"isvc-xgboost-runtime-predictor-779db84d9-m4wj7\" (UID: \"18d2f27e-478e-4b8c-9868-65f52a62749b\") " pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7"
May 20 14:48:53.226044 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.225901    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/18d2f27e-478e-4b8c-9868-65f52a62749b-proxy-tls\") pod \"isvc-xgboost-runtime-predictor-779db84d9-m4wj7\" (UID: \"18d2f27e-478e-4b8c-9868-65f52a62749b\") " pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7"
May 20 14:48:53.226044 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.226026    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpvxw\" (UniqueName: \"kubernetes.io/projected/18d2f27e-478e-4b8c-9868-65f52a62749b-kube-api-access-cpvxw\") pod \"isvc-xgboost-runtime-predictor-779db84d9-m4wj7\" (UID: \"18d2f27e-478e-4b8c-9868-65f52a62749b\") " pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7"
May 20 14:48:53.327245 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.327203    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/18d2f27e-478e-4b8c-9868-65f52a62749b-kserve-provision-location\") pod \"isvc-xgboost-runtime-predictor-779db84d9-m4wj7\" (UID: \"18d2f27e-478e-4b8c-9868-65f52a62749b\") " pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7"
May 20 14:48:53.327426 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.327272    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"isvc-xgboost-runtime-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/18d2f27e-478e-4b8c-9868-65f52a62749b-isvc-xgboost-runtime-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-runtime-predictor-779db84d9-m4wj7\" (UID: \"18d2f27e-478e-4b8c-9868-65f52a62749b\") " pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7"
May 20 14:48:53.327426 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.327315    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/18d2f27e-478e-4b8c-9868-65f52a62749b-cabundle-cert\") pod \"isvc-xgboost-runtime-predictor-779db84d9-m4wj7\" (UID: \"18d2f27e-478e-4b8c-9868-65f52a62749b\") " pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7"
May 20 14:48:53.327426 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.327347    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/18d2f27e-478e-4b8c-9868-65f52a62749b-proxy-tls\") pod \"isvc-xgboost-runtime-predictor-779db84d9-m4wj7\" (UID: \"18d2f27e-478e-4b8c-9868-65f52a62749b\") " pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7"
May 20 14:48:53.327426 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.327401    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cpvxw\" (UniqueName: \"kubernetes.io/projected/18d2f27e-478e-4b8c-9868-65f52a62749b-kube-api-access-cpvxw\") pod \"isvc-xgboost-runtime-predictor-779db84d9-m4wj7\" (UID: \"18d2f27e-478e-4b8c-9868-65f52a62749b\") " pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7"
May 20 14:48:53.327658 ip-10-0-130-144 kubenswrapper[2571]: E0520 14:48:53.327531    2571 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-serving-cert: secret "isvc-xgboost-runtime-predictor-serving-cert" not found
May 20 14:48:53.327658 ip-10-0-130-144 kubenswrapper[2571]: E0520 14:48:53.327612    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18d2f27e-478e-4b8c-9868-65f52a62749b-proxy-tls podName:18d2f27e-478e-4b8c-9868-65f52a62749b nodeName:}" failed. No retries permitted until 2026-05-20 14:48:53.827591296 +0000 UTC m=+3543.700378451 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/18d2f27e-478e-4b8c-9868-65f52a62749b-proxy-tls") pod "isvc-xgboost-runtime-predictor-779db84d9-m4wj7" (UID: "18d2f27e-478e-4b8c-9868-65f52a62749b") : secret "isvc-xgboost-runtime-predictor-serving-cert" not found
May 20 14:48:53.327778 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.327706    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/18d2f27e-478e-4b8c-9868-65f52a62749b-kserve-provision-location\") pod \"isvc-xgboost-runtime-predictor-779db84d9-m4wj7\" (UID: \"18d2f27e-478e-4b8c-9868-65f52a62749b\") " pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7"
May 20 14:48:53.328040 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.328020    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/18d2f27e-478e-4b8c-9868-65f52a62749b-cabundle-cert\") pod \"isvc-xgboost-runtime-predictor-779db84d9-m4wj7\" (UID: \"18d2f27e-478e-4b8c-9868-65f52a62749b\") " pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7"
May 20 14:48:53.328132 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.328062    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"isvc-xgboost-runtime-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/18d2f27e-478e-4b8c-9868-65f52a62749b-isvc-xgboost-runtime-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-runtime-predictor-779db84d9-m4wj7\" (UID: \"18d2f27e-478e-4b8c-9868-65f52a62749b\") " pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7"
May 20 14:48:53.338388 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.338329    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpvxw\" (UniqueName: \"kubernetes.io/projected/18d2f27e-478e-4b8c-9868-65f52a62749b-kube-api-access-cpvxw\") pod \"isvc-xgboost-runtime-predictor-779db84d9-m4wj7\" (UID: \"18d2f27e-478e-4b8c-9868-65f52a62749b\") " pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7"
May 20 14:48:53.832227 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.832188    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/18d2f27e-478e-4b8c-9868-65f52a62749b-proxy-tls\") pod \"isvc-xgboost-runtime-predictor-779db84d9-m4wj7\" (UID: \"18d2f27e-478e-4b8c-9868-65f52a62749b\") " pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7"
May 20 14:48:53.834734 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.834699    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/18d2f27e-478e-4b8c-9868-65f52a62749b-proxy-tls\") pod \"isvc-xgboost-runtime-predictor-779db84d9-m4wj7\" (UID: \"18d2f27e-478e-4b8c-9868-65f52a62749b\") " pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7"
May 20 14:48:53.996853 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:53.996814    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7"
May 20 14:48:54.131709 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:54.131675    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7"]
May 20 14:48:54.134060 ip-10-0-130-144 kubenswrapper[2571]: W0520 14:48:54.134031    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18d2f27e_478e_4b8c_9868_65f52a62749b.slice/crio-3751aeacd4c35e76120788c5b0a67462e49b3d86d170115993eb754b73ea9af0 WatchSource:0}: Error finding container 3751aeacd4c35e76120788c5b0a67462e49b3d86d170115993eb754b73ea9af0: Status 404 returned error can't find the container with id 3751aeacd4c35e76120788c5b0a67462e49b3d86d170115993eb754b73ea9af0
May 20 14:48:54.135969 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:54.135952    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 14:48:54.224526 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:54.224487    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7" event={"ID":"18d2f27e-478e-4b8c-9868-65f52a62749b","Type":"ContainerStarted","Data":"8256aca314d716a9de8efa47dc6e26210ceba61c47ef2986da0cb74840dc0b54"}
May 20 14:48:54.224526 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:54.224523    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7" event={"ID":"18d2f27e-478e-4b8c-9868-65f52a62749b","Type":"ContainerStarted","Data":"3751aeacd4c35e76120788c5b0a67462e49b3d86d170115993eb754b73ea9af0"}
May 20 14:48:58.239763 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:58.239725    2571 generic.go:358] "Generic (PLEG): container finished" podID="18d2f27e-478e-4b8c-9868-65f52a62749b" containerID="8256aca314d716a9de8efa47dc6e26210ceba61c47ef2986da0cb74840dc0b54" exitCode=0
May 20 14:48:58.240129 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:58.239785    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7" event={"ID":"18d2f27e-478e-4b8c-9868-65f52a62749b","Type":"ContainerDied","Data":"8256aca314d716a9de8efa47dc6e26210ceba61c47ef2986da0cb74840dc0b54"}
May 20 14:48:59.245055 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:59.245019    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7" event={"ID":"18d2f27e-478e-4b8c-9868-65f52a62749b","Type":"ContainerStarted","Data":"63c12b01dc66b9c140efc8763ddb78ac3a4fbec08e96f75b7a3b033c69e2ac94"}
May 20 14:48:59.245055 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:59.245060    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7" event={"ID":"18d2f27e-478e-4b8c-9868-65f52a62749b","Type":"ContainerStarted","Data":"e565b49e500f09124bd1bf5f027b31f72a9d409327c710e308a59f6fdbe31083"}
May 20 14:48:59.245464 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:59.245259    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7"
May 20 14:48:59.272056 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:48:59.271999    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7" podStartSLOduration=6.271981768 podStartE2EDuration="6.271981768s" podCreationTimestamp="2026-05-20 14:48:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 14:48:59.27120384 +0000 UTC m=+3549.143991001" watchObservedRunningTime="2026-05-20 14:48:59.271981768 +0000 UTC m=+3549.144768926"
May 20 14:49:00.248857 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:49:00.248825    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7"
May 20 14:49:00.250005 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:49:00.249974    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7" podUID="18d2f27e-478e-4b8c-9868-65f52a62749b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.40:8080: connect: connection refused"
May 20 14:49:01.251985 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:49:01.251942    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7" podUID="18d2f27e-478e-4b8c-9868-65f52a62749b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.40:8080: connect: connection refused"
May 20 14:49:06.256901 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:49:06.256868    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7"
May 20 14:49:06.257477 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:49:06.257448    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7" podUID="18d2f27e-478e-4b8c-9868-65f52a62749b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.40:8080: connect: connection refused"
May 20 14:49:16.257517 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:49:16.257469    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7" podUID="18d2f27e-478e-4b8c-9868-65f52a62749b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.40:8080: connect: connection refused"
May 20 14:49:26.258406 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:49:26.258361    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7" podUID="18d2f27e-478e-4b8c-9868-65f52a62749b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.40:8080: connect: connection refused"
May 20 14:49:36.257473 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:49:36.257426    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7" podUID="18d2f27e-478e-4b8c-9868-65f52a62749b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.40:8080: connect: connection refused"
May 20 14:49:46.257927 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:49:46.257879    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7" podUID="18d2f27e-478e-4b8c-9868-65f52a62749b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.40:8080: connect: connection refused"
May 20 14:49:56.257520 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:49:56.257482    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7" podUID="18d2f27e-478e-4b8c-9868-65f52a62749b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.40:8080: connect: connection refused"
May 20 14:50:06.258803 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:50:06.258766    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7"
May 20 14:50:13.480852 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:50:13.480812    2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7"]
May 20 14:50:13.481376 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:50:13.481169    2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7" podUID="18d2f27e-478e-4b8c-9868-65f52a62749b" containerName="kserve-container" containerID="cri-o://e565b49e500f09124bd1bf5f027b31f72a9d409327c710e308a59f6fdbe31083" gracePeriod=30
May 20 14:50:13.481376 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:50:13.481218    2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7" podUID="18d2f27e-478e-4b8c-9868-65f52a62749b" containerName="kube-rbac-proxy" containerID="cri-o://63c12b01dc66b9c140efc8763ddb78ac3a4fbec08e96f75b7a3b033c69e2ac94" gracePeriod=30
May 20 14:50:14.507873 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:50:14.507834    2571 generic.go:358] "Generic (PLEG): container finished" podID="18d2f27e-478e-4b8c-9868-65f52a62749b" containerID="63c12b01dc66b9c140efc8763ddb78ac3a4fbec08e96f75b7a3b033c69e2ac94" exitCode=2
May 20 14:50:14.508295 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:50:14.507910    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7" event={"ID":"18d2f27e-478e-4b8c-9868-65f52a62749b","Type":"ContainerDied","Data":"63c12b01dc66b9c140efc8763ddb78ac3a4fbec08e96f75b7a3b033c69e2ac94"}
May 20 14:50:16.252309 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:50:16.252248    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7" podUID="18d2f27e-478e-4b8c-9868-65f52a62749b" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.40:8643/healthz\": dial tcp 10.133.0.40:8643: connect: connection refused"
May 20 14:50:16.257518 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:50:16.257475    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7" podUID="18d2f27e-478e-4b8c-9868-65f52a62749b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.40:8080: connect: connection refused"
May 20 14:50:17.521311 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:50:17.521278    2571 generic.go:358] "Generic (PLEG): container finished" podID="18d2f27e-478e-4b8c-9868-65f52a62749b" containerID="e565b49e500f09124bd1bf5f027b31f72a9d409327c710e308a59f6fdbe31083" exitCode=0
May 20 14:50:17.521729 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:50:17.521344    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7" event={"ID":"18d2f27e-478e-4b8c-9868-65f52a62749b","Type":"ContainerDied","Data":"e565b49e500f09124bd1bf5f027b31f72a9d409327c710e308a59f6fdbe31083"}
May 20 14:50:17.536185 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:50:17.536160    2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7"
May 20 14:50:17.564402 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:50:17.564370    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/18d2f27e-478e-4b8c-9868-65f52a62749b-kserve-provision-location\") pod \"18d2f27e-478e-4b8c-9868-65f52a62749b\" (UID: \"18d2f27e-478e-4b8c-9868-65f52a62749b\") "
May 20 14:50:17.564574 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:50:17.564479    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/18d2f27e-478e-4b8c-9868-65f52a62749b-proxy-tls\") pod \"18d2f27e-478e-4b8c-9868-65f52a62749b\" (UID: \"18d2f27e-478e-4b8c-9868-65f52a62749b\") "
May 20 14:50:17.564574 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:50:17.564514    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/18d2f27e-478e-4b8c-9868-65f52a62749b-cabundle-cert\") pod \"18d2f27e-478e-4b8c-9868-65f52a62749b\" (UID: \"18d2f27e-478e-4b8c-9868-65f52a62749b\") "
May 20 14:50:17.564574 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:50:17.564541    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"isvc-xgboost-runtime-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/18d2f27e-478e-4b8c-9868-65f52a62749b-isvc-xgboost-runtime-kube-rbac-proxy-sar-config\") pod \"18d2f27e-478e-4b8c-9868-65f52a62749b\" (UID: \"18d2f27e-478e-4b8c-9868-65f52a62749b\") "
May 20 14:50:17.564714 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:50:17.564575    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpvxw\" (UniqueName: \"kubernetes.io/projected/18d2f27e-478e-4b8c-9868-65f52a62749b-kube-api-access-cpvxw\") pod \"18d2f27e-478e-4b8c-9868-65f52a62749b\" (UID: \"18d2f27e-478e-4b8c-9868-65f52a62749b\") "
May 20 14:50:17.564827 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:50:17.564800    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18d2f27e-478e-4b8c-9868-65f52a62749b-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "18d2f27e-478e-4b8c-9868-65f52a62749b" (UID: "18d2f27e-478e-4b8c-9868-65f52a62749b"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 14:50:17.564973 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:50:17.564945    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18d2f27e-478e-4b8c-9868-65f52a62749b-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "18d2f27e-478e-4b8c-9868-65f52a62749b" (UID: "18d2f27e-478e-4b8c-9868-65f52a62749b"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 14:50:17.565047 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:50:17.564970    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18d2f27e-478e-4b8c-9868-65f52a62749b-isvc-xgboost-runtime-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "isvc-xgboost-runtime-kube-rbac-proxy-sar-config") pod "18d2f27e-478e-4b8c-9868-65f52a62749b" (UID: "18d2f27e-478e-4b8c-9868-65f52a62749b"). InnerVolumeSpecName "isvc-xgboost-runtime-kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 14:50:17.566857 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:50:17.566829    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18d2f27e-478e-4b8c-9868-65f52a62749b-kube-api-access-cpvxw" (OuterVolumeSpecName: "kube-api-access-cpvxw") pod "18d2f27e-478e-4b8c-9868-65f52a62749b" (UID: "18d2f27e-478e-4b8c-9868-65f52a62749b"). InnerVolumeSpecName "kube-api-access-cpvxw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 14:50:17.566992 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:50:17.566956    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18d2f27e-478e-4b8c-9868-65f52a62749b-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "18d2f27e-478e-4b8c-9868-65f52a62749b" (UID: "18d2f27e-478e-4b8c-9868-65f52a62749b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 14:50:17.665333 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:50:17.665246    2571 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/18d2f27e-478e-4b8c-9868-65f52a62749b-kserve-provision-location\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 14:50:17.665333 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:50:17.665276    2571 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/18d2f27e-478e-4b8c-9868-65f52a62749b-proxy-tls\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 14:50:17.665333 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:50:17.665287    2571 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/18d2f27e-478e-4b8c-9868-65f52a62749b-cabundle-cert\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 14:50:17.665333 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:50:17.665298    2571 reconciler_common.go:299] "Volume detached for volume \"isvc-xgboost-runtime-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/18d2f27e-478e-4b8c-9868-65f52a62749b-isvc-xgboost-runtime-kube-rbac-proxy-sar-config\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 14:50:17.665333 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:50:17.665309    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpvxw\" (UniqueName: \"kubernetes.io/projected/18d2f27e-478e-4b8c-9868-65f52a62749b-kube-api-access-cpvxw\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 14:50:18.526535 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:50:18.526501    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7" event={"ID":"18d2f27e-478e-4b8c-9868-65f52a62749b","Type":"ContainerDied","Data":"3751aeacd4c35e76120788c5b0a67462e49b3d86d170115993eb754b73ea9af0"}
May 20 14:50:18.526991 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:50:18.526544    2571 scope.go:117] "RemoveContainer" containerID="63c12b01dc66b9c140efc8763ddb78ac3a4fbec08e96f75b7a3b033c69e2ac94"
May 20 14:50:18.526991 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:50:18.526571    2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7"
May 20 14:50:18.535573 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:50:18.535549    2571 scope.go:117] "RemoveContainer" containerID="e565b49e500f09124bd1bf5f027b31f72a9d409327c710e308a59f6fdbe31083"
May 20 14:50:18.543191 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:50:18.543172    2571 scope.go:117] "RemoveContainer" containerID="8256aca314d716a9de8efa47dc6e26210ceba61c47ef2986da0cb74840dc0b54"
May 20 14:50:18.549657 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:50:18.549628    2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7"]
May 20 14:50:18.557246 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:50:18.557218    2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-779db84d9-m4wj7"]
May 20 14:50:18.666514 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:50:18.666480    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18d2f27e-478e-4b8c-9868-65f52a62749b" path="/var/lib/kubelet/pods/18d2f27e-478e-4b8c-9868-65f52a62749b/volumes"
May 20 14:51:13.559676 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:13.559595    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4"]
May 20 14:51:13.560063 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:13.559926    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18d2f27e-478e-4b8c-9868-65f52a62749b" containerName="kube-rbac-proxy"
May 20 14:51:13.560063 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:13.559952    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="18d2f27e-478e-4b8c-9868-65f52a62749b" containerName="kube-rbac-proxy"
May 20 14:51:13.560063 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:13.559966    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18d2f27e-478e-4b8c-9868-65f52a62749b" containerName="kserve-container"
May 20 14:51:13.560063 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:13.559972    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="18d2f27e-478e-4b8c-9868-65f52a62749b" containerName="kserve-container"
May 20 14:51:13.560063 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:13.559982    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18d2f27e-478e-4b8c-9868-65f52a62749b" containerName="storage-initializer"
May 20 14:51:13.560063 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:13.559988    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="18d2f27e-478e-4b8c-9868-65f52a62749b" containerName="storage-initializer"
May 20 14:51:13.560063 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:13.560042    2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="18d2f27e-478e-4b8c-9868-65f52a62749b" containerName="kserve-container"
May 20 14:51:13.560063 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:13.560052    2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="18d2f27e-478e-4b8c-9868-65f52a62749b" containerName="kube-rbac-proxy"
May 20 14:51:13.563005 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:13.562985    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4"
May 20 14:51:13.566026 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:13.565999    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
May 20 14:51:13.566196 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:13.566006    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-v2-predictor-serving-cert\""
May 20 14:51:13.566196 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:13.566021    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
May 20 14:51:13.566368 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:13.566022    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
May 20 14:51:13.566368 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:13.566023    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-2mlds\""
May 20 14:51:13.566368 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:13.566075    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
May 20 14:51:13.566368 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:13.566078    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-v2-kube-rbac-proxy-sar-config\""
May 20 14:51:13.580228 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:13.580204    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4"]
May 20 14:51:13.654810 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:13.654771    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"isvc-xgboost-v2-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/87f57b45-5f78-4938-b403-cd02326f281c-isvc-xgboost-v2-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4\" (UID: \"87f57b45-5f78-4938-b403-cd02326f281c\") " pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4"
May 20 14:51:13.654810 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:13.654809    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/87f57b45-5f78-4938-b403-cd02326f281c-cabundle-cert\") pod \"isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4\" (UID: \"87f57b45-5f78-4938-b403-cd02326f281c\") " pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4"
May 20 14:51:13.655054 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:13.654868    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-987ph\" (UniqueName: \"kubernetes.io/projected/87f57b45-5f78-4938-b403-cd02326f281c-kube-api-access-987ph\") pod \"isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4\" (UID: \"87f57b45-5f78-4938-b403-cd02326f281c\") " pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4"
May 20 14:51:13.655054 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:13.654902    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/87f57b45-5f78-4938-b403-cd02326f281c-proxy-tls\") pod \"isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4\" (UID: \"87f57b45-5f78-4938-b403-cd02326f281c\") " pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4"
May 20 14:51:13.655054 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:13.655001    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/87f57b45-5f78-4938-b403-cd02326f281c-kserve-provision-location\") pod \"isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4\" (UID: \"87f57b45-5f78-4938-b403-cd02326f281c\") " pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4"
May 20 14:51:13.756378 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:13.756341    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/87f57b45-5f78-4938-b403-cd02326f281c-kserve-provision-location\") pod \"isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4\" (UID: \"87f57b45-5f78-4938-b403-cd02326f281c\") " pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4"
May 20 14:51:13.756559 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:13.756431    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"isvc-xgboost-v2-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/87f57b45-5f78-4938-b403-cd02326f281c-isvc-xgboost-v2-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4\" (UID: \"87f57b45-5f78-4938-b403-cd02326f281c\") " pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4"
May 20 14:51:13.756559 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:13.756453    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/87f57b45-5f78-4938-b403-cd02326f281c-cabundle-cert\") pod \"isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4\" (UID: \"87f57b45-5f78-4938-b403-cd02326f281c\") " pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4"
May 20 14:51:13.756559 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:13.756477    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-987ph\" (UniqueName: \"kubernetes.io/projected/87f57b45-5f78-4938-b403-cd02326f281c-kube-api-access-987ph\") pod \"isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4\" (UID: \"87f57b45-5f78-4938-b403-cd02326f281c\") " pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4"
May 20 14:51:13.756559 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:13.756505    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/87f57b45-5f78-4938-b403-cd02326f281c-proxy-tls\") pod \"isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4\" (UID: \"87f57b45-5f78-4938-b403-cd02326f281c\") " pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4"
May 20 14:51:13.756815 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:13.756788    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/87f57b45-5f78-4938-b403-cd02326f281c-kserve-provision-location\") pod \"isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4\" (UID: \"87f57b45-5f78-4938-b403-cd02326f281c\") " pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4"
May 20 14:51:13.757115 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:13.757084    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/87f57b45-5f78-4938-b403-cd02326f281c-cabundle-cert\") pod \"isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4\" (UID: \"87f57b45-5f78-4938-b403-cd02326f281c\") " pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4"
May 20 14:51:13.757224 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:13.757139    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"isvc-xgboost-v2-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/87f57b45-5f78-4938-b403-cd02326f281c-isvc-xgboost-v2-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4\" (UID: \"87f57b45-5f78-4938-b403-cd02326f281c\") " pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4"
May 20 14:51:13.758884 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:13.758858    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/87f57b45-5f78-4938-b403-cd02326f281c-proxy-tls\") pod \"isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4\" (UID: \"87f57b45-5f78-4938-b403-cd02326f281c\") " pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4"
May 20 14:51:13.766471 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:13.766453    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-987ph\" (UniqueName: \"kubernetes.io/projected/87f57b45-5f78-4938-b403-cd02326f281c-kube-api-access-987ph\") pod \"isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4\" (UID: \"87f57b45-5f78-4938-b403-cd02326f281c\") " pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4"
May 20 14:51:13.874808 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:13.874710    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4"
May 20 14:51:14.007889 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:14.007863    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4"]
May 20 14:51:14.010723 ip-10-0-130-144 kubenswrapper[2571]: W0520 14:51:14.010695    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87f57b45_5f78_4938_b403_cd02326f281c.slice/crio-02ab5ee8decc3537d29ca857a2947b5efa18ec59a95df498cd28dafc929c8d94 WatchSource:0}: Error finding container 02ab5ee8decc3537d29ca857a2947b5efa18ec59a95df498cd28dafc929c8d94: Status 404 returned error can't find the container with id 02ab5ee8decc3537d29ca857a2947b5efa18ec59a95df498cd28dafc929c8d94
May 20 14:51:14.710182 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:14.710141    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4" event={"ID":"87f57b45-5f78-4938-b403-cd02326f281c","Type":"ContainerStarted","Data":"b2f68635fcc9cb42a624b78f9f1415d1985c6d68cce3220722c13e8e9d2fa662"}
May 20 14:51:14.710182 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:14.710185    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4" event={"ID":"87f57b45-5f78-4938-b403-cd02326f281c","Type":"ContainerStarted","Data":"02ab5ee8decc3537d29ca857a2947b5efa18ec59a95df498cd28dafc929c8d94"}
May 20 14:51:18.724706 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:18.724669    2571 generic.go:358] "Generic (PLEG): container finished" podID="87f57b45-5f78-4938-b403-cd02326f281c" containerID="b2f68635fcc9cb42a624b78f9f1415d1985c6d68cce3220722c13e8e9d2fa662" exitCode=0
May 20 14:51:18.725120 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:18.724712    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4" event={"ID":"87f57b45-5f78-4938-b403-cd02326f281c","Type":"ContainerDied","Data":"b2f68635fcc9cb42a624b78f9f1415d1985c6d68cce3220722c13e8e9d2fa662"}
May 20 14:51:19.729979 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:19.729919    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4" event={"ID":"87f57b45-5f78-4938-b403-cd02326f281c","Type":"ContainerStarted","Data":"4a2ab8d59c6b8c18429154990851a9ea421efecf334b18dec80e30fbc876b5d1"}
May 20 14:51:19.729979 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:19.729984    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4" event={"ID":"87f57b45-5f78-4938-b403-cd02326f281c","Type":"ContainerStarted","Data":"4b566e40b0e0939169840b88e1e2af95f571a0081bf290a1994fab45d7e89e33"}
May 20 14:51:19.730427 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:19.730328    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4"
May 20 14:51:19.730484 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:19.730466    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4"
May 20 14:51:19.731868 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:19.731838    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4" podUID="87f57b45-5f78-4938-b403-cd02326f281c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.41:8080: connect: connection refused"
May 20 14:51:19.755441 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:19.755393    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4" podStartSLOduration=6.755377366 podStartE2EDuration="6.755377366s" podCreationTimestamp="2026-05-20 14:51:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 14:51:19.754800758 +0000 UTC m=+3689.627587940" watchObservedRunningTime="2026-05-20 14:51:19.755377366 +0000 UTC m=+3689.628164555"
May 20 14:51:20.733388 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:20.733345    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4" podUID="87f57b45-5f78-4938-b403-cd02326f281c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.41:8080: connect: connection refused"
May 20 14:51:25.737485 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:25.737451    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4"
May 20 14:51:25.738088 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:25.738058    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4" podUID="87f57b45-5f78-4938-b403-cd02326f281c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.41:8080: connect: connection refused"
May 20 14:51:35.738212 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:35.738163    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4" podUID="87f57b45-5f78-4938-b403-cd02326f281c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.41:8080: connect: connection refused"
May 20 14:51:45.738271 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:45.738227    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4" podUID="87f57b45-5f78-4938-b403-cd02326f281c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.41:8080: connect: connection refused"
May 20 14:51:55.738336 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:51:55.738289    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4" podUID="87f57b45-5f78-4938-b403-cd02326f281c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.41:8080: connect: connection refused"
May 20 14:52:05.738507 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:05.738462    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4" podUID="87f57b45-5f78-4938-b403-cd02326f281c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.41:8080: connect: connection refused"
May 20 14:52:15.737921 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:15.737883    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4" podUID="87f57b45-5f78-4938-b403-cd02326f281c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.41:8080: connect: connection refused"
May 20 14:52:25.738979 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:25.738920    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4"
May 20 14:52:33.638238 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:33.638197    2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4"]
May 20 14:52:33.638667 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:33.638618    2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4" podUID="87f57b45-5f78-4938-b403-cd02326f281c" containerName="kserve-container" containerID="cri-o://4b566e40b0e0939169840b88e1e2af95f571a0081bf290a1994fab45d7e89e33" gracePeriod=30
May 20 14:52:33.639011 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:33.638947    2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4" podUID="87f57b45-5f78-4938-b403-cd02326f281c" containerName="kube-rbac-proxy" containerID="cri-o://4a2ab8d59c6b8c18429154990851a9ea421efecf334b18dec80e30fbc876b5d1" gracePeriod=30
May 20 14:52:33.972730 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:33.972688    2571 generic.go:358] "Generic (PLEG): container finished" podID="87f57b45-5f78-4938-b403-cd02326f281c" containerID="4a2ab8d59c6b8c18429154990851a9ea421efecf334b18dec80e30fbc876b5d1" exitCode=2
May 20 14:52:33.972909 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:33.972758    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4" event={"ID":"87f57b45-5f78-4938-b403-cd02326f281c","Type":"ContainerDied","Data":"4a2ab8d59c6b8c18429154990851a9ea421efecf334b18dec80e30fbc876b5d1"}
May 20 14:52:35.734118 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:35.734069    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4" podUID="87f57b45-5f78-4938-b403-cd02326f281c" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.41:8643/healthz\": dial tcp 10.133.0.41:8643: connect: connection refused"
May 20 14:52:35.738336 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:35.738303    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4" podUID="87f57b45-5f78-4938-b403-cd02326f281c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.41:8080: connect: connection refused"
May 20 14:52:37.589265 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:37.589239    2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4"
May 20 14:52:37.697359 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:37.697322    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"isvc-xgboost-v2-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/87f57b45-5f78-4938-b403-cd02326f281c-isvc-xgboost-v2-kube-rbac-proxy-sar-config\") pod \"87f57b45-5f78-4938-b403-cd02326f281c\" (UID: \"87f57b45-5f78-4938-b403-cd02326f281c\") "
May 20 14:52:37.697518 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:37.697370    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-987ph\" (UniqueName: \"kubernetes.io/projected/87f57b45-5f78-4938-b403-cd02326f281c-kube-api-access-987ph\") pod \"87f57b45-5f78-4938-b403-cd02326f281c\" (UID: \"87f57b45-5f78-4938-b403-cd02326f281c\") "
May 20 14:52:37.697518 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:37.697410    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/87f57b45-5f78-4938-b403-cd02326f281c-proxy-tls\") pod \"87f57b45-5f78-4938-b403-cd02326f281c\" (UID: \"87f57b45-5f78-4938-b403-cd02326f281c\") "
May 20 14:52:37.697518 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:37.697465    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/87f57b45-5f78-4938-b403-cd02326f281c-kserve-provision-location\") pod \"87f57b45-5f78-4938-b403-cd02326f281c\" (UID: \"87f57b45-5f78-4938-b403-cd02326f281c\") "
May 20 14:52:37.697518 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:37.697501    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/87f57b45-5f78-4938-b403-cd02326f281c-cabundle-cert\") pod \"87f57b45-5f78-4938-b403-cd02326f281c\" (UID: \"87f57b45-5f78-4938-b403-cd02326f281c\") "
May 20 14:52:37.697841 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:37.697815    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87f57b45-5f78-4938-b403-cd02326f281c-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "87f57b45-5f78-4938-b403-cd02326f281c" (UID: "87f57b45-5f78-4938-b403-cd02326f281c"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 14:52:37.697841 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:37.697831    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87f57b45-5f78-4938-b403-cd02326f281c-isvc-xgboost-v2-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "isvc-xgboost-v2-kube-rbac-proxy-sar-config") pod "87f57b45-5f78-4938-b403-cd02326f281c" (UID: "87f57b45-5f78-4938-b403-cd02326f281c"). InnerVolumeSpecName "isvc-xgboost-v2-kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 14:52:37.697971 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:37.697948    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87f57b45-5f78-4938-b403-cd02326f281c-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "87f57b45-5f78-4938-b403-cd02326f281c" (UID: "87f57b45-5f78-4938-b403-cd02326f281c"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 14:52:37.699643 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:37.699620    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87f57b45-5f78-4938-b403-cd02326f281c-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "87f57b45-5f78-4938-b403-cd02326f281c" (UID: "87f57b45-5f78-4938-b403-cd02326f281c"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 14:52:37.699721 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:37.699662    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87f57b45-5f78-4938-b403-cd02326f281c-kube-api-access-987ph" (OuterVolumeSpecName: "kube-api-access-987ph") pod "87f57b45-5f78-4938-b403-cd02326f281c" (UID: "87f57b45-5f78-4938-b403-cd02326f281c"). InnerVolumeSpecName "kube-api-access-987ph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 14:52:37.798313 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:37.798280    2571 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/87f57b45-5f78-4938-b403-cd02326f281c-kserve-provision-location\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 14:52:37.798313 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:37.798310    2571 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/87f57b45-5f78-4938-b403-cd02326f281c-cabundle-cert\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 14:52:37.798313 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:37.798320    2571 reconciler_common.go:299] "Volume detached for volume \"isvc-xgboost-v2-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/87f57b45-5f78-4938-b403-cd02326f281c-isvc-xgboost-v2-kube-rbac-proxy-sar-config\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 14:52:37.798535 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:37.798331    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-987ph\" (UniqueName: \"kubernetes.io/projected/87f57b45-5f78-4938-b403-cd02326f281c-kube-api-access-987ph\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 14:52:37.798535 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:37.798343    2571 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/87f57b45-5f78-4938-b403-cd02326f281c-proxy-tls\") on node \"ip-10-0-130-144.ec2.internal\" DevicePath \"\""
May 20 14:52:37.989003 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:37.988900    2571 generic.go:358] "Generic (PLEG): container finished" podID="87f57b45-5f78-4938-b403-cd02326f281c" containerID="4b566e40b0e0939169840b88e1e2af95f571a0081bf290a1994fab45d7e89e33" exitCode=0
May 20 14:52:37.989003 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:37.988972    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4" event={"ID":"87f57b45-5f78-4938-b403-cd02326f281c","Type":"ContainerDied","Data":"4b566e40b0e0939169840b88e1e2af95f571a0081bf290a1994fab45d7e89e33"}
May 20 14:52:37.989003 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:37.989000    2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4"
May 20 14:52:37.989209 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:37.989015    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4" event={"ID":"87f57b45-5f78-4938-b403-cd02326f281c","Type":"ContainerDied","Data":"02ab5ee8decc3537d29ca857a2947b5efa18ec59a95df498cd28dafc929c8d94"}
May 20 14:52:37.989209 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:37.989031    2571 scope.go:117] "RemoveContainer" containerID="4a2ab8d59c6b8c18429154990851a9ea421efecf334b18dec80e30fbc876b5d1"
May 20 14:52:37.999817 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:37.999789    2571 scope.go:117] "RemoveContainer" containerID="4b566e40b0e0939169840b88e1e2af95f571a0081bf290a1994fab45d7e89e33"
May 20 14:52:38.008472 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:38.008452    2571 scope.go:117] "RemoveContainer" containerID="b2f68635fcc9cb42a624b78f9f1415d1985c6d68cce3220722c13e8e9d2fa662"
May 20 14:52:38.014772 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:38.014745    2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4"]
May 20 14:52:38.016492 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:38.016469    2571 scope.go:117] "RemoveContainer" containerID="4a2ab8d59c6b8c18429154990851a9ea421efecf334b18dec80e30fbc876b5d1"
May 20 14:52:38.016775 ip-10-0-130-144 kubenswrapper[2571]: E0520 14:52:38.016758    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a2ab8d59c6b8c18429154990851a9ea421efecf334b18dec80e30fbc876b5d1\": container with ID starting with 4a2ab8d59c6b8c18429154990851a9ea421efecf334b18dec80e30fbc876b5d1 not found: ID does not exist" containerID="4a2ab8d59c6b8c18429154990851a9ea421efecf334b18dec80e30fbc876b5d1"
May 20 14:52:38.016821 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:38.016783    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a2ab8d59c6b8c18429154990851a9ea421efecf334b18dec80e30fbc876b5d1"} err="failed to get container status \"4a2ab8d59c6b8c18429154990851a9ea421efecf334b18dec80e30fbc876b5d1\": rpc error: code = NotFound desc = could not find container \"4a2ab8d59c6b8c18429154990851a9ea421efecf334b18dec80e30fbc876b5d1\": container with ID starting with 4a2ab8d59c6b8c18429154990851a9ea421efecf334b18dec80e30fbc876b5d1 not found: ID does not exist"
May 20 14:52:38.016821 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:38.016802    2571 scope.go:117] "RemoveContainer" containerID="4b566e40b0e0939169840b88e1e2af95f571a0081bf290a1994fab45d7e89e33"
May 20 14:52:38.017022 ip-10-0-130-144 kubenswrapper[2571]: E0520 14:52:38.017001    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b566e40b0e0939169840b88e1e2af95f571a0081bf290a1994fab45d7e89e33\": container with ID starting with 4b566e40b0e0939169840b88e1e2af95f571a0081bf290a1994fab45d7e89e33 not found: ID does not exist" containerID="4b566e40b0e0939169840b88e1e2af95f571a0081bf290a1994fab45d7e89e33"
May 20 14:52:38.017133 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:38.017026    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b566e40b0e0939169840b88e1e2af95f571a0081bf290a1994fab45d7e89e33"} err="failed to get container status \"4b566e40b0e0939169840b88e1e2af95f571a0081bf290a1994fab45d7e89e33\": rpc error: code = NotFound desc = could not find container \"4b566e40b0e0939169840b88e1e2af95f571a0081bf290a1994fab45d7e89e33\": container with ID starting with 4b566e40b0e0939169840b88e1e2af95f571a0081bf290a1994fab45d7e89e33 not found: ID does not exist"
May 20 14:52:38.017133 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:38.017048    2571 scope.go:117] "RemoveContainer" containerID="b2f68635fcc9cb42a624b78f9f1415d1985c6d68cce3220722c13e8e9d2fa662"
May 20 14:52:38.017300 ip-10-0-130-144 kubenswrapper[2571]: E0520 14:52:38.017268    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2f68635fcc9cb42a624b78f9f1415d1985c6d68cce3220722c13e8e9d2fa662\": container with ID starting with b2f68635fcc9cb42a624b78f9f1415d1985c6d68cce3220722c13e8e9d2fa662 not found: ID does not exist" containerID="b2f68635fcc9cb42a624b78f9f1415d1985c6d68cce3220722c13e8e9d2fa662"
May 20 14:52:38.017349 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:38.017298    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2f68635fcc9cb42a624b78f9f1415d1985c6d68cce3220722c13e8e9d2fa662"} err="failed to get container status \"b2f68635fcc9cb42a624b78f9f1415d1985c6d68cce3220722c13e8e9d2fa662\": rpc error: code = NotFound desc = could not find container \"b2f68635fcc9cb42a624b78f9f1415d1985c6d68cce3220722c13e8e9d2fa662\": container with ID starting with b2f68635fcc9cb42a624b78f9f1415d1985c6d68cce3220722c13e8e9d2fa662 not found: ID does not exist"
May 20 14:52:38.020282 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:38.020260    2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-v2-predictor-6fcdd6977c-jkjm4"]
May 20 14:52:38.666465 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:52:38.666432    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87f57b45-5f78-4938-b403-cd02326f281c" path="/var/lib/kubelet/pods/87f57b45-5f78-4938-b403-cd02326f281c/volumes"
May 20 14:58:53.361440 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:58:53.361405    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qmxrv_58bb5787-36d9-4965-928a-80631bd54fed/global-pull-secret-syncer/0.log"
May 20 14:58:53.470055 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:58:53.470020    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gmcz8_a9148b87-b372-4314-a484-2aad1d67c649/konnectivity-agent/0.log"
May 20 14:58:53.577305 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:58:53.577268    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-144.ec2.internal_3b58d901cc6734ae2a8b3c707deb5d52/haproxy/0.log"
May 20 14:58:57.014527 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:58:57.014493    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-9bc4w_011983a7-38e4-4e05-bace-2205c8447d2e/cluster-monitoring-operator/0.log"
May 20 14:58:57.129307 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:58:57.129272    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6c9cc46c9f-mzh8v_dc38a275-91cc-43d2-8472-3e1e3451a991/metrics-server/0.log"
May 20 14:58:57.154067 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:58:57.154041    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-gxznb_eaf33819-3641-4939-88ed-3cb13d582565/monitoring-plugin/0.log"
May 20 14:58:57.262698 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:58:57.262665    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dd58g_1b246995-b0aa-4a0d-9d5e-85bf2ee4359d/node-exporter/0.log"
May 20 14:58:57.284020 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:58:57.283943    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dd58g_1b246995-b0aa-4a0d-9d5e-85bf2ee4359d/kube-rbac-proxy/0.log"
May 20 14:58:57.308351 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:58:57.308324    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dd58g_1b246995-b0aa-4a0d-9d5e-85bf2ee4359d/init-textfile/0.log"
May 20 14:58:57.702466 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:58:57.702432    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-kpkch_eef4416c-0eb6-4fa0-a5f4-c1237fdeadec/prometheus-operator/0.log"
May 20 14:58:57.720797 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:58:57.720762    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-kpkch_eef4416c-0eb6-4fa0-a5f4-c1237fdeadec/kube-rbac-proxy/0.log"
May 20 14:58:57.744456 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:58:57.744429    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-j79t9_340cddac-72d0-4800-a21d-8ee64d1a0177/prometheus-operator-admission-webhook/0.log"
May 20 14:58:57.773564 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:58:57.773529    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67cf6b7785-xbtqg_3a179ddd-c533-421f-b137-1e8b18e61622/telemeter-client/0.log"
May 20 14:58:57.800260 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:58:57.800237    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67cf6b7785-xbtqg_3a179ddd-c533-421f-b137-1e8b18e61622/reload/0.log"
May 20 14:58:57.823188 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:58:57.823158    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67cf6b7785-xbtqg_3a179ddd-c533-421f-b137-1e8b18e61622/kube-rbac-proxy/0.log"
May 20 14:58:59.883926 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:58:59.883895    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-74b6dc76d4-qrrnr_41896de0-f450-42a7-8e4d-3fecc8919a0c/console/0.log"
May 20 14:58:59.928716 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:58:59.928681    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-sm8lq_eeb5e81d-0e68-45db-af61-45030f64213c/download-server/0.log"
May 20 14:59:00.359676 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:00.359643    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-674pn/perf-node-gather-daemonset-sfhk9"]
May 20 14:59:00.359993 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:00.359980    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87f57b45-5f78-4938-b403-cd02326f281c" containerName="kserve-container"
May 20 14:59:00.360041 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:00.359995    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="87f57b45-5f78-4938-b403-cd02326f281c" containerName="kserve-container"
May 20 14:59:00.360041 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:00.360015    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87f57b45-5f78-4938-b403-cd02326f281c" containerName="storage-initializer"
May 20 14:59:00.360041 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:00.360020    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="87f57b45-5f78-4938-b403-cd02326f281c" containerName="storage-initializer"
May 20 14:59:00.360041 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:00.360028    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87f57b45-5f78-4938-b403-cd02326f281c" containerName="kube-rbac-proxy"
May 20 14:59:00.360041 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:00.360033    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="87f57b45-5f78-4938-b403-cd02326f281c" containerName="kube-rbac-proxy"
May 20 14:59:00.360331 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:00.360083    2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="87f57b45-5f78-4938-b403-cd02326f281c" containerName="kserve-container"
May 20 14:59:00.360331 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:00.360093    2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="87f57b45-5f78-4938-b403-cd02326f281c" containerName="kube-rbac-proxy"
May 20 14:59:00.363202 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:00.363183    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-674pn/perf-node-gather-daemonset-sfhk9"
May 20 14:59:00.370201 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:00.370178    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-674pn\"/\"openshift-service-ca.crt\""
May 20 14:59:00.371011 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:00.370970    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-674pn\"/\"default-dockercfg-lsp5c\""
May 20 14:59:00.371194 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:00.370998    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-674pn\"/\"kube-root-ca.crt\""
May 20 14:59:00.372139 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:00.372114    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-674pn/perf-node-gather-daemonset-sfhk9"]
May 20 14:59:00.521186 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:00.521156    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5433680a-f61c-4bf8-a48c-84b8bc58ad77-lib-modules\") pod \"perf-node-gather-daemonset-sfhk9\" (UID: \"5433680a-f61c-4bf8-a48c-84b8bc58ad77\") " pod="openshift-must-gather-674pn/perf-node-gather-daemonset-sfhk9"
May 20 14:59:00.521343 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:00.521209    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5433680a-f61c-4bf8-a48c-84b8bc58ad77-podres\") pod \"perf-node-gather-daemonset-sfhk9\" (UID: \"5433680a-f61c-4bf8-a48c-84b8bc58ad77\") " pod="openshift-must-gather-674pn/perf-node-gather-daemonset-sfhk9"
May 20 14:59:00.521343 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:00.521229    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5433680a-f61c-4bf8-a48c-84b8bc58ad77-proc\") pod \"perf-node-gather-daemonset-sfhk9\" (UID: \"5433680a-f61c-4bf8-a48c-84b8bc58ad77\") " pod="openshift-must-gather-674pn/perf-node-gather-daemonset-sfhk9"
May 20 14:59:00.521343 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:00.521269    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5433680a-f61c-4bf8-a48c-84b8bc58ad77-sys\") pod \"perf-node-gather-daemonset-sfhk9\" (UID: \"5433680a-f61c-4bf8-a48c-84b8bc58ad77\") " pod="openshift-must-gather-674pn/perf-node-gather-daemonset-sfhk9"
May 20 14:59:00.521343 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:00.521322    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf7zm\" (UniqueName: \"kubernetes.io/projected/5433680a-f61c-4bf8-a48c-84b8bc58ad77-kube-api-access-pf7zm\") pod \"perf-node-gather-daemonset-sfhk9\" (UID: \"5433680a-f61c-4bf8-a48c-84b8bc58ad77\") " pod="openshift-must-gather-674pn/perf-node-gather-daemonset-sfhk9"
May 20 14:59:00.621957 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:00.621856    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pf7zm\" (UniqueName: \"kubernetes.io/projected/5433680a-f61c-4bf8-a48c-84b8bc58ad77-kube-api-access-pf7zm\") pod \"perf-node-gather-daemonset-sfhk9\" (UID: \"5433680a-f61c-4bf8-a48c-84b8bc58ad77\") " pod="openshift-must-gather-674pn/perf-node-gather-daemonset-sfhk9"
May 20 14:59:00.621957 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:00.621900    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5433680a-f61c-4bf8-a48c-84b8bc58ad77-lib-modules\") pod \"perf-node-gather-daemonset-sfhk9\" (UID: \"5433680a-f61c-4bf8-a48c-84b8bc58ad77\") " pod="openshift-must-gather-674pn/perf-node-gather-daemonset-sfhk9"
May 20 14:59:00.622147 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:00.622053    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5433680a-f61c-4bf8-a48c-84b8bc58ad77-podres\") pod \"perf-node-gather-daemonset-sfhk9\" (UID: \"5433680a-f61c-4bf8-a48c-84b8bc58ad77\") " pod="openshift-must-gather-674pn/perf-node-gather-daemonset-sfhk9"
May 20 14:59:00.622147 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:00.622085    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5433680a-f61c-4bf8-a48c-84b8bc58ad77-proc\") pod \"perf-node-gather-daemonset-sfhk9\" (UID: \"5433680a-f61c-4bf8-a48c-84b8bc58ad77\") " pod="openshift-must-gather-674pn/perf-node-gather-daemonset-sfhk9"
May 20 14:59:00.622147 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:00.622120    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5433680a-f61c-4bf8-a48c-84b8bc58ad77-sys\") pod \"perf-node-gather-daemonset-sfhk9\" (UID: \"5433680a-f61c-4bf8-a48c-84b8bc58ad77\") " pod="openshift-must-gather-674pn/perf-node-gather-daemonset-sfhk9"
May 20 14:59:00.622291 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:00.622195    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5433680a-f61c-4bf8-a48c-84b8bc58ad77-lib-modules\") pod \"perf-node-gather-daemonset-sfhk9\" (UID: \"5433680a-f61c-4bf8-a48c-84b8bc58ad77\") " pod="openshift-must-gather-674pn/perf-node-gather-daemonset-sfhk9"
May 20 14:59:00.622291 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:00.622201    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5433680a-f61c-4bf8-a48c-84b8bc58ad77-proc\") pod \"perf-node-gather-daemonset-sfhk9\" (UID: \"5433680a-f61c-4bf8-a48c-84b8bc58ad77\") " pod="openshift-must-gather-674pn/perf-node-gather-daemonset-sfhk9"
May 20 14:59:00.622291 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:00.622211    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5433680a-f61c-4bf8-a48c-84b8bc58ad77-podres\") pod \"perf-node-gather-daemonset-sfhk9\" (UID: \"5433680a-f61c-4bf8-a48c-84b8bc58ad77\") " pod="openshift-must-gather-674pn/perf-node-gather-daemonset-sfhk9"
May 20 14:59:00.622291 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:00.622210    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5433680a-f61c-4bf8-a48c-84b8bc58ad77-sys\") pod \"perf-node-gather-daemonset-sfhk9\" (UID: \"5433680a-f61c-4bf8-a48c-84b8bc58ad77\") " pod="openshift-must-gather-674pn/perf-node-gather-daemonset-sfhk9"
May 20 14:59:00.630235 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:00.630215    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf7zm\" (UniqueName: \"kubernetes.io/projected/5433680a-f61c-4bf8-a48c-84b8bc58ad77-kube-api-access-pf7zm\") pod \"perf-node-gather-daemonset-sfhk9\" (UID: \"5433680a-f61c-4bf8-a48c-84b8bc58ad77\") " pod="openshift-must-gather-674pn/perf-node-gather-daemonset-sfhk9"
May 20 14:59:00.673706 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:00.673680    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-674pn/perf-node-gather-daemonset-sfhk9"
May 20 14:59:00.803346 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:00.803321    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-674pn/perf-node-gather-daemonset-sfhk9"]
May 20 14:59:00.805642 ip-10-0-130-144 kubenswrapper[2571]: W0520 14:59:00.805611    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5433680a_f61c_4bf8_a48c_84b8bc58ad77.slice/crio-4b51f5193f376b24161f0246dc649538c15b04665773245eb1d9fee1a9202880 WatchSource:0}: Error finding container 4b51f5193f376b24161f0246dc649538c15b04665773245eb1d9fee1a9202880: Status 404 returned error can't find the container with id 4b51f5193f376b24161f0246dc649538c15b04665773245eb1d9fee1a9202880
May 20 14:59:00.807565 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:00.807547    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 14:59:01.168128 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:01.168094    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b64ll_465db268-d10e-4f15-937a-0ff0f966b831/dns/0.log"
May 20 14:59:01.190777 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:01.190744    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b64ll_465db268-d10e-4f15-937a-0ff0f966b831/kube-rbac-proxy/0.log"
May 20 14:59:01.242974 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:01.242949    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jczc6_e8bd843f-d4d6-4179-a9b7-48c5fcce16f2/dns-node-resolver/0.log"
May 20 14:59:01.270788 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:01.270754    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-674pn/perf-node-gather-daemonset-sfhk9" event={"ID":"5433680a-f61c-4bf8-a48c-84b8bc58ad77","Type":"ContainerStarted","Data":"ad023533948dc5dee958e09c6293c427c93e19752b6b8561d1858eedae527ab4"}
May 20 14:59:01.270965 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:01.270792    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-674pn/perf-node-gather-daemonset-sfhk9" event={"ID":"5433680a-f61c-4bf8-a48c-84b8bc58ad77","Type":"ContainerStarted","Data":"4b51f5193f376b24161f0246dc649538c15b04665773245eb1d9fee1a9202880"}
May 20 14:59:01.270965 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:01.270887    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-674pn/perf-node-gather-daemonset-sfhk9"
May 20 14:59:01.301432 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:01.301390    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-674pn/perf-node-gather-daemonset-sfhk9" podStartSLOduration=1.3013770550000001 podStartE2EDuration="1.301377055s" podCreationTimestamp="2026-05-20 14:59:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 14:59:01.301331702 +0000 UTC m=+4151.174118860" watchObservedRunningTime="2026-05-20 14:59:01.301377055 +0000 UTC m=+4151.174164212"
May 20 14:59:01.751682 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:01.751651    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-8cdb97686-22vqz_2dcb385e-d1a9-442f-85b2-b2f3537a783d/registry/0.log"
May 20 14:59:01.805622 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:01.805590    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g8gjr_80b8fd3b-57c3-42a7-8028-8d04d797d224/node-ca/0.log"
May 20 14:59:02.955513 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:02.955465    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9lhwc_2605e754-d0c5-49d1-87e4-d0d4b0f4088e/serve-healthcheck-canary/0.log"
May 20 14:59:03.344521 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:03.344431    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-ppgpb_496f0332-8b87-4f2e-b275-af4f3b0529fa/insights-operator/0.log"
May 20 14:59:03.345307 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:03.345290    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-ppgpb_496f0332-8b87-4f2e-b275-af4f3b0529fa/insights-operator/1.log"
May 20 14:59:03.508541 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:03.508513    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sh9dr_4a2208fd-d8f7-4b95-9a9c-82f7a55017e1/kube-rbac-proxy/0.log"
May 20 14:59:03.530904 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:03.530879    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sh9dr_4a2208fd-d8f7-4b95-9a9c-82f7a55017e1/exporter/0.log"
May 20 14:59:03.556474 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:03.556452    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sh9dr_4a2208fd-d8f7-4b95-9a9c-82f7a55017e1/extractor/0.log"
May 20 14:59:05.611726 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:05.611696    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-867cffc775-ngx2r_0f1f2132-0d7c-4f80-bcd4-2459877a96f2/manager/0.log"
May 20 14:59:05.652971 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:05.652927    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-86f7b4b499-xfvfr_8ed63dce-4f0c-40aa-92c7-2bf81c019b34/server/0.log"
May 20 14:59:06.114545 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:06.114519    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-79f457656b-bm8g8_ffcd06ab-f4eb-45b0-a620-898bded728e2/seaweedfs/0.log"
May 20 14:59:06.144517 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:06.144484    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-tls-custom-5c88b85bb7-8tz78_ccce1b27-5dfb-4f90-8b2b-2304a46938eb/seaweedfs-tls-custom/0.log"
May 20 14:59:07.283338 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:07.283314    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-674pn/perf-node-gather-daemonset-sfhk9"
May 20 14:59:11.969248 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:11.969219    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p86kx_7fb2aae9-8e70-4380-b813-b15da35d6bb4/kube-multus-additional-cni-plugins/0.log"
May 20 14:59:11.992163 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:11.992141    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p86kx_7fb2aae9-8e70-4380-b813-b15da35d6bb4/egress-router-binary-copy/0.log"
May 20 14:59:12.013140 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:12.013115    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p86kx_7fb2aae9-8e70-4380-b813-b15da35d6bb4/cni-plugins/0.log"
May 20 14:59:12.035317 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:12.035299    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p86kx_7fb2aae9-8e70-4380-b813-b15da35d6bb4/bond-cni-plugin/0.log"
May 20 14:59:12.058212 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:12.058187    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p86kx_7fb2aae9-8e70-4380-b813-b15da35d6bb4/routeoverride-cni/0.log"
May 20 14:59:12.080236 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:12.080214    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p86kx_7fb2aae9-8e70-4380-b813-b15da35d6bb4/whereabouts-cni-bincopy/0.log"
May 20 14:59:12.104123 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:12.104031    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p86kx_7fb2aae9-8e70-4380-b813-b15da35d6bb4/whereabouts-cni/0.log"
May 20 14:59:12.350395 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:12.350202    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-l5gz6_b8eb933d-81b4-49cd-ad5e-4c78099bfbd9/kube-multus/0.log"
May 20 14:59:12.532891 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:12.532862    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zhqmq_96bd478e-69c0-43e6-8df1-d6f775d6c864/network-metrics-daemon/0.log"
May 20 14:59:12.552950 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:12.552905    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zhqmq_96bd478e-69c0-43e6-8df1-d6f775d6c864/kube-rbac-proxy/0.log"
May 20 14:59:13.307328 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:13.307299    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-crztq_86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b/ovn-controller/0.log"
May 20 14:59:13.368273 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:13.368240    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-crztq_86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b/ovn-acl-logging/0.log"
May 20 14:59:13.393486 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:13.393437    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-crztq_86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b/kube-rbac-proxy-node/0.log"
May 20 14:59:13.417140 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:13.417117    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-crztq_86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b/kube-rbac-proxy-ovn-metrics/0.log"
May 20 14:59:13.438895 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:13.438873    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-crztq_86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b/northd/0.log"
May 20 14:59:13.459616 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:13.459596    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-crztq_86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b/nbdb/0.log"
May 20 14:59:13.481041 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:13.481017    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-crztq_86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b/sbdb/0.log"
May 20 14:59:13.648367 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:13.648296    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-crztq_86c1e7d3-9fba-4c39-8f01-fb3e20c1ab0b/ovnkube-controller/0.log"
May 20 14:59:15.301211 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:15.301177    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-lbcdw_9428938d-ef32-4fe7-9138-aca8852fdefe/network-check-target-container/0.log"
May 20 14:59:16.390736 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:16.390701    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-vgw8s_7685d6b2-b593-4ea9-a2b8-a427f2f0d129/iptables-alerter/0.log"
May 20 14:59:17.094425 ip-10-0-130-144 kubenswrapper[2571]: I0520 14:59:17.094395    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-md4j7_a65737a0-1eac-4f7e-bc96-c5b3281da578/tuned/0.log"