Jun 15 05:47:37.506177 ip-10-0-131-82 systemd[1]: Starting Kubernetes Kubelet...
Jun 15 05:47:37.959262 ip-10-0-131-82 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 15 05:47:37.959262 ip-10-0-131-82 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jun 15 05:47:37.959262 ip-10-0-131-82 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 15 05:47:37.959262 ip-10-0-131-82 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jun 15 05:47:37.959262 ip-10-0-131-82 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 15 05:47:37.960133 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.960050    2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jun 15 05:47:37.965216 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965201    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 15 05:47:37.965216 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965216    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 15 05:47:37.965280 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965219    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 15 05:47:37.965280 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965223    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 15 05:47:37.965280 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965226    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 15 05:47:37.965280 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965229    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 15 05:47:37.965280 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965233    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 15 05:47:37.965280 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965236    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 15 05:47:37.965280 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965240    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 15 05:47:37.965280 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965244    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 15 05:47:37.965280 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965247    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 15 05:47:37.965280 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965250    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 15 05:47:37.965280 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965252    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 15 05:47:37.965280 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965258    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 15 05:47:37.965280 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965261    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 15 05:47:37.965280 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965264    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 15 05:47:37.965280 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965266    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 15 05:47:37.965280 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965269    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 15 05:47:37.965280 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965271    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 15 05:47:37.965280 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965274    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jun 15 05:47:37.965280 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965276    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 15 05:47:37.965739 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965279    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 15 05:47:37.965739 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965281    2564 feature_gate.go:328] unrecognized feature gate: Example
Jun 15 05:47:37.965739 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965284    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 15 05:47:37.965739 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965287    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 15 05:47:37.965739 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965289    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 15 05:47:37.965739 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965292    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 15 05:47:37.965739 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965295    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 15 05:47:37.965739 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965297    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 15 05:47:37.965739 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965300    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 15 05:47:37.965739 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965302    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 15 05:47:37.965739 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965306    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 15 05:47:37.965739 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965310    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 15 05:47:37.965739 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965312    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 15 05:47:37.965739 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965315    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 15 05:47:37.965739 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965318    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 15 05:47:37.965739 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965321    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 15 05:47:37.965739 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965324    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 15 05:47:37.965739 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965326    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 15 05:47:37.965739 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965328    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 15 05:47:37.966210 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965331    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 15 05:47:37.966210 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965333    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 15 05:47:37.966210 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965335    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 15 05:47:37.966210 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965339    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 15 05:47:37.966210 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965341    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 15 05:47:37.966210 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965344    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 15 05:47:37.966210 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965346    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 15 05:47:37.966210 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965348    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 15 05:47:37.966210 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965351    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 15 05:47:37.966210 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965353    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 15 05:47:37.966210 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965356    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 15 05:47:37.966210 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965358    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 15 05:47:37.966210 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965361    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 15 05:47:37.966210 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965363    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 15 05:47:37.966210 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965367    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 15 05:47:37.966210 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965370    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 15 05:47:37.966210 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965372    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 15 05:47:37.966210 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965375    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 15 05:47:37.966210 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965377    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 15 05:47:37.966210 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965380    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 15 05:47:37.966698 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965382    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 15 05:47:37.966698 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965385    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 15 05:47:37.966698 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965388    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 15 05:47:37.966698 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965391    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 15 05:47:37.966698 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965393    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 15 05:47:37.966698 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965396    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 15 05:47:37.966698 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965398    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 15 05:47:37.966698 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965400    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 15 05:47:37.966698 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965403    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 15 05:47:37.966698 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965405    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 15 05:47:37.966698 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965408    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 15 05:47:37.966698 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965410    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 15 05:47:37.966698 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965412    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 15 05:47:37.966698 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965415    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 15 05:47:37.966698 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965418    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 15 05:47:37.966698 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965420    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 15 05:47:37.966698 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965423    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 15 05:47:37.966698 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965427    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 15 05:47:37.966698 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965430    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 15 05:47:37.966698 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965433    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 15 05:47:37.967180 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965436    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 15 05:47:37.967180 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965438    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 15 05:47:37.967180 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965440    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 15 05:47:37.967180 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965443    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 15 05:47:37.967180 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965445    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 15 05:47:37.967180 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965448    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 15 05:47:37.967180 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965451    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 15 05:47:37.967180 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965453    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 15 05:47:37.967180 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965456    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 15 05:47:37.967180 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965463    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 15 05:47:37.967180 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965465    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 15 05:47:37.967180 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965468    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 15 05:47:37.967180 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965470    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 15 05:47:37.967180 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965473    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 15 05:47:37.967180 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965475    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 15 05:47:37.967180 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965478    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 15 05:47:37.967180 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965480    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 15 05:47:37.967180 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965483    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 15 05:47:37.967180 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.965485    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 15 05:47:37.967753 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967741    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 15 05:47:37.967753 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967754    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 15 05:47:37.967804 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967757    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 15 05:47:37.967804 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967761    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 15 05:47:37.967804 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967765    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 15 05:47:37.967804 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967769    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 15 05:47:37.967804 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967772    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 15 05:47:37.967804 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967775    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 15 05:47:37.967804 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967778    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 15 05:47:37.967804 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967780    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 15 05:47:37.967804 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967783    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 15 05:47:37.967804 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967786    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 15 05:47:37.967804 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967789    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 15 05:47:37.967804 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967791    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 15 05:47:37.967804 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967793    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 15 05:47:37.967804 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967796    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 15 05:47:37.967804 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967799    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 15 05:47:37.967804 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967801    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 15 05:47:37.967804 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967804    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 15 05:47:37.967804 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967807    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 15 05:47:37.967804 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967809    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 15 05:47:37.967804 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967812    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 15 05:47:37.968395 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967815    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 15 05:47:37.968395 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967817    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 15 05:47:37.968395 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967820    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 15 05:47:37.968395 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967822    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 15 05:47:37.968395 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967824    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 15 05:47:37.968395 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967827    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 15 05:47:37.968395 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967830    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 15 05:47:37.968395 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967832    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 15 05:47:37.968395 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967835    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 15 05:47:37.968395 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967837    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 15 05:47:37.968395 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967840    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 15 05:47:37.968395 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967842    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 15 05:47:37.968395 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967845    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 15 05:47:37.968395 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967847    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 15 05:47:37.968395 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967851    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 15 05:47:37.968395 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967854    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 15 05:47:37.968395 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967870    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 15 05:47:37.968395 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967872    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 15 05:47:37.968395 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967875    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 15 05:47:37.968395 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967878    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 15 05:47:37.969178 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967880    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 15 05:47:37.969178 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967883    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 15 05:47:37.969178 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967886    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 15 05:47:37.969178 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967890    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 15 05:47:37.969178 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967892    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 15 05:47:37.969178 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967894    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 15 05:47:37.969178 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967897    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 15 05:47:37.969178 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967899    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 15 05:47:37.969178 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967902    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 15 05:47:37.969178 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967905    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 15 05:47:37.969178 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967907    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 15 05:47:37.969178 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967910    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 15 05:47:37.969178 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967912    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 15 05:47:37.969178 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967916    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 15 05:47:37.969178 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967919    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 15 05:47:37.969178 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967921    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 15 05:47:37.969178 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967924    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 15 05:47:37.969178 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967926    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 15 05:47:37.969178 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967928    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 15 05:47:37.969178 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967931    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 15 05:47:37.969702 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967933    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 15 05:47:37.969702 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967936    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 15 05:47:37.969702 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967938    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 15 05:47:37.969702 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967940    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 15 05:47:37.969702 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967943    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 15 05:47:37.969702 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967945    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 15 05:47:37.969702 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967948    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 15 05:47:37.969702 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967950    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 15 05:47:37.969702 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967952    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 15 05:47:37.969702 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967955    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 15 05:47:37.969702 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967957    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 15 05:47:37.969702 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967960    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jun 15 05:47:37.969702 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967962    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 15 05:47:37.969702 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967966    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 15 05:47:37.969702 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967969    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 15 05:47:37.969702 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967971    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 15 05:47:37.969702 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967974    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 15 05:47:37.969702 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967976    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 15 05:47:37.969702 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967979    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 15 05:47:37.970192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967981    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 15 05:47:37.970192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967983    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 15 05:47:37.970192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967986    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 15 05:47:37.970192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967988    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 15 05:47:37.970192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967991    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 15 05:47:37.970192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967993    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 15 05:47:37.970192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.967999    2564 feature_gate.go:328] unrecognized feature gate: Example
Jun 15 05:47:37.970192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.968001    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 15 05:47:37.970192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.968004    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 15 05:47:37.970192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.968006    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 15 05:47:37.970192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.968008    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 15 05:47:37.970192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.968011    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 15 05:47:37.970192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.968013    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 15 05:47:37.970192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.968016    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 15 05:47:37.970192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.968018    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 15 05:47:37.970192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.968020    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 15 05:47:37.970192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.968024    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 15 05:47:37.970192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.968027    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 15 05:47:37.970192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969128    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 15 05:47:37.970192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969148    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 15 05:47:37.970681 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969152    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 15 05:47:37.970681 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969155    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 15 05:47:37.970681 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969158    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 15 05:47:37.970681 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969163    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 15 05:47:37.970681 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969166    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 15 05:47:37.970681 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969170    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 15 05:47:37.970681 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969173    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 15 05:47:37.970681 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969176    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 15 05:47:37.970681 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969179    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 15 05:47:37.970681 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969182    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 15 05:47:37.970681 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969186    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 15 05:47:37.970681 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969191    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 15 05:47:37.970681 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969196    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 15 05:47:37.970681 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969201    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 15 05:47:37.970681 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969205    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 15 05:47:37.970681 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969209    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 15 05:47:37.970681 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969246    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 15 05:47:37.970681 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969249    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 15 05:47:37.970681 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969368    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 15 05:47:37.970681 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969371    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 15 05:47:37.971192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969374    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 15 05:47:37.971192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969377    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 15 05:47:37.971192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969380    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 15 05:47:37.971192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969382    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 15 05:47:37.971192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969385    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 15 05:47:37.971192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969388    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 15 05:47:37.971192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969390    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 15 05:47:37.971192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969393    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 15 05:47:37.971192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969396    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jun 15 05:47:37.971192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969398    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 15 05:47:37.971192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969401    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 15 05:47:37.971192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969404    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 15 05:47:37.971192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969407    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 15 05:47:37.971192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969410    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 15 05:47:37.971192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969412    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 15 05:47:37.971192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969415    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 15 05:47:37.971192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969417    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 15 05:47:37.971192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969420    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 15 05:47:37.971192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969423    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 15 05:47:37.971192 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969426    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 15 05:47:37.971694 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969428    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 15 05:47:37.971694 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969431    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 15 05:47:37.971694 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969434    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 15 05:47:37.971694 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969437    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 15 05:47:37.971694 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969439    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 15 05:47:37.971694 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969441    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 15 05:47:37.971694 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969444    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 15 05:47:37.971694 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969450    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 15 05:47:37.971694 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969454    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 15 05:47:37.971694 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969457    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 15 05:47:37.971694 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969459    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 15 05:47:37.971694 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969462    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 15 05:47:37.971694 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969464    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 15 05:47:37.971694 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969467    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 15 05:47:37.971694 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969470    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 15 05:47:37.971694 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969473    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 15 05:47:37.971694 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969476    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 15 05:47:37.971694 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969479    2564 feature_gate.go:328] unrecognized feature gate: Example
Jun 15 05:47:37.971694 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969481    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 15 05:47:37.971694 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969484    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 15 05:47:37.972203 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969486    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 15 05:47:37.972203 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969489    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 15 05:47:37.972203 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969491    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 15 05:47:37.972203 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969494    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 15 05:47:37.972203 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969497    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 15 05:47:37.972203 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969500    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 15 05:47:37.972203 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969502    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 15 05:47:37.972203 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969505    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 15 05:47:37.972203 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969507    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 15 05:47:37.972203 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969510    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 15 05:47:37.972203 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969513    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 15 05:47:37.972203 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969515    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 15 05:47:37.972203 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969518    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 15 05:47:37.972203 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969520    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 15 05:47:37.972203 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969522    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 15 05:47:37.972203 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969525    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 15 05:47:37.972203 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969528    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 15 05:47:37.972203 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969530    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 15 05:47:37.972203 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969533    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 15 05:47:37.972203 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969535    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 15 05:47:37.972711 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969541    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 15 05:47:37.972711 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969544    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 15 05:47:37.972711 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969547    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 15 05:47:37.972711 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969550    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 15 05:47:37.972711 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969553    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 15 05:47:37.972711 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969556    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 15 05:47:37.972711 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969559    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 15 05:47:37.972711 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969563    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 15 05:47:37.972711 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969568    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 15 05:47:37.972711 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969571    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 15 05:47:37.972711 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969574    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 15 05:47:37.972711 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969577    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 15 05:47:37.972711 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969580    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 15 05:47:37.972711 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969583    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 15 05:47:37.972711 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969585    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 15 05:47:37.972711 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969588    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 15 05:47:37.972711 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.969591    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 15 05:47:37.972711 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969666    2564 flags.go:64] FLAG: --address="0.0.0.0"
Jun 15 05:47:37.972711 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969673    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jun 15 05:47:37.972711 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969680    2564 flags.go:64] FLAG: --anonymous-auth="true"
Jun 15 05:47:37.973214 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969684    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jun 15 05:47:37.973214 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969688    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
Jun 15 05:47:37.973214 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969692    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jun 15 05:47:37.973214 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969696    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jun 15 05:47:37.973214 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969700    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jun 15 05:47:37.973214 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969703    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jun 15 05:47:37.973214 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969707    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jun 15 05:47:37.973214 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969710    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jun 15 05:47:37.973214 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969714    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jun 15 05:47:37.973214 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969725    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jun 15 05:47:37.973214 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969728    2564 flags.go:64] FLAG: --cgroup-root=""
Jun 15 05:47:37.973214 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969731    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
Jun 15 05:47:37.973214 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969734    2564 flags.go:64] FLAG: --client-ca-file=""
Jun 15 05:47:37.973214 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969736    2564 flags.go:64] FLAG: --cloud-provider="external"
Jun 15 05:47:37.973214 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969747    2564 flags.go:64] FLAG: --cluster-dns="[]"
Jun 15 05:47:37.973214 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969751    2564 flags.go:64] FLAG: --cluster-domain=""
Jun 15 05:47:37.973214 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969754    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jun 15 05:47:37.973214 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969757    2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jun 15 05:47:37.973214 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969760    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jun 15 05:47:37.973214 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969763    2564 flags.go:64] FLAG: --container-log-max-files="5"
Jun 15 05:47:37.973214 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969767    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jun 15 05:47:37.973214 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969770    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jun 15 05:47:37.973214 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969773    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jun 15 05:47:37.973800 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969776    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jun 15 05:47:37.973800 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969779    2564 flags.go:64] FLAG: --contention-profiling="false"
Jun 15 05:47:37.973800 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969782    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jun 15 05:47:37.973800 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969785    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jun 15 05:47:37.973800 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969789    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
Jun 15 05:47:37.973800 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969792    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jun 15 05:47:37.973800 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969796    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jun 15 05:47:37.973800 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969799    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jun 15 05:47:37.973800 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969801    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jun 15 05:47:37.973800 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969804    2564 flags.go:64] FLAG: --enable-load-reader="false"
Jun 15 05:47:37.973800 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969807    2564 flags.go:64] FLAG: --enable-server="true"
Jun 15 05:47:37.973800 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969809    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jun 15 05:47:37.973800 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969815    2564 flags.go:64] FLAG: --event-burst="100"
Jun 15 05:47:37.973800 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969818    2564 flags.go:64] FLAG: --event-qps="50"
Jun 15 05:47:37.973800 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969821    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jun 15 05:47:37.973800 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969823    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jun 15 05:47:37.973800 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969826    2564 flags.go:64] FLAG: --eviction-hard=""
Jun 15 05:47:37.973800 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969830    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jun 15 05:47:37.973800 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969833    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jun 15 05:47:37.973800 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969835    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jun 15 05:47:37.973800 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969838    2564 flags.go:64] FLAG: --eviction-soft=""
Jun 15 05:47:37.973800 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969841    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jun 15 05:47:37.973800 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969843    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jun 15 05:47:37.973800 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969846    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jun 15 05:47:37.973800 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969849    2564 flags.go:64] FLAG: --experimental-mounter-path=""
Jun 15 05:47:37.974531 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969852    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
Jun 15 05:47:37.974531 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969870    2564 flags.go:64] FLAG: --fail-swap-on="true"
Jun 15 05:47:37.974531 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969874    2564 flags.go:64] FLAG: --feature-gates=""
Jun 15 05:47:37.974531 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969878    2564 flags.go:64] FLAG: --file-check-frequency="20s"
Jun 15 05:47:37.974531 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969881    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jun 15 05:47:37.974531 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969884    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jun 15 05:47:37.974531 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969887    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jun 15 05:47:37.974531 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969890    2564 flags.go:64] FLAG: --healthz-port="10248"
Jun 15 05:47:37.974531 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969893    2564 flags.go:64] FLAG: --help="false"
Jun 15 05:47:37.974531 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969896    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-131-82.ec2.internal"
Jun 15 05:47:37.974531 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969899    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
Jun 15 05:47:37.974531 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969902    2564 flags.go:64] FLAG: --http-check-frequency="20s"
Jun 15 05:47:37.974531 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969904    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jun 15 05:47:37.974531 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969908    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jun 15 05:47:37.974531 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969911    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jun 15 05:47:37.974531 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969914    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jun 15 05:47:37.974531 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969916    2564 flags.go:64] FLAG: --image-service-endpoint=""
Jun 15 05:47:37.974531 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969919    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jun 15 05:47:37.974531 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969922    2564 flags.go:64] FLAG: --kube-api-burst="100"
Jun 15 05:47:37.974531 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969924    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jun 15 05:47:37.974531 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969927    2564 flags.go:64] FLAG: --kube-api-qps="50"
Jun 15 05:47:37.974531 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969930    2564 flags.go:64] FLAG: --kube-reserved=""
Jun 15 05:47:37.974531 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969933    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jun 15 05:47:37.974531 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969935    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jun 15 05:47:37.975133 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969938    2564 flags.go:64] FLAG: --kubelet-cgroups=""
Jun 15 05:47:37.975133 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969941    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jun 15 05:47:37.975133 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969943    2564 flags.go:64] FLAG: --lock-file=""
Jun 15 05:47:37.975133 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969946    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jun 15 05:47:37.975133 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969949    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
Jun 15 05:47:37.975133 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969952    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jun 15 05:47:37.975133 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969957    2564 flags.go:64] FLAG: --log-json-split-stream="false"
Jun 15 05:47:37.975133 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969959    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jun 15 05:47:37.975133 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969963    2564 flags.go:64] FLAG: --log-text-split-stream="false"
Jun 15 05:47:37.975133 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969966    2564 flags.go:64] FLAG: --logging-format="text"
Jun 15 05:47:37.975133 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969968    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jun 15 05:47:37.975133 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969972    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jun 15 05:47:37.975133 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969974    2564 flags.go:64] FLAG: --manifest-url=""
Jun 15 05:47:37.975133 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969977    2564 flags.go:64] FLAG: --manifest-url-header=""
Jun 15 05:47:37.975133 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969981    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jun 15 05:47:37.975133 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969984    2564 flags.go:64] FLAG: --max-open-files="1000000"
Jun 15 05:47:37.975133 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969987    2564 flags.go:64] FLAG: --max-pods="110"
Jun 15 05:47:37.975133 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969990    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jun 15 05:47:37.975133 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969993    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jun 15 05:47:37.975133 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969996    2564 flags.go:64] FLAG: --memory-manager-policy="None"
Jun 15 05:47:37.975133 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.969999    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jun 15 05:47:37.975133 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970002    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jun 15 05:47:37.975133 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970005    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jun 15 05:47:37.975133 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970007    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jun 15 05:47:37.975133 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970015    2564 flags.go:64] FLAG: --node-status-max-images="50"
Jun 15 05:47:37.975733 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970018    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jun 15 05:47:37.975733 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970021    2564 flags.go:64] FLAG: --oom-score-adj="-999"
Jun 15 05:47:37.975733 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970023    2564 flags.go:64] FLAG: --pod-cidr=""
Jun 15 05:47:37.975733 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970026    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52"
Jun 15 05:47:37.975733 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970031    2564 flags.go:64] FLAG: --pod-manifest-path=""
Jun 15 05:47:37.975733 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970033    2564 flags.go:64] FLAG: --pod-max-pids="-1"
Jun 15 05:47:37.975733 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970036    2564 flags.go:64] FLAG: --pods-per-core="0"
Jun 15 05:47:37.975733 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970039    2564 flags.go:64] FLAG: --port="10250"
Jun 15 05:47:37.975733 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970041    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jun 15 05:47:37.975733 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970044    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b27ded2777f14cdf"
Jun 15 05:47:37.975733 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970047    2564 flags.go:64] FLAG: --qos-reserved=""
Jun 15 05:47:37.975733 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970050    2564 flags.go:64] FLAG: --read-only-port="10255"
Jun 15 05:47:37.975733 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970053    2564 flags.go:64] FLAG: --register-node="true"
Jun 15 05:47:37.975733 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970056    2564 flags.go:64] FLAG: --register-with-taints=""
Jun 15 05:47:37.975733 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970063    2564 flags.go:64] FLAG: --registry-burst="10"
Jun 15 05:47:37.975733 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970066    2564 flags.go:64] FLAG: --registry-qps="5"
Jun 15 05:47:37.975733 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970069    2564 flags.go:64] FLAG: --reserved-cpus=""
Jun 15 05:47:37.975733 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970072    2564 flags.go:64] FLAG: --reserved-memory=""
Jun 15 05:47:37.975733 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970075    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jun 15 05:47:37.975733 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970078    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jun 15 05:47:37.975733 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970081    2564 flags.go:64] FLAG: --rotate-certificates="false"
Jun 15 05:47:37.975733 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970084    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
Jun 15 05:47:37.975733 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970086    2564 flags.go:64] FLAG: --runonce="false"
Jun 15 05:47:37.975733 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970089    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jun 15 05:47:37.975733 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970092    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jun 15 05:47:37.976351 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970095    2564 flags.go:64] FLAG: --seccomp-default="false"
Jun 15 05:47:37.976351 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970098    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
Jun 15 05:47:37.976351 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970100    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jun 15 05:47:37.976351 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970103    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jun 15 05:47:37.976351 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970106    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jun 15 05:47:37.976351 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970109    2564 flags.go:64] FLAG: --storage-driver-password="root"
Jun 15 05:47:37.976351 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970111    2564 flags.go:64] FLAG: --storage-driver-secure="false"
Jun 15 05:47:37.976351 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970114    2564 flags.go:64] FLAG: --storage-driver-table="stats"
Jun 15 05:47:37.976351 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970117    2564 flags.go:64] FLAG: --storage-driver-user="root"
Jun 15 05:47:37.976351 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970119    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jun 15 05:47:37.976351 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970122    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
Jun 15 05:47:37.976351 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970125    2564 flags.go:64] FLAG: --system-cgroups=""
Jun 15 05:47:37.976351 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970127    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jun 15 05:47:37.976351 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970133    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
Jun 15 05:47:37.976351 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970135    2564 flags.go:64] FLAG: --tls-cert-file=""
Jun 15 05:47:37.976351 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970138    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jun 15 05:47:37.976351 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970141    2564 flags.go:64] FLAG: --tls-min-version=""
Jun 15 05:47:37.976351 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970144    2564 flags.go:64] FLAG: --tls-private-key-file=""
Jun 15 05:47:37.976351 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970146    2564 flags.go:64] FLAG: --topology-manager-policy="none"
Jun 15 05:47:37.976351 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970149    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
Jun 15 05:47:37.976351 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970152    2564 flags.go:64] FLAG: --topology-manager-scope="container"
Jun 15 05:47:37.976351 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970155    2564 flags.go:64] FLAG: --v="2"
Jun 15 05:47:37.976351 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970158    2564 flags.go:64] FLAG: --version="false"
Jun 15 05:47:37.976351 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970162    2564 flags.go:64] FLAG: --vmodule=""
Jun 15 05:47:37.976351 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970168    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jun 15 05:47:37.976964 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.970171    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jun 15 05:47:37.976964 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970281    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 15 05:47:37.976964 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970285    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 15 05:47:37.976964 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970288    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 15 05:47:37.976964 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970291    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 15 05:47:37.976964 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970293    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 15 05:47:37.976964 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970295    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 15 05:47:37.976964 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970298    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 15 05:47:37.976964 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970303    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 15 05:47:37.976964 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970305    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 15 05:47:37.976964 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970308    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 15 05:47:37.976964 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970310    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 15 05:47:37.976964 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970312    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 15 05:47:37.976964 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970315    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 15 05:47:37.976964 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970317    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 15 05:47:37.976964 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970320    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 15 05:47:37.976964 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970323    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 15 05:47:37.976964 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970325    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 15 05:47:37.976964 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970328    2564 feature_gate.go:328] unrecognized feature gate: Example
Jun 15 05:47:37.976964 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970330    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 15 05:47:37.976964 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970333    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 15 05:47:37.977743 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970335    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 15 05:47:37.977743 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970337    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 15 05:47:37.977743 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970340    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 15 05:47:37.977743 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970342    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 15 05:47:37.977743 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970345    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 15 05:47:37.977743 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970347    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 15 05:47:37.977743 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970349    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 15 05:47:37.977743 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970352    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 15 05:47:37.977743 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970354    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 15 05:47:37.977743 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970356    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 15 05:47:37.977743 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970359    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 15 05:47:37.977743 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970362    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 15 05:47:37.977743 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970365    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 15 05:47:37.977743 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970367    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 15 05:47:37.977743 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970370    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jun 15 05:47:37.977743 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970372    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 15 05:47:37.977743 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970375    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 15 05:47:37.977743 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970377    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 15 05:47:37.977743 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970379    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 15 05:47:37.977743 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970383    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 15 05:47:37.978624 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970390    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 15 05:47:37.978624 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970393    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 15 05:47:37.978624 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970395    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 15 05:47:37.978624 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970397    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 15 05:47:37.978624 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970400    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 15 05:47:37.978624 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970402    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 15 05:47:37.978624 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970405    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 15 05:47:37.978624 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970407    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 15 05:47:37.978624 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970410    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 15 05:47:37.978624 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970412    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 15 05:47:37.978624 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970414    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 15 05:47:37.978624 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970417    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 15 05:47:37.978624 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970420    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 15 05:47:37.978624 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970422    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 15 05:47:37.978624 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970424    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 15 05:47:37.978624 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970427    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 15 05:47:37.978624 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970429    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 15 05:47:37.978624 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970431    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 15 05:47:37.978624 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970434    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 15 05:47:37.978624 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970436    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 15 05:47:37.979485 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970438    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 15 05:47:37.979485 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970442    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 15 05:47:37.979485 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970445    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 15 05:47:37.979485 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970451    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 15 05:47:37.979485 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970454    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 15 05:47:37.979485 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970457    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 15 05:47:37.979485 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970460    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 15 05:47:37.979485 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970462    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 15 05:47:37.979485 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970465    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 15 05:47:37.979485 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970467    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 15 05:47:37.979485 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970470    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 15 05:47:37.979485 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970474    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 15 05:47:37.979485 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970476    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 15 05:47:37.979485 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970478    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 15 05:47:37.979485 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970481    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 15 05:47:37.979485 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970483    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 15 05:47:37.979485 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970486    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 15 05:47:37.979485 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970488    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 15 05:47:37.979485 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970491    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 15 05:47:37.980398 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970493    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 15 05:47:37.980398 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970496    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 15 05:47:37.980398 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970499    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 15 05:47:37.980398 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970501    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 15 05:47:37.980398 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970503    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 15 05:47:37.980398 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970506    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 15 05:47:37.980398 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970510    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 15 05:47:37.980398 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970513    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 15 05:47:37.980398 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970516    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 15 05:47:37.980398 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970519    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 15 05:47:37.980398 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970521    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 15 05:47:37.980398 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970524    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 15 05:47:37.980398 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970526    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 15 05:47:37.980398 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970529    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 15 05:47:37.980398 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970531    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 15 05:47:37.980398 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970534    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 15 05:47:37.980398 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970537    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 15 05:47:37.980398 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970540    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 15 05:47:37.980398 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970543    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 15 05:47:37.981130 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.970546    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 15 05:47:37.981130 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.971329    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 15 05:47:37.981130 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.979508    2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jun 15 05:47:37.981130 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.979527    2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jun 15 05:47:37.981130 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.979549    2564 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jun 15 05:47:37.981130 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.979563    2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jun 15 05:47:37.981130 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979645    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 15 05:47:37.981130 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979653    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 15 05:47:37.981130 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979658    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 15 05:47:37.981130 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979662    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 15 05:47:37.981130 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979666    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 15 05:47:37.981130 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979671    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 15 05:47:37.981130 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979676    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 15 05:47:37.981464 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979681    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 15 05:47:37.981464 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979687    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 15 05:47:37.981464 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979691    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 15 05:47:37.981464 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979695    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 15 05:47:37.981464 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979700    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 15 05:47:37.981464 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979705    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 15 05:47:37.981464 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979710    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 15 05:47:37.981464 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979714    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 15 05:47:37.981464 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979719    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 15 05:47:37.981464 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979723    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 15 05:47:37.981464 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979727    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 15 05:47:37.981464 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979734    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 15 05:47:37.981464 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979741    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 15 05:47:37.981464 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979747    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 15 05:47:37.981464 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979753    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 15 05:47:37.981464 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979758    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 15 05:47:37.981464 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979762    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 15 05:47:37.981464 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979767    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 15 05:47:37.981464 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979772    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 15 05:47:37.982187 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979777    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 15 05:47:37.982187 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979781    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 15 05:47:37.982187 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979786    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 15 05:47:37.982187 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979791    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 15 05:47:37.982187 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979796    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 15 05:47:37.982187 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979800    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 15 05:47:37.982187 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979804    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 15 05:47:37.982187 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979809    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 15 05:47:37.982187 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979813    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 15 05:47:37.982187 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979817    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 15 05:47:37.982187 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979821    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 15 05:47:37.982187 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979825    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 15 05:47:37.982187 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979829    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 15 05:47:37.982187 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979833    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 15 05:47:37.982187 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979837    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 15 05:47:37.982187 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979841    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 15 05:47:37.982187 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979845    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 15 05:47:37.982187 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979849    2564 feature_gate.go:328] unrecognized feature gate: Example
Jun 15 05:47:37.982187 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979853    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 15 05:47:37.982187 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979879    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 15 05:47:37.983047 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979884    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 15 05:47:37.983047 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979887    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 15 05:47:37.983047 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979891    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 15 05:47:37.983047 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979894    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 15 05:47:37.983047 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979898    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 15 05:47:37.983047 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979901    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 15 05:47:37.983047 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979905    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jun 15 05:47:37.983047 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979909    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 15 05:47:37.983047 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979913    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 15 05:47:37.983047 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979916    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 15 05:47:37.983047 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979920    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 15 05:47:37.983047 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979924    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 15 05:47:37.983047 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979930    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 15 05:47:37.983047 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979936    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 15 05:47:37.983047 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979940    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 15 05:47:37.983047 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979944    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 15 05:47:37.983047 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979948    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 15 05:47:37.983047 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979951    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 15 05:47:37.983047 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979955    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 15 05:47:37.983564 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979959    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 15 05:47:37.983564 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979963    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 15 05:47:37.983564 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979967    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 15 05:47:37.983564 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979971    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 15 05:47:37.983564 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979975    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 15 05:47:37.983564 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979979    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 15 05:47:37.983564 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979983    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 15 05:47:37.983564 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979987    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 15 05:47:37.983564 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979991    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 15 05:47:37.983564 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979994    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 15 05:47:37.983564 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.979998    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 15 05:47:37.983564 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980003    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 15 05:47:37.983564 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980007    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 15 05:47:37.983564 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980011    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 15 05:47:37.983564 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980015    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 15 05:47:37.983564 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980019    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 15 05:47:37.983564 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980023    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 15 05:47:37.983564 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980027    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 15 05:47:37.983564 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980031    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 15 05:47:37.983564 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980035    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 15 05:47:37.984203 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980040    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 15 05:47:37.984203 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980044    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 15 05:47:37.984203 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980048    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 15 05:47:37.984203 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980052    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 15 05:47:37.984203 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980057    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 15 05:47:37.984203 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980061    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 15 05:47:37.984203 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980066    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 15 05:47:37.984203 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980070    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 15 05:47:37.984203 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980074    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 15 05:47:37.984203 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980078    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 15 05:47:37.984203 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980082    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 15 05:47:37.984203 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980087    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 15 05:47:37.984203 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980091    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 15 05:47:37.984203 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980095    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 15 05:47:37.984203 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.980103    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 15 05:47:37.984570 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980278    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 15 05:47:37.984570 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980286    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jun 15 05:47:37.984570 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980290    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 15 05:47:37.984570 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980295    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 15 05:47:37.984570 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980300    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 15 05:47:37.984570 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980304    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 15 05:47:37.984570 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980309    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 15 05:47:37.984570 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980313    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 15 05:47:37.984570 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980317    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 15 05:47:37.984570 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980321    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 15 05:47:37.984570 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980325    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 15 05:47:37.984570 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980329    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 15 05:47:37.984570 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980333    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 15 05:47:37.984570 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980337    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 15 05:47:37.984570 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980341    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 15 05:47:37.984570 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980345    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 15 05:47:37.984570 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980349    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 15 05:47:37.984570 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980353    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 15 05:47:37.984570 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980357    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 15 05:47:37.984570 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980362    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 15 05:47:37.985113 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980366    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 15 05:47:37.985113 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980370    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 15 05:47:37.985113 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980375    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 15 05:47:37.985113 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980379    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 15 05:47:37.985113 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980384    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 15 05:47:37.985113 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980388    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 15 05:47:37.985113 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980392    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 15 05:47:37.985113 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980396    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 15 05:47:37.985113 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980400    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 15 05:47:37.985113 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980403    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 15 05:47:37.985113 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980408    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 15 05:47:37.985113 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980414    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 15 05:47:37.985113 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980417    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 15 05:47:37.985113 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980421    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 15 05:47:37.985113 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980425    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 15 05:47:37.985113 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980429    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 15 05:47:37.985113 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980433    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 15 05:47:37.985113 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980438    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 15 05:47:37.985113 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980442    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 15 05:47:37.985566 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980446    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 15 05:47:37.985566 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980450    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 15 05:47:37.985566 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980454    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 15 05:47:37.985566 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980458    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 15 05:47:37.985566 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980462    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 15 05:47:37.985566 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980466    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 15 05:47:37.985566 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980471    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 15 05:47:37.985566 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980474    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 15 05:47:37.985566 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980479    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 15 05:47:37.985566 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980483    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 15 05:47:37.985566 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980487    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 15 05:47:37.985566 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980491    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 15 05:47:37.985566 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980495    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 15 05:47:37.985566 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980499    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 15 05:47:37.985566 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980503    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 15 05:47:37.985566 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980507    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 15 05:47:37.985566 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980511    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 15 05:47:37.985566 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980515    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 15 05:47:37.985566 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980520    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 15 05:47:37.985566 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980524    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 15 05:47:37.986223 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980528    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 15 05:47:37.986223 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980532    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 15 05:47:37.986223 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980539    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 15 05:47:37.986223 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980544    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 15 05:47:37.986223 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980548    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 15 05:47:37.986223 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980553    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 15 05:47:37.986223 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980557    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 15 05:47:37.986223 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980562    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 15 05:47:37.986223 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980566    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 15 05:47:37.986223 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980571    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 15 05:47:37.986223 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980575    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 15 05:47:37.986223 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980579    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 15 05:47:37.986223 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980583    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 15 05:47:37.986223 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980588    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 15 05:47:37.986223 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980591    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 15 05:47:37.986223 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980596    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 15 05:47:37.986223 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980600    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 15 05:47:37.986223 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980603    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 15 05:47:37.986223 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980608    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 15 05:47:37.986223 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980612    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 15 05:47:37.986765 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980616    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 15 05:47:37.986765 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980620    2564 feature_gate.go:328] unrecognized feature gate: Example
Jun 15 05:47:37.986765 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980628    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 15 05:47:37.986765 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980632    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 15 05:47:37.986765 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980636    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 15 05:47:37.986765 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980643    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 15 05:47:37.986765 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980648    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 15 05:47:37.986765 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980653    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 15 05:47:37.986765 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980657    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 15 05:47:37.986765 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980661    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 15 05:47:37.986765 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980666    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 15 05:47:37.986765 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980671    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 15 05:47:37.986765 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980676    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 15 05:47:37.986765 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980681    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 15 05:47:37.986765 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980685    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 15 05:47:37.986765 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980690    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 15 05:47:37.986765 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980694    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 15 05:47:37.986765 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980697    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 15 05:47:37.986765 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980701    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 15 05:47:37.987254 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:37.980706    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 15 05:47:37.987254 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.980714    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 15 05:47:37.987254 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.980854    2564 server.go:962] "Client rotation is on, will bootstrap in background"
Jun 15 05:47:37.987254 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.983976    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jun 15 05:47:37.987254 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.985745    2564 server.go:1019] "Starting client certificate rotation"
Jun 15 05:47:37.987254 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.985853    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 15 05:47:37.987254 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.985908    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 15 05:47:37.988748 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.988731    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 15 05:47:37.991463 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:37.991446    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 15 05:47:38.009136 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.009112    2564 log.go:25] "Validated CRI v1 runtime API"
Jun 15 05:47:38.013795 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.013778    2564 log.go:25] "Validated CRI v1 image API"
Jun 15 05:47:38.014729 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.014713    2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jun 15 05:47:38.017247 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.017230    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 15 05:47:38.019937 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.019917    2564 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7ea8d556-a003-4962-9e5e-3362fc08642f:/dev/nvme0n1p4 9698249b-aa3c-4ae4-942f-3be80bf20025:/dev/nvme0n1p3]
Jun 15 05:47:38.019999 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.019937    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jun 15 05:47:38.025536 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.025428    2564 manager.go:216] Machine: {Timestamp:2026-06-15 05:47:38.024057972 +0000 UTC m=+0.390603014 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094056 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cd699660ea1e09063fa6a88df3422 SystemUUID:ec2cd699-660e-a1e0-9063-fa6a88df3422 BootID:cf45ea1b-07b3-44fd-be2b-0d8790cc58ba Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:40:ac:1f:43:b9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:40:ac:1f:43:b9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:86:7a:e2:0e:01:4e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jun 15 05:47:38.025536 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.025532    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jun 15 05:47:38.025636 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.025611    2564 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jun 15 05:47:38.028500 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.028478    2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jun 15 05:47:38.028633 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.028503    2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-82.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jun 15 05:47:38.029332 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.029322    2564 topology_manager.go:138] "Creating topology manager with none policy"
Jun 15 05:47:38.029370 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.029335    2564 container_manager_linux.go:309] "Creating device plugin manager"
Jun 15 05:47:38.029370 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.029343    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 15 05:47:38.029370 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.029357    2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 15 05:47:38.031195 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.031185    2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jun 15 05:47:38.035887 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.035876    2564 state_mem.go:36] "Initialized new in-memory state store"
Jun 15 05:47:38.035997 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.035987    2564 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jun 15 05:47:38.036035 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.036016    2564 kubelet.go:486] "Attempting to sync node with API server"
Jun 15 05:47:38.036035 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.036027    2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jun 15 05:47:38.036106 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.036041    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jun 15 05:47:38.036106 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.036052    2564 kubelet.go:398] "Adding apiserver pod source"
Jun 15 05:47:38.036106 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.036061    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jun 15 05:47:38.036435 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.036423    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 15 05:47:38.036474 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.036446    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 15 05:47:38.039074 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.039048    2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jun 15 05:47:38.041267 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.041253    2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jun 15 05:47:38.041313 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.041294    2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jun 15 05:47:38.041571 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.041558    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jun 15 05:47:38.041611 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.041580    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jun 15 05:47:38.041611 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.041589    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jun 15 05:47:38.041611 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.041598    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jun 15 05:47:38.041611 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.041610    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jun 15 05:47:38.041735 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.041619    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jun 15 05:47:38.042213 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.042196    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jun 15 05:47:38.042271 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.042216    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jun 15 05:47:38.042271 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.042228    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jun 15 05:47:38.042271 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.042238    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jun 15 05:47:38.042271 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.042251    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jun 15 05:47:38.042271 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.042263    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jun 15 05:47:38.043854 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.043838    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jun 15 05:47:38.043940 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.043872    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jun 15 05:47:38.047018 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.047002    2564 server.go:1268] "Started kubelet"
Jun 15 05:47:38.047142 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.047096    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jun 15 05:47:38.047564 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.047130    2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jun 15 05:47:38.047648 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.047592    2564 server_v1.go:49] "podresources" method="list" useActivePods=true
Jun 15 05:47:38.047892 ip-10-0-131-82 systemd[1]: Started Kubernetes Kubelet.
Jun 15 05:47:38.051479 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.051454    2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jun 15 05:47:38.051839 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.051821    2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-82.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jun 15 05:47:38.051986 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:38.051964    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-82.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jun 15 05:47:38.052112 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:38.052091    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jun 15 05:47:38.053181 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.053152    2564 server.go:310] "Adding debug handlers to kubelet server"
Jun 15 05:47:38.056210 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:38.056186    2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jun 15 05:47:38.057456 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:38.055220    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-82.ec2.internal.18b92b0bfa5fff9f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-82.ec2.internal,UID:ip-10-0-131-82.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-82.ec2.internal,},FirstTimestamp:2026-06-15 05:47:38.046971807 +0000 UTC m=+0.413516852,LastTimestamp:2026-06-15 05:47:38.046971807 +0000 UTC m=+0.413516852,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-82.ec2.internal,}"
Jun 15 05:47:38.057805 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.057791    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jun 15 05:47:38.057873 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.057809    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jun 15 05:47:38.057975 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:38.057957    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-82.ec2.internal\" not found"
Jun 15 05:47:38.058512 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.058495    2564 factory.go:55] Registering systemd factory
Jun 15 05:47:38.058585 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.058535    2564 factory.go:223] Registration of the systemd container factory successfully
Jun 15 05:47:38.058649 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.058573    2564 volume_manager.go:311] "The desired_state_of_world populator starts"
Jun 15 05:47:38.058649 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.058599    2564 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jun 15 05:47:38.058734 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.058573    2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jun 15 05:47:38.058784 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.058741    2564 reconstruct.go:97] "Volume reconstruction finished"
Jun 15 05:47:38.058784 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.058749    2564 reconciler.go:29] "Reconciler: start to sync state"
Jun 15 05:47:38.058913 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.058799    2564 factory.go:153] Registering CRI-O factory
Jun 15 05:47:38.058913 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.058815    2564 factory.go:223] Registration of the crio container factory successfully
Jun 15 05:47:38.058913 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.058884    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jun 15 05:47:38.058913 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.058909    2564 factory.go:103] Registering Raw factory
Jun 15 05:47:38.059103 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.058924    2564 manager.go:1196] Started watching for new ooms in manager
Jun 15 05:47:38.059372 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.059304    2564 manager.go:349] Starting recovery of all containers
Jun 15 05:47:38.060391 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:38.060362    2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-82.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jun 15 05:47:38.060486 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:38.060468    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jun 15 05:47:38.066098 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.065982    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6n6fh"
Jun 15 05:47:38.068227 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.068209    2564 manager.go:354] Recovery completed
Jun 15 05:47:38.072505 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.072491    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 15 05:47:38.074449 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.074428    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-82.ec2.internal" event="NodeHasSufficientMemory"
Jun 15 05:47:38.074525 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.074463    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-82.ec2.internal" event="NodeHasNoDiskPressure"
Jun 15 05:47:38.074525 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.074477    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-82.ec2.internal" event="NodeHasSufficientPID"
Jun 15 05:47:38.075045 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.075032    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jun 15 05:47:38.075096 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.075050    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jun 15 05:47:38.075096 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.075067    2564 state_mem.go:36] "Initialized new in-memory state store"
Jun 15 05:47:38.075162 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.075039    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 15 05:47:38.076174 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.076161    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-82.ec2.internal" event="NodeHasSufficientMemory"
Jun 15 05:47:38.076221 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.076183    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-82.ec2.internal" event="NodeHasNoDiskPressure"
Jun 15 05:47:38.076221 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.076197    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-82.ec2.internal" event="NodeHasSufficientPID"
Jun 15 05:47:38.076832 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:38.076759    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-82.ec2.internal.18b92b0bfc033fc0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-82.ec2.internal,UID:ip-10-0-131-82.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-82.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-82.ec2.internal,},FirstTimestamp:2026-06-15 05:47:38.074447808 +0000 UTC m=+0.440992850,LastTimestamp:2026-06-15 05:47:38.074447808 +0000 UTC m=+0.440992850,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-82.ec2.internal,}"
Jun 15 05:47:38.077212 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.077201    2564 policy_none.go:49] "None policy: Start"
Jun 15 05:47:38.077250 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.077216    2564 memory_manager.go:187] "Starting memorymanager" policy="None"
Jun 15 05:47:38.077250 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.077226    2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jun 15 05:47:38.078977 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.078963    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6n6fh"
Jun 15 05:47:38.080318 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.080304    2564 policy_none.go:47] "Start"
Jun 15 05:47:38.085527 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:38.085458    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-82.ec2.internal.18b92b0bfc03993d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-82.ec2.internal,UID:ip-10-0-131-82.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-131-82.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-131-82.ec2.internal,},FirstTimestamp:2026-06-15 05:47:38.074470717 +0000 UTC m=+0.441015759,LastTimestamp:2026-06-15 05:47:38.074470717 +0000 UTC m=+0.441015759,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-82.ec2.internal,}"
Jun 15 05:47:38.129041 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.129004    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jun 15 05:47:38.141128 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.130253    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jun 15 05:47:38.141128 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.130291    2564 status_manager.go:244] "Starting to sync pod status with apiserver"
Jun 15 05:47:38.141128 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.130311    2564 kubelet.go:2448] "Starting kubelet main sync loop"
Jun 15 05:47:38.141128 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:38.130350    2564 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Jun 15 05:47:38.141128 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.131709    2564 manager.go:337] "Starting Device Plugin manager"
Jun 15 05:47:38.141128 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:38.131748    2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jun 15 05:47:38.141128 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.131762    2564 server.go:87] "Starting device plugin registration server"
Jun 15 05:47:38.141128 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.132036    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
Jun 15 05:47:38.141128 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.132049    2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jun 15 05:47:38.141128 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.132257    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 15 05:47:38.141128 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.132403    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jun 15 05:47:38.141128 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.132472    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jun 15 05:47:38.141128 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.132480    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jun 15 05:47:38.141128 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:38.132902    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jun 15 05:47:38.141128 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:38.132943    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-82.ec2.internal\" not found"
Jun 15 05:47:38.231401 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.231345    2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-82.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-82.ec2.internal"]
Jun 15 05:47:38.231483 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.231409    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 15 05:47:38.232678 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.232664    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 15 05:47:38.237199 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.237175    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-82.ec2.internal" event="NodeHasSufficientMemory"
Jun 15 05:47:38.237199 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.237202    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-82.ec2.internal" event="NodeHasNoDiskPressure"
Jun 15 05:47:38.237327 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.237213    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-82.ec2.internal" event="NodeHasSufficientPID"
Jun 15 05:47:38.237327 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.237244    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-82.ec2.internal"
Jun 15 05:47:38.237948 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.237933    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-82.ec2.internal" event="NodeHasSufficientMemory"
Jun 15 05:47:38.238031 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.237964    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-82.ec2.internal" event="NodeHasNoDiskPressure"
Jun 15 05:47:38.238031 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.237979    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-82.ec2.internal" event="NodeHasSufficientPID"
Jun 15 05:47:38.240267 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.240252    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 15 05:47:38.240413 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.240385    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-82.ec2.internal"
Jun 15 05:47:38.240460 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.240429    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 15 05:47:38.240991 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.240976    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-82.ec2.internal" event="NodeHasSufficientMemory"
Jun 15 05:47:38.241082 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.240997    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-82.ec2.internal" event="NodeHasNoDiskPressure"
Jun 15 05:47:38.241082 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.241006    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-82.ec2.internal" event="NodeHasSufficientPID"
Jun 15 05:47:38.241082 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.240982    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-82.ec2.internal" event="NodeHasSufficientMemory"
Jun 15 05:47:38.241082 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.241066    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-82.ec2.internal" event="NodeHasNoDiskPressure"
Jun 15 05:47:38.241082 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.241075    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-82.ec2.internal" event="NodeHasSufficientPID"
Jun 15 05:47:38.243288 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.243272    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-82.ec2.internal"
Jun 15 05:47:38.243373 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.243301    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 15 05:47:38.244262 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.244247    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-82.ec2.internal" event="NodeHasSufficientMemory"
Jun 15 05:47:38.244262 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.244273    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-82.ec2.internal" event="NodeHasNoDiskPressure"
Jun 15 05:47:38.244408 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.244282    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-82.ec2.internal" event="NodeHasSufficientPID"
Jun 15 05:47:38.246785 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.246770    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-82.ec2.internal"
Jun 15 05:47:38.246848 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:38.246791    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-82.ec2.internal\": node \"ip-10-0-131-82.ec2.internal\" not found"
Jun 15 05:47:38.260103 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.260081    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f628656103b87af6a4969bd9cbf47555-config\") pod \"kube-apiserver-proxy-ip-10-0-131-82.ec2.internal\" (UID: \"f628656103b87af6a4969bd9cbf47555\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-82.ec2.internal"
Jun 15 05:47:38.260175 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.260104    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b1720615f104def57996580484e4fe33-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-82.ec2.internal\" (UID: \"b1720615f104def57996580484e4fe33\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-82.ec2.internal"
Jun 15 05:47:38.260175 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.260122    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1720615f104def57996580484e4fe33-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-82.ec2.internal\" (UID: \"b1720615f104def57996580484e4fe33\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-82.ec2.internal"
Jun 15 05:47:38.262384 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:38.262368    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-82.ec2.internal\" not found" node="ip-10-0-131-82.ec2.internal"
Jun 15 05:47:38.266715 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:38.266699    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-82.ec2.internal\" not found" node="ip-10-0-131-82.ec2.internal"
Jun 15 05:47:38.293562 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:38.293548    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-82.ec2.internal\" not found"
Jun 15 05:47:38.360389 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.360370    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1720615f104def57996580484e4fe33-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-82.ec2.internal\" (UID: \"b1720615f104def57996580484e4fe33\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-82.ec2.internal"
Jun 15 05:47:38.360504 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.360411    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f628656103b87af6a4969bd9cbf47555-config\") pod \"kube-apiserver-proxy-ip-10-0-131-82.ec2.internal\" (UID: \"f628656103b87af6a4969bd9cbf47555\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-82.ec2.internal"
Jun 15 05:47:38.360504 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.360428    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b1720615f104def57996580484e4fe33-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-82.ec2.internal\" (UID: \"b1720615f104def57996580484e4fe33\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-82.ec2.internal"
Jun 15 05:47:38.360504 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.360475    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f628656103b87af6a4969bd9cbf47555-config\") pod \"kube-apiserver-proxy-ip-10-0-131-82.ec2.internal\" (UID: \"f628656103b87af6a4969bd9cbf47555\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-82.ec2.internal"
Jun 15 05:47:38.360504 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.360489    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1720615f104def57996580484e4fe33-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-82.ec2.internal\" (UID: \"b1720615f104def57996580484e4fe33\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-82.ec2.internal"
Jun 15 05:47:38.360642 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.360519    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b1720615f104def57996580484e4fe33-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-82.ec2.internal\" (UID: \"b1720615f104def57996580484e4fe33\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-82.ec2.internal"
Jun 15 05:47:38.394621 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:38.394596    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-82.ec2.internal\" not found"
Jun 15 05:47:38.495727 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:38.495659    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-82.ec2.internal\" not found"
Jun 15 05:47:38.565169 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.565151    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-82.ec2.internal"
Jun 15 05:47:38.571212 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.571192    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-82.ec2.internal"
Jun 15 05:47:38.596172 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:38.596146    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-82.ec2.internal\" not found"
Jun 15 05:47:38.696709 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:38.696684    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-82.ec2.internal\" not found"
Jun 15 05:47:38.797147 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:38.797094    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-82.ec2.internal\" not found"
Jun 15 05:47:38.897771 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:38.897747    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-82.ec2.internal\" not found"
Jun 15 05:47:38.985232 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.985210    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jun 15 05:47:38.985801 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:38.985372    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 15 05:47:38.998494 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:38.998470    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-82.ec2.internal\" not found"
Jun 15 05:47:39.040674 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:39.040658    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 15 05:47:39.058345 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:39.058281    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-82.ec2.internal"
Jun 15 05:47:39.058345 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:39.058313    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jun 15 05:47:39.069957 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:39.069936    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 15 05:47:39.071926 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:39.071908    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-82.ec2.internal"
Jun 15 05:47:39.073809 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:39.073792    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 15 05:47:39.086305 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:39.086280    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-14 05:42:38 +0000 UTC" deadline="2028-02-14 04:02:08.668597958 +0000 UTC"
Jun 15 05:47:39.086305 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:39.086303    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14614h14m29.582297199s"
Jun 15 05:47:39.088959 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:39.088946    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 15 05:47:39.094812 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:39.094783    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zbsbp"
Jun 15 05:47:39.103524 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:39.103511    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zbsbp"
Jun 15 05:47:39.123709 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:39.123687    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 15 05:47:39.150724 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:39.150699    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1720615f104def57996580484e4fe33.slice/crio-588bbb27f9292d295eed463b6422db6bf29ddc240d692f8c5d664e44be7b736d WatchSource:0}: Error finding container 588bbb27f9292d295eed463b6422db6bf29ddc240d692f8c5d664e44be7b736d: Status 404 returned error can't find the container with id 588bbb27f9292d295eed463b6422db6bf29ddc240d692f8c5d664e44be7b736d
Jun 15 05:47:39.155929 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:39.155908    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 15 05:47:39.162432 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:39.162411    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf628656103b87af6a4969bd9cbf47555.slice/crio-5b6e94228590a3b35f6790403cda725651d906110b6c8f9a123457f65ca95a8a WatchSource:0}: Error finding container 5b6e94228590a3b35f6790403cda725651d906110b6c8f9a123457f65ca95a8a: Status 404 returned error can't find the container with id 5b6e94228590a3b35f6790403cda725651d906110b6c8f9a123457f65ca95a8a
Jun 15 05:47:39.383887 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:39.383837    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 15 05:47:40.037394 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.037367    2564 apiserver.go:52] "Watching apiserver"
Jun 15 05:47:40.046711 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.046682    2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jun 15 05:47:40.047089 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.047066    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-8v9wt","openshift-multus/network-metrics-daemon-qm5gv","openshift-network-operator/iptables-alerter-dp464","openshift-cluster-node-tuning-operator/tuned-pjdzl","openshift-dns/node-resolver-qdcqb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-82.ec2.internal","openshift-multus/multus-78lp9","openshift-multus/multus-additional-cni-plugins-s5nvg","openshift-network-diagnostics/network-check-target-jg5zt","openshift-ovn-kubernetes/ovnkube-node-7qndp","kube-system/global-pull-secret-syncer-xl66m","kube-system/konnectivity-agent-kkfqp","kube-system/kube-apiserver-proxy-ip-10-0-131-82.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ht9b"]
Jun 15 05:47:40.049571 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.049553    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.051649 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.051624    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl66m"
Jun 15 05:47:40.051738 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:40.051711    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xl66m" podUID="80312796-b102-426c-a974-354e77b12b12"
Jun 15 05:47:40.052250 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.052229    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-s829x\""
Jun 15 05:47:40.052328 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.052264    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jun 15 05:47:40.052556 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.052542    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jun 15 05:47:40.052650 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.052581    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jun 15 05:47:40.052735 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.052720    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jun 15 05:47:40.053926 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.053906    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dp464"
Jun 15 05:47:40.056096 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.056078    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.056692 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.056490    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fq8hs\""
Jun 15 05:47:40.056692 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.056526    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jun 15 05:47:40.056692 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.056578    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jun 15 05:47:40.056692 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.056615    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jun 15 05:47:40.058316 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.058297    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qdcqb"
Jun 15 05:47:40.059497 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.059475    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jun 15 05:47:40.059646 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.059629    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jww2h\""
Jun 15 05:47:40.059700 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.059475    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jun 15 05:47:40.061746 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.061728    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jun 15 05:47:40.061931 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.061906    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pl6bc\""
Jun 15 05:47:40.062025 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.062010    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jun 15 05:47:40.062752 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.062736    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ht9b"
Jun 15 05:47:40.064848 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.064830    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jun 15 05:47:40.065050 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.065031    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jun 15 05:47:40.065130 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.065057    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ssvtp\""
Jun 15 05:47:40.065130 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.065086    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jg5zt"
Jun 15 05:47:40.065230 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:40.065146    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jg5zt" podUID="2b0e234e-c49a-4504-9737-8d32181944e5"
Jun 15 05:47:40.065317 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.065298    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jun 15 05:47:40.067472 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.067455    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s5nvg"
Jun 15 05:47:40.069792 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.069771    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qm5gv"
Jun 15 05:47:40.069917 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:40.069829    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qm5gv" podUID="ecbcc04e-289f-482a-b26e-49a2cee2e45f"
Jun 15 05:47:40.069917 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.069836    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jun 15 05:47:40.069917 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.069885    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jun 15 05:47:40.070071 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.069968    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5b8nt\""
Jun 15 05:47:40.070122 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070099    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-etc-sysconfig\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.070174 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070128    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-host\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.070174 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070162    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w9wm\" (UniqueName: \"kubernetes.io/projected/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-kube-api-access-6w9wm\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.070271 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070184    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcmnx\" (UniqueName: \"kubernetes.io/projected/9ff3747f-c776-4f08-b35b-6d886f1e3cfc-kube-api-access-qcmnx\") pod \"node-resolver-qdcqb\" (UID: \"9ff3747f-c776-4f08-b35b-6d886f1e3cfc\") " pod="openshift-dns/node-resolver-qdcqb"
Jun 15 05:47:40.070271 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070203    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2196caf7-fa75-4e09-8673-688b078dd5a3-sys-fs\") pod \"aws-ebs-csi-driver-node-2ht9b\" (UID: \"2196caf7-fa75-4e09-8673-688b078dd5a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ht9b"
Jun 15 05:47:40.070271 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070223    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-host-run-netns\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.070271 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070246    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-multus-conf-dir\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.070437 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070284    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/13e4b538-8b93-4137-aedf-11a30b014942-iptables-alerter-script\") pod \"iptables-alerter-dp464\" (UID: \"13e4b538-8b93-4137-aedf-11a30b014942\") " pod="openshift-network-operator/iptables-alerter-dp464"
Jun 15 05:47:40.070437 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070321    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13e4b538-8b93-4137-aedf-11a30b014942-host-slash\") pod \"iptables-alerter-dp464\" (UID: \"13e4b538-8b93-4137-aedf-11a30b014942\") " pod="openshift-network-operator/iptables-alerter-dp464"
Jun 15 05:47:40.070437 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070344    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-etc-modprobe-d\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.070437 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070359    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-etc-sysctl-conf\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.070437 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070374    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-lib-modules\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.070437 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070396    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-system-cni-dir\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.070437 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070418    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-multus-socket-dir-parent\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.070709 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070439    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-hostroot\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.070709 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070460    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-var-lib-kubelet\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.070709 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070480    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9ff3747f-c776-4f08-b35b-6d886f1e3cfc-hosts-file\") pod \"node-resolver-qdcqb\" (UID: \"9ff3747f-c776-4f08-b35b-6d886f1e3cfc\") " pod="openshift-dns/node-resolver-qdcqb"
Jun 15 05:47:40.070709 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070503    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2196caf7-fa75-4e09-8673-688b078dd5a3-socket-dir\") pod \"aws-ebs-csi-driver-node-2ht9b\" (UID: \"2196caf7-fa75-4e09-8673-688b078dd5a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ht9b"
Jun 15 05:47:40.070709 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070526    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2196caf7-fa75-4e09-8673-688b078dd5a3-etc-selinux\") pod \"aws-ebs-csi-driver-node-2ht9b\" (UID: \"2196caf7-fa75-4e09-8673-688b078dd5a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ht9b"
Jun 15 05:47:40.070709 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070549    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-host-var-lib-kubelet\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.070709 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070562    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d898204a-f058-4bf3-b6be-6b5edd43b362-multus-daemon-config\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.070709 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070577    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhfhd\" (UniqueName: \"kubernetes.io/projected/13e4b538-8b93-4137-aedf-11a30b014942-kube-api-access-zhfhd\") pod \"iptables-alerter-dp464\" (UID: \"13e4b538-8b93-4137-aedf-11a30b014942\") " pod="openshift-network-operator/iptables-alerter-dp464"
Jun 15 05:47:40.070709 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070591    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-etc-tuned\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.070709 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070625    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-tmp\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.070709 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070650    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ff3747f-c776-4f08-b35b-6d886f1e3cfc-tmp-dir\") pod \"node-resolver-qdcqb\" (UID: \"9ff3747f-c776-4f08-b35b-6d886f1e3cfc\") " pod="openshift-dns/node-resolver-qdcqb"
Jun 15 05:47:40.070709 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070664    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2196caf7-fa75-4e09-8673-688b078dd5a3-registration-dir\") pod \"aws-ebs-csi-driver-node-2ht9b\" (UID: \"2196caf7-fa75-4e09-8673-688b078dd5a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ht9b"
Jun 15 05:47:40.070709 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070682    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80312796-b102-426c-a974-354e77b12b12-original-pull-secret\") pod \"global-pull-secret-syncer-xl66m\" (UID: \"80312796-b102-426c-a974-354e77b12b12\") " pod="kube-system/global-pull-secret-syncer-xl66m"
Jun 15 05:47:40.070709 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070703    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-etc-systemd\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.071383 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070726    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d898204a-f058-4bf3-b6be-6b5edd43b362-cni-binary-copy\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.071383 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070750    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-host-run-k8s-cni-cncf-io\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.071383 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070771    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-host-var-lib-cni-bin\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.071383 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070794    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-host-run-multus-certs\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.071383 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070849    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-run\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.071383 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070886    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-cnibin\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.071383 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070921    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-os-release\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.071383 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070942    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-etc-kubernetes\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.071383 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070960    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkm4s\" (UniqueName: \"kubernetes.io/projected/d898204a-f058-4bf3-b6be-6b5edd43b362-kube-api-access-dkm4s\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.071383 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.070992    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/80312796-b102-426c-a974-354e77b12b12-kubelet-config\") pod \"global-pull-secret-syncer-xl66m\" (UID: \"80312796-b102-426c-a974-354e77b12b12\") " pod="kube-system/global-pull-secret-syncer-xl66m"
Jun 15 05:47:40.071383 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.071005    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/80312796-b102-426c-a974-354e77b12b12-dbus\") pod \"global-pull-secret-syncer-xl66m\" (UID: \"80312796-b102-426c-a974-354e77b12b12\") " pod="kube-system/global-pull-secret-syncer-xl66m"
Jun 15 05:47:40.071383 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.071020    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-etc-kubernetes\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.071383 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.071035    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-etc-sysctl-d\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.071383 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.071094    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2196caf7-fa75-4e09-8673-688b078dd5a3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2ht9b\" (UID: \"2196caf7-fa75-4e09-8673-688b078dd5a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ht9b"
Jun 15 05:47:40.071383 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.071117    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2196caf7-fa75-4e09-8673-688b078dd5a3-device-dir\") pod \"aws-ebs-csi-driver-node-2ht9b\" (UID: \"2196caf7-fa75-4e09-8673-688b078dd5a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ht9b"
Jun 15 05:47:40.071383 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.071142    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vz7w\" (UniqueName: \"kubernetes.io/projected/2196caf7-fa75-4e09-8673-688b078dd5a3-kube-api-access-7vz7w\") pod \"aws-ebs-csi-driver-node-2ht9b\" (UID: \"2196caf7-fa75-4e09-8673-688b078dd5a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ht9b"
Jun 15 05:47:40.071383 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.071181    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-host-var-lib-cni-multus\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.072226 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.071208    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-sys\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.072226 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.071223    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-multus-cni-dir\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.072496 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.072477    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.074944 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.074637    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8v9wt"
Jun 15 05:47:40.076349 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.076183    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jun 15 05:47:40.076349 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.076198    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jun 15 05:47:40.076349 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.076234    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jun 15 05:47:40.076349 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.076267    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jun 15 05:47:40.076349 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.076282    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lx7cx\""
Jun 15 05:47:40.076349 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.076294    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jun 15 05:47:40.076679 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.076413    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jun 15 05:47:40.077241 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.076912    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jun 15 05:47:40.077241 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.076942    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wmkz5\""
Jun 15 05:47:40.077241 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.076950    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jun 15 05:47:40.077241 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.077057    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jun 15 05:47:40.077241 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.077067    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kkfqp"
Jun 15 05:47:40.079422 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.079406    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jun 15 05:47:40.079507 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.079416    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jun 15 05:47:40.079564 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.079517    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-llbbn\""
Jun 15 05:47:40.106250 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.106206    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 05:42:39 +0000 UTC" deadline="2028-02-18 13:44:21.375977894 +0000 UTC"
Jun 15 05:47:40.106250 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.106249    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14719h56m41.269732838s"
Jun 15 05:47:40.135813 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.135761    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-82.ec2.internal" event={"ID":"f628656103b87af6a4969bd9cbf47555","Type":"ContainerStarted","Data":"5b6e94228590a3b35f6790403cda725651d906110b6c8f9a123457f65ca95a8a"}
Jun 15 05:47:40.136914 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.136888    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-82.ec2.internal" event={"ID":"b1720615f104def57996580484e4fe33","Type":"ContainerStarted","Data":"588bbb27f9292d295eed463b6422db6bf29ddc240d692f8c5d664e44be7b736d"}
Jun 15 05:47:40.160242 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.160219    2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jun 15 05:47:40.171958 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.171934    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-tmp\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.172050 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.171971    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2196caf7-fa75-4e09-8673-688b078dd5a3-registration-dir\") pod \"aws-ebs-csi-driver-node-2ht9b\" (UID: \"2196caf7-fa75-4e09-8673-688b078dd5a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ht9b"
Jun 15 05:47:40.172050 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172000    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80312796-b102-426c-a974-354e77b12b12-original-pull-secret\") pod \"global-pull-secret-syncer-xl66m\" (UID: \"80312796-b102-426c-a974-354e77b12b12\") " pod="kube-system/global-pull-secret-syncer-xl66m"
Jun 15 05:47:40.172050 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172029    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/01d7cf7a-bc4a-43be-a3b0-10d8e29e8735-serviceca\") pod \"node-ca-8v9wt\" (UID: \"01d7cf7a-bc4a-43be-a3b0-10d8e29e8735\") " pod="openshift-image-registry/node-ca-8v9wt"
Jun 15 05:47:40.172190 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172054    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbdhd\" (UniqueName: \"kubernetes.io/projected/2b0e234e-c49a-4504-9737-8d32181944e5-kube-api-access-sbdhd\") pod \"network-check-target-jg5zt\" (UID: \"2b0e234e-c49a-4504-9737-8d32181944e5\") " pod="openshift-network-diagnostics/network-check-target-jg5zt"
Jun 15 05:47:40.172190 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172078    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvpzw\" (UniqueName: \"kubernetes.io/projected/365f2bf1-0391-46a7-961e-a41133c65588-kube-api-access-rvpzw\") pod \"multus-additional-cni-plugins-s5nvg\" (UID: \"365f2bf1-0391-46a7-961e-a41133c65588\") " pod="openshift-multus/multus-additional-cni-plugins-s5nvg"
Jun 15 05:47:40.172190 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172078    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2196caf7-fa75-4e09-8673-688b078dd5a3-registration-dir\") pod \"aws-ebs-csi-driver-node-2ht9b\" (UID: \"2196caf7-fa75-4e09-8673-688b078dd5a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ht9b"
Jun 15 05:47:40.172190 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172102    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-etc-systemd\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.172190 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172150    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d898204a-f058-4bf3-b6be-6b5edd43b362-cni-binary-copy\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.172190 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172164    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-etc-systemd\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.172190 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172183    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-host-run-k8s-cni-cncf-io\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.172442 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172206    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-host-var-lib-cni-bin\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.172442 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172232    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-node-log\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.172442 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172295    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdsjv\" (UniqueName: \"kubernetes.io/projected/4783d7d6-1895-41f7-b11a-dea0c4405bc8-kube-api-access-tdsjv\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.172442 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172296    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-host-var-lib-cni-bin\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.172442 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172332    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-host-run-k8s-cni-cncf-io\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.172442 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172351    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jun 15 05:47:40.172442 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172363    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccxgv\" (UniqueName: \"kubernetes.io/projected/01d7cf7a-bc4a-43be-a3b0-10d8e29e8735-kube-api-access-ccxgv\") pod \"node-ca-8v9wt\" (UID: \"01d7cf7a-bc4a-43be-a3b0-10d8e29e8735\") " pod="openshift-image-registry/node-ca-8v9wt"
Jun 15 05:47:40.172442 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172389    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-cnibin\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.172442 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172411    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-os-release\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.172442 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:40.172435    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 15 05:47:40.172810 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172465    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-etc-kubernetes\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.172810 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:40.172515    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80312796-b102-426c-a974-354e77b12b12-original-pull-secret podName:80312796-b102-426c-a974-354e77b12b12 nodeName:}" failed. No retries permitted until 2026-06-15 05:47:40.672475387 +0000 UTC m=+3.039020415 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80312796-b102-426c-a974-354e77b12b12-original-pull-secret") pod "global-pull-secret-syncer-xl66m" (UID: "80312796-b102-426c-a974-354e77b12b12") : object "kube-system"/"original-pull-secret" not registered
Jun 15 05:47:40.172810 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172519    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-cnibin\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.172810 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172433    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-etc-kubernetes\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.172810 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172551    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkm4s\" (UniqueName: \"kubernetes.io/projected/d898204a-f058-4bf3-b6be-6b5edd43b362-kube-api-access-dkm4s\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.172810 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172577    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4783d7d6-1895-41f7-b11a-dea0c4405bc8-ovnkube-config\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.172810 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172600    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/13b42759-3601-4360-a714-779f88b86a52-konnectivity-ca\") pod \"konnectivity-agent-kkfqp\" (UID: \"13b42759-3601-4360-a714-779f88b86a52\") " pod="kube-system/konnectivity-agent-kkfqp"
Jun 15 05:47:40.172810 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172624    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecbcc04e-289f-482a-b26e-49a2cee2e45f-metrics-certs\") pod \"network-metrics-daemon-qm5gv\" (UID: \"ecbcc04e-289f-482a-b26e-49a2cee2e45f\") " pod="openshift-multus/network-metrics-daemon-qm5gv"
Jun 15 05:47:40.172810 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172647    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2196caf7-fa75-4e09-8673-688b078dd5a3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2ht9b\" (UID: \"2196caf7-fa75-4e09-8673-688b078dd5a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ht9b"
Jun 15 05:47:40.172810 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172687    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2196caf7-fa75-4e09-8673-688b078dd5a3-device-dir\") pod \"aws-ebs-csi-driver-node-2ht9b\" (UID: \"2196caf7-fa75-4e09-8673-688b078dd5a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ht9b"
Jun 15 05:47:40.172810 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172716    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vz7w\" (UniqueName: \"kubernetes.io/projected/2196caf7-fa75-4e09-8673-688b078dd5a3-kube-api-access-7vz7w\") pod \"aws-ebs-csi-driver-node-2ht9b\" (UID: \"2196caf7-fa75-4e09-8673-688b078dd5a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ht9b"
Jun 15 05:47:40.172810 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172735    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-os-release\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.172810 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172749    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d898204a-f058-4bf3-b6be-6b5edd43b362-cni-binary-copy\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.173299 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172825    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2196caf7-fa75-4e09-8673-688b078dd5a3-device-dir\") pod \"aws-ebs-csi-driver-node-2ht9b\" (UID: \"2196caf7-fa75-4e09-8673-688b078dd5a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ht9b"
Jun 15 05:47:40.173299 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172740    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-run-systemd\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.173299 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172826    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2196caf7-fa75-4e09-8673-688b078dd5a3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2ht9b\" (UID: \"2196caf7-fa75-4e09-8673-688b078dd5a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ht9b"
Jun 15 05:47:40.173299 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172884    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-log-socket\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.173299 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172901    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-host-cni-bin\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.173299 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172915    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4783d7d6-1895-41f7-b11a-dea0c4405bc8-env-overrides\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.173299 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172950    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4783d7d6-1895-41f7-b11a-dea0c4405bc8-ovnkube-script-lib\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.173299 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172982    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-sys\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.173299 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.172998    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-host-cni-netd\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.173299 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173026    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/365f2bf1-0391-46a7-961e-a41133c65588-os-release\") pod \"multus-additional-cni-plugins-s5nvg\" (UID: \"365f2bf1-0391-46a7-961e-a41133c65588\") " pod="openshift-multus/multus-additional-cni-plugins-s5nvg"
Jun 15 05:47:40.173299 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173053    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-sys\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.173299 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173045    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w9wm\" (UniqueName: \"kubernetes.io/projected/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-kube-api-access-6w9wm\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.173299 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173100    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-multus-conf-dir\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.173299 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173124    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-systemd-units\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.173299 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173146    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/13b42759-3601-4360-a714-779f88b86a52-agent-certs\") pod \"konnectivity-agent-kkfqp\" (UID: \"13b42759-3601-4360-a714-779f88b86a52\") " pod="kube-system/konnectivity-agent-kkfqp"
Jun 15 05:47:40.173299 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173172    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/365f2bf1-0391-46a7-961e-a41133c65588-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s5nvg\" (UID: \"365f2bf1-0391-46a7-961e-a41133c65588\") " pod="openshift-multus/multus-additional-cni-plugins-s5nvg"
Jun 15 05:47:40.173299 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173188    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-multus-conf-dir\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.173942 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173195    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-etc-sysctl-conf\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.173942 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173232    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-hostroot\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.173942 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173258    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-host-run-netns\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.173942 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173275    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-hostroot\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.173942 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173289    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-etc-sysctl-conf\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.173942 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173295    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-var-lib-kubelet\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.173942 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173319    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2196caf7-fa75-4e09-8673-688b078dd5a3-socket-dir\") pod \"aws-ebs-csi-driver-node-2ht9b\" (UID: \"2196caf7-fa75-4e09-8673-688b078dd5a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ht9b"
Jun 15 05:47:40.173942 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173341    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-host-var-lib-kubelet\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.173942 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173322    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-var-lib-kubelet\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.173942 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173367    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhfhd\" (UniqueName: \"kubernetes.io/projected/13e4b538-8b93-4137-aedf-11a30b014942-kube-api-access-zhfhd\") pod \"iptables-alerter-dp464\" (UID: \"13e4b538-8b93-4137-aedf-11a30b014942\") " pod="openshift-network-operator/iptables-alerter-dp464"
Jun 15 05:47:40.173942 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173388    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-host-var-lib-kubelet\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.173942 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173396    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2196caf7-fa75-4e09-8673-688b078dd5a3-socket-dir\") pod \"aws-ebs-csi-driver-node-2ht9b\" (UID: \"2196caf7-fa75-4e09-8673-688b078dd5a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ht9b"
Jun 15 05:47:40.173942 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173391    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ff3747f-c776-4f08-b35b-6d886f1e3cfc-tmp-dir\") pod \"node-resolver-qdcqb\" (UID: \"9ff3747f-c776-4f08-b35b-6d886f1e3cfc\") " pod="openshift-dns/node-resolver-qdcqb"
Jun 15 05:47:40.173942 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173435    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/365f2bf1-0391-46a7-961e-a41133c65588-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s5nvg\" (UID: \"365f2bf1-0391-46a7-961e-a41133c65588\") " pod="openshift-multus/multus-additional-cni-plugins-s5nvg"
Jun 15 05:47:40.173942 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173463    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-host-run-multus-certs\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.173942 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173488    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-host-kubelet\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.173942 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173505    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-host-slash\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.174504 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173519    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-run\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.174504 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173533    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/80312796-b102-426c-a974-354e77b12b12-kubelet-config\") pod \"global-pull-secret-syncer-xl66m\" (UID: \"80312796-b102-426c-a974-354e77b12b12\") " pod="kube-system/global-pull-secret-syncer-xl66m"
Jun 15 05:47:40.174504 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173551    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/80312796-b102-426c-a974-354e77b12b12-dbus\") pod \"global-pull-secret-syncer-xl66m\" (UID: \"80312796-b102-426c-a974-354e77b12b12\") " pod="kube-system/global-pull-secret-syncer-xl66m"
Jun 15 05:47:40.174504 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173567    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-etc-openvswitch\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.174504 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173581    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01d7cf7a-bc4a-43be-a3b0-10d8e29e8735-host\") pod \"node-ca-8v9wt\" (UID: \"01d7cf7a-bc4a-43be-a3b0-10d8e29e8735\") " pod="openshift-image-registry/node-ca-8v9wt"
Jun 15 05:47:40.174504 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173596    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-etc-kubernetes\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.174504 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173605    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-host-run-multus-certs\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.174504 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173612    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-etc-sysctl-d\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.174504 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173629    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ff3747f-c776-4f08-b35b-6d886f1e3cfc-tmp-dir\") pod \"node-resolver-qdcqb\" (UID: \"9ff3747f-c776-4f08-b35b-6d886f1e3cfc\") " pod="openshift-dns/node-resolver-qdcqb"
Jun 15 05:47:40.174504 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173638    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-host-var-lib-cni-multus\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.174504 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173669    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/365f2bf1-0391-46a7-961e-a41133c65588-cni-binary-copy\") pod \"multus-additional-cni-plugins-s5nvg\" (UID: \"365f2bf1-0391-46a7-961e-a41133c65588\") " pod="openshift-multus/multus-additional-cni-plugins-s5nvg"
Jun 15 05:47:40.174504 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173674    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-run\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.174504 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173685    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-multus-cni-dir\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.174504 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173704    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-host-run-ovn-kubernetes\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.174504 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173740    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/365f2bf1-0391-46a7-961e-a41133c65588-cnibin\") pod \"multus-additional-cni-plugins-s5nvg\" (UID: \"365f2bf1-0391-46a7-961e-a41133c65588\") " pod="openshift-multus/multus-additional-cni-plugins-s5nvg"
Jun 15 05:47:40.174504 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173743    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/80312796-b102-426c-a974-354e77b12b12-kubelet-config\") pod \"global-pull-secret-syncer-xl66m\" (UID: \"80312796-b102-426c-a974-354e77b12b12\") " pod="kube-system/global-pull-secret-syncer-xl66m"
Jun 15 05:47:40.174504 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173756    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/365f2bf1-0391-46a7-961e-a41133c65588-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s5nvg\" (UID: \"365f2bf1-0391-46a7-961e-a41133c65588\") " pod="openshift-multus/multus-additional-cni-plugins-s5nvg"
Jun 15 05:47:40.175172 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173773    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-etc-sysconfig\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.175172 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173796    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-host\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.175172 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173801    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-etc-kubernetes\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.175172 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173818    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcmnx\" (UniqueName: \"kubernetes.io/projected/9ff3747f-c776-4f08-b35b-6d886f1e3cfc-kube-api-access-qcmnx\") pod \"node-resolver-qdcqb\" (UID: \"9ff3747f-c776-4f08-b35b-6d886f1e3cfc\") " pod="openshift-dns/node-resolver-qdcqb"
Jun 15 05:47:40.175172 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173880    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-host-var-lib-cni-multus\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.175172 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173885    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-multus-cni-dir\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.175172 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173905    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2196caf7-fa75-4e09-8673-688b078dd5a3-sys-fs\") pod \"aws-ebs-csi-driver-node-2ht9b\" (UID: \"2196caf7-fa75-4e09-8673-688b078dd5a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ht9b"
Jun 15 05:47:40.175172 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173938    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-etc-sysctl-d\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.175172 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173950    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-etc-sysconfig\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.175172 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173942    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-host-run-netns\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.175172 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173775    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/80312796-b102-426c-a974-354e77b12b12-dbus\") pod \"global-pull-secret-syncer-xl66m\" (UID: \"80312796-b102-426c-a974-354e77b12b12\") " pod="kube-system/global-pull-secret-syncer-xl66m"
Jun 15 05:47:40.175172 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173959    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-host-run-netns\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.175172 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173983    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-var-lib-openvswitch\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.175172 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.173992    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2196caf7-fa75-4e09-8673-688b078dd5a3-sys-fs\") pod \"aws-ebs-csi-driver-node-2ht9b\" (UID: \"2196caf7-fa75-4e09-8673-688b078dd5a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ht9b"
Jun 15 05:47:40.175172 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.174016    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-host\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.175172 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.174020    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.175172 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.174128    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4783d7d6-1895-41f7-b11a-dea0c4405bc8-ovn-node-metrics-cert\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.175758 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.174152    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/13e4b538-8b93-4137-aedf-11a30b014942-iptables-alerter-script\") pod \"iptables-alerter-dp464\" (UID: \"13e4b538-8b93-4137-aedf-11a30b014942\") " pod="openshift-network-operator/iptables-alerter-dp464"
Jun 15 05:47:40.175758 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.174168    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13e4b538-8b93-4137-aedf-11a30b014942-host-slash\") pod \"iptables-alerter-dp464\" (UID: \"13e4b538-8b93-4137-aedf-11a30b014942\") " pod="openshift-network-operator/iptables-alerter-dp464"
Jun 15 05:47:40.175758 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.174189    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-etc-modprobe-d\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.175758 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.174204    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-lib-modules\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.175758 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.174219    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-system-cni-dir\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.175758 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.174237    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-multus-socket-dir-parent\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.175758 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.174254    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/365f2bf1-0391-46a7-961e-a41133c65588-system-cni-dir\") pod \"multus-additional-cni-plugins-s5nvg\" (UID: \"365f2bf1-0391-46a7-961e-a41133c65588\") " pod="openshift-multus/multus-additional-cni-plugins-s5nvg"
Jun 15 05:47:40.175758 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.174278    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ndzr\" (UniqueName: \"kubernetes.io/projected/ecbcc04e-289f-482a-b26e-49a2cee2e45f-kube-api-access-5ndzr\") pod \"network-metrics-daemon-qm5gv\" (UID: \"ecbcc04e-289f-482a-b26e-49a2cee2e45f\") " pod="openshift-multus/network-metrics-daemon-qm5gv"
Jun 15 05:47:40.175758 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.174219    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13e4b538-8b93-4137-aedf-11a30b014942-host-slash\") pod \"iptables-alerter-dp464\" (UID: \"13e4b538-8b93-4137-aedf-11a30b014942\") " pod="openshift-network-operator/iptables-alerter-dp464"
Jun 15 05:47:40.175758 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.174303    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9ff3747f-c776-4f08-b35b-6d886f1e3cfc-hosts-file\") pod \"node-resolver-qdcqb\" (UID: \"9ff3747f-c776-4f08-b35b-6d886f1e3cfc\") " pod="openshift-dns/node-resolver-qdcqb"
Jun 15 05:47:40.175758 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.174328    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2196caf7-fa75-4e09-8673-688b078dd5a3-etc-selinux\") pod \"aws-ebs-csi-driver-node-2ht9b\" (UID: \"2196caf7-fa75-4e09-8673-688b078dd5a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ht9b"
Jun 15 05:47:40.175758 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.174350    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d898204a-f058-4bf3-b6be-6b5edd43b362-multus-daemon-config\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.175758 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.174362    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-lib-modules\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.175758 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.174374    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-run-openvswitch\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.175758 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.174390    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-run-ovn\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.175758 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.174403    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-system-cni-dir\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.175758 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.174404    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-etc-tuned\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.176486 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.174476    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9ff3747f-c776-4f08-b35b-6d886f1e3cfc-hosts-file\") pod \"node-resolver-qdcqb\" (UID: \"9ff3747f-c776-4f08-b35b-6d886f1e3cfc\") " pod="openshift-dns/node-resolver-qdcqb"
Jun 15 05:47:40.176486 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.174536    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d898204a-f058-4bf3-b6be-6b5edd43b362-multus-socket-dir-parent\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.176486 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.174280    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-etc-modprobe-d\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.176486 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.174691    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/13e4b538-8b93-4137-aedf-11a30b014942-iptables-alerter-script\") pod \"iptables-alerter-dp464\" (UID: \"13e4b538-8b93-4137-aedf-11a30b014942\") " pod="openshift-network-operator/iptables-alerter-dp464"
Jun 15 05:47:40.176486 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.174724    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2196caf7-fa75-4e09-8673-688b078dd5a3-etc-selinux\") pod \"aws-ebs-csi-driver-node-2ht9b\" (UID: \"2196caf7-fa75-4e09-8673-688b078dd5a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ht9b"
Jun 15 05:47:40.176486 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.175001    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d898204a-f058-4bf3-b6be-6b5edd43b362-multus-daemon-config\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.177973 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.177955    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-etc-tuned\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.178048 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.177995    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-tmp\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.185009 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.184987    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w9wm\" (UniqueName: \"kubernetes.io/projected/e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d-kube-api-access-6w9wm\") pod \"tuned-pjdzl\" (UID: \"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d\") " pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.185371 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.185349    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vz7w\" (UniqueName: \"kubernetes.io/projected/2196caf7-fa75-4e09-8673-688b078dd5a3-kube-api-access-7vz7w\") pod \"aws-ebs-csi-driver-node-2ht9b\" (UID: \"2196caf7-fa75-4e09-8673-688b078dd5a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ht9b"
Jun 15 05:47:40.185619 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.185603    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhfhd\" (UniqueName: \"kubernetes.io/projected/13e4b538-8b93-4137-aedf-11a30b014942-kube-api-access-zhfhd\") pod \"iptables-alerter-dp464\" (UID: \"13e4b538-8b93-4137-aedf-11a30b014942\") " pod="openshift-network-operator/iptables-alerter-dp464"
Jun 15 05:47:40.186442 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.186422    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcmnx\" (UniqueName: \"kubernetes.io/projected/9ff3747f-c776-4f08-b35b-6d886f1e3cfc-kube-api-access-qcmnx\") pod \"node-resolver-qdcqb\" (UID: \"9ff3747f-c776-4f08-b35b-6d886f1e3cfc\") " pod="openshift-dns/node-resolver-qdcqb"
Jun 15 05:47:40.187657 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.187639    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkm4s\" (UniqueName: \"kubernetes.io/projected/d898204a-f058-4bf3-b6be-6b5edd43b362-kube-api-access-dkm4s\") pod \"multus-78lp9\" (UID: \"d898204a-f058-4bf3-b6be-6b5edd43b362\") " pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.275229 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.275198    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-node-log\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.275385 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.275234    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdsjv\" (UniqueName: \"kubernetes.io/projected/4783d7d6-1895-41f7-b11a-dea0c4405bc8-kube-api-access-tdsjv\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.275385 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.275260    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccxgv\" (UniqueName: \"kubernetes.io/projected/01d7cf7a-bc4a-43be-a3b0-10d8e29e8735-kube-api-access-ccxgv\") pod \"node-ca-8v9wt\" (UID: \"01d7cf7a-bc4a-43be-a3b0-10d8e29e8735\") " pod="openshift-image-registry/node-ca-8v9wt"
Jun 15 05:47:40.275385 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.275301    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4783d7d6-1895-41f7-b11a-dea0c4405bc8-ovnkube-config\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.275385 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.275338    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/13b42759-3601-4360-a714-779f88b86a52-konnectivity-ca\") pod \"konnectivity-agent-kkfqp\" (UID: \"13b42759-3601-4360-a714-779f88b86a52\") " pod="kube-system/konnectivity-agent-kkfqp"
Jun 15 05:47:40.275385 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.275363    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecbcc04e-289f-482a-b26e-49a2cee2e45f-metrics-certs\") pod \"network-metrics-daemon-qm5gv\" (UID: \"ecbcc04e-289f-482a-b26e-49a2cee2e45f\") " pod="openshift-multus/network-metrics-daemon-qm5gv"
Jun 15 05:47:40.275630 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.275389    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-run-systemd\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.275630 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.275413    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-log-socket\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.275630 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.275438    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-host-cni-bin\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.275630 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.275460    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4783d7d6-1895-41f7-b11a-dea0c4405bc8-env-overrides\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.275630 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.275485    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4783d7d6-1895-41f7-b11a-dea0c4405bc8-ovnkube-script-lib\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.275630 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.275487    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-run-systemd\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.275630 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.275509    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-host-cni-netd\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.275630 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.275532    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/365f2bf1-0391-46a7-961e-a41133c65588-os-release\") pod \"multus-additional-cni-plugins-s5nvg\" (UID: \"365f2bf1-0391-46a7-961e-a41133c65588\") " pod="openshift-multus/multus-additional-cni-plugins-s5nvg"
Jun 15 05:47:40.275630 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.275549    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-host-cni-bin\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.275630 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.275562    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-systemd-units\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.275630 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.275591    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-log-socket\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.275630 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.275307    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-node-log\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.275630 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.275611    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/13b42759-3601-4360-a714-779f88b86a52-agent-certs\") pod \"konnectivity-agent-kkfqp\" (UID: \"13b42759-3601-4360-a714-779f88b86a52\") " pod="kube-system/konnectivity-agent-kkfqp"
Jun 15 05:47:40.276267 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:40.275533    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:47:40.276267 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:40.275701    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecbcc04e-289f-482a-b26e-49a2cee2e45f-metrics-certs podName:ecbcc04e-289f-482a-b26e-49a2cee2e45f nodeName:}" failed. No retries permitted until 2026-06-15 05:47:40.775680313 +0000 UTC m=+3.142225345 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecbcc04e-289f-482a-b26e-49a2cee2e45f-metrics-certs") pod "network-metrics-daemon-qm5gv" (UID: "ecbcc04e-289f-482a-b26e-49a2cee2e45f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:47:40.276267 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.275736    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-systemd-units\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.276267 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.275889    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-host-cni-netd\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.276267 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.275962    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/365f2bf1-0391-46a7-961e-a41133c65588-os-release\") pod \"multus-additional-cni-plugins-s5nvg\" (UID: \"365f2bf1-0391-46a7-961e-a41133c65588\") " pod="openshift-multus/multus-additional-cni-plugins-s5nvg"
Jun 15 05:47:40.276267 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.275638    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/365f2bf1-0391-46a7-961e-a41133c65588-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s5nvg\" (UID: \"365f2bf1-0391-46a7-961e-a41133c65588\") " pod="openshift-multus/multus-additional-cni-plugins-s5nvg"
Jun 15 05:47:40.276267 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.276015    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-host-run-netns\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.276267 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.276041    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4783d7d6-1895-41f7-b11a-dea0c4405bc8-ovnkube-script-lib\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.276267 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.276048    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/365f2bf1-0391-46a7-961e-a41133c65588-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s5nvg\" (UID: \"365f2bf1-0391-46a7-961e-a41133c65588\") " pod="openshift-multus/multus-additional-cni-plugins-s5nvg"
Jun 15 05:47:40.276267 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.276015    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/13b42759-3601-4360-a714-779f88b86a52-konnectivity-ca\") pod \"konnectivity-agent-kkfqp\" (UID: \"13b42759-3601-4360-a714-779f88b86a52\") " pod="kube-system/konnectivity-agent-kkfqp"
Jun 15 05:47:40.276267 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.276054    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-host-run-netns\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.276267 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.275979    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4783d7d6-1895-41f7-b11a-dea0c4405bc8-ovnkube-config\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.276267 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.276083    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-host-kubelet\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.276267 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.276112    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-host-slash\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.276267 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.276116    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-host-kubelet\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.276267 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.276161    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-etc-openvswitch\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.276267 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.276187    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01d7cf7a-bc4a-43be-a3b0-10d8e29e8735-host\") pod \"node-ca-8v9wt\" (UID: \"01d7cf7a-bc4a-43be-a3b0-10d8e29e8735\") " pod="openshift-image-registry/node-ca-8v9wt"
Jun 15 05:47:40.277070 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.276196    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-host-slash\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.277070 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.276219    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/365f2bf1-0391-46a7-961e-a41133c65588-cni-binary-copy\") pod \"multus-additional-cni-plugins-s5nvg\" (UID: \"365f2bf1-0391-46a7-961e-a41133c65588\") " pod="openshift-multus/multus-additional-cni-plugins-s5nvg"
Jun 15 05:47:40.277070 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.276224    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-etc-openvswitch\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.277070 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.276245    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-host-run-ovn-kubernetes\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.277070 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.276255    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/365f2bf1-0391-46a7-961e-a41133c65588-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s5nvg\" (UID: \"365f2bf1-0391-46a7-961e-a41133c65588\") " pod="openshift-multus/multus-additional-cni-plugins-s5nvg"
Jun 15 05:47:40.277070 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.276280    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/365f2bf1-0391-46a7-961e-a41133c65588-cnibin\") pod \"multus-additional-cni-plugins-s5nvg\" (UID: \"365f2bf1-0391-46a7-961e-a41133c65588\") " pod="openshift-multus/multus-additional-cni-plugins-s5nvg"
Jun 15 05:47:40.277070 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.276307    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/365f2bf1-0391-46a7-961e-a41133c65588-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s5nvg\" (UID: \"365f2bf1-0391-46a7-961e-a41133c65588\") " pod="openshift-multus/multus-additional-cni-plugins-s5nvg"
Jun 15 05:47:40.277070 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.276254    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01d7cf7a-bc4a-43be-a3b0-10d8e29e8735-host\") pod \"node-ca-8v9wt\" (UID: \"01d7cf7a-bc4a-43be-a3b0-10d8e29e8735\") " pod="openshift-image-registry/node-ca-8v9wt"
Jun 15 05:47:40.277070 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.276334    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-var-lib-openvswitch\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.277070 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.276360    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/365f2bf1-0391-46a7-961e-a41133c65588-cnibin\") pod \"multus-additional-cni-plugins-s5nvg\" (UID: \"365f2bf1-0391-46a7-961e-a41133c65588\") " pod="openshift-multus/multus-additional-cni-plugins-s5nvg"
Jun 15 05:47:40.277070 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.276360    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.277070 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.276399    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4783d7d6-1895-41f7-b11a-dea0c4405bc8-ovn-node-metrics-cert\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.277070 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.276429    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-var-lib-openvswitch\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.277070 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.276323    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-host-run-ovn-kubernetes\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.277070 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.276486    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/365f2bf1-0391-46a7-961e-a41133c65588-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s5nvg\" (UID: \"365f2bf1-0391-46a7-961e-a41133c65588\") " pod="openshift-multus/multus-additional-cni-plugins-s5nvg"
Jun 15 05:47:40.277070 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.276504    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4783d7d6-1895-41f7-b11a-dea0c4405bc8-env-overrides\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.277070 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.276564    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/365f2bf1-0391-46a7-961e-a41133c65588-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s5nvg\" (UID: \"365f2bf1-0391-46a7-961e-a41133c65588\") " pod="openshift-multus/multus-additional-cni-plugins-s5nvg"
Jun 15 05:47:40.277769 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.276399    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.277769 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.276687    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/365f2bf1-0391-46a7-961e-a41133c65588-cni-binary-copy\") pod \"multus-additional-cni-plugins-s5nvg\" (UID: \"365f2bf1-0391-46a7-961e-a41133c65588\") " pod="openshift-multus/multus-additional-cni-plugins-s5nvg"
Jun 15 05:47:40.277769 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.276887    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/365f2bf1-0391-46a7-961e-a41133c65588-system-cni-dir\") pod \"multus-additional-cni-plugins-s5nvg\" (UID: \"365f2bf1-0391-46a7-961e-a41133c65588\") " pod="openshift-multus/multus-additional-cni-plugins-s5nvg"
Jun 15 05:47:40.277769 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.276917    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ndzr\" (UniqueName: \"kubernetes.io/projected/ecbcc04e-289f-482a-b26e-49a2cee2e45f-kube-api-access-5ndzr\") pod \"network-metrics-daemon-qm5gv\" (UID: \"ecbcc04e-289f-482a-b26e-49a2cee2e45f\") " pod="openshift-multus/network-metrics-daemon-qm5gv"
Jun 15 05:47:40.277769 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.276943    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-run-openvswitch\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.277769 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.276967    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-run-ovn\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.277769 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.277045    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/01d7cf7a-bc4a-43be-a3b0-10d8e29e8735-serviceca\") pod \"node-ca-8v9wt\" (UID: \"01d7cf7a-bc4a-43be-a3b0-10d8e29e8735\") " pod="openshift-image-registry/node-ca-8v9wt"
Jun 15 05:47:40.277769 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.277071    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbdhd\" (UniqueName: \"kubernetes.io/projected/2b0e234e-c49a-4504-9737-8d32181944e5-kube-api-access-sbdhd\") pod \"network-check-target-jg5zt\" (UID: \"2b0e234e-c49a-4504-9737-8d32181944e5\") " pod="openshift-network-diagnostics/network-check-target-jg5zt"
Jun 15 05:47:40.277769 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.277094    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvpzw\" (UniqueName: \"kubernetes.io/projected/365f2bf1-0391-46a7-961e-a41133c65588-kube-api-access-rvpzw\") pod \"multus-additional-cni-plugins-s5nvg\" (UID: \"365f2bf1-0391-46a7-961e-a41133c65588\") " pod="openshift-multus/multus-additional-cni-plugins-s5nvg"
Jun 15 05:47:40.277769 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.277142    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-run-openvswitch\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.277769 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.277190    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/365f2bf1-0391-46a7-961e-a41133c65588-system-cni-dir\") pod \"multus-additional-cni-plugins-s5nvg\" (UID: \"365f2bf1-0391-46a7-961e-a41133c65588\") " pod="openshift-multus/multus-additional-cni-plugins-s5nvg"
Jun 15 05:47:40.277769 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.277454    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4783d7d6-1895-41f7-b11a-dea0c4405bc8-run-ovn\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.277769 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.277512    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/01d7cf7a-bc4a-43be-a3b0-10d8e29e8735-serviceca\") pod \"node-ca-8v9wt\" (UID: \"01d7cf7a-bc4a-43be-a3b0-10d8e29e8735\") " pod="openshift-image-registry/node-ca-8v9wt"
Jun 15 05:47:40.278552 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.278533    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4783d7d6-1895-41f7-b11a-dea0c4405bc8-ovn-node-metrics-cert\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.278735 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.278718    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/13b42759-3601-4360-a714-779f88b86a52-agent-certs\") pod \"konnectivity-agent-kkfqp\" (UID: \"13b42759-3601-4360-a714-779f88b86a52\") " pod="kube-system/konnectivity-agent-kkfqp"
Jun 15 05:47:40.284672 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:40.284652    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 15 05:47:40.284672 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:40.284674    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 15 05:47:40.284818 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:40.284687    2564 projected.go:196] Error preparing data for projected volume kube-api-access-sbdhd for pod openshift-network-diagnostics/network-check-target-jg5zt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:47:40.284818 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:40.284742    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b0e234e-c49a-4504-9737-8d32181944e5-kube-api-access-sbdhd podName:2b0e234e-c49a-4504-9737-8d32181944e5 nodeName:}" failed. No retries permitted until 2026-06-15 05:47:40.784727126 +0000 UTC m=+3.151272161 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-sbdhd" (UniqueName: "kubernetes.io/projected/2b0e234e-c49a-4504-9737-8d32181944e5-kube-api-access-sbdhd") pod "network-check-target-jg5zt" (UID: "2b0e234e-c49a-4504-9737-8d32181944e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:47:40.285431 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.285334    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccxgv\" (UniqueName: \"kubernetes.io/projected/01d7cf7a-bc4a-43be-a3b0-10d8e29e8735-kube-api-access-ccxgv\") pod \"node-ca-8v9wt\" (UID: \"01d7cf7a-bc4a-43be-a3b0-10d8e29e8735\") " pod="openshift-image-registry/node-ca-8v9wt"
Jun 15 05:47:40.286078 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.286055    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdsjv\" (UniqueName: \"kubernetes.io/projected/4783d7d6-1895-41f7-b11a-dea0c4405bc8-kube-api-access-tdsjv\") pod \"ovnkube-node-7qndp\" (UID: \"4783d7d6-1895-41f7-b11a-dea0c4405bc8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.286945 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.286917    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvpzw\" (UniqueName: \"kubernetes.io/projected/365f2bf1-0391-46a7-961e-a41133c65588-kube-api-access-rvpzw\") pod \"multus-additional-cni-plugins-s5nvg\" (UID: \"365f2bf1-0391-46a7-961e-a41133c65588\") " pod="openshift-multus/multus-additional-cni-plugins-s5nvg"
Jun 15 05:47:40.287197 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.287177    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ndzr\" (UniqueName: \"kubernetes.io/projected/ecbcc04e-289f-482a-b26e-49a2cee2e45f-kube-api-access-5ndzr\") pod \"network-metrics-daemon-qm5gv\" (UID: \"ecbcc04e-289f-482a-b26e-49a2cee2e45f\") " pod="openshift-multus/network-metrics-daemon-qm5gv"
Jun 15 05:47:40.362826 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.362731    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-78lp9"
Jun 15 05:47:40.369803 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.369783    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dp464"
Jun 15 05:47:40.377480 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.377463    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pjdzl"
Jun 15 05:47:40.385167 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.385149    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qdcqb"
Jun 15 05:47:40.392925 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.392905    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ht9b"
Jun 15 05:47:40.398575 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.398556    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s5nvg"
Jun 15 05:47:40.405173 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.405157    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:47:40.411722 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.411707    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8v9wt"
Jun 15 05:47:40.416268 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.416252    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kkfqp"
Jun 15 05:47:40.553944 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.553915    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 15 05:47:40.679450 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.679415    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80312796-b102-426c-a974-354e77b12b12-original-pull-secret\") pod \"global-pull-secret-syncer-xl66m\" (UID: \"80312796-b102-426c-a974-354e77b12b12\") " pod="kube-system/global-pull-secret-syncer-xl66m"
Jun 15 05:47:40.679628 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:40.679609    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 15 05:47:40.679702 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:40.679691    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80312796-b102-426c-a974-354e77b12b12-original-pull-secret podName:80312796-b102-426c-a974-354e77b12b12 nodeName:}" failed. No retries permitted until 2026-06-15 05:47:41.679669137 +0000 UTC m=+4.046214167 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80312796-b102-426c-a974-354e77b12b12-original-pull-secret") pod "global-pull-secret-syncer-xl66m" (UID: "80312796-b102-426c-a974-354e77b12b12") : object "kube-system"/"original-pull-secret" not registered
Jun 15 05:47:40.780561 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.780528    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecbcc04e-289f-482a-b26e-49a2cee2e45f-metrics-certs\") pod \"network-metrics-daemon-qm5gv\" (UID: \"ecbcc04e-289f-482a-b26e-49a2cee2e45f\") " pod="openshift-multus/network-metrics-daemon-qm5gv"
Jun 15 05:47:40.780734 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:40.780646    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:47:40.780734 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:40.780701    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecbcc04e-289f-482a-b26e-49a2cee2e45f-metrics-certs podName:ecbcc04e-289f-482a-b26e-49a2cee2e45f nodeName:}" failed. No retries permitted until 2026-06-15 05:47:41.78068642 +0000 UTC m=+4.147231466 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecbcc04e-289f-482a-b26e-49a2cee2e45f-metrics-certs") pod "network-metrics-daemon-qm5gv" (UID: "ecbcc04e-289f-482a-b26e-49a2cee2e45f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:47:40.881053 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:40.881023    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbdhd\" (UniqueName: \"kubernetes.io/projected/2b0e234e-c49a-4504-9737-8d32181944e5-kube-api-access-sbdhd\") pod \"network-check-target-jg5zt\" (UID: \"2b0e234e-c49a-4504-9737-8d32181944e5\") " pod="openshift-network-diagnostics/network-check-target-jg5zt"
Jun 15 05:47:40.881202 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:40.881182    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 15 05:47:40.881245 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:40.881206    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 15 05:47:40.881245 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:40.881216    2564 projected.go:196] Error preparing data for projected volume kube-api-access-sbdhd for pod openshift-network-diagnostics/network-check-target-jg5zt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:47:40.881307 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:40.881264    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b0e234e-c49a-4504-9737-8d32181944e5-kube-api-access-sbdhd podName:2b0e234e-c49a-4504-9737-8d32181944e5 nodeName:}" failed. No retries permitted until 2026-06-15 05:47:41.881251177 +0000 UTC m=+4.247796205 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-sbdhd" (UniqueName: "kubernetes.io/projected/2b0e234e-c49a-4504-9737-8d32181944e5-kube-api-access-sbdhd") pod "network-check-target-jg5zt" (UID: "2b0e234e-c49a-4504-9737-8d32181944e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:47:40.949669 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:40.949575    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13e4b538_8b93_4137_aedf_11a30b014942.slice/crio-2bfb65652810456084cdd33fb883417999b0d2e2bbe29319c3a80094b6f2036d WatchSource:0}: Error finding container 2bfb65652810456084cdd33fb883417999b0d2e2bbe29319c3a80094b6f2036d: Status 404 returned error can't find the container with id 2bfb65652810456084cdd33fb883417999b0d2e2bbe29319c3a80094b6f2036d
Jun 15 05:47:40.951036 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:40.950981    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff3747f_c776_4f08_b35b_6d886f1e3cfc.slice/crio-a84ed84ca50fb876ce77e227d498022a5dbb64f6d20c34969f6e1aab90e51c4c WatchSource:0}: Error finding container a84ed84ca50fb876ce77e227d498022a5dbb64f6d20c34969f6e1aab90e51c4c: Status 404 returned error can't find the container with id a84ed84ca50fb876ce77e227d498022a5dbb64f6d20c34969f6e1aab90e51c4c
Jun 15 05:47:40.951678 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:40.951625    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01d7cf7a_bc4a_43be_a3b0_10d8e29e8735.slice/crio-2914afe1fdbd45c5f73305ddb2cb99d06f3f2ca51aa73e473131f93d724d45d5 WatchSource:0}: Error finding container 2914afe1fdbd45c5f73305ddb2cb99d06f3f2ca51aa73e473131f93d724d45d5: Status 404 returned error can't find the container with id 2914afe1fdbd45c5f73305ddb2cb99d06f3f2ca51aa73e473131f93d724d45d5
Jun 15 05:47:40.952353 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:40.952268    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5ecf91d_0604_4b15_96b5_b7b1f6fd5a2d.slice/crio-13fb84e5e67ff3d7efa4ed6beb66695bcf8382286da545f2baf7a2819c766c17 WatchSource:0}: Error finding container 13fb84e5e67ff3d7efa4ed6beb66695bcf8382286da545f2baf7a2819c766c17: Status 404 returned error can't find the container with id 13fb84e5e67ff3d7efa4ed6beb66695bcf8382286da545f2baf7a2819c766c17
Jun 15 05:47:40.955231 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:40.955207    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4783d7d6_1895_41f7_b11a_dea0c4405bc8.slice/crio-e0e4467f82bcbe4e86a3c6c25ef156f13a54e31ccf9ef5f49d0b3fdffa405227 WatchSource:0}: Error finding container e0e4467f82bcbe4e86a3c6c25ef156f13a54e31ccf9ef5f49d0b3fdffa405227: Status 404 returned error can't find the container with id e0e4467f82bcbe4e86a3c6c25ef156f13a54e31ccf9ef5f49d0b3fdffa405227
Jun 15 05:47:40.956880 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:40.956063    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13b42759_3601_4360_a714_779f88b86a52.slice/crio-10afebda48cd3be699b00411528a562c6f3648e02ccd89b3f85e862fa527ef89 WatchSource:0}: Error finding container 10afebda48cd3be699b00411528a562c6f3648e02ccd89b3f85e862fa527ef89: Status 404 returned error can't find the container with id 10afebda48cd3be699b00411528a562c6f3648e02ccd89b3f85e862fa527ef89
Jun 15 05:47:40.956880 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:40.956805    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod365f2bf1_0391_46a7_961e_a41133c65588.slice/crio-eebd40516044855aeec0847fc6bfa60c4665e614d56526df8e6f81b10ef97152 WatchSource:0}: Error finding container eebd40516044855aeec0847fc6bfa60c4665e614d56526df8e6f81b10ef97152: Status 404 returned error can't find the container with id eebd40516044855aeec0847fc6bfa60c4665e614d56526df8e6f81b10ef97152
Jun 15 05:47:40.960335 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:40.958360    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd898204a_f058_4bf3_b6be_6b5edd43b362.slice/crio-b3077d09d0045860c1fe3e8b69125df6e8b6f43f22fc1c050261194b84595bc7 WatchSource:0}: Error finding container b3077d09d0045860c1fe3e8b69125df6e8b6f43f22fc1c050261194b84595bc7: Status 404 returned error can't find the container with id b3077d09d0045860c1fe3e8b69125df6e8b6f43f22fc1c050261194b84595bc7
Jun 15 05:47:40.960335 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:47:40.959730    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2196caf7_fa75_4e09_8673_688b078dd5a3.slice/crio-92f8ef42438641aa5778acc97c5e8c696640629b39059587b560c2237200d0d9 WatchSource:0}: Error finding container 92f8ef42438641aa5778acc97c5e8c696640629b39059587b560c2237200d0d9: Status 404 returned error can't find the container with id 92f8ef42438641aa5778acc97c5e8c696640629b39059587b560c2237200d0d9
Jun 15 05:47:41.106557 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:41.106385    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 05:42:39 +0000 UTC" deadline="2028-03-21 06:00:21.528754164 +0000 UTC"
Jun 15 05:47:41.106557 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:41.106553    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15480h12m40.422203721s"
Jun 15 05:47:41.140378 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:41.140309    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kkfqp" event={"ID":"13b42759-3601-4360-a714-779f88b86a52","Type":"ContainerStarted","Data":"10afebda48cd3be699b00411528a562c6f3648e02ccd89b3f85e862fa527ef89"}
Jun 15 05:47:41.141587 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:41.141562    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pjdzl" event={"ID":"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d","Type":"ContainerStarted","Data":"13fb84e5e67ff3d7efa4ed6beb66695bcf8382286da545f2baf7a2819c766c17"}
Jun 15 05:47:41.143118 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:41.143090    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dp464" event={"ID":"13e4b538-8b93-4137-aedf-11a30b014942","Type":"ContainerStarted","Data":"2bfb65652810456084cdd33fb883417999b0d2e2bbe29319c3a80094b6f2036d"}
Jun 15 05:47:41.145301 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:41.145244    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-82.ec2.internal" event={"ID":"f628656103b87af6a4969bd9cbf47555","Type":"ContainerStarted","Data":"eb17909b678e81064e1b0650af47ff40d879762265bd10f8eb4c06ef52e48a43"}
Jun 15 05:47:41.147630 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:41.147179    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ht9b" event={"ID":"2196caf7-fa75-4e09-8673-688b078dd5a3","Type":"ContainerStarted","Data":"92f8ef42438641aa5778acc97c5e8c696640629b39059587b560c2237200d0d9"}
Jun 15 05:47:41.148808 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:41.148785    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-78lp9" event={"ID":"d898204a-f058-4bf3-b6be-6b5edd43b362","Type":"ContainerStarted","Data":"b3077d09d0045860c1fe3e8b69125df6e8b6f43f22fc1c050261194b84595bc7"}
Jun 15 05:47:41.150205 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:41.150185    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7qndp" event={"ID":"4783d7d6-1895-41f7-b11a-dea0c4405bc8","Type":"ContainerStarted","Data":"e0e4467f82bcbe4e86a3c6c25ef156f13a54e31ccf9ef5f49d0b3fdffa405227"}
Jun 15 05:47:41.151459 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:41.151436    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qdcqb" event={"ID":"9ff3747f-c776-4f08-b35b-6d886f1e3cfc","Type":"ContainerStarted","Data":"a84ed84ca50fb876ce77e227d498022a5dbb64f6d20c34969f6e1aab90e51c4c"}
Jun 15 05:47:41.152576 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:41.152555    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8v9wt" event={"ID":"01d7cf7a-bc4a-43be-a3b0-10d8e29e8735","Type":"ContainerStarted","Data":"2914afe1fdbd45c5f73305ddb2cb99d06f3f2ca51aa73e473131f93d724d45d5"}
Jun 15 05:47:41.153591 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:41.153571    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s5nvg" event={"ID":"365f2bf1-0391-46a7-961e-a41133c65588","Type":"ContainerStarted","Data":"eebd40516044855aeec0847fc6bfa60c4665e614d56526df8e6f81b10ef97152"}
Jun 15 05:47:41.163020 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:41.162958    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-82.ec2.internal" podStartSLOduration=2.162941696 podStartE2EDuration="2.162941696s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:47:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:47:41.162785995 +0000 UTC m=+3.529331047" watchObservedRunningTime="2026-06-15 05:47:41.162941696 +0000 UTC m=+3.529486757"
Jun 15 05:47:41.689409 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:41.689353    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80312796-b102-426c-a974-354e77b12b12-original-pull-secret\") pod \"global-pull-secret-syncer-xl66m\" (UID: \"80312796-b102-426c-a974-354e77b12b12\") " pod="kube-system/global-pull-secret-syncer-xl66m"
Jun 15 05:47:41.689595 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:41.689509    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 15 05:47:41.689595 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:41.689569    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80312796-b102-426c-a974-354e77b12b12-original-pull-secret podName:80312796-b102-426c-a974-354e77b12b12 nodeName:}" failed. No retries permitted until 2026-06-15 05:47:43.689552078 +0000 UTC m=+6.056097120 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80312796-b102-426c-a974-354e77b12b12-original-pull-secret") pod "global-pull-secret-syncer-xl66m" (UID: "80312796-b102-426c-a974-354e77b12b12") : object "kube-system"/"original-pull-secret" not registered
Jun 15 05:47:41.790464 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:41.790430    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecbcc04e-289f-482a-b26e-49a2cee2e45f-metrics-certs\") pod \"network-metrics-daemon-qm5gv\" (UID: \"ecbcc04e-289f-482a-b26e-49a2cee2e45f\") " pod="openshift-multus/network-metrics-daemon-qm5gv"
Jun 15 05:47:41.790637 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:41.790565    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:47:41.790637 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:41.790628    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecbcc04e-289f-482a-b26e-49a2cee2e45f-metrics-certs podName:ecbcc04e-289f-482a-b26e-49a2cee2e45f nodeName:}" failed. No retries permitted until 2026-06-15 05:47:43.79061185 +0000 UTC m=+6.157156892 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecbcc04e-289f-482a-b26e-49a2cee2e45f-metrics-certs") pod "network-metrics-daemon-qm5gv" (UID: "ecbcc04e-289f-482a-b26e-49a2cee2e45f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:47:41.891758 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:41.891725    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbdhd\" (UniqueName: \"kubernetes.io/projected/2b0e234e-c49a-4504-9737-8d32181944e5-kube-api-access-sbdhd\") pod \"network-check-target-jg5zt\" (UID: \"2b0e234e-c49a-4504-9737-8d32181944e5\") " pod="openshift-network-diagnostics/network-check-target-jg5zt"
Jun 15 05:47:41.891948 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:41.891911    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 15 05:47:41.891948 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:41.891929    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 15 05:47:41.891948 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:41.891941    2564 projected.go:196] Error preparing data for projected volume kube-api-access-sbdhd for pod openshift-network-diagnostics/network-check-target-jg5zt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:47:41.892112 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:41.891994    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b0e234e-c49a-4504-9737-8d32181944e5-kube-api-access-sbdhd podName:2b0e234e-c49a-4504-9737-8d32181944e5 nodeName:}" failed. No retries permitted until 2026-06-15 05:47:43.891977818 +0000 UTC m=+6.258522866 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-sbdhd" (UniqueName: "kubernetes.io/projected/2b0e234e-c49a-4504-9737-8d32181944e5-kube-api-access-sbdhd") pod "network-check-target-jg5zt" (UID: "2b0e234e-c49a-4504-9737-8d32181944e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:47:42.131691 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:42.131608    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl66m"
Jun 15 05:47:42.132128 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:42.131743    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xl66m" podUID="80312796-b102-426c-a974-354e77b12b12"
Jun 15 05:47:42.132182 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:42.132170    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jg5zt"
Jun 15 05:47:42.132298 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:42.132260    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jg5zt" podUID="2b0e234e-c49a-4504-9737-8d32181944e5"
Jun 15 05:47:42.132396 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:42.132359    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qm5gv"
Jun 15 05:47:42.132454 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:42.132443    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qm5gv" podUID="ecbcc04e-289f-482a-b26e-49a2cee2e45f"
Jun 15 05:47:42.179815 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:42.179782    2564 generic.go:356] "Generic (PLEG): container finished" podID="b1720615f104def57996580484e4fe33" containerID="39af52b75fbc4625dee8e50513f573f1bde5e902a48d2fdf54d9577c5f24b3e2" exitCode=0
Jun 15 05:47:42.180087 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:42.180025    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-82.ec2.internal" event={"ID":"b1720615f104def57996580484e4fe33","Type":"ContainerDied","Data":"39af52b75fbc4625dee8e50513f573f1bde5e902a48d2fdf54d9577c5f24b3e2"}
Jun 15 05:47:43.209109 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:43.209072    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-82.ec2.internal" event={"ID":"b1720615f104def57996580484e4fe33","Type":"ContainerStarted","Data":"587fce94b1926d5012f1b32ad47c0d3f0dff7926d241b91baf7d05c57a0103b9"}
Jun 15 05:47:43.707597 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:43.707561    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80312796-b102-426c-a974-354e77b12b12-original-pull-secret\") pod \"global-pull-secret-syncer-xl66m\" (UID: \"80312796-b102-426c-a974-354e77b12b12\") " pod="kube-system/global-pull-secret-syncer-xl66m"
Jun 15 05:47:43.707764 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:43.707736    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 15 05:47:43.707815 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:43.707792    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80312796-b102-426c-a974-354e77b12b12-original-pull-secret podName:80312796-b102-426c-a974-354e77b12b12 nodeName:}" failed. No retries permitted until 2026-06-15 05:47:47.707775873 +0000 UTC m=+10.074320903 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80312796-b102-426c-a974-354e77b12b12-original-pull-secret") pod "global-pull-secret-syncer-xl66m" (UID: "80312796-b102-426c-a974-354e77b12b12") : object "kube-system"/"original-pull-secret" not registered
Jun 15 05:47:43.808547 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:43.808515    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecbcc04e-289f-482a-b26e-49a2cee2e45f-metrics-certs\") pod \"network-metrics-daemon-qm5gv\" (UID: \"ecbcc04e-289f-482a-b26e-49a2cee2e45f\") " pod="openshift-multus/network-metrics-daemon-qm5gv"
Jun 15 05:47:43.808715 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:43.808670    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:47:43.808780 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:43.808726    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecbcc04e-289f-482a-b26e-49a2cee2e45f-metrics-certs podName:ecbcc04e-289f-482a-b26e-49a2cee2e45f nodeName:}" failed. No retries permitted until 2026-06-15 05:47:47.808708857 +0000 UTC m=+10.175253888 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecbcc04e-289f-482a-b26e-49a2cee2e45f-metrics-certs") pod "network-metrics-daemon-qm5gv" (UID: "ecbcc04e-289f-482a-b26e-49a2cee2e45f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:47:43.909171 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:43.909139    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbdhd\" (UniqueName: \"kubernetes.io/projected/2b0e234e-c49a-4504-9737-8d32181944e5-kube-api-access-sbdhd\") pod \"network-check-target-jg5zt\" (UID: \"2b0e234e-c49a-4504-9737-8d32181944e5\") " pod="openshift-network-diagnostics/network-check-target-jg5zt"
Jun 15 05:47:43.909352 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:43.909278    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 15 05:47:43.909352 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:43.909291    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 15 05:47:43.909352 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:43.909300    2564 projected.go:196] Error preparing data for projected volume kube-api-access-sbdhd for pod openshift-network-diagnostics/network-check-target-jg5zt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:47:43.909352 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:43.909338    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b0e234e-c49a-4504-9737-8d32181944e5-kube-api-access-sbdhd podName:2b0e234e-c49a-4504-9737-8d32181944e5 nodeName:}" failed. No retries permitted until 2026-06-15 05:47:47.909327234 +0000 UTC m=+10.275872262 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-sbdhd" (UniqueName: "kubernetes.io/projected/2b0e234e-c49a-4504-9737-8d32181944e5-kube-api-access-sbdhd") pod "network-check-target-jg5zt" (UID: "2b0e234e-c49a-4504-9737-8d32181944e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:47:44.131386 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:44.131316    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jg5zt"
Jun 15 05:47:44.131532 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:44.131321    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl66m"
Jun 15 05:47:44.131532 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:44.131413    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jg5zt" podUID="2b0e234e-c49a-4504-9737-8d32181944e5"
Jun 15 05:47:44.131532 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:44.131498    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xl66m" podUID="80312796-b102-426c-a974-354e77b12b12"
Jun 15 05:47:44.131689 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:44.131553    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qm5gv"
Jun 15 05:47:44.131689 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:44.131641    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qm5gv" podUID="ecbcc04e-289f-482a-b26e-49a2cee2e45f"
Jun 15 05:47:46.131445 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:46.130957    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qm5gv"
Jun 15 05:47:46.131445 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:46.130971    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl66m"
Jun 15 05:47:46.131445 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:46.131098    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qm5gv" podUID="ecbcc04e-289f-482a-b26e-49a2cee2e45f"
Jun 15 05:47:46.131445 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:46.131144    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jg5zt"
Jun 15 05:47:46.131445 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:46.131261    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xl66m" podUID="80312796-b102-426c-a974-354e77b12b12"
Jun 15 05:47:46.131445 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:46.131340    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jg5zt" podUID="2b0e234e-c49a-4504-9737-8d32181944e5"
Jun 15 05:47:47.740283 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:47.740241    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80312796-b102-426c-a974-354e77b12b12-original-pull-secret\") pod \"global-pull-secret-syncer-xl66m\" (UID: \"80312796-b102-426c-a974-354e77b12b12\") " pod="kube-system/global-pull-secret-syncer-xl66m"
Jun 15 05:47:47.740825 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:47.740393    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 15 05:47:47.740825 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:47.740447    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80312796-b102-426c-a974-354e77b12b12-original-pull-secret podName:80312796-b102-426c-a974-354e77b12b12 nodeName:}" failed. No retries permitted until 2026-06-15 05:47:55.740433907 +0000 UTC m=+18.106978935 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80312796-b102-426c-a974-354e77b12b12-original-pull-secret") pod "global-pull-secret-syncer-xl66m" (UID: "80312796-b102-426c-a974-354e77b12b12") : object "kube-system"/"original-pull-secret" not registered
Jun 15 05:47:47.841135 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:47.841098    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecbcc04e-289f-482a-b26e-49a2cee2e45f-metrics-certs\") pod \"network-metrics-daemon-qm5gv\" (UID: \"ecbcc04e-289f-482a-b26e-49a2cee2e45f\") " pod="openshift-multus/network-metrics-daemon-qm5gv"
Jun 15 05:47:47.841315 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:47.841258    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:47:47.841375 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:47.841331    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecbcc04e-289f-482a-b26e-49a2cee2e45f-metrics-certs podName:ecbcc04e-289f-482a-b26e-49a2cee2e45f nodeName:}" failed. No retries permitted until 2026-06-15 05:47:55.841315639 +0000 UTC m=+18.207860690 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecbcc04e-289f-482a-b26e-49a2cee2e45f-metrics-certs") pod "network-metrics-daemon-qm5gv" (UID: "ecbcc04e-289f-482a-b26e-49a2cee2e45f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:47:47.942420 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:47.942316    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbdhd\" (UniqueName: \"kubernetes.io/projected/2b0e234e-c49a-4504-9737-8d32181944e5-kube-api-access-sbdhd\") pod \"network-check-target-jg5zt\" (UID: \"2b0e234e-c49a-4504-9737-8d32181944e5\") " pod="openshift-network-diagnostics/network-check-target-jg5zt"
Jun 15 05:47:47.942592 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:47.942511    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 15 05:47:47.942592 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:47.942539    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 15 05:47:47.942592 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:47.942553    2564 projected.go:196] Error preparing data for projected volume kube-api-access-sbdhd for pod openshift-network-diagnostics/network-check-target-jg5zt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:47:47.942744 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:47.942626    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b0e234e-c49a-4504-9737-8d32181944e5-kube-api-access-sbdhd podName:2b0e234e-c49a-4504-9737-8d32181944e5 nodeName:}" failed. No retries permitted until 2026-06-15 05:47:55.942605116 +0000 UTC m=+18.309150149 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-sbdhd" (UniqueName: "kubernetes.io/projected/2b0e234e-c49a-4504-9737-8d32181944e5-kube-api-access-sbdhd") pod "network-check-target-jg5zt" (UID: "2b0e234e-c49a-4504-9737-8d32181944e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:47:48.133075 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:48.132157    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jg5zt"
Jun 15 05:47:48.133075 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:48.132258    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jg5zt" podUID="2b0e234e-c49a-4504-9737-8d32181944e5"
Jun 15 05:47:48.133075 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:48.132617    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl66m"
Jun 15 05:47:48.133075 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:48.132701    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xl66m" podUID="80312796-b102-426c-a974-354e77b12b12"
Jun 15 05:47:48.133075 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:48.132758    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qm5gv"
Jun 15 05:47:48.133075 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:48.132836    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qm5gv" podUID="ecbcc04e-289f-482a-b26e-49a2cee2e45f"
Jun 15 05:47:50.131993 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:50.131950    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl66m"
Jun 15 05:47:50.131993 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:50.131967    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qm5gv"
Jun 15 05:47:50.131993 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:50.131977    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jg5zt"
Jun 15 05:47:50.132515 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:50.132075    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xl66m" podUID="80312796-b102-426c-a974-354e77b12b12"
Jun 15 05:47:50.132515 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:50.132244    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qm5gv" podUID="ecbcc04e-289f-482a-b26e-49a2cee2e45f"
Jun 15 05:47:50.132515 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:50.132360    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jg5zt" podUID="2b0e234e-c49a-4504-9737-8d32181944e5"
Jun 15 05:47:52.130921 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:52.130881    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jg5zt"
Jun 15 05:47:52.131372 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:52.130935    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qm5gv"
Jun 15 05:47:52.131372 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:52.130888    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl66m"
Jun 15 05:47:52.131372 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:52.131057    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qm5gv" podUID="ecbcc04e-289f-482a-b26e-49a2cee2e45f"
Jun 15 05:47:52.131372 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:52.131089    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xl66m" podUID="80312796-b102-426c-a974-354e77b12b12"
Jun 15 05:47:52.131372 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:52.131194    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jg5zt" podUID="2b0e234e-c49a-4504-9737-8d32181944e5"
Jun 15 05:47:54.131918 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:54.131409    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jg5zt"
Jun 15 05:47:54.131918 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:54.131433    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qm5gv"
Jun 15 05:47:54.131918 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:54.131420    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl66m"
Jun 15 05:47:54.131918 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:54.131536    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jg5zt" podUID="2b0e234e-c49a-4504-9737-8d32181944e5"
Jun 15 05:47:54.131918 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:54.131613    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xl66m" podUID="80312796-b102-426c-a974-354e77b12b12"
Jun 15 05:47:54.131918 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:54.131686    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qm5gv" podUID="ecbcc04e-289f-482a-b26e-49a2cee2e45f"
Jun 15 05:47:55.799251 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:55.799218    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80312796-b102-426c-a974-354e77b12b12-original-pull-secret\") pod \"global-pull-secret-syncer-xl66m\" (UID: \"80312796-b102-426c-a974-354e77b12b12\") " pod="kube-system/global-pull-secret-syncer-xl66m"
Jun 15 05:47:55.799722 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:55.799359    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 15 05:47:55.799722 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:55.799426    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80312796-b102-426c-a974-354e77b12b12-original-pull-secret podName:80312796-b102-426c-a974-354e77b12b12 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:11.799408114 +0000 UTC m=+34.165953143 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80312796-b102-426c-a974-354e77b12b12-original-pull-secret") pod "global-pull-secret-syncer-xl66m" (UID: "80312796-b102-426c-a974-354e77b12b12") : object "kube-system"/"original-pull-secret" not registered
Jun 15 05:47:55.900536 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:55.900496    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecbcc04e-289f-482a-b26e-49a2cee2e45f-metrics-certs\") pod \"network-metrics-daemon-qm5gv\" (UID: \"ecbcc04e-289f-482a-b26e-49a2cee2e45f\") " pod="openshift-multus/network-metrics-daemon-qm5gv"
Jun 15 05:47:55.900692 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:55.900625    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:47:55.900692 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:55.900684    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecbcc04e-289f-482a-b26e-49a2cee2e45f-metrics-certs podName:ecbcc04e-289f-482a-b26e-49a2cee2e45f nodeName:}" failed. No retries permitted until 2026-06-15 05:48:11.900668567 +0000 UTC m=+34.267213598 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecbcc04e-289f-482a-b26e-49a2cee2e45f-metrics-certs") pod "network-metrics-daemon-qm5gv" (UID: "ecbcc04e-289f-482a-b26e-49a2cee2e45f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:47:56.001176 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:56.001134    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbdhd\" (UniqueName: \"kubernetes.io/projected/2b0e234e-c49a-4504-9737-8d32181944e5-kube-api-access-sbdhd\") pod \"network-check-target-jg5zt\" (UID: \"2b0e234e-c49a-4504-9737-8d32181944e5\") " pod="openshift-network-diagnostics/network-check-target-jg5zt"
Jun 15 05:47:56.001363 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:56.001328    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 15 05:47:56.001363 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:56.001358    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 15 05:47:56.001514 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:56.001371    2564 projected.go:196] Error preparing data for projected volume kube-api-access-sbdhd for pod openshift-network-diagnostics/network-check-target-jg5zt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:47:56.001514 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:56.001436    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b0e234e-c49a-4504-9737-8d32181944e5-kube-api-access-sbdhd podName:2b0e234e-c49a-4504-9737-8d32181944e5 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:12.00141645 +0000 UTC m=+34.367961489 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-sbdhd" (UniqueName: "kubernetes.io/projected/2b0e234e-c49a-4504-9737-8d32181944e5-kube-api-access-sbdhd") pod "network-check-target-jg5zt" (UID: "2b0e234e-c49a-4504-9737-8d32181944e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:47:56.131248 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:56.131172    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qm5gv"
Jun 15 05:47:56.131382 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:56.131297    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qm5gv" podUID="ecbcc04e-289f-482a-b26e-49a2cee2e45f"
Jun 15 05:47:56.131623 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:56.131608    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl66m"
Jun 15 05:47:56.131711 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:56.131691    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xl66m" podUID="80312796-b102-426c-a974-354e77b12b12"
Jun 15 05:47:56.131758 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:56.131172    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jg5zt"
Jun 15 05:47:56.131840 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:56.131761    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jg5zt" podUID="2b0e234e-c49a-4504-9737-8d32181944e5"
Jun 15 05:47:58.132001 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:58.131964    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qm5gv"
Jun 15 05:47:58.132389 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:58.132088    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qm5gv" podUID="ecbcc04e-289f-482a-b26e-49a2cee2e45f"
Jun 15 05:47:58.132487 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:58.132469    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl66m"
Jun 15 05:47:58.132585 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:58.132567    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xl66m" podUID="80312796-b102-426c-a974-354e77b12b12"
Jun 15 05:47:58.132630 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:47:58.132620    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jg5zt"
Jun 15 05:47:58.132716 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:47:58.132699    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jg5zt" podUID="2b0e234e-c49a-4504-9737-8d32181944e5"
Jun 15 05:48:00.133180 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:00.132992    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jg5zt"
Jun 15 05:48:00.133566 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:00.133275    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jg5zt" podUID="2b0e234e-c49a-4504-9737-8d32181944e5"
Jun 15 05:48:00.133566 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:00.133348    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl66m"
Jun 15 05:48:00.133566 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:00.133417    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xl66m" podUID="80312796-b102-426c-a974-354e77b12b12"
Jun 15 05:48:00.134408 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:00.134388    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qm5gv"
Jun 15 05:48:00.134514 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:00.134493    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qm5gv" podUID="ecbcc04e-289f-482a-b26e-49a2cee2e45f"
Jun 15 05:48:00.252958 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:00.252719    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s5nvg" event={"ID":"365f2bf1-0391-46a7-961e-a41133c65588","Type":"ContainerStarted","Data":"33b2f25c912d48c8b6d6329be83b2ccc930fa252cf764193ba9d03793a85ea72"}
Jun 15 05:48:00.256107 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:00.256074    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kkfqp" event={"ID":"13b42759-3601-4360-a714-779f88b86a52","Type":"ContainerStarted","Data":"e76a9808eb83a514566dea287e5274ecad89f962e0882e57fb3485018dc36da4"}
Jun 15 05:48:00.257721 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:00.257640    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pjdzl" event={"ID":"e5ecf91d-0604-4b15-96b5-b7b1f6fd5a2d","Type":"ContainerStarted","Data":"eb39db4ac0fd14dbe403b3aada3abd79bf18c8f7f2a37018192d8af69077e2d6"}
Jun 15 05:48:00.259312 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:00.259254    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ht9b" event={"ID":"2196caf7-fa75-4e09-8673-688b078dd5a3","Type":"ContainerStarted","Data":"176af2f9e13458bc5884d6d1175345783bf7b629a7f1e23d375230fa0d6522e0"}
Jun 15 05:48:00.260897 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:00.260852    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-78lp9" event={"ID":"d898204a-f058-4bf3-b6be-6b5edd43b362","Type":"ContainerStarted","Data":"32f61741ed42b631b5f951ce343cb24fb168d5ae2784dcb700ed12690b1f51c5"}
Jun 15 05:48:00.262692 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:00.262667    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7qndp" event={"ID":"4783d7d6-1895-41f7-b11a-dea0c4405bc8","Type":"ContainerStarted","Data":"b106372684fdcf5bc62d1aba8cee7b3ecd9d9d582450c2a9e3b646b2caca9e9a"}
Jun 15 05:48:00.262786 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:00.262753    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7qndp" event={"ID":"4783d7d6-1895-41f7-b11a-dea0c4405bc8","Type":"ContainerStarted","Data":"4ea390172a7952add63dd29722e14fe64170482a8a74aa65b0866f31ef51fb98"}
Jun 15 05:48:00.265409 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:00.265386    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qdcqb" event={"ID":"9ff3747f-c776-4f08-b35b-6d886f1e3cfc","Type":"ContainerStarted","Data":"ec5647e0a343129c1e2cb2f8c632b60e6d6ced604e0f7a4b5fe1be203a2f351a"}
Jun 15 05:48:00.267030 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:00.267009    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8v9wt" event={"ID":"01d7cf7a-bc4a-43be-a3b0-10d8e29e8735","Type":"ContainerStarted","Data":"c6be3b8b95ee84f906a97558a05902fc97c9898272908617bcf0a4d4d0c1af58"}
Jun 15 05:48:00.285220 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:00.285161    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-82.ec2.internal" podStartSLOduration=21.28514234 podStartE2EDuration="21.28514234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:47:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:47:43.227464281 +0000 UTC m=+5.594009333" watchObservedRunningTime="2026-06-15 05:48:00.28514234 +0000 UTC m=+22.651687390"
Jun 15 05:48:00.301226 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:00.301183    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qdcqb" podStartSLOduration=3.290435773 podStartE2EDuration="22.301168148s" totalImagesPullingTime="19.010732375s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:00.301168837 +0000 UTC m=+22.667713889" watchObservedRunningTime="2026-06-15 05:48:00.301168148 +0000 UTC m=+22.667713197"
Jun 15 05:48:00.320971 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:00.320934    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8v9wt" podStartSLOduration=3.309678859 podStartE2EDuration="22.320919238s" totalImagesPullingTime="19.011240379s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:00.320372583 +0000 UTC m=+22.686917633" watchObservedRunningTime="2026-06-15 05:48:00.320919238 +0000 UTC m=+22.687464288"
Jun 15 05:48:00.337199 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:00.337100    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kkfqp" podStartSLOduration=7.954418147 podStartE2EDuration="22.337085179s" totalImagesPullingTime="14.382667032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:00.336955015 +0000 UTC m=+22.703500065" watchObservedRunningTime="2026-06-15 05:48:00.337085179 +0000 UTC m=+22.703630236"
Jun 15 05:48:00.356131 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:00.356093    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-78lp9" podStartSLOduration=3.238272075 podStartE2EDuration="22.356079854s" totalImagesPullingTime="19.117807779s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:00.35599091 +0000 UTC m=+22.722535959" watchObservedRunningTime="2026-06-15 05:48:00.356079854 +0000 UTC m=+22.722624902"
Jun 15 05:48:01.271665 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:01.271587    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7qndp" event={"ID":"4783d7d6-1895-41f7-b11a-dea0c4405bc8","Type":"ContainerStarted","Data":"8b81e55232cb27ce709c444b5fd18c61432f7a15be0a64c16d96b71024b14ef7"}
Jun 15 05:48:01.272418 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:01.271694    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7qndp" event={"ID":"4783d7d6-1895-41f7-b11a-dea0c4405bc8","Type":"ContainerStarted","Data":"dfd73c97837c2c25393b514d6244bb2c9d80f0bb9514136987da1091fc9a5223"}
Jun 15 05:48:01.272418 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:01.271723    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7qndp" event={"ID":"4783d7d6-1895-41f7-b11a-dea0c4405bc8","Type":"ContainerStarted","Data":"30801522e481911460f4c083606691e9c0786bbd6a752d78819292970364b2cd"}
Jun 15 05:48:01.272418 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:01.271759    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7qndp" event={"ID":"4783d7d6-1895-41f7-b11a-dea0c4405bc8","Type":"ContainerStarted","Data":"a93908dab599e1d53658b15b7869983249986892d9f9394c7f4f5aa5070f8f12"}
Jun 15 05:48:01.272669 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:01.272639    2564 generic.go:356] "Generic (PLEG): container finished" podID="365f2bf1-0391-46a7-961e-a41133c65588" containerID="33b2f25c912d48c8b6d6329be83b2ccc930fa252cf764193ba9d03793a85ea72" exitCode=0
Jun 15 05:48:01.272793 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:01.272735    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s5nvg" event={"ID":"365f2bf1-0391-46a7-961e-a41133c65588","Type":"ContainerDied","Data":"33b2f25c912d48c8b6d6329be83b2ccc930fa252cf764193ba9d03793a85ea72"}
Jun 15 05:48:01.299445 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:01.299405    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pjdzl" podStartSLOduration=4.287124199 podStartE2EDuration="23.299392775s" totalImagesPullingTime="19.012268576s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:00.378033368 +0000 UTC m=+22.744578419" watchObservedRunningTime="2026-06-15 05:48:01.299392775 +0000 UTC m=+23.665937824"
Jun 15 05:48:01.518225 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:01.518201    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jun 15 05:48:02.130975 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:02.130942    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qm5gv"
Jun 15 05:48:02.131155 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:02.131048    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qm5gv" podUID="ecbcc04e-289f-482a-b26e-49a2cee2e45f"
Jun 15 05:48:02.131434 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:02.131415    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jg5zt"
Jun 15 05:48:02.131528 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:02.131508    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jg5zt" podUID="2b0e234e-c49a-4504-9737-8d32181944e5"
Jun 15 05:48:02.131995 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:02.131963    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl66m"
Jun 15 05:48:02.132158 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:02.132049    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xl66m" podUID="80312796-b102-426c-a974-354e77b12b12"
Jun 15 05:48:02.149833 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:02.149746    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-15T05:48:01.51821701Z","UUID":"27bb072f-4de9-48c0-bbc8-20e7ca72be2a","Handler":null,"Name":"","Endpoint":""}
Jun 15 05:48:02.151460 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:02.151437    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jun 15 05:48:02.151561 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:02.151474    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jun 15 05:48:02.277887 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:02.277637    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ht9b" event={"ID":"2196caf7-fa75-4e09-8673-688b078dd5a3","Type":"ContainerStarted","Data":"a16237359e430a52777b06755e5bc031d1c479c9c51a905234d356b2534231df"}
Jun 15 05:48:02.279354 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:02.279327    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dp464" event={"ID":"13e4b538-8b93-4137-aedf-11a30b014942","Type":"ContainerStarted","Data":"cd33616c151c4175441b9ce2f2d51dc47e35f8ef585de0d9a221e893e4c96ba6"}
Jun 15 05:48:02.305885 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:02.299290    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dp464" podStartSLOduration=5.29867207 podStartE2EDuration="24.299268848s" totalImagesPullingTime="19.000596778s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:02.297283432 +0000 UTC m=+24.663828483" watchObservedRunningTime="2026-06-15 05:48:02.299268848 +0000 UTC m=+24.665813892"
Jun 15 05:48:03.286558 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:03.286515    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7qndp" event={"ID":"4783d7d6-1895-41f7-b11a-dea0c4405bc8","Type":"ContainerStarted","Data":"cca96ac91ea6f0a7e7e7e5762796aecd9cab068f7c93651ed75fb65d6857a5c7"}
Jun 15 05:48:03.288716 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:03.288672    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ht9b" event={"ID":"2196caf7-fa75-4e09-8673-688b078dd5a3","Type":"ContainerStarted","Data":"d822e3d29e9a92ec95179db7e1cd12d7bcef93dc0a964e458d4167f524035b15"}
Jun 15 05:48:03.310007 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:03.309959    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ht9b" podStartSLOduration=4.13383014 podStartE2EDuration="25.309940732s" totalImagesPullingTime="21.176110592s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:47:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:03.309463704 +0000 UTC m=+25.676008755" watchObservedRunningTime="2026-06-15 05:48:03.309940732 +0000 UTC m=+25.676485783"
Jun 15 05:48:04.131016 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:04.130816    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jg5zt"
Jun 15 05:48:04.131171 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:04.130817    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl66m"
Jun 15 05:48:04.131171 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:04.131092    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jg5zt" podUID="2b0e234e-c49a-4504-9737-8d32181944e5"
Jun 15 05:48:04.131275 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:04.130871    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qm5gv"
Jun 15 05:48:04.131275 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:04.131185    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xl66m" podUID="80312796-b102-426c-a974-354e77b12b12"
Jun 15 05:48:04.131364 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:04.131294    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qm5gv" podUID="ecbcc04e-289f-482a-b26e-49a2cee2e45f"
Jun 15 05:48:04.418750 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:04.418717    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kkfqp"
Jun 15 05:48:04.419414 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:04.419391    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kkfqp"
Jun 15 05:48:05.292977 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:05.292909    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kkfqp"
Jun 15 05:48:05.293511 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:05.293492    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kkfqp"
Jun 15 05:48:06.130966 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:06.130929    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jg5zt"
Jun 15 05:48:06.130966 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:06.130952    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qm5gv"
Jun 15 05:48:06.131720 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:06.130934    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl66m"
Jun 15 05:48:06.131720 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:06.131026    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jg5zt" podUID="2b0e234e-c49a-4504-9737-8d32181944e5"
Jun 15 05:48:06.131720 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:06.131101    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xl66m" podUID="80312796-b102-426c-a974-354e77b12b12"
Jun 15 05:48:06.131720 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:06.131178    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qm5gv" podUID="ecbcc04e-289f-482a-b26e-49a2cee2e45f"
Jun 15 05:48:06.298090 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:06.298059    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7qndp" event={"ID":"4783d7d6-1895-41f7-b11a-dea0c4405bc8","Type":"ContainerStarted","Data":"ea30827ba23b332754254ef395b91259b8c1e33561850624be767cf1c449e88c"}
Jun 15 05:48:06.298319 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:06.298305    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:48:06.299931 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:06.299906    2564 generic.go:356] "Generic (PLEG): container finished" podID="365f2bf1-0391-46a7-961e-a41133c65588" containerID="fb547fd557326bc25da203bf8a93fb0493660a8f2b408acce6fe8f06f0ea8cff" exitCode=0
Jun 15 05:48:06.300052 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:06.299969    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s5nvg" event={"ID":"365f2bf1-0391-46a7-961e-a41133c65588","Type":"ContainerDied","Data":"fb547fd557326bc25da203bf8a93fb0493660a8f2b408acce6fe8f06f0ea8cff"}
Jun 15 05:48:06.314190 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:06.314168    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:48:06.329101 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:06.329057    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7qndp" podStartSLOduration=9.261613863000001 podStartE2EDuration="28.329044859s" totalImagesPullingTime="19.067430996s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:06.327324569 +0000 UTC m=+28.693869618" watchObservedRunningTime="2026-06-15 05:48:06.329044859 +0000 UTC m=+28.695589939"
Jun 15 05:48:07.305528 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:07.305482    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s5nvg" event={"ID":"365f2bf1-0391-46a7-961e-a41133c65588","Type":"ContainerStarted","Data":"3a2c76fd6daf2aa7beafb1f7339ba70d6548c759ca3fa052c1c6b539560d9a6c"}
Jun 15 05:48:07.306330 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:07.306307    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:48:07.306438 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:07.306368    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:48:07.322384 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:07.322358    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:48:07.574002 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:07.573924    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xl66m"]
Jun 15 05:48:07.574131 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:07.574055    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl66m"
Jun 15 05:48:07.574173 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:07.574133    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xl66m" podUID="80312796-b102-426c-a974-354e77b12b12"
Jun 15 05:48:07.576883 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:07.576818    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jg5zt"]
Jun 15 05:48:07.576985 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:07.576928    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jg5zt"
Jun 15 05:48:07.577032 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:07.577018    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jg5zt" podUID="2b0e234e-c49a-4504-9737-8d32181944e5"
Jun 15 05:48:07.577565 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:07.577545    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qm5gv"]
Jun 15 05:48:07.577686 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:07.577671    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qm5gv"
Jun 15 05:48:07.577794 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:07.577775    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qm5gv" podUID="ecbcc04e-289f-482a-b26e-49a2cee2e45f"
Jun 15 05:48:08.308773 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:08.308741    2564 generic.go:356] "Generic (PLEG): container finished" podID="365f2bf1-0391-46a7-961e-a41133c65588" containerID="3a2c76fd6daf2aa7beafb1f7339ba70d6548c759ca3fa052c1c6b539560d9a6c" exitCode=0
Jun 15 05:48:08.309134 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:08.308798    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s5nvg" event={"ID":"365f2bf1-0391-46a7-961e-a41133c65588","Type":"ContainerDied","Data":"3a2c76fd6daf2aa7beafb1f7339ba70d6548c759ca3fa052c1c6b539560d9a6c"}
Jun 15 05:48:09.130915 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:09.130888    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qm5gv"
Jun 15 05:48:09.131041 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:09.130915    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jg5zt"
Jun 15 05:48:09.131041 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:09.130923    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl66m"
Jun 15 05:48:09.131041 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:09.130992    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qm5gv" podUID="ecbcc04e-289f-482a-b26e-49a2cee2e45f"
Jun 15 05:48:09.131135 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:09.131039    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jg5zt" podUID="2b0e234e-c49a-4504-9737-8d32181944e5"
Jun 15 05:48:09.131135 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:09.131108    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xl66m" podUID="80312796-b102-426c-a974-354e77b12b12"
Jun 15 05:48:10.315245 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:10.315209    2564 generic.go:356] "Generic (PLEG): container finished" podID="365f2bf1-0391-46a7-961e-a41133c65588" containerID="38ebbd1813af07aa5a935b3c1870e494a3ac26e9eea4db01a65e6df018f1b473" exitCode=0
Jun 15 05:48:10.315592 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:10.315280    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s5nvg" event={"ID":"365f2bf1-0391-46a7-961e-a41133c65588","Type":"ContainerDied","Data":"38ebbd1813af07aa5a935b3c1870e494a3ac26e9eea4db01a65e6df018f1b473"}
Jun 15 05:48:11.131212 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:11.131177    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl66m"
Jun 15 05:48:11.131385 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:11.131220    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qm5gv"
Jun 15 05:48:11.131385 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:11.131220    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jg5zt"
Jun 15 05:48:11.131385 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:11.131311    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xl66m" podUID="80312796-b102-426c-a974-354e77b12b12"
Jun 15 05:48:11.131536 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:11.131408    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qm5gv" podUID="ecbcc04e-289f-482a-b26e-49a2cee2e45f"
Jun 15 05:48:11.131536 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:11.131490    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jg5zt" podUID="2b0e234e-c49a-4504-9737-8d32181944e5"
Jun 15 05:48:11.828916 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:11.828801    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80312796-b102-426c-a974-354e77b12b12-original-pull-secret\") pod \"global-pull-secret-syncer-xl66m\" (UID: \"80312796-b102-426c-a974-354e77b12b12\") " pod="kube-system/global-pull-secret-syncer-xl66m"
Jun 15 05:48:11.829286 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:11.828971    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 15 05:48:11.829286 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:11.829034    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80312796-b102-426c-a974-354e77b12b12-original-pull-secret podName:80312796-b102-426c-a974-354e77b12b12 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:43.829013789 +0000 UTC m=+66.195558818 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80312796-b102-426c-a974-354e77b12b12-original-pull-secret") pod "global-pull-secret-syncer-xl66m" (UID: "80312796-b102-426c-a974-354e77b12b12") : object "kube-system"/"original-pull-secret" not registered
Jun 15 05:48:11.929490 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:11.929452    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecbcc04e-289f-482a-b26e-49a2cee2e45f-metrics-certs\") pod \"network-metrics-daemon-qm5gv\" (UID: \"ecbcc04e-289f-482a-b26e-49a2cee2e45f\") " pod="openshift-multus/network-metrics-daemon-qm5gv"
Jun 15 05:48:11.929732 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:11.929586    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:48:11.929732 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:11.929678    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecbcc04e-289f-482a-b26e-49a2cee2e45f-metrics-certs podName:ecbcc04e-289f-482a-b26e-49a2cee2e45f nodeName:}" failed. No retries permitted until 2026-06-15 05:48:43.929642066 +0000 UTC m=+66.296187107 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecbcc04e-289f-482a-b26e-49a2cee2e45f-metrics-certs") pod "network-metrics-daemon-qm5gv" (UID: "ecbcc04e-289f-482a-b26e-49a2cee2e45f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:48:12.030515 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:12.030485    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbdhd\" (UniqueName: \"kubernetes.io/projected/2b0e234e-c49a-4504-9737-8d32181944e5-kube-api-access-sbdhd\") pod \"network-check-target-jg5zt\" (UID: \"2b0e234e-c49a-4504-9737-8d32181944e5\") " pod="openshift-network-diagnostics/network-check-target-jg5zt"
Jun 15 05:48:12.030727 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:12.030631    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 15 05:48:12.030727 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:12.030648    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 15 05:48:12.030727 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:12.030657    2564 projected.go:196] Error preparing data for projected volume kube-api-access-sbdhd for pod openshift-network-diagnostics/network-check-target-jg5zt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:48:12.030727 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:12.030711    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b0e234e-c49a-4504-9737-8d32181944e5-kube-api-access-sbdhd podName:2b0e234e-c49a-4504-9737-8d32181944e5 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:44.030698162 +0000 UTC m=+66.397243202 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-sbdhd" (UniqueName: "kubernetes.io/projected/2b0e234e-c49a-4504-9737-8d32181944e5-kube-api-access-sbdhd") pod "network-check-target-jg5zt" (UID: "2b0e234e-c49a-4504-9737-8d32181944e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:48:12.967284 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:12.967254    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-82.ec2.internal" event="NodeReady"
Jun 15 05:48:12.967759 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:12.967383    2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jun 15 05:48:13.009547 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.009519    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-zwmqd"]
Jun 15 05:48:13.013953 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.013929    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-kn9gn"]
Jun 15 05:48:13.015290 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.014708    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-zwmqd"
Jun 15 05:48:13.016511 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.016485    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pwv4p"]
Jun 15 05:48:13.016626 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.016609    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-kn9gn"
Jun 15 05:48:13.017326 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.017307    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jun 15 05:48:13.017434 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.017309    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jun 15 05:48:13.019105 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.018928    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jun 15 05:48:13.019105 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.018946    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jun 15 05:48:13.019261 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.019156    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-kkp9q"]
Jun 15 05:48:13.019261 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.019224    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pwv4p"
Jun 15 05:48:13.021488 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.021309    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jun 15 05:48:13.021488 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.021346    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-jqx4c\""
Jun 15 05:48:13.021488 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.021370    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jun 15 05:48:13.021488 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.021476    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jun 15 05:48:13.021772 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.021556    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-7d5x6\""
Jun 15 05:48:13.021772 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.021690    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-67hw4"]
Jun 15 05:48:13.021772 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.021762    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-kkp9q"
Jun 15 05:48:13.022543 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.022524    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jun 15 05:48:13.022652 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.022547    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jun 15 05:48:13.022652 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.022583    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-25fjl\""
Jun 15 05:48:13.022652 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.022529    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jun 15 05:48:13.024339 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.024315    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-98f645c89-cjthz"]
Jun 15 05:48:13.024567 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.024540    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-67hw4"
Jun 15 05:48:13.027181 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.027162    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-98f645c89-cjthz"
Jun 15 05:48:13.028180 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.028158    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jun 15 05:48:13.028513 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.028493    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jun 15 05:48:13.028786 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.028768    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mxmkk\""
Jun 15 05:48:13.029022 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.028997    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jun 15 05:48:13.029262 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.029211    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-dcmvp\""
Jun 15 05:48:13.029369 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.029285    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jun 15 05:48:13.029369 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.029308    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jun 15 05:48:13.029485 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.029453    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-9jqt9"]
Jun 15 05:48:13.030520 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.030500    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jun 15 05:48:13.031940 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.031547    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jun 15 05:48:13.031940 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.031780    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jun 15 05:48:13.031940 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.031808    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jun 15 05:48:13.031940 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.031894    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jun 15 05:48:13.032170 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.032098    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6qs5n\""
Jun 15 05:48:13.032170 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.032163    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jun 15 05:48:13.035401 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.035380    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-67dff766cb-95zdt"]
Jun 15 05:48:13.039953 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.037188    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9jqt9"
Jun 15 05:48:13.039953 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.038175    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-zwmqd"]
Jun 15 05:48:13.039953 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.038196    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-gbgcf"]
Jun 15 05:48:13.039953 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.038290    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-67dff766cb-95zdt"
Jun 15 05:48:13.045224 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.045202    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jun 15 05:48:13.048065 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.046836    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jun 15 05:48:13.048065 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.047076    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-f6j57\""
Jun 15 05:48:13.048065 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.047268    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-vbmdw"]
Jun 15 05:48:13.048970 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.048414    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jun 15 05:48:13.048970 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.048883    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jun 15 05:48:13.048970 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.048926    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jun 15 05:48:13.049152 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.049105    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jun 15 05:48:13.049152 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.049117    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jun 15 05:48:13.049252 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.049242    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jun 15 05:48:13.049927 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.049352    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hm76g\""
Jun 15 05:48:13.049927 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.049413    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jun 15 05:48:13.049927 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.049475    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jun 15 05:48:13.049927 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.049625    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-gbgcf"
Jun 15 05:48:13.050281 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.050262    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jun 15 05:48:13.054043 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.051269    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-4msss"]
Jun 15 05:48:13.054043 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.052029    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-vbmdw"
Jun 15 05:48:13.056587 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.056157    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jun 15 05:48:13.056587 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.056363    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jun 15 05:48:13.056587 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.056419    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jun 15 05:48:13.056587 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.056364    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-tm7j2\""
Jun 15 05:48:13.056587 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.056558    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-kn9gn"]
Jun 15 05:48:13.056587 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.056587    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-kkp9q"]
Jun 15 05:48:13.058248 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.056604    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pwv4p"]
Jun 15 05:48:13.058248 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.056617    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-98f645c89-cjthz"]
Jun 15 05:48:13.058248 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.056630    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qndls"]
Jun 15 05:48:13.058248 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.056723    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-4msss"
Jun 15 05:48:13.058248 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.057624    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jun 15 05:48:13.058248 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.057632    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jun 15 05:48:13.058248 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.058147    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jun 15 05:48:13.058248 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.058151    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-p2zqw\""
Jun 15 05:48:13.060910 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.060893    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 15 05:48:13.061075 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.061058    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-42blt"]
Jun 15 05:48:13.062764 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.062020    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-fhgrx\""
Jun 15 05:48:13.062764 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.062211    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 15 05:48:13.062764 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.062231    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qndls"
Jun 15 05:48:13.064126 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.064110    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-67dff766cb-95zdt"]
Jun 15 05:48:13.064263 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.064245    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-4msss"]
Jun 15 05:48:13.064360 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.064280    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qndls"]
Jun 15 05:48:13.064360 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.064304    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-67hw4"]
Jun 15 05:48:13.064360 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.064325    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-gbgcf"]
Jun 15 05:48:13.064360 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.064342    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-vbmdw"]
Jun 15 05:48:13.064561 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.064363    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-9jqt9"]
Jun 15 05:48:13.064561 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.064205    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-42blt"
Jun 15 05:48:13.066041 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.066021    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jun 15 05:48:13.068595 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.068579    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jun 15 05:48:13.068886 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.068851    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jun 15 05:48:13.068990 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.068952    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-z7kzt\""
Jun 15 05:48:13.069062 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.069050    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bq4gf\""
Jun 15 05:48:13.069119 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.069098    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jun 15 05:48:13.069638 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.069224    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jun 15 05:48:13.069638 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.069340    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-42blt"]
Jun 15 05:48:13.069638 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.069408    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jun 15 05:48:13.131078 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.131058    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jg5zt"
Jun 15 05:48:13.131246 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.131226    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl66m"
Jun 15 05:48:13.131364 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.131348    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qm5gv"
Jun 15 05:48:13.135786 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.135767    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 15 05:48:13.135902 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.135813    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 15 05:48:13.135902 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.135886    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4mr6w\""
Jun 15 05:48:13.136023 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.135958    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sh6m9\""
Jun 15 05:48:13.137564 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.137545    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8bf514ab-857d-416e-b51f-2235f4cb429d-config\") pod \"console-operator-5dbbb5d744-kn9gn\" (UID: \"8bf514ab-857d-416e-b51f-2235f4cb429d\") " pod="openshift-console-operator/console-operator-5dbbb5d744-kn9gn"
Jun 15 05:48:13.137677 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.137575    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f919e023-d50d-4b4b-bb00-28e41fd896dd-installation-pull-secrets\") pod \"image-registry-98f645c89-cjthz\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") " pod="openshift-image-registry/image-registry-98f645c89-cjthz"
Jun 15 05:48:13.137677 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.137603    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc17a9a3-092b-4007-b1dc-5860349dc4a0-service-ca-bundle\") pod \"router-default-67dff766cb-95zdt\" (UID: \"fc17a9a3-092b-4007-b1dc-5860349dc4a0\") " pod="openshift-ingress/router-default-67dff766cb-95zdt"
Jun 15 05:48:13.137677 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.137635    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tfqv\" (UniqueName: \"kubernetes.io/projected/f919e023-d50d-4b4b-bb00-28e41fd896dd-kube-api-access-8tfqv\") pod \"image-registry-98f645c89-cjthz\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") " pod="openshift-image-registry/image-registry-98f645c89-cjthz"
Jun 15 05:48:13.137838 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.137735    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fc17a9a3-092b-4007-b1dc-5860349dc4a0-default-certificate\") pod \"router-default-67dff766cb-95zdt\" (UID: \"fc17a9a3-092b-4007-b1dc-5860349dc4a0\") " pod="openshift-ingress/router-default-67dff766cb-95zdt"
Jun 15 05:48:13.137838 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.137753    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f919e023-d50d-4b4b-bb00-28e41fd896dd-registry-tls\") pod \"image-registry-98f645c89-cjthz\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") " pod="openshift-image-registry/image-registry-98f645c89-cjthz"
Jun 15 05:48:13.137838 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.137798    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs7ms\" (UniqueName: \"kubernetes.io/projected/f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a-kube-api-access-zs7ms\") pod \"cluster-samples-operator-9547488fd-67hw4\" (UID: \"f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-67hw4"
Jun 15 05:48:13.137838 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.137830    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2kn9\" (UniqueName: \"kubernetes.io/projected/39c1a446-4af7-43a2-8a43-35bf376df260-kube-api-access-s2kn9\") pod \"volume-data-source-validator-bd4ccd799-zwmqd\" (UID: \"39c1a446-4af7-43a2-8a43-35bf376df260\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-zwmqd"
Jun 15 05:48:13.138027 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.137882    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5d1c36b4-80f4-46a1-bfb2-6323cb64f65e-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-kkp9q\" (UID: \"5d1c36b4-80f4-46a1-bfb2-6323cb64f65e\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-kkp9q"
Jun 15 05:48:13.138027 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.137907    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6b663716-76fa-4580-afdb-73c283d06ac2-nginx-conf\") pod \"networking-console-plugin-867b76cb74-gbgcf\" (UID: \"6b663716-76fa-4580-afdb-73c283d06ac2\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-gbgcf"
Jun 15 05:48:13.138027 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.137947    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f919e023-d50d-4b4b-bb00-28e41fd896dd-image-registry-private-configuration\") pod \"image-registry-98f645c89-cjthz\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") " pod="openshift-image-registry/image-registry-98f645c89-cjthz"
Jun 15 05:48:13.138027 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.137985    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f919e023-d50d-4b4b-bb00-28e41fd896dd-registry-certificates\") pod \"image-registry-98f645c89-cjthz\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") " pod="openshift-image-registry/image-registry-98f645c89-cjthz"
Jun 15 05:48:13.138231 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.138029    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-67hw4\" (UID: \"f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-67hw4"
Jun 15 05:48:13.138231 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.138068    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e30f3f9f-2bc5-4603-9343-e3bbdd26fd7d-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-pwv4p\" (UID: \"e30f3f9f-2bc5-4603-9343-e3bbdd26fd7d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pwv4p"
Jun 15 05:48:13.138231 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.138111    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5d1c36b4-80f4-46a1-bfb2-6323cb64f65e-config\") pod \"service-ca-operator-7ccbfd59dc-kkp9q\" (UID: \"5d1c36b4-80f4-46a1-bfb2-6323cb64f65e\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-kkp9q"
Jun 15 05:48:13.138231 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.138138    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gfpt\" (UniqueName: \"kubernetes.io/projected/03282db6-9df2-4e5f-b462-d7d252ccef87-kube-api-access-8gfpt\") pod \"cluster-monitoring-operator-f9d7df769-9jqt9\" (UID: \"03282db6-9df2-4e5f-b462-d7d252ccef87\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9jqt9"
Jun 15 05:48:13.138231 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.138155    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt6v7\" (UniqueName: \"kubernetes.io/projected/5d1c36b4-80f4-46a1-bfb2-6323cb64f65e-kube-api-access-dt6v7\") pod \"service-ca-operator-7ccbfd59dc-kkp9q\" (UID: \"5d1c36b4-80f4-46a1-bfb2-6323cb64f65e\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-kkp9q"
Jun 15 05:48:13.138231 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.138186    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f919e023-d50d-4b4b-bb00-28e41fd896dd-ca-trust-extracted\") pod \"image-registry-98f645c89-cjthz\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") " pod="openshift-image-registry/image-registry-98f645c89-cjthz"
Jun 15 05:48:13.138485 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.138230    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8bf514ab-857d-416e-b51f-2235f4cb429d-trusted-ca\") pod \"console-operator-5dbbb5d744-kn9gn\" (UID: \"8bf514ab-857d-416e-b51f-2235f4cb429d\") " pod="openshift-console-operator/console-operator-5dbbb5d744-kn9gn"
Jun 15 05:48:13.138485 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.138258    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de5e4b97-769f-4d62-8aea-b9cdf3bca1a7-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-vbmdw\" (UID: \"de5e4b97-769f-4d62-8aea-b9cdf3bca1a7\") " pod="openshift-insights/insights-operator-5bbd86d6bd-vbmdw"
Jun 15 05:48:13.138485 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.138278    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/de5e4b97-769f-4d62-8aea-b9cdf3bca1a7-serving-cert\") pod \"insights-operator-5bbd86d6bd-vbmdw\" (UID: \"de5e4b97-769f-4d62-8aea-b9cdf3bca1a7\") " pod="openshift-insights/insights-operator-5bbd86d6bd-vbmdw"
Jun 15 05:48:13.138485 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.138311    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/03282db6-9df2-4e5f-b462-d7d252ccef87-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-9jqt9\" (UID: \"03282db6-9df2-4e5f-b462-d7d252ccef87\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9jqt9"
Jun 15 05:48:13.138485 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.138332    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de5e4b97-769f-4d62-8aea-b9cdf3bca1a7-tmp\") pod \"insights-operator-5bbd86d6bd-vbmdw\" (UID: \"de5e4b97-769f-4d62-8aea-b9cdf3bca1a7\") " pod="openshift-insights/insights-operator-5bbd86d6bd-vbmdw"
Jun 15 05:48:13.138485 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.138354    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f9qx\" (UniqueName: \"kubernetes.io/projected/fc17a9a3-092b-4007-b1dc-5860349dc4a0-kube-api-access-7f9qx\") pod \"router-default-67dff766cb-95zdt\" (UID: \"fc17a9a3-092b-4007-b1dc-5860349dc4a0\") " pod="openshift-ingress/router-default-67dff766cb-95zdt"
Jun 15 05:48:13.138485 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.138378    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9wvh\" (UniqueName: \"kubernetes.io/projected/e30f3f9f-2bc5-4603-9343-e3bbdd26fd7d-kube-api-access-s9wvh\") pod \"kube-storage-version-migrator-operator-7c578b78fc-pwv4p\" (UID: \"e30f3f9f-2bc5-4603-9343-e3bbdd26fd7d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pwv4p"
Jun 15 05:48:13.138485 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.138396    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8v49\" (UniqueName: \"kubernetes.io/projected/de5e4b97-769f-4d62-8aea-b9cdf3bca1a7-kube-api-access-p8v49\") pod \"insights-operator-5bbd86d6bd-vbmdw\" (UID: \"de5e4b97-769f-4d62-8aea-b9cdf3bca1a7\") " pod="openshift-insights/insights-operator-5bbd86d6bd-vbmdw"
Jun 15 05:48:13.138485 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.138416    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f919e023-d50d-4b4b-bb00-28e41fd896dd-trusted-ca\") pod \"image-registry-98f645c89-cjthz\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") " pod="openshift-image-registry/image-registry-98f645c89-cjthz"
Jun 15 05:48:13.138485 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.138439    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/03282db6-9df2-4e5f-b462-d7d252ccef87-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-9jqt9\" (UID: \"03282db6-9df2-4e5f-b462-d7d252ccef87\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9jqt9"
Jun 15 05:48:13.138485 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.138473    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de5e4b97-769f-4d62-8aea-b9cdf3bca1a7-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-vbmdw\" (UID: \"de5e4b97-769f-4d62-8aea-b9cdf3bca1a7\") " pod="openshift-insights/insights-operator-5bbd86d6bd-vbmdw"
Jun 15 05:48:13.139929 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.138505    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fc17a9a3-092b-4007-b1dc-5860349dc4a0-stats-auth\") pod \"router-default-67dff766cb-95zdt\" (UID: \"fc17a9a3-092b-4007-b1dc-5860349dc4a0\") " pod="openshift-ingress/router-default-67dff766cb-95zdt"
Jun 15 05:48:13.139929 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.138528    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6b663716-76fa-4580-afdb-73c283d06ac2-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-gbgcf\" (UID: \"6b663716-76fa-4580-afdb-73c283d06ac2\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-gbgcf"
Jun 15 05:48:13.139929 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.138582    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmh2h\" (UniqueName: \"kubernetes.io/projected/8bf514ab-857d-416e-b51f-2235f4cb429d-kube-api-access-zmh2h\") pod \"console-operator-5dbbb5d744-kn9gn\" (UID: \"8bf514ab-857d-416e-b51f-2235f4cb429d\") " pod="openshift-console-operator/console-operator-5dbbb5d744-kn9gn"
Jun 15 05:48:13.139929 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.138605    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f919e023-d50d-4b4b-bb00-28e41fd896dd-bound-sa-token\") pod \"image-registry-98f645c89-cjthz\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") " pod="openshift-image-registry/image-registry-98f645c89-cjthz"
Jun 15 05:48:13.139929 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.138657    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc17a9a3-092b-4007-b1dc-5860349dc4a0-metrics-certs\") pod \"router-default-67dff766cb-95zdt\" (UID: \"fc17a9a3-092b-4007-b1dc-5860349dc4a0\") " pod="openshift-ingress/router-default-67dff766cb-95zdt"
Jun 15 05:48:13.139929 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.138688    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/de5e4b97-769f-4d62-8aea-b9cdf3bca1a7-snapshots\") pod \"insights-operator-5bbd86d6bd-vbmdw\" (UID: \"de5e4b97-769f-4d62-8aea-b9cdf3bca1a7\") " pod="openshift-insights/insights-operator-5bbd86d6bd-vbmdw"
Jun 15 05:48:13.139929 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.138715    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8bf514ab-857d-416e-b51f-2235f4cb429d-serving-cert\") pod \"console-operator-5dbbb5d744-kn9gn\" (UID: \"8bf514ab-857d-416e-b51f-2235f4cb429d\") " pod="openshift-console-operator/console-operator-5dbbb5d744-kn9gn"
Jun 15 05:48:13.139929 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.138774    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e30f3f9f-2bc5-4603-9343-e3bbdd26fd7d-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-pwv4p\" (UID: \"e30f3f9f-2bc5-4603-9343-e3bbdd26fd7d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pwv4p"
Jun 15 05:48:13.239247 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.239172    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6b663716-76fa-4580-afdb-73c283d06ac2-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-gbgcf\" (UID: \"6b663716-76fa-4580-afdb-73c283d06ac2\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-gbgcf"
Jun 15 05:48:13.239247 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.239204    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmh2h\" (UniqueName: \"kubernetes.io/projected/8bf514ab-857d-416e-b51f-2235f4cb429d-kube-api-access-zmh2h\") pod \"console-operator-5dbbb5d744-kn9gn\" (UID: \"8bf514ab-857d-416e-b51f-2235f4cb429d\") " pod="openshift-console-operator/console-operator-5dbbb5d744-kn9gn"
Jun 15 05:48:13.239247 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.239225    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f919e023-d50d-4b4b-bb00-28e41fd896dd-bound-sa-token\") pod \"image-registry-98f645c89-cjthz\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") " pod="openshift-image-registry/image-registry-98f645c89-cjthz"
Jun 15 05:48:13.239247 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.239242    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc17a9a3-092b-4007-b1dc-5860349dc4a0-metrics-certs\") pod \"router-default-67dff766cb-95zdt\" (UID: \"fc17a9a3-092b-4007-b1dc-5860349dc4a0\") " pod="openshift-ingress/router-default-67dff766cb-95zdt"
Jun 15 05:48:13.239539 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.239263    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/de5e4b97-769f-4d62-8aea-b9cdf3bca1a7-snapshots\") pod \"insights-operator-5bbd86d6bd-vbmdw\" (UID: \"de5e4b97-769f-4d62-8aea-b9cdf3bca1a7\") " pod="openshift-insights/insights-operator-5bbd86d6bd-vbmdw"
Jun 15 05:48:13.239539 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.239279    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8bf514ab-857d-416e-b51f-2235f4cb429d-serving-cert\") pod \"console-operator-5dbbb5d744-kn9gn\" (UID: \"8bf514ab-857d-416e-b51f-2235f4cb429d\") " pod="openshift-console-operator/console-operator-5dbbb5d744-kn9gn"
Jun 15 05:48:13.239539 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:13.239290    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 15 05:48:13.239539 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:13.239356    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b663716-76fa-4580-afdb-73c283d06ac2-networking-console-plugin-cert podName:6b663716-76fa-4580-afdb-73c283d06ac2 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:13.739337214 +0000 UTC m=+36.105882268 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6b663716-76fa-4580-afdb-73c283d06ac2-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-gbgcf" (UID: "6b663716-76fa-4580-afdb-73c283d06ac2") : secret "networking-console-plugin-cert" not found
Jun 15 05:48:13.239539 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:13.239379    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 15 05:48:13.239539 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.239295    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e30f3f9f-2bc5-4603-9343-e3bbdd26fd7d-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-pwv4p\" (UID: \"e30f3f9f-2bc5-4603-9343-e3bbdd26fd7d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pwv4p"
Jun 15 05:48:13.239539 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:13.239445    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc17a9a3-092b-4007-b1dc-5860349dc4a0-metrics-certs podName:fc17a9a3-092b-4007-b1dc-5860349dc4a0 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:13.739426763 +0000 UTC m=+36.105971793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc17a9a3-092b-4007-b1dc-5860349dc4a0-metrics-certs") pod "router-default-67dff766cb-95zdt" (UID: "fc17a9a3-092b-4007-b1dc-5860349dc4a0") : secret "router-metrics-certs-default" not found
Jun 15 05:48:13.239539 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.239468    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4df2971e-f461-424e-a003-dcfbc0eba623-config-volume\") pod \"dns-default-qndls\" (UID: \"4df2971e-f461-424e-a003-dcfbc0eba623\") " pod="openshift-dns/dns-default-qndls"
Jun 15 05:48:13.239539 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.239528    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8bf514ab-857d-416e-b51f-2235f4cb429d-config\") pod \"console-operator-5dbbb5d744-kn9gn\" (UID: \"8bf514ab-857d-416e-b51f-2235f4cb429d\") " pod="openshift-console-operator/console-operator-5dbbb5d744-kn9gn"
Jun 15 05:48:13.239999 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.239556    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f919e023-d50d-4b4b-bb00-28e41fd896dd-installation-pull-secrets\") pod \"image-registry-98f645c89-cjthz\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") " pod="openshift-image-registry/image-registry-98f645c89-cjthz"
Jun 15 05:48:13.239999 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.239594    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc17a9a3-092b-4007-b1dc-5860349dc4a0-service-ca-bundle\") pod \"router-default-67dff766cb-95zdt\" (UID: \"fc17a9a3-092b-4007-b1dc-5860349dc4a0\") " pod="openshift-ingress/router-default-67dff766cb-95zdt"
Jun 15 05:48:13.239999 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.239619    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tfqv\" (UniqueName: \"kubernetes.io/projected/f919e023-d50d-4b4b-bb00-28e41fd896dd-kube-api-access-8tfqv\") pod \"image-registry-98f645c89-cjthz\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") " pod="openshift-image-registry/image-registry-98f645c89-cjthz"
Jun 15 05:48:13.239999 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:13.239931    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fc17a9a3-092b-4007-b1dc-5860349dc4a0-service-ca-bundle podName:fc17a9a3-092b-4007-b1dc-5860349dc4a0 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:13.739916485 +0000 UTC m=+36.106461519 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fc17a9a3-092b-4007-b1dc-5860349dc4a0-service-ca-bundle") pod "router-default-67dff766cb-95zdt" (UID: "fc17a9a3-092b-4007-b1dc-5860349dc4a0") : configmap references non-existent config key: service-ca.crt
Jun 15 05:48:13.239999 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.239977    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/de5e4b97-769f-4d62-8aea-b9cdf3bca1a7-snapshots\") pod \"insights-operator-5bbd86d6bd-vbmdw\" (UID: \"de5e4b97-769f-4d62-8aea-b9cdf3bca1a7\") " pod="openshift-insights/insights-operator-5bbd86d6bd-vbmdw"
Jun 15 05:48:13.240234 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.240005    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e30f3f9f-2bc5-4603-9343-e3bbdd26fd7d-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-pwv4p\" (UID: \"e30f3f9f-2bc5-4603-9343-e3bbdd26fd7d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pwv4p"
Jun 15 05:48:13.240234 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.240052    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fc17a9a3-092b-4007-b1dc-5860349dc4a0-default-certificate\") pod \"router-default-67dff766cb-95zdt\" (UID: \"fc17a9a3-092b-4007-b1dc-5860349dc4a0\") " pod="openshift-ingress/router-default-67dff766cb-95zdt"
Jun 15 05:48:13.240234 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.240089    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f919e023-d50d-4b4b-bb00-28e41fd896dd-registry-tls\") pod \"image-registry-98f645c89-cjthz\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") " pod="openshift-image-registry/image-registry-98f645c89-cjthz"
Jun 15 05:48:13.240234 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.240117    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs7ms\" (UniqueName: \"kubernetes.io/projected/f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a-kube-api-access-zs7ms\") pod \"cluster-samples-operator-9547488fd-67hw4\" (UID: \"f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-67hw4"
Jun 15 05:48:13.240234 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.240175    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2kn9\" (UniqueName: \"kubernetes.io/projected/39c1a446-4af7-43a2-8a43-35bf376df260-kube-api-access-s2kn9\") pod \"volume-data-source-validator-bd4ccd799-zwmqd\" (UID: \"39c1a446-4af7-43a2-8a43-35bf376df260\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-zwmqd"
Jun 15 05:48:13.240234 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.240203    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5d1c36b4-80f4-46a1-bfb2-6323cb64f65e-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-kkp9q\" (UID: \"5d1c36b4-80f4-46a1-bfb2-6323cb64f65e\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-kkp9q"
Jun 15 05:48:13.240234 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.240228    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6b663716-76fa-4580-afdb-73c283d06ac2-nginx-conf\") pod \"networking-console-plugin-867b76cb74-gbgcf\" (UID: \"6b663716-76fa-4580-afdb-73c283d06ac2\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-gbgcf"
Jun 15 05:48:13.240546 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.240255    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f919e023-d50d-4b4b-bb00-28e41fd896dd-image-registry-private-configuration\") pod \"image-registry-98f645c89-cjthz\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") " pod="openshift-image-registry/image-registry-98f645c89-cjthz"
Jun 15 05:48:13.240546 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.240277    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f919e023-d50d-4b4b-bb00-28e41fd896dd-registry-certificates\") pod \"image-registry-98f645c89-cjthz\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") " pod="openshift-image-registry/image-registry-98f645c89-cjthz"
Jun 15 05:48:13.240546 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.240299    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-67hw4\" (UID: \"f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-67hw4"
Jun 15 05:48:13.240546 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.240305    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8bf514ab-857d-416e-b51f-2235f4cb429d-config\") pod \"console-operator-5dbbb5d744-kn9gn\" (UID: \"8bf514ab-857d-416e-b51f-2235f4cb429d\") " pod="openshift-console-operator/console-operator-5dbbb5d744-kn9gn"
Jun 15 05:48:13.240546 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.240322    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4df2971e-f461-424e-a003-dcfbc0eba623-tmp-dir\") pod \"dns-default-qndls\" (UID: \"4df2971e-f461-424e-a003-dcfbc0eba623\") " pod="openshift-dns/dns-default-qndls"
Jun 15 05:48:13.240546 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:13.240382    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 15 05:48:13.240546 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:13.240395    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-98f645c89-cjthz: secret "image-registry-tls" not found
Jun 15 05:48:13.240546 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:13.240442    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f919e023-d50d-4b4b-bb00-28e41fd896dd-registry-tls podName:f919e023-d50d-4b4b-bb00-28e41fd896dd nodeName:}" failed. No retries permitted until 2026-06-15 05:48:13.740428606 +0000 UTC m=+36.106973637 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f919e023-d50d-4b4b-bb00-28e41fd896dd-registry-tls") pod "image-registry-98f645c89-cjthz" (UID: "f919e023-d50d-4b4b-bb00-28e41fd896dd") : secret "image-registry-tls" not found
Jun 15 05:48:13.240546 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.240469    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e30f3f9f-2bc5-4603-9343-e3bbdd26fd7d-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-pwv4p\" (UID: \"e30f3f9f-2bc5-4603-9343-e3bbdd26fd7d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pwv4p"
Jun 15 05:48:13.240546 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.240523    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5d1c36b4-80f4-46a1-bfb2-6323cb64f65e-config\") pod \"service-ca-operator-7ccbfd59dc-kkp9q\" (UID: \"5d1c36b4-80f4-46a1-bfb2-6323cb64f65e\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-kkp9q"
Jun 15 05:48:13.241042 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.240551    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrzr5\" (UniqueName: \"kubernetes.io/projected/caf71ecd-2952-4e38-947b-9e18f1341517-kube-api-access-zrzr5\") pod \"ingress-canary-42blt\" (UID: \"caf71ecd-2952-4e38-947b-9e18f1341517\") " pod="openshift-ingress-canary/ingress-canary-42blt"
Jun 15 05:48:13.241042 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.240596    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gfpt\" (UniqueName: \"kubernetes.io/projected/03282db6-9df2-4e5f-b462-d7d252ccef87-kube-api-access-8gfpt\") pod \"cluster-monitoring-operator-f9d7df769-9jqt9\" (UID: \"03282db6-9df2-4e5f-b462-d7d252ccef87\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9jqt9"
Jun 15 05:48:13.241042 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.240625    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt6v7\" (UniqueName: \"kubernetes.io/projected/5d1c36b4-80f4-46a1-bfb2-6323cb64f65e-kube-api-access-dt6v7\") pod \"service-ca-operator-7ccbfd59dc-kkp9q\" (UID: \"5d1c36b4-80f4-46a1-bfb2-6323cb64f65e\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-kkp9q"
Jun 15 05:48:13.241042 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.240666    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f919e023-d50d-4b4b-bb00-28e41fd896dd-ca-trust-extracted\") pod \"image-registry-98f645c89-cjthz\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") " pod="openshift-image-registry/image-registry-98f645c89-cjthz"
Jun 15 05:48:13.241042 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.240712    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8bf514ab-857d-416e-b51f-2235f4cb429d-trusted-ca\") pod \"console-operator-5dbbb5d744-kn9gn\" (UID: \"8bf514ab-857d-416e-b51f-2235f4cb429d\") " pod="openshift-console-operator/console-operator-5dbbb5d744-kn9gn"
Jun 15 05:48:13.241042 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.240742    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkpw4\" (UniqueName: \"kubernetes.io/projected/1c426d10-8221-4f39-b21e-6e42e3c77906-kube-api-access-wkpw4\") pod \"network-check-source-6947749cfc-4msss\" (UID: \"1c426d10-8221-4f39-b21e-6e42e3c77906\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-4msss"
Jun 15 05:48:13.241042 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.240770    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4df2971e-f461-424e-a003-dcfbc0eba623-metrics-tls\") pod \"dns-default-qndls\" (UID: \"4df2971e-f461-424e-a003-dcfbc0eba623\") " pod="openshift-dns/dns-default-qndls"
Jun 15 05:48:13.241042 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.240800    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de5e4b97-769f-4d62-8aea-b9cdf3bca1a7-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-vbmdw\" (UID: \"de5e4b97-769f-4d62-8aea-b9cdf3bca1a7\") " pod="openshift-insights/insights-operator-5bbd86d6bd-vbmdw"
Jun 15 05:48:13.241042 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.240822    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/de5e4b97-769f-4d62-8aea-b9cdf3bca1a7-serving-cert\") pod \"insights-operator-5bbd86d6bd-vbmdw\" (UID: \"de5e4b97-769f-4d62-8aea-b9cdf3bca1a7\") " pod="openshift-insights/insights-operator-5bbd86d6bd-vbmdw"
Jun 15 05:48:13.241042 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.240844    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/caf71ecd-2952-4e38-947b-9e18f1341517-cert\") pod \"ingress-canary-42blt\" (UID: \"caf71ecd-2952-4e38-947b-9e18f1341517\") " pod="openshift-ingress-canary/ingress-canary-42blt"
Jun 15 05:48:13.241042 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.240926    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/03282db6-9df2-4e5f-b462-d7d252ccef87-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-9jqt9\" (UID: \"03282db6-9df2-4e5f-b462-d7d252ccef87\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9jqt9"
Jun 15 05:48:13.241042 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.240950    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de5e4b97-769f-4d62-8aea-b9cdf3bca1a7-tmp\") pod \"insights-operator-5bbd86d6bd-vbmdw\" (UID: \"de5e4b97-769f-4d62-8aea-b9cdf3bca1a7\") " pod="openshift-insights/insights-operator-5bbd86d6bd-vbmdw"
Jun 15 05:48:13.241042 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.240954    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6b663716-76fa-4580-afdb-73c283d06ac2-nginx-conf\") pod \"networking-console-plugin-867b76cb74-gbgcf\" (UID: \"6b663716-76fa-4580-afdb-73c283d06ac2\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-gbgcf"
Jun 15 05:48:13.241042 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.240979    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f9qx\" (UniqueName: \"kubernetes.io/projected/fc17a9a3-092b-4007-b1dc-5860349dc4a0-kube-api-access-7f9qx\") pod \"router-default-67dff766cb-95zdt\" (UID: \"fc17a9a3-092b-4007-b1dc-5860349dc4a0\") " pod="openshift-ingress/router-default-67dff766cb-95zdt"
Jun 15 05:48:13.241042 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.241007    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9wvh\" (UniqueName: \"kubernetes.io/projected/e30f3f9f-2bc5-4603-9343-e3bbdd26fd7d-kube-api-access-s9wvh\") pod \"kube-storage-version-migrator-operator-7c578b78fc-pwv4p\" (UID: \"e30f3f9f-2bc5-4603-9343-e3bbdd26fd7d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pwv4p"
Jun 15 05:48:13.241042 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.241032    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d42t4\" (UniqueName: \"kubernetes.io/projected/4df2971e-f461-424e-a003-dcfbc0eba623-kube-api-access-d42t4\") pod \"dns-default-qndls\" (UID: \"4df2971e-f461-424e-a003-dcfbc0eba623\") " pod="openshift-dns/dns-default-qndls"
Jun 15 05:48:13.241978 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.241060    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8v49\" (UniqueName: \"kubernetes.io/projected/de5e4b97-769f-4d62-8aea-b9cdf3bca1a7-kube-api-access-p8v49\") pod \"insights-operator-5bbd86d6bd-vbmdw\" (UID: \"de5e4b97-769f-4d62-8aea-b9cdf3bca1a7\") " pod="openshift-insights/insights-operator-5bbd86d6bd-vbmdw"
Jun 15 05:48:13.241978 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.241098    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f919e023-d50d-4b4b-bb00-28e41fd896dd-trusted-ca\") pod \"image-registry-98f645c89-cjthz\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") " pod="openshift-image-registry/image-registry-98f645c89-cjthz"
Jun 15 05:48:13.241978 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.241125    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/03282db6-9df2-4e5f-b462-d7d252ccef87-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-9jqt9\" (UID: \"03282db6-9df2-4e5f-b462-d7d252ccef87\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9jqt9"
Jun 15 05:48:13.241978 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.241154    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de5e4b97-769f-4d62-8aea-b9cdf3bca1a7-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-vbmdw\" (UID: \"de5e4b97-769f-4d62-8aea-b9cdf3bca1a7\") " pod="openshift-insights/insights-operator-5bbd86d6bd-vbmdw"
Jun 15 05:48:13.241978 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.241676    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f919e023-d50d-4b4b-bb00-28e41fd896dd-registry-certificates\") pod \"image-registry-98f645c89-cjthz\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") " pod="openshift-image-registry/image-registry-98f645c89-cjthz"
Jun 15 05:48:13.241978 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.241722    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fc17a9a3-092b-4007-b1dc-5860349dc4a0-stats-auth\") pod \"router-default-67dff766cb-95zdt\" (UID: \"fc17a9a3-092b-4007-b1dc-5860349dc4a0\") " pod="openshift-ingress/router-default-67dff766cb-95zdt"
Jun 15 05:48:13.242259 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.242067    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de5e4b97-769f-4d62-8aea-b9cdf3bca1a7-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-vbmdw\" (UID: \"de5e4b97-769f-4d62-8aea-b9cdf3bca1a7\") " pod="openshift-insights/insights-operator-5bbd86d6bd-vbmdw"
Jun 15 05:48:13.245721 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.242707    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de5e4b97-769f-4d62-8aea-b9cdf3bca1a7-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-vbmdw\" (UID: \"de5e4b97-769f-4d62-8aea-b9cdf3bca1a7\") " pod="openshift-insights/insights-operator-5bbd86d6bd-vbmdw"
Jun 15 05:48:13.245721 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.242828    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5d1c36b4-80f4-46a1-bfb2-6323cb64f65e-config\") pod \"service-ca-operator-7ccbfd59dc-kkp9q\" (UID: \"5d1c36b4-80f4-46a1-bfb2-6323cb64f65e\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-kkp9q"
Jun 15 05:48:13.245721 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.243482    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f919e023-d50d-4b4b-bb00-28e41fd896dd-ca-trust-extracted\") pod \"image-registry-98f645c89-cjthz\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") " pod="openshift-image-registry/image-registry-98f645c89-cjthz"
Jun 15 05:48:13.245721 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:13.243564    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 15 05:48:13.245721 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:13.243614    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a-samples-operator-tls podName:f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a nodeName:}" failed. No retries permitted until 2026-06-15 05:48:13.743601326 +0000 UTC m=+36.110146358 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a-samples-operator-tls") pod "cluster-samples-operator-9547488fd-67hw4" (UID: "f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a") : secret "samples-operator-tls" not found
Jun 15 05:48:13.245721 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.244359    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/03282db6-9df2-4e5f-b462-d7d252ccef87-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-9jqt9\" (UID: \"03282db6-9df2-4e5f-b462-d7d252ccef87\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9jqt9"
Jun 15 05:48:13.245721 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.244656    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8bf514ab-857d-416e-b51f-2235f4cb429d-trusted-ca\") pod \"console-operator-5dbbb5d744-kn9gn\" (UID: \"8bf514ab-857d-416e-b51f-2235f4cb429d\") " pod="openshift-console-operator/console-operator-5dbbb5d744-kn9gn"
Jun 15 05:48:13.245721 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.244672    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e30f3f9f-2bc5-4603-9343-e3bbdd26fd7d-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-pwv4p\" (UID: \"e30f3f9f-2bc5-4603-9343-e3bbdd26fd7d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pwv4p"
Jun 15 05:48:13.245721 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.245145    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de5e4b97-769f-4d62-8aea-b9cdf3bca1a7-tmp\") pod \"insights-operator-5bbd86d6bd-vbmdw\" (UID: \"de5e4b97-769f-4d62-8aea-b9cdf3bca1a7\") " pod="openshift-insights/insights-operator-5bbd86d6bd-vbmdw"
Jun 15 05:48:13.245721 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.245353    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5d1c36b4-80f4-46a1-bfb2-6323cb64f65e-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-kkp9q\" (UID: \"5d1c36b4-80f4-46a1-bfb2-6323cb64f65e\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-kkp9q"
Jun 15 05:48:13.245721 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:13.245441    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 15 05:48:13.245721 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:13.245481    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03282db6-9df2-4e5f-b462-d7d252ccef87-cluster-monitoring-operator-tls podName:03282db6-9df2-4e5f-b462-d7d252ccef87 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:13.745469105 +0000 UTC m=+36.112014134 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/03282db6-9df2-4e5f-b462-d7d252ccef87-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-9jqt9" (UID: "03282db6-9df2-4e5f-b462-d7d252ccef87") : secret "cluster-monitoring-operator-tls" not found
Jun 15 05:48:13.245721 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.245673    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f919e023-d50d-4b4b-bb00-28e41fd896dd-image-registry-private-configuration\") pod \"image-registry-98f645c89-cjthz\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") " pod="openshift-image-registry/image-registry-98f645c89-cjthz"
Jun 15 05:48:13.246873 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.245948    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f919e023-d50d-4b4b-bb00-28e41fd896dd-trusted-ca\") pod \"image-registry-98f645c89-cjthz\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") " pod="openshift-image-registry/image-registry-98f645c89-cjthz"
Jun 15 05:48:13.247487 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.247453    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f919e023-d50d-4b4b-bb00-28e41fd896dd-installation-pull-secrets\") pod \"image-registry-98f645c89-cjthz\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") " pod="openshift-image-registry/image-registry-98f645c89-cjthz"
Jun 15 05:48:13.247598 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.247493    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fc17a9a3-092b-4007-b1dc-5860349dc4a0-stats-auth\") pod \"router-default-67dff766cb-95zdt\" (UID: \"fc17a9a3-092b-4007-b1dc-5860349dc4a0\") " pod="openshift-ingress/router-default-67dff766cb-95zdt"
Jun 15 05:48:13.248176 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.248079    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fc17a9a3-092b-4007-b1dc-5860349dc4a0-default-certificate\") pod \"router-default-67dff766cb-95zdt\" (UID: \"fc17a9a3-092b-4007-b1dc-5860349dc4a0\") " pod="openshift-ingress/router-default-67dff766cb-95zdt"
Jun 15 05:48:13.249283 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.249232    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/de5e4b97-769f-4d62-8aea-b9cdf3bca1a7-serving-cert\") pod \"insights-operator-5bbd86d6bd-vbmdw\" (UID: \"de5e4b97-769f-4d62-8aea-b9cdf3bca1a7\") " pod="openshift-insights/insights-operator-5bbd86d6bd-vbmdw"
Jun 15 05:48:13.250397 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.250374    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tfqv\" (UniqueName: \"kubernetes.io/projected/f919e023-d50d-4b4b-bb00-28e41fd896dd-kube-api-access-8tfqv\") pod \"image-registry-98f645c89-cjthz\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") " pod="openshift-image-registry/image-registry-98f645c89-cjthz"
Jun 15 05:48:13.250735 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.250535    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmh2h\" (UniqueName: \"kubernetes.io/projected/8bf514ab-857d-416e-b51f-2235f4cb429d-kube-api-access-zmh2h\") pod \"console-operator-5dbbb5d744-kn9gn\" (UID: \"8bf514ab-857d-416e-b51f-2235f4cb429d\") " pod="openshift-console-operator/console-operator-5dbbb5d744-kn9gn"
Jun 15 05:48:13.251002 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.250977    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2kn9\" (UniqueName: \"kubernetes.io/projected/39c1a446-4af7-43a2-8a43-35bf376df260-kube-api-access-s2kn9\") pod \"volume-data-source-validator-bd4ccd799-zwmqd\" (UID: \"39c1a446-4af7-43a2-8a43-35bf376df260\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-zwmqd"
Jun 15 05:48:13.252075 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.251706    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f919e023-d50d-4b4b-bb00-28e41fd896dd-bound-sa-token\") pod \"image-registry-98f645c89-cjthz\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") " pod="openshift-image-registry/image-registry-98f645c89-cjthz"
Jun 15 05:48:13.252996 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.252910    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt6v7\" (UniqueName: \"kubernetes.io/projected/5d1c36b4-80f4-46a1-bfb2-6323cb64f65e-kube-api-access-dt6v7\") pod \"service-ca-operator-7ccbfd59dc-kkp9q\" (UID: \"5d1c36b4-80f4-46a1-bfb2-6323cb64f65e\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-kkp9q"
Jun 15 05:48:13.252996 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.252911    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs7ms\" (UniqueName: \"kubernetes.io/projected/f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a-kube-api-access-zs7ms\") pod \"cluster-samples-operator-9547488fd-67hw4\" (UID: \"f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-67hw4"
Jun 15 05:48:13.253224 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.253205    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gfpt\" (UniqueName: \"kubernetes.io/projected/03282db6-9df2-4e5f-b462-d7d252ccef87-kube-api-access-8gfpt\") pod \"cluster-monitoring-operator-f9d7df769-9jqt9\" (UID: \"03282db6-9df2-4e5f-b462-d7d252ccef87\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9jqt9"
Jun 15 05:48:13.253344 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.253322    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8bf514ab-857d-416e-b51f-2235f4cb429d-serving-cert\") pod \"console-operator-5dbbb5d744-kn9gn\" (UID: \"8bf514ab-857d-416e-b51f-2235f4cb429d\") " pod="openshift-console-operator/console-operator-5dbbb5d744-kn9gn"
Jun 15 05:48:13.256357 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.254524    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9wvh\" (UniqueName: \"kubernetes.io/projected/e30f3f9f-2bc5-4603-9343-e3bbdd26fd7d-kube-api-access-s9wvh\") pod \"kube-storage-version-migrator-operator-7c578b78fc-pwv4p\" (UID: \"e30f3f9f-2bc5-4603-9343-e3bbdd26fd7d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pwv4p"
Jun 15 05:48:13.256357 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.255671    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8v49\" (UniqueName: \"kubernetes.io/projected/de5e4b97-769f-4d62-8aea-b9cdf3bca1a7-kube-api-access-p8v49\") pod \"insights-operator-5bbd86d6bd-vbmdw\" (UID: \"de5e4b97-769f-4d62-8aea-b9cdf3bca1a7\") " pod="openshift-insights/insights-operator-5bbd86d6bd-vbmdw"
Jun 15 05:48:13.256357 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.256093    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f9qx\" (UniqueName: \"kubernetes.io/projected/fc17a9a3-092b-4007-b1dc-5860349dc4a0-kube-api-access-7f9qx\") pod \"router-default-67dff766cb-95zdt\" (UID: \"fc17a9a3-092b-4007-b1dc-5860349dc4a0\") " pod="openshift-ingress/router-default-67dff766cb-95zdt"
Jun 15 05:48:13.328853 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.328817    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-zwmqd"
Jun 15 05:48:13.342700 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.342677    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4df2971e-f461-424e-a003-dcfbc0eba623-tmp-dir\") pod \"dns-default-qndls\" (UID: \"4df2971e-f461-424e-a003-dcfbc0eba623\") " pod="openshift-dns/dns-default-qndls"
Jun 15 05:48:13.342823 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.342712    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrzr5\" (UniqueName: \"kubernetes.io/projected/caf71ecd-2952-4e38-947b-9e18f1341517-kube-api-access-zrzr5\") pod \"ingress-canary-42blt\" (UID: \"caf71ecd-2952-4e38-947b-9e18f1341517\") " pod="openshift-ingress-canary/ingress-canary-42blt"
Jun 15 05:48:13.342823 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.342742    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkpw4\" (UniqueName: \"kubernetes.io/projected/1c426d10-8221-4f39-b21e-6e42e3c77906-kube-api-access-wkpw4\") pod \"network-check-source-6947749cfc-4msss\" (UID: \"1c426d10-8221-4f39-b21e-6e42e3c77906\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-4msss"
Jun 15 05:48:13.342823 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.342800    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4df2971e-f461-424e-a003-dcfbc0eba623-metrics-tls\") pod \"dns-default-qndls\" (UID: \"4df2971e-f461-424e-a003-dcfbc0eba623\") " pod="openshift-dns/dns-default-qndls"
Jun 15 05:48:13.343009 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.342841    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/caf71ecd-2952-4e38-947b-9e18f1341517-cert\") pod \"ingress-canary-42blt\" (UID: \"caf71ecd-2952-4e38-947b-9e18f1341517\") " pod="openshift-ingress-canary/ingress-canary-42blt"
Jun 15 05:48:13.343009 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.342888    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d42t4\" (UniqueName: \"kubernetes.io/projected/4df2971e-f461-424e-a003-dcfbc0eba623-kube-api-access-d42t4\") pod \"dns-default-qndls\" (UID: \"4df2971e-f461-424e-a003-dcfbc0eba623\") " pod="openshift-dns/dns-default-qndls"
Jun 15 05:48:13.343353 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:13.343315    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 15 05:48:13.343458 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:13.343407    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4df2971e-f461-424e-a003-dcfbc0eba623-metrics-tls podName:4df2971e-f461-424e-a003-dcfbc0eba623 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:13.843390216 +0000 UTC m=+36.209935244 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4df2971e-f461-424e-a003-dcfbc0eba623-metrics-tls") pod "dns-default-qndls" (UID: "4df2971e-f461-424e-a003-dcfbc0eba623") : secret "dns-default-metrics-tls" not found
Jun 15 05:48:13.343458 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.343398    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4df2971e-f461-424e-a003-dcfbc0eba623-tmp-dir\") pod \"dns-default-qndls\" (UID: \"4df2971e-f461-424e-a003-dcfbc0eba623\") " pod="openshift-dns/dns-default-qndls"
Jun 15 05:48:13.347422 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.343649    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4df2971e-f461-424e-a003-dcfbc0eba623-config-volume\") pod \"dns-default-qndls\" (UID: \"4df2971e-f461-424e-a003-dcfbc0eba623\") " pod="openshift-dns/dns-default-qndls"
Jun 15 05:48:13.347422 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.344342    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4df2971e-f461-424e-a003-dcfbc0eba623-config-volume\") pod \"dns-default-qndls\" (UID: \"4df2971e-f461-424e-a003-dcfbc0eba623\") " pod="openshift-dns/dns-default-qndls"
Jun 15 05:48:13.348211 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.348188    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/caf71ecd-2952-4e38-947b-9e18f1341517-cert\") pod \"ingress-canary-42blt\" (UID: \"caf71ecd-2952-4e38-947b-9e18f1341517\") " pod="openshift-ingress-canary/ingress-canary-42blt"
Jun 15 05:48:13.349731 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.349714    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-kn9gn"
Jun 15 05:48:13.354758 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.354734    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkpw4\" (UniqueName: \"kubernetes.io/projected/1c426d10-8221-4f39-b21e-6e42e3c77906-kube-api-access-wkpw4\") pod \"network-check-source-6947749cfc-4msss\" (UID: \"1c426d10-8221-4f39-b21e-6e42e3c77906\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-4msss"
Jun 15 05:48:13.355420 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.355400    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrzr5\" (UniqueName: \"kubernetes.io/projected/caf71ecd-2952-4e38-947b-9e18f1341517-kube-api-access-zrzr5\") pod \"ingress-canary-42blt\" (UID: \"caf71ecd-2952-4e38-947b-9e18f1341517\") " pod="openshift-ingress-canary/ingress-canary-42blt"
Jun 15 05:48:13.355539 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.355516    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d42t4\" (UniqueName: \"kubernetes.io/projected/4df2971e-f461-424e-a003-dcfbc0eba623-kube-api-access-d42t4\") pod \"dns-default-qndls\" (UID: \"4df2971e-f461-424e-a003-dcfbc0eba623\") " pod="openshift-dns/dns-default-qndls"
Jun 15 05:48:13.368491 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.368467    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pwv4p"
Jun 15 05:48:13.377244 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.377222    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-kkp9q"
Jun 15 05:48:13.418574 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.418555    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-vbmdw"
Jun 15 05:48:13.425238 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.425220    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-4msss"
Jun 15 05:48:13.438523 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.438502    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-42blt"
Jun 15 05:48:13.748325 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.748281    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/03282db6-9df2-4e5f-b462-d7d252ccef87-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-9jqt9\" (UID: \"03282db6-9df2-4e5f-b462-d7d252ccef87\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9jqt9"
Jun 15 05:48:13.748325 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.748329    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6b663716-76fa-4580-afdb-73c283d06ac2-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-gbgcf\" (UID: \"6b663716-76fa-4580-afdb-73c283d06ac2\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-gbgcf"
Jun 15 05:48:13.748552 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.748352    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc17a9a3-092b-4007-b1dc-5860349dc4a0-metrics-certs\") pod \"router-default-67dff766cb-95zdt\" (UID: \"fc17a9a3-092b-4007-b1dc-5860349dc4a0\") " pod="openshift-ingress/router-default-67dff766cb-95zdt"
Jun 15 05:48:13.748552 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:13.748453    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 15 05:48:13.748552 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:13.748471    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 15 05:48:13.748552 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:13.748516    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b663716-76fa-4580-afdb-73c283d06ac2-networking-console-plugin-cert podName:6b663716-76fa-4580-afdb-73c283d06ac2 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:14.748503049 +0000 UTC m=+37.115048089 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6b663716-76fa-4580-afdb-73c283d06ac2-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-gbgcf" (UID: "6b663716-76fa-4580-afdb-73c283d06ac2") : secret "networking-console-plugin-cert" not found
Jun 15 05:48:13.748552 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:13.748528    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03282db6-9df2-4e5f-b462-d7d252ccef87-cluster-monitoring-operator-tls podName:03282db6-9df2-4e5f-b462-d7d252ccef87 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:14.748521947 +0000 UTC m=+37.115066975 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/03282db6-9df2-4e5f-b462-d7d252ccef87-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-9jqt9" (UID: "03282db6-9df2-4e5f-b462-d7d252ccef87") : secret "cluster-monitoring-operator-tls" not found
Jun 15 05:48:13.748780 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.748560    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc17a9a3-092b-4007-b1dc-5860349dc4a0-service-ca-bundle\") pod \"router-default-67dff766cb-95zdt\" (UID: \"fc17a9a3-092b-4007-b1dc-5860349dc4a0\") " pod="openshift-ingress/router-default-67dff766cb-95zdt"
Jun 15 05:48:13.748780 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.748588    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f919e023-d50d-4b4b-bb00-28e41fd896dd-registry-tls\") pod \"image-registry-98f645c89-cjthz\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") " pod="openshift-image-registry/image-registry-98f645c89-cjthz"
Jun 15 05:48:13.748780 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.748626    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-67hw4\" (UID: \"f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-67hw4"
Jun 15 05:48:13.748780 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:13.748704    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 15 05:48:13.748780 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:13.748741    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a-samples-operator-tls podName:f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a nodeName:}" failed. No retries permitted until 2026-06-15 05:48:14.748729486 +0000 UTC m=+37.115274532 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a-samples-operator-tls") pod "cluster-samples-operator-9547488fd-67hw4" (UID: "f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a") : secret "samples-operator-tls" not found
Jun 15 05:48:13.749034 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:13.748788    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 15 05:48:13.749034 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:13.748818    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc17a9a3-092b-4007-b1dc-5860349dc4a0-metrics-certs podName:fc17a9a3-092b-4007-b1dc-5860349dc4a0 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:14.748808152 +0000 UTC m=+37.115353197 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc17a9a3-092b-4007-b1dc-5860349dc4a0-metrics-certs") pod "router-default-67dff766cb-95zdt" (UID: "fc17a9a3-092b-4007-b1dc-5860349dc4a0") : secret "router-metrics-certs-default" not found
Jun 15 05:48:13.749034 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:13.748891    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fc17a9a3-092b-4007-b1dc-5860349dc4a0-service-ca-bundle podName:fc17a9a3-092b-4007-b1dc-5860349dc4a0 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:14.748884567 +0000 UTC m=+37.115429608 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fc17a9a3-092b-4007-b1dc-5860349dc4a0-service-ca-bundle") pod "router-default-67dff766cb-95zdt" (UID: "fc17a9a3-092b-4007-b1dc-5860349dc4a0") : configmap references non-existent config key: service-ca.crt
Jun 15 05:48:13.749034 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:13.748951    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 15 05:48:13.749034 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:13.748966    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-98f645c89-cjthz: secret "image-registry-tls" not found
Jun 15 05:48:13.749034 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:13.749007    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f919e023-d50d-4b4b-bb00-28e41fd896dd-registry-tls podName:f919e023-d50d-4b4b-bb00-28e41fd896dd nodeName:}" failed. No retries permitted until 2026-06-15 05:48:14.748990961 +0000 UTC m=+37.115536015 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f919e023-d50d-4b4b-bb00-28e41fd896dd-registry-tls") pod "image-registry-98f645c89-cjthz" (UID: "f919e023-d50d-4b4b-bb00-28e41fd896dd") : secret "image-registry-tls" not found
Jun 15 05:48:13.850010 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:13.849977    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4df2971e-f461-424e-a003-dcfbc0eba623-metrics-tls\") pod \"dns-default-qndls\" (UID: \"4df2971e-f461-424e-a003-dcfbc0eba623\") " pod="openshift-dns/dns-default-qndls"
Jun 15 05:48:13.850181 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:13.850148    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 15 05:48:13.850232 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:13.850222    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4df2971e-f461-424e-a003-dcfbc0eba623-metrics-tls podName:4df2971e-f461-424e-a003-dcfbc0eba623 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:14.850203733 +0000 UTC m=+37.216748777 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4df2971e-f461-424e-a003-dcfbc0eba623-metrics-tls") pod "dns-default-qndls" (UID: "4df2971e-f461-424e-a003-dcfbc0eba623") : secret "dns-default-metrics-tls" not found
Jun 15 05:48:14.375218 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:14.375032    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pwv4p"]
Jun 15 05:48:14.377682 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:14.377643    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-kkp9q"]
Jun 15 05:48:14.383735 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:14.383712    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-4msss"]
Jun 15 05:48:14.384532 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:14.384511    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-kn9gn"]
Jun 15 05:48:14.387258 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:14.387236    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-zwmqd"]
Jun 15 05:48:14.389233 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:48:14.388354    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d1c36b4_80f4_46a1_bfb2_6323cb64f65e.slice/crio-134c3285a5d9b328dff239dd5377ddd6fcaeea6dec21372fc810af9b1611c216 WatchSource:0}: Error finding container 134c3285a5d9b328dff239dd5377ddd6fcaeea6dec21372fc810af9b1611c216: Status 404 returned error can't find the container with id 134c3285a5d9b328dff239dd5377ddd6fcaeea6dec21372fc810af9b1611c216
Jun 15 05:48:14.390751 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:14.390732    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-42blt"]
Jun 15 05:48:14.394097 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:14.393107    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-vbmdw"]
Jun 15 05:48:14.395498 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:48:14.395482    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaf71ecd_2952_4e38_947b_9e18f1341517.slice/crio-d79cfaf2b2110d7027dcae3edbd0475ff6c1276baaba50847a66111e7b70f64f WatchSource:0}: Error finding container d79cfaf2b2110d7027dcae3edbd0475ff6c1276baaba50847a66111e7b70f64f: Status 404 returned error can't find the container with id d79cfaf2b2110d7027dcae3edbd0475ff6c1276baaba50847a66111e7b70f64f
Jun 15 05:48:14.397429 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:48:14.397330    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde5e4b97_769f_4d62_8aea_b9cdf3bca1a7.slice/crio-73ac4fa6e33d605fff0ec7378e175846a75466a2cfa49842e8b1b89c9285596a WatchSource:0}: Error finding container 73ac4fa6e33d605fff0ec7378e175846a75466a2cfa49842e8b1b89c9285596a: Status 404 returned error can't find the container with id 73ac4fa6e33d605fff0ec7378e175846a75466a2cfa49842e8b1b89c9285596a
Jun 15 05:48:14.399258 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:48:14.399238    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39c1a446_4af7_43a2_8a43_35bf376df260.slice/crio-3b1c0ecbb1d6651074c13ef6d071aa73e0bca9a9b2729f677c0850508ca5c390 WatchSource:0}: Error finding container 3b1c0ecbb1d6651074c13ef6d071aa73e0bca9a9b2729f677c0850508ca5c390: Status 404 returned error can't find the container with id 3b1c0ecbb1d6651074c13ef6d071aa73e0bca9a9b2729f677c0850508ca5c390
Jun 15 05:48:14.758992 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:14.758962    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-67hw4\" (UID: \"f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-67hw4"
Jun 15 05:48:14.759159 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:14.759043    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/03282db6-9df2-4e5f-b462-d7d252ccef87-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-9jqt9\" (UID: \"03282db6-9df2-4e5f-b462-d7d252ccef87\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9jqt9"
Jun 15 05:48:14.759159 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:14.759080    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6b663716-76fa-4580-afdb-73c283d06ac2-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-gbgcf\" (UID: \"6b663716-76fa-4580-afdb-73c283d06ac2\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-gbgcf"
Jun 15 05:48:14.759159 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:14.759106    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc17a9a3-092b-4007-b1dc-5860349dc4a0-metrics-certs\") pod \"router-default-67dff766cb-95zdt\" (UID: \"fc17a9a3-092b-4007-b1dc-5860349dc4a0\") " pod="openshift-ingress/router-default-67dff766cb-95zdt"
Jun 15 05:48:14.759159 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:14.759111    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 15 05:48:14.759452 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:14.759172    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a-samples-operator-tls podName:f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a nodeName:}" failed. No retries permitted until 2026-06-15 05:48:16.759154934 +0000 UTC m=+39.125699965 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a-samples-operator-tls") pod "cluster-samples-operator-9547488fd-67hw4" (UID: "f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a") : secret "samples-operator-tls" not found
Jun 15 05:48:14.759452 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:14.759199    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 15 05:48:14.759452 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:14.759213    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 15 05:48:14.759452 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:14.759199    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 15 05:48:14.759452 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:14.759206    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc17a9a3-092b-4007-b1dc-5860349dc4a0-service-ca-bundle\") pod \"router-default-67dff766cb-95zdt\" (UID: \"fc17a9a3-092b-4007-b1dc-5860349dc4a0\") " pod="openshift-ingress/router-default-67dff766cb-95zdt"
Jun 15 05:48:14.759452 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:14.759248    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc17a9a3-092b-4007-b1dc-5860349dc4a0-metrics-certs podName:fc17a9a3-092b-4007-b1dc-5860349dc4a0 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:16.759238185 +0000 UTC m=+39.125783213 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc17a9a3-092b-4007-b1dc-5860349dc4a0-metrics-certs") pod "router-default-67dff766cb-95zdt" (UID: "fc17a9a3-092b-4007-b1dc-5860349dc4a0") : secret "router-metrics-certs-default" not found
Jun 15 05:48:14.759452 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:14.759321    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b663716-76fa-4580-afdb-73c283d06ac2-networking-console-plugin-cert podName:6b663716-76fa-4580-afdb-73c283d06ac2 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:16.759297391 +0000 UTC m=+39.125842434 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6b663716-76fa-4580-afdb-73c283d06ac2-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-gbgcf" (UID: "6b663716-76fa-4580-afdb-73c283d06ac2") : secret "networking-console-plugin-cert" not found
Jun 15 05:48:14.759452 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:14.759345    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fc17a9a3-092b-4007-b1dc-5860349dc4a0-service-ca-bundle podName:fc17a9a3-092b-4007-b1dc-5860349dc4a0 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:16.759335281 +0000 UTC m=+39.125880316 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fc17a9a3-092b-4007-b1dc-5860349dc4a0-service-ca-bundle") pod "router-default-67dff766cb-95zdt" (UID: "fc17a9a3-092b-4007-b1dc-5860349dc4a0") : configmap references non-existent config key: service-ca.crt
Jun 15 05:48:14.759452 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:14.759363    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03282db6-9df2-4e5f-b462-d7d252ccef87-cluster-monitoring-operator-tls podName:03282db6-9df2-4e5f-b462-d7d252ccef87 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:16.759353329 +0000 UTC m=+39.125898357 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/03282db6-9df2-4e5f-b462-d7d252ccef87-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-9jqt9" (UID: "03282db6-9df2-4e5f-b462-d7d252ccef87") : secret "cluster-monitoring-operator-tls" not found
Jun 15 05:48:14.759452 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:14.759396    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f919e023-d50d-4b4b-bb00-28e41fd896dd-registry-tls\") pod \"image-registry-98f645c89-cjthz\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") " pod="openshift-image-registry/image-registry-98f645c89-cjthz"
Jun 15 05:48:14.759786 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:14.759502    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 15 05:48:14.759786 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:14.759513    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-98f645c89-cjthz: secret "image-registry-tls" not found
Jun 15 05:48:14.759786 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:14.759558    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f919e023-d50d-4b4b-bb00-28e41fd896dd-registry-tls podName:f919e023-d50d-4b4b-bb00-28e41fd896dd nodeName:}" failed. No retries permitted until 2026-06-15 05:48:16.759547214 +0000 UTC m=+39.126092245 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f919e023-d50d-4b4b-bb00-28e41fd896dd-registry-tls") pod "image-registry-98f645c89-cjthz" (UID: "f919e023-d50d-4b4b-bb00-28e41fd896dd") : secret "image-registry-tls" not found
Jun 15 05:48:14.860014 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:14.859988    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4df2971e-f461-424e-a003-dcfbc0eba623-metrics-tls\") pod \"dns-default-qndls\" (UID: \"4df2971e-f461-424e-a003-dcfbc0eba623\") " pod="openshift-dns/dns-default-qndls"
Jun 15 05:48:14.860181 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:14.860156    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 15 05:48:14.860238 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:14.860227    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4df2971e-f461-424e-a003-dcfbc0eba623-metrics-tls podName:4df2971e-f461-424e-a003-dcfbc0eba623 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:16.860208083 +0000 UTC m=+39.226753133 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4df2971e-f461-424e-a003-dcfbc0eba623-metrics-tls") pod "dns-default-qndls" (UID: "4df2971e-f461-424e-a003-dcfbc0eba623") : secret "dns-default-metrics-tls" not found
Jun 15 05:48:15.331972 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:15.331880    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-kkp9q" event={"ID":"5d1c36b4-80f4-46a1-bfb2-6323cb64f65e","Type":"ContainerStarted","Data":"134c3285a5d9b328dff239dd5377ddd6fcaeea6dec21372fc810af9b1611c216"}
Jun 15 05:48:15.338386 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:15.337402    2564 generic.go:356] "Generic (PLEG): container finished" podID="365f2bf1-0391-46a7-961e-a41133c65588" containerID="b7a0fb6e30b08a7cbec07413f528747dbd77d98ba2b4b31363b7360d23bbd33b" exitCode=0
Jun 15 05:48:15.338386 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:15.337479    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s5nvg" event={"ID":"365f2bf1-0391-46a7-961e-a41133c65588","Type":"ContainerDied","Data":"b7a0fb6e30b08a7cbec07413f528747dbd77d98ba2b4b31363b7360d23bbd33b"}
Jun 15 05:48:15.342398 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:15.342370    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-zwmqd" event={"ID":"39c1a446-4af7-43a2-8a43-35bf376df260","Type":"ContainerStarted","Data":"3b1c0ecbb1d6651074c13ef6d071aa73e0bca9a9b2729f677c0850508ca5c390"}
Jun 15 05:48:15.349598 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:15.349570    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-4msss" event={"ID":"1c426d10-8221-4f39-b21e-6e42e3c77906","Type":"ContainerStarted","Data":"1ba1d3eb741aa9d36e01b23b97fe6e5d42afdd33bef64d3e67be10e2a9a17c5e"}
Jun 15 05:48:15.353883 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:15.353839    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-kn9gn" event={"ID":"8bf514ab-857d-416e-b51f-2235f4cb429d","Type":"ContainerStarted","Data":"307d49dbaff4914f6361f39bf8a9f855a905de06b31d9eb2c66f0a8493a26843"}
Jun 15 05:48:15.359936 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:15.359913    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-42blt" event={"ID":"caf71ecd-2952-4e38-947b-9e18f1341517","Type":"ContainerStarted","Data":"d79cfaf2b2110d7027dcae3edbd0475ff6c1276baaba50847a66111e7b70f64f"}
Jun 15 05:48:15.366373 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:15.366347    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pwv4p" event={"ID":"e30f3f9f-2bc5-4603-9343-e3bbdd26fd7d","Type":"ContainerStarted","Data":"e5eb447bc1e73d1cdb082320494a6d738b045be2867dd753d1834873710a6c8e"}
Jun 15 05:48:15.368237 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:15.368215    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-vbmdw" event={"ID":"de5e4b97-769f-4d62-8aea-b9cdf3bca1a7","Type":"ContainerStarted","Data":"73ac4fa6e33d605fff0ec7378e175846a75466a2cfa49842e8b1b89c9285596a"}
Jun 15 05:48:16.379590 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:16.378683    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s5nvg" event={"ID":"365f2bf1-0391-46a7-961e-a41133c65588","Type":"ContainerStarted","Data":"d2fe6e0d9ef55cef699890820545ada8ebf016ed3b4d0dd430af4698ce4bdb4f"}
Jun 15 05:48:16.779835 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:16.779789    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/03282db6-9df2-4e5f-b462-d7d252ccef87-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-9jqt9\" (UID: \"03282db6-9df2-4e5f-b462-d7d252ccef87\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9jqt9"
Jun 15 05:48:16.780019 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:16.779878    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6b663716-76fa-4580-afdb-73c283d06ac2-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-gbgcf\" (UID: \"6b663716-76fa-4580-afdb-73c283d06ac2\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-gbgcf"
Jun 15 05:48:16.780019 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:16.779915    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc17a9a3-092b-4007-b1dc-5860349dc4a0-metrics-certs\") pod \"router-default-67dff766cb-95zdt\" (UID: \"fc17a9a3-092b-4007-b1dc-5860349dc4a0\") " pod="openshift-ingress/router-default-67dff766cb-95zdt"
Jun 15 05:48:16.780019 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:16.779994    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc17a9a3-092b-4007-b1dc-5860349dc4a0-service-ca-bundle\") pod \"router-default-67dff766cb-95zdt\" (UID: \"fc17a9a3-092b-4007-b1dc-5860349dc4a0\") " pod="openshift-ingress/router-default-67dff766cb-95zdt"
Jun 15 05:48:16.780359 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:16.780023    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f919e023-d50d-4b4b-bb00-28e41fd896dd-registry-tls\") pod \"image-registry-98f645c89-cjthz\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") " pod="openshift-image-registry/image-registry-98f645c89-cjthz"
Jun 15 05:48:16.780359 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:16.780062    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-67hw4\" (UID: \"f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-67hw4"
Jun 15 05:48:16.780359 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:16.780212    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 15 05:48:16.780359 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:16.780278    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a-samples-operator-tls podName:f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a nodeName:}" failed. No retries permitted until 2026-06-15 05:48:20.780258619 +0000 UTC m=+43.146803650 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a-samples-operator-tls") pod "cluster-samples-operator-9547488fd-67hw4" (UID: "f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a") : secret "samples-operator-tls" not found
Jun 15 05:48:16.780844 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:16.780628    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 15 05:48:16.780844 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:16.780673    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03282db6-9df2-4e5f-b462-d7d252ccef87-cluster-monitoring-operator-tls podName:03282db6-9df2-4e5f-b462-d7d252ccef87 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:20.780659175 +0000 UTC m=+43.147204207 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/03282db6-9df2-4e5f-b462-d7d252ccef87-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-9jqt9" (UID: "03282db6-9df2-4e5f-b462-d7d252ccef87") : secret "cluster-monitoring-operator-tls" not found
Jun 15 05:48:16.780844 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:16.780716    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 15 05:48:16.780844 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:16.780742    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b663716-76fa-4580-afdb-73c283d06ac2-networking-console-plugin-cert podName:6b663716-76fa-4580-afdb-73c283d06ac2 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:20.780732816 +0000 UTC m=+43.147277844 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6b663716-76fa-4580-afdb-73c283d06ac2-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-gbgcf" (UID: "6b663716-76fa-4580-afdb-73c283d06ac2") : secret "networking-console-plugin-cert" not found
Jun 15 05:48:16.780844 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:16.780780    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 15 05:48:16.780844 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:16.780807    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc17a9a3-092b-4007-b1dc-5860349dc4a0-metrics-certs podName:fc17a9a3-092b-4007-b1dc-5860349dc4a0 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:20.78080066 +0000 UTC m=+43.147345688 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc17a9a3-092b-4007-b1dc-5860349dc4a0-metrics-certs") pod "router-default-67dff766cb-95zdt" (UID: "fc17a9a3-092b-4007-b1dc-5860349dc4a0") : secret "router-metrics-certs-default" not found
Jun 15 05:48:16.780844 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:16.780874    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fc17a9a3-092b-4007-b1dc-5860349dc4a0-service-ca-bundle podName:fc17a9a3-092b-4007-b1dc-5860349dc4a0 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:20.780848274 +0000 UTC m=+43.147393309 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fc17a9a3-092b-4007-b1dc-5860349dc4a0-service-ca-bundle") pod "router-default-67dff766cb-95zdt" (UID: "fc17a9a3-092b-4007-b1dc-5860349dc4a0") : configmap references non-existent config key: service-ca.crt
Jun 15 05:48:16.781468 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:16.780932    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 15 05:48:16.781468 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:16.780943    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-98f645c89-cjthz: secret "image-registry-tls" not found
Jun 15 05:48:16.781468 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:16.780976    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f919e023-d50d-4b4b-bb00-28e41fd896dd-registry-tls podName:f919e023-d50d-4b4b-bb00-28e41fd896dd nodeName:}" failed. No retries permitted until 2026-06-15 05:48:20.780966081 +0000 UTC m=+43.147511111 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f919e023-d50d-4b4b-bb00-28e41fd896dd-registry-tls") pod "image-registry-98f645c89-cjthz" (UID: "f919e023-d50d-4b4b-bb00-28e41fd896dd") : secret "image-registry-tls" not found
Jun 15 05:48:16.881601 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:16.881567    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4df2971e-f461-424e-a003-dcfbc0eba623-metrics-tls\") pod \"dns-default-qndls\" (UID: \"4df2971e-f461-424e-a003-dcfbc0eba623\") " pod="openshift-dns/dns-default-qndls"
Jun 15 05:48:16.881771 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:16.881743    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 15 05:48:16.881823 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:16.881806    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4df2971e-f461-424e-a003-dcfbc0eba623-metrics-tls podName:4df2971e-f461-424e-a003-dcfbc0eba623 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:20.881791999 +0000 UTC m=+43.248337032 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4df2971e-f461-424e-a003-dcfbc0eba623-metrics-tls") pod "dns-default-qndls" (UID: "4df2971e-f461-424e-a003-dcfbc0eba623") : secret "dns-default-metrics-tls" not found
Jun 15 05:48:17.386339 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:17.386310    2564 generic.go:356] "Generic (PLEG): container finished" podID="365f2bf1-0391-46a7-961e-a41133c65588" containerID="d2fe6e0d9ef55cef699890820545ada8ebf016ed3b4d0dd430af4698ce4bdb4f" exitCode=0
Jun 15 05:48:17.386694 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:17.386346    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s5nvg" event={"ID":"365f2bf1-0391-46a7-961e-a41133c65588","Type":"ContainerDied","Data":"d2fe6e0d9ef55cef699890820545ada8ebf016ed3b4d0dd430af4698ce4bdb4f"}
Jun 15 05:48:20.822285 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:20.822235    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/03282db6-9df2-4e5f-b462-d7d252ccef87-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-9jqt9\" (UID: \"03282db6-9df2-4e5f-b462-d7d252ccef87\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9jqt9"
Jun 15 05:48:20.822794 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:20.822296    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6b663716-76fa-4580-afdb-73c283d06ac2-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-gbgcf\" (UID: \"6b663716-76fa-4580-afdb-73c283d06ac2\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-gbgcf"
Jun 15 05:48:20.822794 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:20.822331    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc17a9a3-092b-4007-b1dc-5860349dc4a0-metrics-certs\") pod \"router-default-67dff766cb-95zdt\" (UID: \"fc17a9a3-092b-4007-b1dc-5860349dc4a0\") " pod="openshift-ingress/router-default-67dff766cb-95zdt"
Jun 15 05:48:20.822794 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:20.822404    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 15 05:48:20.822794 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:20.822467    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 15 05:48:20.822794 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:20.822409    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc17a9a3-092b-4007-b1dc-5860349dc4a0-service-ca-bundle\") pod \"router-default-67dff766cb-95zdt\" (UID: \"fc17a9a3-092b-4007-b1dc-5860349dc4a0\") " pod="openshift-ingress/router-default-67dff766cb-95zdt"
Jun 15 05:48:20.822794 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:20.822486    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03282db6-9df2-4e5f-b462-d7d252ccef87-cluster-monitoring-operator-tls podName:03282db6-9df2-4e5f-b462-d7d252ccef87 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:28.822466102 +0000 UTC m=+51.189011131 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/03282db6-9df2-4e5f-b462-d7d252ccef87-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-9jqt9" (UID: "03282db6-9df2-4e5f-b462-d7d252ccef87") : secret "cluster-monitoring-operator-tls" not found
Jun 15 05:48:20.822794 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:20.822516    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fc17a9a3-092b-4007-b1dc-5860349dc4a0-service-ca-bundle podName:fc17a9a3-092b-4007-b1dc-5860349dc4a0 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:28.822500807 +0000 UTC m=+51.189045848 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fc17a9a3-092b-4007-b1dc-5860349dc4a0-service-ca-bundle") pod "router-default-67dff766cb-95zdt" (UID: "fc17a9a3-092b-4007-b1dc-5860349dc4a0") : configmap references non-existent config key: service-ca.crt
Jun 15 05:48:20.822794 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:20.822517    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 15 05:48:20.822794 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:20.822537    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b663716-76fa-4580-afdb-73c283d06ac2-networking-console-plugin-cert podName:6b663716-76fa-4580-afdb-73c283d06ac2 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:28.822525026 +0000 UTC m=+51.189070057 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6b663716-76fa-4580-afdb-73c283d06ac2-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-gbgcf" (UID: "6b663716-76fa-4580-afdb-73c283d06ac2") : secret "networking-console-plugin-cert" not found
Jun 15 05:48:20.822794 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:20.822559    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc17a9a3-092b-4007-b1dc-5860349dc4a0-metrics-certs podName:fc17a9a3-092b-4007-b1dc-5860349dc4a0 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:28.8225487 +0000 UTC m=+51.189093732 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc17a9a3-092b-4007-b1dc-5860349dc4a0-metrics-certs") pod "router-default-67dff766cb-95zdt" (UID: "fc17a9a3-092b-4007-b1dc-5860349dc4a0") : secret "router-metrics-certs-default" not found
Jun 15 05:48:20.822794 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:20.822584    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f919e023-d50d-4b4b-bb00-28e41fd896dd-registry-tls\") pod \"image-registry-98f645c89-cjthz\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") " pod="openshift-image-registry/image-registry-98f645c89-cjthz"
Jun 15 05:48:20.822794 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:20.822615    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-67hw4\" (UID: \"f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-67hw4"
Jun 15 05:48:20.822794 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:20.822661    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 15 05:48:20.822794 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:20.822672    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-98f645c89-cjthz: secret "image-registry-tls" not found
Jun 15 05:48:20.822794 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:20.822698    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f919e023-d50d-4b4b-bb00-28e41fd896dd-registry-tls podName:f919e023-d50d-4b4b-bb00-28e41fd896dd nodeName:}" failed. No retries permitted until 2026-06-15 05:48:28.822689856 +0000 UTC m=+51.189234884 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f919e023-d50d-4b4b-bb00-28e41fd896dd-registry-tls") pod "image-registry-98f645c89-cjthz" (UID: "f919e023-d50d-4b4b-bb00-28e41fd896dd") : secret "image-registry-tls" not found
Jun 15 05:48:20.823339 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:20.822711    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 15 05:48:20.823339 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:20.822733    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a-samples-operator-tls podName:f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a nodeName:}" failed. No retries permitted until 2026-06-15 05:48:28.822726604 +0000 UTC m=+51.189271632 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a-samples-operator-tls") pod "cluster-samples-operator-9547488fd-67hw4" (UID: "f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a") : secret "samples-operator-tls" not found
Jun 15 05:48:20.923156 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:20.923123    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4df2971e-f461-424e-a003-dcfbc0eba623-metrics-tls\") pod \"dns-default-qndls\" (UID: \"4df2971e-f461-424e-a003-dcfbc0eba623\") " pod="openshift-dns/dns-default-qndls"
Jun 15 05:48:20.923348 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:20.923332    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 15 05:48:20.923424 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:20.923398    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4df2971e-f461-424e-a003-dcfbc0eba623-metrics-tls podName:4df2971e-f461-424e-a003-dcfbc0eba623 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:28.923380224 +0000 UTC m=+51.289925257 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4df2971e-f461-424e-a003-dcfbc0eba623-metrics-tls") pod "dns-default-qndls" (UID: "4df2971e-f461-424e-a003-dcfbc0eba623") : secret "dns-default-metrics-tls" not found
Jun 15 05:48:22.399958 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:22.399887    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-vbmdw" event={"ID":"de5e4b97-769f-4d62-8aea-b9cdf3bca1a7","Type":"ContainerStarted","Data":"120eff3d9783920a756ec25841c626e3a986d7bc90e9301c7787201c70e5b3ae"}
Jun 15 05:48:22.401313 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:22.401283    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-kkp9q" event={"ID":"5d1c36b4-80f4-46a1-bfb2-6323cb64f65e","Type":"ContainerStarted","Data":"dad3f3e6262defb2ebc313972739a7869279e375e3250b7c3dd27ef8754b0435"}
Jun 15 05:48:22.404967 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:22.404947    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s5nvg" event={"ID":"365f2bf1-0391-46a7-961e-a41133c65588","Type":"ContainerStarted","Data":"7bd7a1a6b2bac9fd3c7ec6580de427bec65b590c553c79c414ea8d236af43e6c"}
Jun 15 05:48:22.406879 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:22.406833    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-zwmqd" event={"ID":"39c1a446-4af7-43a2-8a43-35bf376df260","Type":"ContainerStarted","Data":"c94e706c728e2e9988c8e400c434dade4365801474857988702863d269ee6405"}
Jun 15 05:48:22.408479 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:22.408449    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-4msss" event={"ID":"1c426d10-8221-4f39-b21e-6e42e3c77906","Type":"ContainerStarted","Data":"1aa28a913decfb1805942c999623109652af707c6f678b229b45091ed07da03f"}
Jun 15 05:48:22.409988 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:22.409968    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kn9gn_8bf514ab-857d-416e-b51f-2235f4cb429d/console-operator/0.log"
Jun 15 05:48:22.410103 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:22.410023    2564 generic.go:356] "Generic (PLEG): container finished" podID="8bf514ab-857d-416e-b51f-2235f4cb429d" containerID="ff57fdbdc14b1ca2bb6685bc8db1b5f0cd2ff8d52e92841cc43fe6abbd5efcfd" exitCode=255
Jun 15 05:48:22.410103 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:22.410089    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-kn9gn" event={"ID":"8bf514ab-857d-416e-b51f-2235f4cb429d","Type":"ContainerDied","Data":"ff57fdbdc14b1ca2bb6685bc8db1b5f0cd2ff8d52e92841cc43fe6abbd5efcfd"}
Jun 15 05:48:22.410270 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:22.410253    2564 scope.go:117] "RemoveContainer" containerID="ff57fdbdc14b1ca2bb6685bc8db1b5f0cd2ff8d52e92841cc43fe6abbd5efcfd"
Jun 15 05:48:22.412595 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:22.412573    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-42blt" event={"ID":"caf71ecd-2952-4e38-947b-9e18f1341517","Type":"ContainerStarted","Data":"af3a3d49b45c41a43bc67b2fda95e0e50ef48732d71b78565c03adc63c7820c6"}
Jun 15 05:48:22.414117 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:22.414095    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pwv4p" event={"ID":"e30f3f9f-2bc5-4603-9343-e3bbdd26fd7d","Type":"ContainerStarted","Data":"bd954bd21f84c2b0921d2b57a0aa6b64cfcb37c727b1a9b952b5305e4a9b7fdb"}
Jun 15 05:48:22.420064 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:22.420015    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5bbd86d6bd-vbmdw" podStartSLOduration=20.113530969 podStartE2EDuration="27.420002755s" totalImagesPullingTime="7.306471786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:47:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:22.419310782 +0000 UTC m=+44.785855830" watchObservedRunningTime="2026-06-15 05:48:22.420002755 +0000 UTC m=+44.786547807"
Jun 15 05:48:22.455981 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:22.455482    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-kkp9q" podStartSLOduration=20.141486009 podStartE2EDuration="27.455463049s" totalImagesPullingTime="7.31397704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:47:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:22.452940985 +0000 UTC m=+44.819486034" watchObservedRunningTime="2026-06-15 05:48:22.455463049 +0000 UTC m=+44.822008111"
Jun 15 05:48:22.506224 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:22.503884    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-zwmqd" podStartSLOduration=20.201307103 podStartE2EDuration="27.503848667s" totalImagesPullingTime="7.302541564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:47:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:22.477115109 +0000 UTC m=+44.843660160" watchObservedRunningTime="2026-06-15 05:48:22.503848667 +0000 UTC m=+44.870393717"
Jun 15 05:48:22.524962 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:22.524260    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-s5nvg" podStartSLOduration=15.433163882 podStartE2EDuration="44.524240011s" totalImagesPullingTime="29.091076129s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:47:38 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:22.505724513 +0000 UTC m=+44.872269566" watchObservedRunningTime="2026-06-15 05:48:22.524240011 +0000 UTC m=+44.890785062"
Jun 15 05:48:22.524962 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:22.524818    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pwv4p" podStartSLOduration=20.20905468 podStartE2EDuration="27.524811247s" totalImagesPullingTime="7.315756567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:47:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:22.524799468 +0000 UTC m=+44.891344519" watchObservedRunningTime="2026-06-15 05:48:22.524811247 +0000 UTC m=+44.891356278"
Jun 15 05:48:22.549396 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:22.549165    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6947749cfc-4msss" podStartSLOduration=19.952825952 podStartE2EDuration="27.549150143s" totalImagesPullingTime="7.596324191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:47:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:22.547800353 +0000 UTC m=+44.914345402" watchObservedRunningTime="2026-06-15 05:48:22.549150143 +0000 UTC m=+44.915695194"
Jun 15 05:48:22.571544 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:22.571408    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-42blt" podStartSLOduration=2.264381033 podStartE2EDuration="9.5713884s" totalImagesPullingTime="7.307007367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:22.569720349 +0000 UTC m=+44.936265401" watchObservedRunningTime="2026-06-15 05:48:22.5713884 +0000 UTC m=+44.937933449"
Jun 15 05:48:23.103202 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:23.103168    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-l4gs5"]
Jun 15 05:48:23.122957 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:23.122920    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l4gs5"
Jun 15 05:48:23.123408 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:23.123353    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l4gs5"]
Jun 15 05:48:23.126031 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:23.125727    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jun 15 05:48:23.126823 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:23.126391    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jun 15 05:48:23.126823 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:23.126648    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fsjw7\""
Jun 15 05:48:23.147292 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:23.146372    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7d7f3f7-2380-4f93-96d6-59a58f32b056-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l4gs5\" (UID: \"c7d7f3f7-2380-4f93-96d6-59a58f32b056\") " pod="openshift-insights/insights-runtime-extractor-l4gs5"
Jun 15 05:48:23.147292 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:23.146411    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7d7f3f7-2380-4f93-96d6-59a58f32b056-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l4gs5\" (UID: \"c7d7f3f7-2380-4f93-96d6-59a58f32b056\") " pod="openshift-insights/insights-runtime-extractor-l4gs5"
Jun 15 05:48:23.147292 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:23.146489    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c7d7f3f7-2380-4f93-96d6-59a58f32b056-crio-socket\") pod \"insights-runtime-extractor-l4gs5\" (UID: \"c7d7f3f7-2380-4f93-96d6-59a58f32b056\") " pod="openshift-insights/insights-runtime-extractor-l4gs5"
Jun 15 05:48:23.147292 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:23.146522    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jg2w\" (UniqueName: \"kubernetes.io/projected/c7d7f3f7-2380-4f93-96d6-59a58f32b056-kube-api-access-7jg2w\") pod \"insights-runtime-extractor-l4gs5\" (UID: \"c7d7f3f7-2380-4f93-96d6-59a58f32b056\") " pod="openshift-insights/insights-runtime-extractor-l4gs5"
Jun 15 05:48:23.147292 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:23.146637    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7d7f3f7-2380-4f93-96d6-59a58f32b056-data-volume\") pod \"insights-runtime-extractor-l4gs5\" (UID: \"c7d7f3f7-2380-4f93-96d6-59a58f32b056\") " pod="openshift-insights/insights-runtime-extractor-l4gs5"
Jun 15 05:48:23.247369 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:23.247339    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7d7f3f7-2380-4f93-96d6-59a58f32b056-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l4gs5\" (UID: \"c7d7f3f7-2380-4f93-96d6-59a58f32b056\") " pod="openshift-insights/insights-runtime-extractor-l4gs5"
Jun 15 05:48:23.247369 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:23.247371    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7d7f3f7-2380-4f93-96d6-59a58f32b056-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l4gs5\" (UID: \"c7d7f3f7-2380-4f93-96d6-59a58f32b056\") " pod="openshift-insights/insights-runtime-extractor-l4gs5"
Jun 15 05:48:23.247585 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:23.247456    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jun 15 05:48:23.247585 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:23.247470    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 15 05:48:23.247585 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:23.247509    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c7d7f3f7-2380-4f93-96d6-59a58f32b056-crio-socket\") pod \"insights-runtime-extractor-l4gs5\" (UID: \"c7d7f3f7-2380-4f93-96d6-59a58f32b056\") " pod="openshift-insights/insights-runtime-extractor-l4gs5"
Jun 15 05:48:23.247585 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:23.247528    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7d7f3f7-2380-4f93-96d6-59a58f32b056-kube-rbac-proxy-cm podName:c7d7f3f7-2380-4f93-96d6-59a58f32b056 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:23.747506946 +0000 UTC m=+46.114052158 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c7d7f3f7-2380-4f93-96d6-59a58f32b056-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l4gs5" (UID: "c7d7f3f7-2380-4f93-96d6-59a58f32b056") : configmap "kube-rbac-proxy" not found
Jun 15 05:48:23.247585 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:23.247561    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c7d7f3f7-2380-4f93-96d6-59a58f32b056-crio-socket\") pod \"insights-runtime-extractor-l4gs5\" (UID: \"c7d7f3f7-2380-4f93-96d6-59a58f32b056\") " pod="openshift-insights/insights-runtime-extractor-l4gs5"
Jun 15 05:48:23.247812 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:23.247597    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7d7f3f7-2380-4f93-96d6-59a58f32b056-insights-runtime-extractor-tls podName:c7d7f3f7-2380-4f93-96d6-59a58f32b056 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:23.747583139 +0000 UTC m=+46.114128169 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c7d7f3f7-2380-4f93-96d6-59a58f32b056-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l4gs5" (UID: "c7d7f3f7-2380-4f93-96d6-59a58f32b056") : secret "insights-runtime-extractor-tls" not found
Jun 15 05:48:23.247812 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:23.247662    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jg2w\" (UniqueName: \"kubernetes.io/projected/c7d7f3f7-2380-4f93-96d6-59a58f32b056-kube-api-access-7jg2w\") pod \"insights-runtime-extractor-l4gs5\" (UID: \"c7d7f3f7-2380-4f93-96d6-59a58f32b056\") " pod="openshift-insights/insights-runtime-extractor-l4gs5"
Jun 15 05:48:23.247947 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:23.247809    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7d7f3f7-2380-4f93-96d6-59a58f32b056-data-volume\") pod \"insights-runtime-extractor-l4gs5\" (UID: \"c7d7f3f7-2380-4f93-96d6-59a58f32b056\") " pod="openshift-insights/insights-runtime-extractor-l4gs5"
Jun 15 05:48:23.248121 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:23.248105    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7d7f3f7-2380-4f93-96d6-59a58f32b056-data-volume\") pod \"insights-runtime-extractor-l4gs5\" (UID: \"c7d7f3f7-2380-4f93-96d6-59a58f32b056\") " pod="openshift-insights/insights-runtime-extractor-l4gs5"
Jun 15 05:48:23.270839 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:23.270819    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jg2w\" (UniqueName: \"kubernetes.io/projected/c7d7f3f7-2380-4f93-96d6-59a58f32b056-kube-api-access-7jg2w\") pod \"insights-runtime-extractor-l4gs5\" (UID: \"c7d7f3f7-2380-4f93-96d6-59a58f32b056\") " pod="openshift-insights/insights-runtime-extractor-l4gs5"
Jun 15 05:48:23.349887 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:23.349845    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-kn9gn"
Jun 15 05:48:23.350033 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:23.349907    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-kn9gn"
Jun 15 05:48:23.424913 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:23.424891    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kn9gn_8bf514ab-857d-416e-b51f-2235f4cb429d/console-operator/1.log"
Jun 15 05:48:23.425391 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:23.425373    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kn9gn_8bf514ab-857d-416e-b51f-2235f4cb429d/console-operator/0.log"
Jun 15 05:48:23.425447 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:23.425417    2564 generic.go:356] "Generic (PLEG): container finished" podID="8bf514ab-857d-416e-b51f-2235f4cb429d" containerID="867d51472f925fe07e5893d2ac5e647367f26eb5296a8488a9e89060ca3605b0" exitCode=255
Jun 15 05:48:23.425548 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:23.425525    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-kn9gn" event={"ID":"8bf514ab-857d-416e-b51f-2235f4cb429d","Type":"ContainerDied","Data":"867d51472f925fe07e5893d2ac5e647367f26eb5296a8488a9e89060ca3605b0"}
Jun 15 05:48:23.425632 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:23.425611    2564 scope.go:117] "RemoveContainer" containerID="ff57fdbdc14b1ca2bb6685bc8db1b5f0cd2ff8d52e92841cc43fe6abbd5efcfd"
Jun 15 05:48:23.425773 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:23.425752    2564 scope.go:117] "RemoveContainer" containerID="867d51472f925fe07e5893d2ac5e647367f26eb5296a8488a9e89060ca3605b0"
Jun 15 05:48:23.425990 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:23.425966    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-kn9gn_openshift-console-operator(8bf514ab-857d-416e-b51f-2235f4cb429d)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-kn9gn" podUID="8bf514ab-857d-416e-b51f-2235f4cb429d"
Jun 15 05:48:23.753335 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:23.753255    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7d7f3f7-2380-4f93-96d6-59a58f32b056-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l4gs5\" (UID: \"c7d7f3f7-2380-4f93-96d6-59a58f32b056\") " pod="openshift-insights/insights-runtime-extractor-l4gs5"
Jun 15 05:48:23.753335 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:23.753289    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7d7f3f7-2380-4f93-96d6-59a58f32b056-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l4gs5\" (UID: \"c7d7f3f7-2380-4f93-96d6-59a58f32b056\") " pod="openshift-insights/insights-runtime-extractor-l4gs5"
Jun 15 05:48:23.753555 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:23.753395    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jun 15 05:48:23.753555 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:23.753468    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 15 05:48:23.753555 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:23.753471    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7d7f3f7-2380-4f93-96d6-59a58f32b056-kube-rbac-proxy-cm podName:c7d7f3f7-2380-4f93-96d6-59a58f32b056 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:24.753452161 +0000 UTC m=+47.119997189 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c7d7f3f7-2380-4f93-96d6-59a58f32b056-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l4gs5" (UID: "c7d7f3f7-2380-4f93-96d6-59a58f32b056") : configmap "kube-rbac-proxy" not found
Jun 15 05:48:23.753555 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:23.753526    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7d7f3f7-2380-4f93-96d6-59a58f32b056-insights-runtime-extractor-tls podName:c7d7f3f7-2380-4f93-96d6-59a58f32b056 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:24.753510555 +0000 UTC m=+47.120055586 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c7d7f3f7-2380-4f93-96d6-59a58f32b056-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l4gs5" (UID: "c7d7f3f7-2380-4f93-96d6-59a58f32b056") : secret "insights-runtime-extractor-tls" not found
Jun 15 05:48:24.431175 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:24.431150    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kn9gn_8bf514ab-857d-416e-b51f-2235f4cb429d/console-operator/1.log"
Jun 15 05:48:24.431561 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:24.431465    2564 scope.go:117] "RemoveContainer" containerID="867d51472f925fe07e5893d2ac5e647367f26eb5296a8488a9e89060ca3605b0"
Jun 15 05:48:24.431644 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:24.431626    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-kn9gn_openshift-console-operator(8bf514ab-857d-416e-b51f-2235f4cb429d)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-kn9gn" podUID="8bf514ab-857d-416e-b51f-2235f4cb429d"
Jun 15 05:48:24.762538 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:24.762457    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7d7f3f7-2380-4f93-96d6-59a58f32b056-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l4gs5\" (UID: \"c7d7f3f7-2380-4f93-96d6-59a58f32b056\") " pod="openshift-insights/insights-runtime-extractor-l4gs5"
Jun 15 05:48:24.762538 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:24.762492    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7d7f3f7-2380-4f93-96d6-59a58f32b056-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l4gs5\" (UID: \"c7d7f3f7-2380-4f93-96d6-59a58f32b056\") " pod="openshift-insights/insights-runtime-extractor-l4gs5"
Jun 15 05:48:24.762749 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:24.762595    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jun 15 05:48:24.762749 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:24.762673    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7d7f3f7-2380-4f93-96d6-59a58f32b056-kube-rbac-proxy-cm podName:c7d7f3f7-2380-4f93-96d6-59a58f32b056 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:26.76265247 +0000 UTC m=+49.129197514 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c7d7f3f7-2380-4f93-96d6-59a58f32b056-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l4gs5" (UID: "c7d7f3f7-2380-4f93-96d6-59a58f32b056") : configmap "kube-rbac-proxy" not found
Jun 15 05:48:24.762749 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:24.762673    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 15 05:48:24.762749 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:24.762730    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7d7f3f7-2380-4f93-96d6-59a58f32b056-insights-runtime-extractor-tls podName:c7d7f3f7-2380-4f93-96d6-59a58f32b056 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:26.762718906 +0000 UTC m=+49.129263935 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c7d7f3f7-2380-4f93-96d6-59a58f32b056-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l4gs5" (UID: "c7d7f3f7-2380-4f93-96d6-59a58f32b056") : secret "insights-runtime-extractor-tls" not found
Jun 15 05:48:24.922590 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:24.922563    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qdcqb_9ff3747f-c776-4f08-b35b-6d886f1e3cfc/dns-node-resolver/0.log"
Jun 15 05:48:25.710793 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:25.710755    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8v9wt_01d7cf7a-bc4a-43be-a3b0-10d8e29e8735/node-ca/0.log"
Jun 15 05:48:26.325010 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:26.324987    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-42blt_caf71ecd-2952-4e38-947b-9e18f1341517/serve-healthcheck-canary/0.log"
Jun 15 05:48:26.781678 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:26.781618    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7d7f3f7-2380-4f93-96d6-59a58f32b056-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l4gs5\" (UID: \"c7d7f3f7-2380-4f93-96d6-59a58f32b056\") " pod="openshift-insights/insights-runtime-extractor-l4gs5"
Jun 15 05:48:26.781678 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:26.781680    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7d7f3f7-2380-4f93-96d6-59a58f32b056-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l4gs5\" (UID: \"c7d7f3f7-2380-4f93-96d6-59a58f32b056\") " pod="openshift-insights/insights-runtime-extractor-l4gs5"
Jun 15 05:48:26.782144 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:26.781748    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jun 15 05:48:26.782144 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:26.781788    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 15 05:48:26.782144 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:26.781812    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7d7f3f7-2380-4f93-96d6-59a58f32b056-kube-rbac-proxy-cm podName:c7d7f3f7-2380-4f93-96d6-59a58f32b056 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:30.781797639 +0000 UTC m=+53.148342668 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c7d7f3f7-2380-4f93-96d6-59a58f32b056-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l4gs5" (UID: "c7d7f3f7-2380-4f93-96d6-59a58f32b056") : configmap "kube-rbac-proxy" not found
Jun 15 05:48:26.782144 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:26.781842    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7d7f3f7-2380-4f93-96d6-59a58f32b056-insights-runtime-extractor-tls podName:c7d7f3f7-2380-4f93-96d6-59a58f32b056 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:30.781826492 +0000 UTC m=+53.148371543 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c7d7f3f7-2380-4f93-96d6-59a58f32b056-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l4gs5" (UID: "c7d7f3f7-2380-4f93-96d6-59a58f32b056") : secret "insights-runtime-extractor-tls" not found
Jun 15 05:48:28.897527 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:28.897488    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/03282db6-9df2-4e5f-b462-d7d252ccef87-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-9jqt9\" (UID: \"03282db6-9df2-4e5f-b462-d7d252ccef87\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9jqt9"
Jun 15 05:48:28.897527 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:28.897530    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6b663716-76fa-4580-afdb-73c283d06ac2-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-gbgcf\" (UID: \"6b663716-76fa-4580-afdb-73c283d06ac2\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-gbgcf"
Jun 15 05:48:28.897993 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:28.897556    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc17a9a3-092b-4007-b1dc-5860349dc4a0-metrics-certs\") pod \"router-default-67dff766cb-95zdt\" (UID: \"fc17a9a3-092b-4007-b1dc-5860349dc4a0\") " pod="openshift-ingress/router-default-67dff766cb-95zdt"
Jun 15 05:48:28.897993 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:28.897648    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 15 05:48:28.897993 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:28.897646    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 15 05:48:28.897993 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:28.897712    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc17a9a3-092b-4007-b1dc-5860349dc4a0-metrics-certs podName:fc17a9a3-092b-4007-b1dc-5860349dc4a0 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:44.897699997 +0000 UTC m=+67.264245026 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc17a9a3-092b-4007-b1dc-5860349dc4a0-metrics-certs") pod "router-default-67dff766cb-95zdt" (UID: "fc17a9a3-092b-4007-b1dc-5860349dc4a0") : secret "router-metrics-certs-default" not found
Jun 15 05:48:28.897993 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:28.897739    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b663716-76fa-4580-afdb-73c283d06ac2-networking-console-plugin-cert podName:6b663716-76fa-4580-afdb-73c283d06ac2 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:44.897725732 +0000 UTC m=+67.264270765 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6b663716-76fa-4580-afdb-73c283d06ac2-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-gbgcf" (UID: "6b663716-76fa-4580-afdb-73c283d06ac2") : secret "networking-console-plugin-cert" not found
Jun 15 05:48:28.897993 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:28.897650    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 15 05:48:28.897993 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:28.897781    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc17a9a3-092b-4007-b1dc-5860349dc4a0-service-ca-bundle\") pod \"router-default-67dff766cb-95zdt\" (UID: \"fc17a9a3-092b-4007-b1dc-5860349dc4a0\") " pod="openshift-ingress/router-default-67dff766cb-95zdt"
Jun 15 05:48:28.897993 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:28.897804    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f919e023-d50d-4b4b-bb00-28e41fd896dd-registry-tls\") pod \"image-registry-98f645c89-cjthz\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") " pod="openshift-image-registry/image-registry-98f645c89-cjthz"
Jun 15 05:48:28.897993 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:28.897822    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03282db6-9df2-4e5f-b462-d7d252ccef87-cluster-monitoring-operator-tls podName:03282db6-9df2-4e5f-b462-d7d252ccef87 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:44.897809589 +0000 UTC m=+67.264354621 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/03282db6-9df2-4e5f-b462-d7d252ccef87-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-9jqt9" (UID: "03282db6-9df2-4e5f-b462-d7d252ccef87") : secret "cluster-monitoring-operator-tls" not found
Jun 15 05:48:28.897993 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:28.897854    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 15 05:48:28.897993 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:28.897884    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-98f645c89-cjthz: secret "image-registry-tls" not found
Jun 15 05:48:28.897993 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:28.897888    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-67hw4\" (UID: \"f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-67hw4"
Jun 15 05:48:28.897993 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:28.897912    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f919e023-d50d-4b4b-bb00-28e41fd896dd-registry-tls podName:f919e023-d50d-4b4b-bb00-28e41fd896dd nodeName:}" failed. No retries permitted until 2026-06-15 05:48:44.89790362 +0000 UTC m=+67.264448648 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f919e023-d50d-4b4b-bb00-28e41fd896dd-registry-tls") pod "image-registry-98f645c89-cjthz" (UID: "f919e023-d50d-4b4b-bb00-28e41fd896dd") : secret "image-registry-tls" not found
Jun 15 05:48:28.897993 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:28.897961    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 15 05:48:28.897993 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:28.897971    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fc17a9a3-092b-4007-b1dc-5860349dc4a0-service-ca-bundle podName:fc17a9a3-092b-4007-b1dc-5860349dc4a0 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:44.897949457 +0000 UTC m=+67.264494506 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fc17a9a3-092b-4007-b1dc-5860349dc4a0-service-ca-bundle") pod "router-default-67dff766cb-95zdt" (UID: "fc17a9a3-092b-4007-b1dc-5860349dc4a0") : configmap references non-existent config key: service-ca.crt
Jun 15 05:48:28.898438 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:28.897995    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a-samples-operator-tls podName:f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a nodeName:}" failed. No retries permitted until 2026-06-15 05:48:44.897984531 +0000 UTC m=+67.264529561 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a-samples-operator-tls") pod "cluster-samples-operator-9547488fd-67hw4" (UID: "f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a") : secret "samples-operator-tls" not found
Jun 15 05:48:28.998871 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:28.998830    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4df2971e-f461-424e-a003-dcfbc0eba623-metrics-tls\") pod \"dns-default-qndls\" (UID: \"4df2971e-f461-424e-a003-dcfbc0eba623\") " pod="openshift-dns/dns-default-qndls"
Jun 15 05:48:28.999000 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:28.998962    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 15 05:48:28.999038 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:28.999007    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4df2971e-f461-424e-a003-dcfbc0eba623-metrics-tls podName:4df2971e-f461-424e-a003-dcfbc0eba623 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:44.998996148 +0000 UTC m=+67.365541176 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4df2971e-f461-424e-a003-dcfbc0eba623-metrics-tls") pod "dns-default-qndls" (UID: "4df2971e-f461-424e-a003-dcfbc0eba623") : secret "dns-default-metrics-tls" not found
Jun 15 05:48:30.812579 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:30.812542    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7d7f3f7-2380-4f93-96d6-59a58f32b056-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l4gs5\" (UID: \"c7d7f3f7-2380-4f93-96d6-59a58f32b056\") " pod="openshift-insights/insights-runtime-extractor-l4gs5"
Jun 15 05:48:30.812579 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:30.812576    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7d7f3f7-2380-4f93-96d6-59a58f32b056-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l4gs5\" (UID: \"c7d7f3f7-2380-4f93-96d6-59a58f32b056\") " pod="openshift-insights/insights-runtime-extractor-l4gs5"
Jun 15 05:48:30.813020 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:30.812706    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 15 05:48:30.813020 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:30.812757    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7d7f3f7-2380-4f93-96d6-59a58f32b056-insights-runtime-extractor-tls podName:c7d7f3f7-2380-4f93-96d6-59a58f32b056 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:38.81274486 +0000 UTC m=+61.179289888 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c7d7f3f7-2380-4f93-96d6-59a58f32b056-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l4gs5" (UID: "c7d7f3f7-2380-4f93-96d6-59a58f32b056") : secret "insights-runtime-extractor-tls" not found
Jun 15 05:48:30.813134 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:30.813112    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7d7f3f7-2380-4f93-96d6-59a58f32b056-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l4gs5\" (UID: \"c7d7f3f7-2380-4f93-96d6-59a58f32b056\") " pod="openshift-insights/insights-runtime-extractor-l4gs5"
Jun 15 05:48:33.350011 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:33.349977    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-kn9gn"
Jun 15 05:48:33.350357 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:33.350052    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-kn9gn"
Jun 15 05:48:33.350357 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:33.350328    2564 scope.go:117] "RemoveContainer" containerID="867d51472f925fe07e5893d2ac5e647367f26eb5296a8488a9e89060ca3605b0"
Jun 15 05:48:33.466592 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:33.466568    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kn9gn_8bf514ab-857d-416e-b51f-2235f4cb429d/console-operator/1.log"
Jun 15 05:48:33.466714 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:33.466648    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-kn9gn" event={"ID":"8bf514ab-857d-416e-b51f-2235f4cb429d","Type":"ContainerStarted","Data":"2a1628a8c6bbef4c6cfe9cea5761e9d95985a16aad481debbf9f0a5bbb06a7aa"}
Jun 15 05:48:33.466926 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:33.466897    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-kn9gn"
Jun 15 05:48:33.467782 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:33.467757    2564 patch_prober.go:28] interesting pod/console-operator-5dbbb5d744-kn9gn container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.7:8443/readyz\": dial tcp 10.132.0.7:8443: connect: connection refused" start-of-body=
Jun 15 05:48:33.467896 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:33.467806    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-5dbbb5d744-kn9gn" podUID="8bf514ab-857d-416e-b51f-2235f4cb429d" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.7:8443/readyz\": dial tcp 10.132.0.7:8443: connect: connection refused"
Jun 15 05:48:33.492184 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:33.492134    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5dbbb5d744-kn9gn" podStartSLOduration=31.175343024 podStartE2EDuration="38.492117052s" totalImagesPullingTime="7.316774028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:47:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:33.491121899 +0000 UTC m=+55.857666948" watchObservedRunningTime="2026-06-15 05:48:33.492117052 +0000 UTC m=+55.858662102"
Jun 15 05:48:34.472874 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:34.472832    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5dbbb5d744-kn9gn"
Jun 15 05:48:38.880998 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:38.880951    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7d7f3f7-2380-4f93-96d6-59a58f32b056-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l4gs5\" (UID: \"c7d7f3f7-2380-4f93-96d6-59a58f32b056\") " pod="openshift-insights/insights-runtime-extractor-l4gs5"
Jun 15 05:48:38.883340 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:38.883318    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7d7f3f7-2380-4f93-96d6-59a58f32b056-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l4gs5\" (UID: \"c7d7f3f7-2380-4f93-96d6-59a58f32b056\") " pod="openshift-insights/insights-runtime-extractor-l4gs5"
Jun 15 05:48:39.039332 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:39.039300    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fsjw7\""
Jun 15 05:48:39.046710 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:39.046692    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l4gs5"
Jun 15 05:48:39.174602 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:39.174573    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l4gs5"]
Jun 15 05:48:39.177029 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:48:39.177004    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7d7f3f7_2380_4f93_96d6_59a58f32b056.slice/crio-6e8a9c06742ca20e3e78a40669a0b8ad6372cffb968380be908d30b30f58050c WatchSource:0}: Error finding container 6e8a9c06742ca20e3e78a40669a0b8ad6372cffb968380be908d30b30f58050c: Status 404 returned error can't find the container with id 6e8a9c06742ca20e3e78a40669a0b8ad6372cffb968380be908d30b30f58050c
Jun 15 05:48:39.323482 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:39.323459    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7qndp"
Jun 15 05:48:39.483463 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:39.483367    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l4gs5" event={"ID":"c7d7f3f7-2380-4f93-96d6-59a58f32b056","Type":"ContainerStarted","Data":"6e8a9c06742ca20e3e78a40669a0b8ad6372cffb968380be908d30b30f58050c"}
Jun 15 05:48:43.497325 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:43.497239    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l4gs5" event={"ID":"c7d7f3f7-2380-4f93-96d6-59a58f32b056","Type":"ContainerStarted","Data":"3f56ae2803e13334cd392262d18c667050ee06bf22575fb60f313e76c520d4f2"}
Jun 15 05:48:43.497325 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:43.497307    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l4gs5" event={"ID":"c7d7f3f7-2380-4f93-96d6-59a58f32b056","Type":"ContainerStarted","Data":"b08acca6ccb14556e29fe237a276b595108de24ec493e68fc5b1694f6c9e3867"}
Jun 15 05:48:43.830365 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:43.830282    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80312796-b102-426c-a974-354e77b12b12-original-pull-secret\") pod \"global-pull-secret-syncer-xl66m\" (UID: \"80312796-b102-426c-a974-354e77b12b12\") " pod="kube-system/global-pull-secret-syncer-xl66m"
Jun 15 05:48:43.833184 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:43.833164    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 15 05:48:43.843584 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:43.843546    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80312796-b102-426c-a974-354e77b12b12-original-pull-secret\") pod \"global-pull-secret-syncer-xl66m\" (UID: \"80312796-b102-426c-a974-354e77b12b12\") " pod="kube-system/global-pull-secret-syncer-xl66m"
Jun 15 05:48:43.931021 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:43.930984    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecbcc04e-289f-482a-b26e-49a2cee2e45f-metrics-certs\") pod \"network-metrics-daemon-qm5gv\" (UID: \"ecbcc04e-289f-482a-b26e-49a2cee2e45f\") " pod="openshift-multus/network-metrics-daemon-qm5gv"
Jun 15 05:48:43.933919 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:43.933893    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 15 05:48:43.944011 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:43.943984    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecbcc04e-289f-482a-b26e-49a2cee2e45f-metrics-certs\") pod \"network-metrics-daemon-qm5gv\" (UID: \"ecbcc04e-289f-482a-b26e-49a2cee2e45f\") " pod="openshift-multus/network-metrics-daemon-qm5gv"
Jun 15 05:48:44.031937 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:44.031904    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbdhd\" (UniqueName: \"kubernetes.io/projected/2b0e234e-c49a-4504-9737-8d32181944e5-kube-api-access-sbdhd\") pod \"network-check-target-jg5zt\" (UID: \"2b0e234e-c49a-4504-9737-8d32181944e5\") " pod="openshift-network-diagnostics/network-check-target-jg5zt"
Jun 15 05:48:44.034913 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:44.034891    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbdhd\" (UniqueName: \"kubernetes.io/projected/2b0e234e-c49a-4504-9737-8d32181944e5-kube-api-access-sbdhd\") pod \"network-check-target-jg5zt\" (UID: \"2b0e234e-c49a-4504-9737-8d32181944e5\") " pod="openshift-network-diagnostics/network-check-target-jg5zt"
Jun 15 05:48:44.049092 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:44.049069    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sh6m9\""
Jun 15 05:48:44.053784 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:44.053763    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl66m"
Jun 15 05:48:44.055947 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:44.055920    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jg5zt"
Jun 15 05:48:44.061115 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:44.061092    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4mr6w\""
Jun 15 05:48:44.069241 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:44.069226    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qm5gv"
Jun 15 05:48:44.273309 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:44.273275    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xl66m"]
Jun 15 05:48:44.276710 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:48:44.276680    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80312796_b102_426c_a974_354e77b12b12.slice/crio-5a8fff62f17b8e60a169f0e6bb4f1a66bbbed001f64df4bccb8c208703004f16 WatchSource:0}: Error finding container 5a8fff62f17b8e60a169f0e6bb4f1a66bbbed001f64df4bccb8c208703004f16: Status 404 returned error can't find the container with id 5a8fff62f17b8e60a169f0e6bb4f1a66bbbed001f64df4bccb8c208703004f16
Jun 15 05:48:44.280616 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:44.280594    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jg5zt"]
Jun 15 05:48:44.284771 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:48:44.284750    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b0e234e_c49a_4504_9737_8d32181944e5.slice/crio-2e6fdc06f737b9f25a8df7b9e2b1de54a5fad874a633a7c0abfa9ccb29d89d52 WatchSource:0}: Error finding container 2e6fdc06f737b9f25a8df7b9e2b1de54a5fad874a633a7c0abfa9ccb29d89d52: Status 404 returned error can't find the container with id 2e6fdc06f737b9f25a8df7b9e2b1de54a5fad874a633a7c0abfa9ccb29d89d52
Jun 15 05:48:44.289076 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:44.288448    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qm5gv"]
Jun 15 05:48:44.290375 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:48:44.290348    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecbcc04e_289f_482a_b26e_49a2cee2e45f.slice/crio-6b163baf3a5a549b5fe61db55b8bb22e60d29a1d015a5fbf907241a692c824fa WatchSource:0}: Error finding container 6b163baf3a5a549b5fe61db55b8bb22e60d29a1d015a5fbf907241a692c824fa: Status 404 returned error can't find the container with id 6b163baf3a5a549b5fe61db55b8bb22e60d29a1d015a5fbf907241a692c824fa
Jun 15 05:48:44.505005 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:44.504967    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jg5zt" event={"ID":"2b0e234e-c49a-4504-9737-8d32181944e5","Type":"ContainerStarted","Data":"afbd8049550e9c3419b7c15e989b566edcb4802abb378fc86acdf6af97f756d4"}
Jun 15 05:48:44.505546 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:44.505027    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jg5zt" event={"ID":"2b0e234e-c49a-4504-9737-8d32181944e5","Type":"ContainerStarted","Data":"2e6fdc06f737b9f25a8df7b9e2b1de54a5fad874a633a7c0abfa9ccb29d89d52"}
Jun 15 05:48:44.505546 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:44.505074    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jg5zt"
Jun 15 05:48:44.506613 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:44.506592    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xl66m" event={"ID":"80312796-b102-426c-a974-354e77b12b12","Type":"ContainerStarted","Data":"5a8fff62f17b8e60a169f0e6bb4f1a66bbbed001f64df4bccb8c208703004f16"}
Jun 15 05:48:44.507879 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:44.507825    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qm5gv" event={"ID":"ecbcc04e-289f-482a-b26e-49a2cee2e45f","Type":"ContainerStarted","Data":"6b163baf3a5a549b5fe61db55b8bb22e60d29a1d015a5fbf907241a692c824fa"}
Jun 15 05:48:44.530083 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:44.530037    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jg5zt" podStartSLOduration=66.530023399 podStartE2EDuration="1m6.530023399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:47:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:44.528761234 +0000 UTC m=+66.895306283" watchObservedRunningTime="2026-06-15 05:48:44.530023399 +0000 UTC m=+66.896568450"
Jun 15 05:48:44.941929 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:44.941894    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc17a9a3-092b-4007-b1dc-5860349dc4a0-service-ca-bundle\") pod \"router-default-67dff766cb-95zdt\" (UID: \"fc17a9a3-092b-4007-b1dc-5860349dc4a0\") " pod="openshift-ingress/router-default-67dff766cb-95zdt"
Jun 15 05:48:44.942116 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:44.941938    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f919e023-d50d-4b4b-bb00-28e41fd896dd-registry-tls\") pod \"image-registry-98f645c89-cjthz\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") " pod="openshift-image-registry/image-registry-98f645c89-cjthz"
Jun 15 05:48:44.942116 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:44.942021    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-67hw4\" (UID: \"f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-67hw4"
Jun 15 05:48:44.942116 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:44.942094    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/03282db6-9df2-4e5f-b462-d7d252ccef87-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-9jqt9\" (UID: \"03282db6-9df2-4e5f-b462-d7d252ccef87\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9jqt9"
Jun 15 05:48:44.942280 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:44.942121    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6b663716-76fa-4580-afdb-73c283d06ac2-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-gbgcf\" (UID: \"6b663716-76fa-4580-afdb-73c283d06ac2\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-gbgcf"
Jun 15 05:48:44.942280 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:44.942142    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc17a9a3-092b-4007-b1dc-5860349dc4a0-metrics-certs\") pod \"router-default-67dff766cb-95zdt\" (UID: \"fc17a9a3-092b-4007-b1dc-5860349dc4a0\") " pod="openshift-ingress/router-default-67dff766cb-95zdt"
Jun 15 05:48:44.942738 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:44.942703    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc17a9a3-092b-4007-b1dc-5860349dc4a0-service-ca-bundle\") pod \"router-default-67dff766cb-95zdt\" (UID: \"fc17a9a3-092b-4007-b1dc-5860349dc4a0\") " pod="openshift-ingress/router-default-67dff766cb-95zdt"
Jun 15 05:48:44.944783 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:44.944756    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc17a9a3-092b-4007-b1dc-5860349dc4a0-metrics-certs\") pod \"router-default-67dff766cb-95zdt\" (UID: \"fc17a9a3-092b-4007-b1dc-5860349dc4a0\") " pod="openshift-ingress/router-default-67dff766cb-95zdt"
Jun 15 05:48:44.944883 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:44.944756    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6b663716-76fa-4580-afdb-73c283d06ac2-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-gbgcf\" (UID: \"6b663716-76fa-4580-afdb-73c283d06ac2\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-gbgcf"
Jun 15 05:48:44.944883 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:44.944806    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-67hw4\" (UID: \"f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-67hw4"
Jun 15 05:48:44.945105 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:44.945087    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f919e023-d50d-4b4b-bb00-28e41fd896dd-registry-tls\") pod \"image-registry-98f645c89-cjthz\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") " pod="openshift-image-registry/image-registry-98f645c89-cjthz"
Jun 15 05:48:44.945149 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:44.945121    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/03282db6-9df2-4e5f-b462-d7d252ccef87-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-9jqt9\" (UID: \"03282db6-9df2-4e5f-b462-d7d252ccef87\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9jqt9"
Jun 15 05:48:45.043025 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:45.042995    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4df2971e-f461-424e-a003-dcfbc0eba623-metrics-tls\") pod \"dns-default-qndls\" (UID: \"4df2971e-f461-424e-a003-dcfbc0eba623\") " pod="openshift-dns/dns-default-qndls"
Jun 15 05:48:45.045129 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:45.045110    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4df2971e-f461-424e-a003-dcfbc0eba623-metrics-tls\") pod \"dns-default-qndls\" (UID: \"4df2971e-f461-424e-a003-dcfbc0eba623\") " pod="openshift-dns/dns-default-qndls"
Jun 15 05:48:45.187338 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:45.187312    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mxmkk\""
Jun 15 05:48:45.193351 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:45.193310    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6qs5n\""
Jun 15 05:48:45.195414 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:45.195399    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-67hw4"
Jun 15 05:48:45.199400 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:45.199384    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-f6j57\""
Jun 15 05:48:45.201521 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:45.201508    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-98f645c89-cjthz"
Jun 15 05:48:45.205307 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:45.205294    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hm76g\""
Jun 15 05:48:45.207393 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:45.207380    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9jqt9"
Jun 15 05:48:45.212625 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:45.212609    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-tm7j2\""
Jun 15 05:48:45.213720 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:45.213697    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-67dff766cb-95zdt"
Jun 15 05:48:45.220758 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:45.220745    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-gbgcf"
Jun 15 05:48:45.234758 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:45.234737    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bq4gf\""
Jun 15 05:48:45.242248 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:45.242208    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qndls"
Jun 15 05:48:45.381536 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:45.381449    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-67hw4"]
Jun 15 05:48:45.475759 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:45.475679    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qndls"]
Jun 15 05:48:45.481963 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:45.481896    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-9jqt9"]
Jun 15 05:48:45.486300 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:48:45.486237    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03282db6_9df2_4e5f_b462_d7d252ccef87.slice/crio-2a901d14b0f2a2411eda527f2c4c5ad9a738cb4642ab99872f386a7eadae5609 WatchSource:0}: Error finding container 2a901d14b0f2a2411eda527f2c4c5ad9a738cb4642ab99872f386a7eadae5609: Status 404 returned error can't find the container with id 2a901d14b0f2a2411eda527f2c4c5ad9a738cb4642ab99872f386a7eadae5609
Jun 15 05:48:45.503585 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:45.503536    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-98f645c89-cjthz"]
Jun 15 05:48:45.516837 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:45.516761    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-67hw4" event={"ID":"f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a","Type":"ContainerStarted","Data":"fd1f8676efca1a7a62a1b5d04a9950106a7c146495d2dd3c65469c22a60afd46"}
Jun 15 05:48:45.519252 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:45.519164    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-98f645c89-cjthz" event={"ID":"f919e023-d50d-4b4b-bb00-28e41fd896dd","Type":"ContainerStarted","Data":"a80f7b6afcc85e9883b654aea42aba6da7c7b5f9fae184a52fc5975a65a1505d"}
Jun 15 05:48:45.522380 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:45.522344    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l4gs5" event={"ID":"c7d7f3f7-2380-4f93-96d6-59a58f32b056","Type":"ContainerStarted","Data":"1ffb1abd2024857b25613ff2e0809662b6ae8a9434734fd69be666c48872b221"}
Jun 15 05:48:45.524494 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:45.524443    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qndls" event={"ID":"4df2971e-f461-424e-a003-dcfbc0eba623","Type":"ContainerStarted","Data":"339e416644e98169a3580dba5c532e3e2a9ebc66212729b469d0b13024de9614"}
Jun 15 05:48:45.525960 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:45.525935    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9jqt9" event={"ID":"03282db6-9df2-4e5f-b462-d7d252ccef87","Type":"ContainerStarted","Data":"2a901d14b0f2a2411eda527f2c4c5ad9a738cb4642ab99872f386a7eadae5609"}
Jun 15 05:48:45.535101 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:45.535032    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-gbgcf"]
Jun 15 05:48:45.537017 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:45.536994    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-67dff766cb-95zdt"]
Jun 15 05:48:45.548332 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:45.547814    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-l4gs5" podStartSLOduration=16.584234508 podStartE2EDuration="22.547799328s" totalImagesPullingTime="5.96356482s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:48:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:45.547095573 +0000 UTC m=+67.913640624" watchObservedRunningTime="2026-06-15 05:48:45.547799328 +0000 UTC m=+67.914344379"
Jun 15 05:48:45.549477 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:48:45.548722    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b663716_76fa_4580_afdb_73c283d06ac2.slice/crio-f46c217321826fb5a9df661f50abc7125ff1f878d990f2a57eb0f7804ea4ab47 WatchSource:0}: Error finding container f46c217321826fb5a9df661f50abc7125ff1f878d990f2a57eb0f7804ea4ab47: Status 404 returned error can't find the container with id f46c217321826fb5a9df661f50abc7125ff1f878d990f2a57eb0f7804ea4ab47
Jun 15 05:48:45.550009 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:48:45.549988    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc17a9a3_092b_4007_b1dc_5860349dc4a0.slice/crio-60237959ac8fcfc261c780530ef7d9dec3aff0298947e0dc809357c7b40ca326 WatchSource:0}: Error finding container 60237959ac8fcfc261c780530ef7d9dec3aff0298947e0dc809357c7b40ca326: Status 404 returned error can't find the container with id 60237959ac8fcfc261c780530ef7d9dec3aff0298947e0dc809357c7b40ca326
Jun 15 05:48:46.534896 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:46.534270    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qm5gv" event={"ID":"ecbcc04e-289f-482a-b26e-49a2cee2e45f","Type":"ContainerStarted","Data":"4257e6b371515d06470dcd7cd636bdc95d4058eebde9585fa3f5f2385612c369"}
Jun 15 05:48:46.534896 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:46.534334    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qm5gv" event={"ID":"ecbcc04e-289f-482a-b26e-49a2cee2e45f","Type":"ContainerStarted","Data":"d3c75a8f8e497d79faa41112425bb2ad7a66bf00f6e44bd5860f6c8c638e70cb"}
Jun 15 05:48:46.538485 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:46.538452    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-gbgcf" event={"ID":"6b663716-76fa-4580-afdb-73c283d06ac2","Type":"ContainerStarted","Data":"f46c217321826fb5a9df661f50abc7125ff1f878d990f2a57eb0f7804ea4ab47"}
Jun 15 05:48:46.540628 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:46.540604    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-67dff766cb-95zdt" event={"ID":"fc17a9a3-092b-4007-b1dc-5860349dc4a0","Type":"ContainerStarted","Data":"afd95ebee587e73601c86805f5971b400086285eeadb5f08b99ed046e0c3e29a"}
Jun 15 05:48:46.540745 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:46.540650    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-67dff766cb-95zdt" event={"ID":"fc17a9a3-092b-4007-b1dc-5860349dc4a0","Type":"ContainerStarted","Data":"60237959ac8fcfc261c780530ef7d9dec3aff0298947e0dc809357c7b40ca326"}
Jun 15 05:48:46.544700 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:46.544676    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-98f645c89-cjthz" event={"ID":"f919e023-d50d-4b4b-bb00-28e41fd896dd","Type":"ContainerStarted","Data":"d7adf409c41ef9cfe5a6f3afefa5d0e7001c4452ee7f1a5be743cee6721ad30b"}
Jun 15 05:48:46.544787 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:46.544722    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-98f645c89-cjthz"
Jun 15 05:48:46.560279 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:46.559774    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qm5gv" podStartSLOduration=66.633568665 podStartE2EDuration="1m8.559754099s" totalImagesPullingTime="1.926185434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:46.558386779 +0000 UTC m=+68.924931831" watchObservedRunningTime="2026-06-15 05:48:46.559754099 +0000 UTC m=+68.926299150"
Jun 15 05:48:46.588234 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:46.587362    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-98f645c89-cjthz" podStartSLOduration=68.587343517 podStartE2EDuration="1m8.587343517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:47:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:46.586243637 +0000 UTC m=+68.952788690" watchObservedRunningTime="2026-06-15 05:48:46.587343517 +0000 UTC m=+68.953888571"
Jun 15 05:48:47.214201 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:47.214147    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-67dff766cb-95zdt"
Jun 15 05:48:47.217245 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:47.217221    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-67dff766cb-95zdt"
Jun 15 05:48:47.250526 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:47.250480    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-67dff766cb-95zdt" podStartSLOduration=52.250464662 podStartE2EDuration="52.250464662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:47:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:46.613500711 +0000 UTC m=+68.980045761" watchObservedRunningTime="2026-06-15 05:48:47.250464662 +0000 UTC m=+69.617009714"
Jun 15 05:48:47.548663 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:47.548589    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-67dff766cb-95zdt"
Jun 15 05:48:47.550274 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:47.550249    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-67dff766cb-95zdt"
Jun 15 05:48:49.800080 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:49.800042    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b6d887d56-gsvgp"]
Jun 15 05:48:49.804066 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:49.804045    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b6d887d56-gsvgp"
Jun 15 05:48:49.808319 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:49.807908    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jun 15 05:48:49.808319 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:49.808085    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jun 15 05:48:49.808319 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:49.808166    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jun 15 05:48:49.808542 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:49.808459    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jun 15 05:48:49.818765 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:49.818740    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b6d887d56-gsvgp"]
Jun 15 05:48:49.872441 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:49.871751    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-694c955b9-657c9"]
Jun 15 05:48:49.875203 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:49.875182    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-657c9"
Jun 15 05:48:49.878135 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:49.877986    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-6zjb6\""
Jun 15 05:48:49.878135 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:49.878038    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jun 15 05:48:49.878473 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:49.878456    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jun 15 05:48:49.890011 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:49.889981    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-657c9"]
Jun 15 05:48:49.988373 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:49.988346    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frgn2\" (UniqueName: \"kubernetes.io/projected/4d527272-25fb-4bae-88f7-e940eac6739d-kube-api-access-frgn2\") pod \"klusterlet-addon-workmgr-b6d887d56-gsvgp\" (UID: \"4d527272-25fb-4bae-88f7-e940eac6739d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b6d887d56-gsvgp"
Jun 15 05:48:49.988537 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:49.988470    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4d527272-25fb-4bae-88f7-e940eac6739d-klusterlet-config\") pod \"klusterlet-addon-workmgr-b6d887d56-gsvgp\" (UID: \"4d527272-25fb-4bae-88f7-e940eac6739d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b6d887d56-gsvgp"
Jun 15 05:48:49.988537 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:49.988534    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vsnp\" (UniqueName: \"kubernetes.io/projected/2db45f44-748c-40ad-9c89-05ab2816c8f7-kube-api-access-2vsnp\") pod \"downloads-694c955b9-657c9\" (UID: \"2db45f44-748c-40ad-9c89-05ab2816c8f7\") " pod="openshift-console/downloads-694c955b9-657c9"
Jun 15 05:48:49.988640 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:49.988567    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d527272-25fb-4bae-88f7-e940eac6739d-tmp\") pod \"klusterlet-addon-workmgr-b6d887d56-gsvgp\" (UID: \"4d527272-25fb-4bae-88f7-e940eac6739d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b6d887d56-gsvgp"
Jun 15 05:48:50.089354 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:50.089253    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4d527272-25fb-4bae-88f7-e940eac6739d-klusterlet-config\") pod \"klusterlet-addon-workmgr-b6d887d56-gsvgp\" (UID: \"4d527272-25fb-4bae-88f7-e940eac6739d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b6d887d56-gsvgp"
Jun 15 05:48:50.089354 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:50.089330    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vsnp\" (UniqueName: \"kubernetes.io/projected/2db45f44-748c-40ad-9c89-05ab2816c8f7-kube-api-access-2vsnp\") pod \"downloads-694c955b9-657c9\" (UID: \"2db45f44-748c-40ad-9c89-05ab2816c8f7\") " pod="openshift-console/downloads-694c955b9-657c9"
Jun 15 05:48:50.089568 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:50.089362    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d527272-25fb-4bae-88f7-e940eac6739d-tmp\") pod \"klusterlet-addon-workmgr-b6d887d56-gsvgp\" (UID: \"4d527272-25fb-4bae-88f7-e940eac6739d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b6d887d56-gsvgp"
Jun 15 05:48:50.089568 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:50.089395    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frgn2\" (UniqueName: \"kubernetes.io/projected/4d527272-25fb-4bae-88f7-e940eac6739d-kube-api-access-frgn2\") pod \"klusterlet-addon-workmgr-b6d887d56-gsvgp\" (UID: \"4d527272-25fb-4bae-88f7-e940eac6739d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b6d887d56-gsvgp"
Jun 15 05:48:50.089914 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:50.089873    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d527272-25fb-4bae-88f7-e940eac6739d-tmp\") pod \"klusterlet-addon-workmgr-b6d887d56-gsvgp\" (UID: \"4d527272-25fb-4bae-88f7-e940eac6739d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b6d887d56-gsvgp"
Jun 15 05:48:50.092218 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:50.092192    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4d527272-25fb-4bae-88f7-e940eac6739d-klusterlet-config\") pod \"klusterlet-addon-workmgr-b6d887d56-gsvgp\" (UID: \"4d527272-25fb-4bae-88f7-e940eac6739d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b6d887d56-gsvgp"
Jun 15 05:48:50.101430 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:50.101401    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vsnp\" (UniqueName: \"kubernetes.io/projected/2db45f44-748c-40ad-9c89-05ab2816c8f7-kube-api-access-2vsnp\") pod \"downloads-694c955b9-657c9\" (UID: \"2db45f44-748c-40ad-9c89-05ab2816c8f7\") " pod="openshift-console/downloads-694c955b9-657c9"
Jun 15 05:48:50.101555 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:50.101460    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frgn2\" (UniqueName: \"kubernetes.io/projected/4d527272-25fb-4bae-88f7-e940eac6739d-kube-api-access-frgn2\") pod \"klusterlet-addon-workmgr-b6d887d56-gsvgp\" (UID: \"4d527272-25fb-4bae-88f7-e940eac6739d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b6d887d56-gsvgp"
Jun 15 05:48:50.119439 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:50.119409    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b6d887d56-gsvgp"
Jun 15 05:48:50.187344 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:50.187311    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-657c9"
Jun 15 05:48:50.437386 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:50.437270    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b6d887d56-gsvgp"]
Jun 15 05:48:50.451056 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:50.451016    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-657c9"]
Jun 15 05:48:50.459023 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:48:50.458994    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2db45f44_748c_40ad_9c89_05ab2816c8f7.slice/crio-7abcdf3cae1bd3cf433f5e1be5d8a608347c4a4f0315f56bee4edd645e9b4f80 WatchSource:0}: Error finding container 7abcdf3cae1bd3cf433f5e1be5d8a608347c4a4f0315f56bee4edd645e9b4f80: Status 404 returned error can't find the container with id 7abcdf3cae1bd3cf433f5e1be5d8a608347c4a4f0315f56bee4edd645e9b4f80
Jun 15 05:48:50.568296 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:50.567447    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b6d887d56-gsvgp" event={"ID":"4d527272-25fb-4bae-88f7-e940eac6739d","Type":"ContainerStarted","Data":"c99fa097b342511c43569b45ad49523073125fbd77805cf2037184a61991858e"}
Jun 15 05:48:50.569878 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:50.569789    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-657c9" event={"ID":"2db45f44-748c-40ad-9c89-05ab2816c8f7","Type":"ContainerStarted","Data":"7abcdf3cae1bd3cf433f5e1be5d8a608347c4a4f0315f56bee4edd645e9b4f80"}
Jun 15 05:48:50.571892 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:50.571833    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-67hw4" event={"ID":"f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a","Type":"ContainerStarted","Data":"06729e392a7f2aca29f6b2d22c5bbba3f18736d580adfa192a193bd631c9635a"}
Jun 15 05:48:50.571998 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:50.571910    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-67hw4" event={"ID":"f90c65a1-f0d1-4ea8-bb29-58a913fa7d3a","Type":"ContainerStarted","Data":"b6bc174117dfb45c2800f2ef7eecde8224c0d1f7c99d38f670ee6cbed25cac35"}
Jun 15 05:48:50.580930 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:50.580906    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xl66m" event={"ID":"80312796-b102-426c-a974-354e77b12b12","Type":"ContainerStarted","Data":"8646896c9ec8cda286ea3f9fdf6210a187e8dc8431e07934496ce4cb10b39bc5"}
Jun 15 05:48:50.582681 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:50.582658    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qndls" event={"ID":"4df2971e-f461-424e-a003-dcfbc0eba623","Type":"ContainerStarted","Data":"22c74e383c4d27fadddc047a37749398bc21727394e3da032ba307255e6926fd"}
Jun 15 05:48:50.586064 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:50.586047    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9jqt9" event={"ID":"03282db6-9df2-4e5f-b462-d7d252ccef87","Type":"ContainerStarted","Data":"5a4a75dfe7abce95890b85cbee2e598c4e198e62f36a589e2ba3052438ef2263"}
Jun 15 05:48:50.588085 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:50.588068    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-gbgcf" event={"ID":"6b663716-76fa-4580-afdb-73c283d06ac2","Type":"ContainerStarted","Data":"51a3745ee30ebfe8124c952be3603b8a6a7b3b3d5439a38fd2ab449eb5027a3f"}
Jun 15 05:48:50.593577 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:50.593503    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-67hw4" podStartSLOduration=50.781813689 podStartE2EDuration="55.593491286s" totalImagesPullingTime="4.811677597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:47:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:50.592796818 +0000 UTC m=+72.959341870" watchObservedRunningTime="2026-06-15 05:48:50.593491286 +0000 UTC m=+72.960036335"
Jun 15 05:48:50.653450 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:50.651991    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xl66m" podStartSLOduration=66.618340336 podStartE2EDuration="1m12.651969235s" totalImagesPullingTime="6.033628899s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:50.651420357 +0000 UTC m=+73.017965409" watchObservedRunningTime="2026-06-15 05:48:50.651969235 +0000 UTC m=+73.018514285"
Jun 15 05:48:50.653450 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:50.652392    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9jqt9" podStartSLOduration=50.884569867 podStartE2EDuration="55.652381749s" totalImagesPullingTime="4.767811882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:47:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:50.626545644 +0000 UTC m=+72.993090696" watchObservedRunningTime="2026-06-15 05:48:50.652381749 +0000 UTC m=+73.018926800"
Jun 15 05:48:50.674932 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:50.674880    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-867b76cb74-gbgcf" podStartSLOduration=46.975653257 podStartE2EDuration="51.674843076s" totalImagesPullingTime="4.699189819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:50.674437938 +0000 UTC m=+73.040982995" watchObservedRunningTime="2026-06-15 05:48:50.674843076 +0000 UTC m=+73.041388126"
Jun 15 05:48:50.979568 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:50.979533    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-45lk7"]
Jun 15 05:48:50.989961 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:50.989939    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-45lk7"
Jun 15 05:48:50.992681 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:50.992659    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-45lk7"]
Jun 15 05:48:50.992783 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:50.992750    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jun 15 05:48:50.992951 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:50.992926    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-dffz2\""
Jun 15 05:48:51.097449 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:51.097397    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f3e2de53-0de1-4e9f-8365-ed9df2069272-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-45lk7\" (UID: \"f3e2de53-0de1-4e9f-8365-ed9df2069272\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-45lk7"
Jun 15 05:48:51.198701 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:51.198631    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f3e2de53-0de1-4e9f-8365-ed9df2069272-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-45lk7\" (UID: \"f3e2de53-0de1-4e9f-8365-ed9df2069272\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-45lk7"
Jun 15 05:48:51.198920 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:51.198823    2564 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jun 15 05:48:51.198980 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:48:51.198921    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3e2de53-0de1-4e9f-8365-ed9df2069272-tls-certificates podName:f3e2de53-0de1-4e9f-8365-ed9df2069272 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:51.698900157 +0000 UTC m=+74.065445188 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/f3e2de53-0de1-4e9f-8365-ed9df2069272-tls-certificates") pod "prometheus-operator-admission-webhook-5cf667749c-45lk7" (UID: "f3e2de53-0de1-4e9f-8365-ed9df2069272") : secret "prometheus-operator-admission-webhook-tls" not found
Jun 15 05:48:51.601325 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:51.601291    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qndls" event={"ID":"4df2971e-f461-424e-a003-dcfbc0eba623","Type":"ContainerStarted","Data":"c07e29fb1059e5e92b58f4ef597228638ceaff766201e9acc10ffd89145ca8d0"}
Jun 15 05:48:51.601632 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:51.601607    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qndls"
Jun 15 05:48:51.705576 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:51.702960    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f3e2de53-0de1-4e9f-8365-ed9df2069272-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-45lk7\" (UID: \"f3e2de53-0de1-4e9f-8365-ed9df2069272\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-45lk7"
Jun 15 05:48:51.710038 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:51.710000    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f3e2de53-0de1-4e9f-8365-ed9df2069272-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-45lk7\" (UID: \"f3e2de53-0de1-4e9f-8365-ed9df2069272\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-45lk7"
Jun 15 05:48:51.902655 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:51.902411    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-45lk7"
Jun 15 05:48:53.134190 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:53.134123    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qndls" podStartSLOduration=35.337038881 podStartE2EDuration="40.134098222s" totalImagesPullingTime="4.797059341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:51.624119428 +0000 UTC m=+73.990664478" watchObservedRunningTime="2026-06-15 05:48:53.134098222 +0000 UTC m=+75.500643275"
Jun 15 05:48:53.134838 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:53.134819    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-45lk7"]
Jun 15 05:48:53.137364 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:48:53.137330    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3e2de53_0de1_4e9f_8365_ed9df2069272.slice/crio-39f6ffbba08d57f0b9319e38d7e5f3b03d5528b297b9b23ac46ed95171604133 WatchSource:0}: Error finding container 39f6ffbba08d57f0b9319e38d7e5f3b03d5528b297b9b23ac46ed95171604133: Status 404 returned error can't find the container with id 39f6ffbba08d57f0b9319e38d7e5f3b03d5528b297b9b23ac46ed95171604133
Jun 15 05:48:53.614249 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:53.614213    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-45lk7" event={"ID":"f3e2de53-0de1-4e9f-8365-ed9df2069272","Type":"ContainerStarted","Data":"39f6ffbba08d57f0b9319e38d7e5f3b03d5528b297b9b23ac46ed95171604133"}
Jun 15 05:48:53.847792 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:53.847538    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fcbc854d6-lwbgg"]
Jun 15 05:48:53.868052 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:53.867117    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fcbc854d6-lwbgg"]
Jun 15 05:48:53.868052 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:53.867233    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fcbc854d6-lwbgg"
Jun 15 05:48:53.870798 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:53.870742    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jun 15 05:48:53.871050 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:53.871025    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jun 15 05:48:53.871194 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:53.871171    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qvwbv\""
Jun 15 05:48:53.871326 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:53.871300    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jun 15 05:48:53.871407 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:53.871389    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jun 15 05:48:53.871460 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:53.871029    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jun 15 05:48:54.020969 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:54.020930    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d-console-serving-cert\") pod \"console-6fcbc854d6-lwbgg\" (UID: \"c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d\") " pod="openshift-console/console-6fcbc854d6-lwbgg"
Jun 15 05:48:54.021142 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:54.020983    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmhq8\" (UniqueName: \"kubernetes.io/projected/c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d-kube-api-access-lmhq8\") pod \"console-6fcbc854d6-lwbgg\" (UID: \"c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d\") " pod="openshift-console/console-6fcbc854d6-lwbgg"
Jun 15 05:48:54.021142 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:54.021028    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d-service-ca\") pod \"console-6fcbc854d6-lwbgg\" (UID: \"c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d\") " pod="openshift-console/console-6fcbc854d6-lwbgg"
Jun 15 05:48:54.021142 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:54.021064    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d-oauth-serving-cert\") pod \"console-6fcbc854d6-lwbgg\" (UID: \"c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d\") " pod="openshift-console/console-6fcbc854d6-lwbgg"
Jun 15 05:48:54.021282 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:54.021154    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d-console-config\") pod \"console-6fcbc854d6-lwbgg\" (UID: \"c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d\") " pod="openshift-console/console-6fcbc854d6-lwbgg"
Jun 15 05:48:54.021282 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:54.021204    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d-console-oauth-config\") pod \"console-6fcbc854d6-lwbgg\" (UID: \"c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d\") " pod="openshift-console/console-6fcbc854d6-lwbgg"
Jun 15 05:48:54.122119 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:54.122040    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d-console-serving-cert\") pod \"console-6fcbc854d6-lwbgg\" (UID: \"c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d\") " pod="openshift-console/console-6fcbc854d6-lwbgg"
Jun 15 05:48:54.122119 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:54.122088    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmhq8\" (UniqueName: \"kubernetes.io/projected/c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d-kube-api-access-lmhq8\") pod \"console-6fcbc854d6-lwbgg\" (UID: \"c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d\") " pod="openshift-console/console-6fcbc854d6-lwbgg"
Jun 15 05:48:54.122329 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:54.122129    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d-service-ca\") pod \"console-6fcbc854d6-lwbgg\" (UID: \"c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d\") " pod="openshift-console/console-6fcbc854d6-lwbgg"
Jun 15 05:48:54.122329 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:54.122162    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d-oauth-serving-cert\") pod \"console-6fcbc854d6-lwbgg\" (UID: \"c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d\") " pod="openshift-console/console-6fcbc854d6-lwbgg"
Jun 15 05:48:54.122329 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:54.122195    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d-console-config\") pod \"console-6fcbc854d6-lwbgg\" (UID: \"c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d\") " pod="openshift-console/console-6fcbc854d6-lwbgg"
Jun 15 05:48:54.122329 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:54.122219    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d-console-oauth-config\") pod \"console-6fcbc854d6-lwbgg\" (UID: \"c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d\") " pod="openshift-console/console-6fcbc854d6-lwbgg"
Jun 15 05:48:54.124355 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:54.123306    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d-service-ca\") pod \"console-6fcbc854d6-lwbgg\" (UID: \"c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d\") " pod="openshift-console/console-6fcbc854d6-lwbgg"
Jun 15 05:48:54.124355 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:54.124325    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d-oauth-serving-cert\") pod \"console-6fcbc854d6-lwbgg\" (UID: \"c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d\") " pod="openshift-console/console-6fcbc854d6-lwbgg"
Jun 15 05:48:54.124522 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:54.124496    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d-console-config\") pod \"console-6fcbc854d6-lwbgg\" (UID: \"c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d\") " pod="openshift-console/console-6fcbc854d6-lwbgg"
Jun 15 05:48:54.125036 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:54.125016    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d-console-oauth-config\") pod \"console-6fcbc854d6-lwbgg\" (UID: \"c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d\") " pod="openshift-console/console-6fcbc854d6-lwbgg"
Jun 15 05:48:54.126896 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:54.126853    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d-console-serving-cert\") pod \"console-6fcbc854d6-lwbgg\" (UID: \"c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d\") " pod="openshift-console/console-6fcbc854d6-lwbgg"
Jun 15 05:48:54.135504 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:54.135483    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmhq8\" (UniqueName: \"kubernetes.io/projected/c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d-kube-api-access-lmhq8\") pod \"console-6fcbc854d6-lwbgg\" (UID: \"c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d\") " pod="openshift-console/console-6fcbc854d6-lwbgg"
Jun 15 05:48:54.181078 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:54.180839    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fcbc854d6-lwbgg"
Jun 15 05:48:56.268178 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:56.268142    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fcbc854d6-lwbgg"]
Jun 15 05:48:56.272545 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:48:56.272517    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2b55ca1_f430_4ffc_9fc4_48b8ff1b7a8d.slice/crio-f20817c87c4ae04613fc76c053b2d787b966f863f69612a670f4fb2b76d25829 WatchSource:0}: Error finding container f20817c87c4ae04613fc76c053b2d787b966f863f69612a670f4fb2b76d25829: Status 404 returned error can't find the container with id f20817c87c4ae04613fc76c053b2d787b966f863f69612a670f4fb2b76d25829
Jun 15 05:48:56.630790 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:56.630371    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b6d887d56-gsvgp" event={"ID":"4d527272-25fb-4bae-88f7-e940eac6739d","Type":"ContainerStarted","Data":"37a7773487480eb089fe9df0abee41f8b3e89154fbd6e6af15d90cd5cba5e71d"}
Jun 15 05:48:56.630790 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:56.630443    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b6d887d56-gsvgp"
Jun 15 05:48:56.632364 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:56.632332    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-45lk7" event={"ID":"f3e2de53-0de1-4e9f-8365-ed9df2069272","Type":"ContainerStarted","Data":"3f7dd2f1c6d3517bcf84c94aae20c7dcee29be8ef97507a1e50fbf6678f73ba1"}
Jun 15 05:48:56.632473 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:56.632392    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-45lk7"
Jun 15 05:48:56.632658 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:56.632639    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b6d887d56-gsvgp"
Jun 15 05:48:56.633958 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:56.633934    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fcbc854d6-lwbgg" event={"ID":"c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d","Type":"ContainerStarted","Data":"f20817c87c4ae04613fc76c053b2d787b966f863f69612a670f4fb2b76d25829"}
Jun 15 05:48:56.637522 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:56.637500    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-45lk7"
Jun 15 05:48:56.651025 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:56.650986    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b6d887d56-gsvgp" podStartSLOduration=1.9807775250000001 podStartE2EDuration="7.650972429s" totalImagesPullingTime="5.670194904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:56.648522694 +0000 UTC m=+79.015067743" watchObservedRunningTime="2026-06-15 05:48:56.650972429 +0000 UTC m=+79.017517478"
Jun 15 05:48:56.669092 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:56.669033    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-45lk7" podStartSLOduration=3.691789924 podStartE2EDuration="6.669014571s" totalImagesPullingTime="2.977224647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:48:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:56.667373352 +0000 UTC m=+79.033918403" watchObservedRunningTime="2026-06-15 05:48:56.669014571 +0000 UTC m=+79.035559619"
Jun 15 05:48:59.651671 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:59.651619    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fcbc854d6-lwbgg" event={"ID":"c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d","Type":"ContainerStarted","Data":"3b8cbbc3040a9fd7ffe4eabe2974201d017faea6a43b2303ce3917c940c75adf"}
Jun 15 05:48:59.681878 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:48:59.681819    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fcbc854d6-lwbgg" podStartSLOduration=3.458126256 podStartE2EDuration="6.681804736s" totalImagesPullingTime="3.22367848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:48:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:59.681594261 +0000 UTC m=+82.048139308" watchObservedRunningTime="2026-06-15 05:48:59.681804736 +0000 UTC m=+82.048349787"
Jun 15 05:49:02.616584 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:02.616554    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qndls"
Jun 15 05:49:04.181504 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:04.181465    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fcbc854d6-lwbgg"
Jun 15 05:49:04.182007 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:04.181839    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6fcbc854d6-lwbgg"
Jun 15 05:49:04.188782 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:04.188575    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6fcbc854d6-lwbgg"
Jun 15 05:49:04.672945 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:04.671488    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-v78lm"]
Jun 15 05:49:04.804901 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:04.804851    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6fcbc854d6-lwbgg"
Jun 15 05:49:04.805103 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:04.805083    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v78lm"
Jun 15 05:49:04.808642 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:04.808282    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jun 15 05:49:04.808642 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:04.808308    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5jhpc\""
Jun 15 05:49:04.808642 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:04.808533    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jun 15 05:49:04.809323 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:04.809296    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jun 15 05:49:04.809532 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:04.809512    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jun 15 05:49:04.917528 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:04.917496    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70d9d755-3947-4657-9cb3-f86f1108c503-metrics-client-ca\") pod \"node-exporter-v78lm\" (UID: \"70d9d755-3947-4657-9cb3-f86f1108c503\") " pod="openshift-monitoring/node-exporter-v78lm"
Jun 15 05:49:04.917528 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:04.917533    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/70d9d755-3947-4657-9cb3-f86f1108c503-node-exporter-tls\") pod \"node-exporter-v78lm\" (UID: \"70d9d755-3947-4657-9cb3-f86f1108c503\") " pod="openshift-monitoring/node-exporter-v78lm"
Jun 15 05:49:04.917762 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:04.917561    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/70d9d755-3947-4657-9cb3-f86f1108c503-node-exporter-accelerators-collector-config\") pod \"node-exporter-v78lm\" (UID: \"70d9d755-3947-4657-9cb3-f86f1108c503\") " pod="openshift-monitoring/node-exporter-v78lm"
Jun 15 05:49:04.917762 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:04.917636    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/70d9d755-3947-4657-9cb3-f86f1108c503-node-exporter-textfile\") pod \"node-exporter-v78lm\" (UID: \"70d9d755-3947-4657-9cb3-f86f1108c503\") " pod="openshift-monitoring/node-exporter-v78lm"
Jun 15 05:49:04.917762 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:04.917705    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ljjk\" (UniqueName: \"kubernetes.io/projected/70d9d755-3947-4657-9cb3-f86f1108c503-kube-api-access-4ljjk\") pod \"node-exporter-v78lm\" (UID: \"70d9d755-3947-4657-9cb3-f86f1108c503\") " pod="openshift-monitoring/node-exporter-v78lm"
Jun 15 05:49:04.917942 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:04.917795    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70d9d755-3947-4657-9cb3-f86f1108c503-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v78lm\" (UID: \"70d9d755-3947-4657-9cb3-f86f1108c503\") " pod="openshift-monitoring/node-exporter-v78lm"
Jun 15 05:49:04.917942 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:04.917832    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70d9d755-3947-4657-9cb3-f86f1108c503-sys\") pod \"node-exporter-v78lm\" (UID: \"70d9d755-3947-4657-9cb3-f86f1108c503\") " pod="openshift-monitoring/node-exporter-v78lm"
Jun 15 05:49:04.917942 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:04.917894    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/70d9d755-3947-4657-9cb3-f86f1108c503-root\") pod \"node-exporter-v78lm\" (UID: \"70d9d755-3947-4657-9cb3-f86f1108c503\") " pod="openshift-monitoring/node-exporter-v78lm"
Jun 15 05:49:04.917942 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:04.917932    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/70d9d755-3947-4657-9cb3-f86f1108c503-node-exporter-wtmp\") pod \"node-exporter-v78lm\" (UID: \"70d9d755-3947-4657-9cb3-f86f1108c503\") " pod="openshift-monitoring/node-exporter-v78lm"
Jun 15 05:49:05.018774 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:05.018681    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/70d9d755-3947-4657-9cb3-f86f1108c503-node-exporter-tls\") pod \"node-exporter-v78lm\" (UID: \"70d9d755-3947-4657-9cb3-f86f1108c503\") " pod="openshift-monitoring/node-exporter-v78lm"
Jun 15 05:49:05.018774 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:05.018722    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/70d9d755-3947-4657-9cb3-f86f1108c503-node-exporter-accelerators-collector-config\") pod \"node-exporter-v78lm\" (UID: \"70d9d755-3947-4657-9cb3-f86f1108c503\") " pod="openshift-monitoring/node-exporter-v78lm"
Jun 15 05:49:05.018774 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:05.018761    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/70d9d755-3947-4657-9cb3-f86f1108c503-node-exporter-textfile\") pod \"node-exporter-v78lm\" (UID: \"70d9d755-3947-4657-9cb3-f86f1108c503\") " pod="openshift-monitoring/node-exporter-v78lm"
Jun 15 05:49:05.019069 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:05.018796    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ljjk\" (UniqueName: \"kubernetes.io/projected/70d9d755-3947-4657-9cb3-f86f1108c503-kube-api-access-4ljjk\") pod \"node-exporter-v78lm\" (UID: \"70d9d755-3947-4657-9cb3-f86f1108c503\") " pod="openshift-monitoring/node-exporter-v78lm"
Jun 15 05:49:05.019069 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:05.018871    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70d9d755-3947-4657-9cb3-f86f1108c503-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v78lm\" (UID: \"70d9d755-3947-4657-9cb3-f86f1108c503\") " pod="openshift-monitoring/node-exporter-v78lm"
Jun 15 05:49:05.019069 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:05.018909    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70d9d755-3947-4657-9cb3-f86f1108c503-sys\") pod \"node-exporter-v78lm\" (UID: \"70d9d755-3947-4657-9cb3-f86f1108c503\") " pod="openshift-monitoring/node-exporter-v78lm"
Jun 15 05:49:05.019069 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:05.018948    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/70d9d755-3947-4657-9cb3-f86f1108c503-root\") pod \"node-exporter-v78lm\" (UID: \"70d9d755-3947-4657-9cb3-f86f1108c503\") " pod="openshift-monitoring/node-exporter-v78lm"
Jun 15 05:49:05.019069 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:05.018988    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/70d9d755-3947-4657-9cb3-f86f1108c503-node-exporter-wtmp\") pod \"node-exporter-v78lm\" (UID: \"70d9d755-3947-4657-9cb3-f86f1108c503\") " pod="openshift-monitoring/node-exporter-v78lm"
Jun 15 05:49:05.019069 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:05.019040    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70d9d755-3947-4657-9cb3-f86f1108c503-metrics-client-ca\") pod \"node-exporter-v78lm\" (UID: \"70d9d755-3947-4657-9cb3-f86f1108c503\") " pod="openshift-monitoring/node-exporter-v78lm"
Jun 15 05:49:05.019332 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:05.019127    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70d9d755-3947-4657-9cb3-f86f1108c503-sys\") pod \"node-exporter-v78lm\" (UID: \"70d9d755-3947-4657-9cb3-f86f1108c503\") " pod="openshift-monitoring/node-exporter-v78lm"
Jun 15 05:49:05.019332 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:05.019188    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/70d9d755-3947-4657-9cb3-f86f1108c503-root\") pod \"node-exporter-v78lm\" (UID: \"70d9d755-3947-4657-9cb3-f86f1108c503\") " pod="openshift-monitoring/node-exporter-v78lm"
Jun 15 05:49:05.019332 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:05.019204    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/70d9d755-3947-4657-9cb3-f86f1108c503-node-exporter-wtmp\") pod \"node-exporter-v78lm\" (UID: \"70d9d755-3947-4657-9cb3-f86f1108c503\") " pod="openshift-monitoring/node-exporter-v78lm"
Jun 15 05:49:05.019332 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:05.019215    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/70d9d755-3947-4657-9cb3-f86f1108c503-node-exporter-textfile\") pod \"node-exporter-v78lm\" (UID: \"70d9d755-3947-4657-9cb3-f86f1108c503\") " pod="openshift-monitoring/node-exporter-v78lm"
Jun 15 05:49:05.019332 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:49:05.019305    2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jun 15 05:49:05.019475 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:49:05.019399    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70d9d755-3947-4657-9cb3-f86f1108c503-node-exporter-tls podName:70d9d755-3947-4657-9cb3-f86f1108c503 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:05.51937974 +0000 UTC m=+87.885924787 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/70d9d755-3947-4657-9cb3-f86f1108c503-node-exporter-tls") pod "node-exporter-v78lm" (UID: "70d9d755-3947-4657-9cb3-f86f1108c503") : secret "node-exporter-tls" not found
Jun 15 05:49:05.019475 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:05.019410    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/70d9d755-3947-4657-9cb3-f86f1108c503-node-exporter-accelerators-collector-config\") pod \"node-exporter-v78lm\" (UID: \"70d9d755-3947-4657-9cb3-f86f1108c503\") " pod="openshift-monitoring/node-exporter-v78lm"
Jun 15 05:49:05.019593 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:05.019568    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70d9d755-3947-4657-9cb3-f86f1108c503-metrics-client-ca\") pod \"node-exporter-v78lm\" (UID: \"70d9d755-3947-4657-9cb3-f86f1108c503\") " pod="openshift-monitoring/node-exporter-v78lm"
Jun 15 05:49:05.021594 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:05.021572    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70d9d755-3947-4657-9cb3-f86f1108c503-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v78lm\" (UID: \"70d9d755-3947-4657-9cb3-f86f1108c503\") " pod="openshift-monitoring/node-exporter-v78lm"
Jun 15 05:49:05.031178 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:05.031128    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ljjk\" (UniqueName: \"kubernetes.io/projected/70d9d755-3947-4657-9cb3-f86f1108c503-kube-api-access-4ljjk\") pod \"node-exporter-v78lm\" (UID: \"70d9d755-3947-4657-9cb3-f86f1108c503\") " pod="openshift-monitoring/node-exporter-v78lm"
Jun 15 05:49:05.522951 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:05.522917    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/70d9d755-3947-4657-9cb3-f86f1108c503-node-exporter-tls\") pod \"node-exporter-v78lm\" (UID: \"70d9d755-3947-4657-9cb3-f86f1108c503\") " pod="openshift-monitoring/node-exporter-v78lm"
Jun 15 05:49:05.525531 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:05.525506    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/70d9d755-3947-4657-9cb3-f86f1108c503-node-exporter-tls\") pod \"node-exporter-v78lm\" (UID: \"70d9d755-3947-4657-9cb3-f86f1108c503\") " pod="openshift-monitoring/node-exporter-v78lm"
Jun 15 05:49:05.717551 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:05.717512    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v78lm"
Jun 15 05:49:07.553624 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:07.553587    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-98f645c89-cjthz"
Jun 15 05:49:08.116678 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:49:08.116653    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70d9d755_3947_4657_9cb3_f86f1108c503.slice/crio-f6bed2c92944a20d09b916579f5cb9b7ccb52ce9d0028c67ca93b4251da459a2 WatchSource:0}: Error finding container f6bed2c92944a20d09b916579f5cb9b7ccb52ce9d0028c67ca93b4251da459a2: Status 404 returned error can't find the container with id f6bed2c92944a20d09b916579f5cb9b7ccb52ce9d0028c67ca93b4251da459a2
Jun 15 05:49:08.693443 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:08.693403    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-657c9" event={"ID":"2db45f44-748c-40ad-9c89-05ab2816c8f7","Type":"ContainerStarted","Data":"2c0516780a08c65cd40660d35d4695f5540e82b8342840f88464cfd42e525506"}
Jun 15 05:49:08.693941 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:08.693585    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-694c955b9-657c9"
Jun 15 05:49:08.695227 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:08.695172    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v78lm" event={"ID":"70d9d755-3947-4657-9cb3-f86f1108c503","Type":"ContainerStarted","Data":"f6bed2c92944a20d09b916579f5cb9b7ccb52ce9d0028c67ca93b4251da459a2"}
Jun 15 05:49:08.695438 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:08.695414    2564 patch_prober.go:28] interesting pod/downloads-694c955b9-657c9 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.21:8080/\": dial tcp 10.132.0.21:8080: connect: connection refused" start-of-body=
Jun 15 05:49:08.695531 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:08.695453    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-694c955b9-657c9" podUID="2db45f44-748c-40ad-9c89-05ab2816c8f7" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.21:8080/\": dial tcp 10.132.0.21:8080: connect: connection refused"
Jun 15 05:49:08.720888 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:08.720637    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-694c955b9-657c9" podStartSLOduration=1.663044443 podStartE2EDuration="19.720619685s" totalImagesPullingTime="18.057575242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:08.719268365 +0000 UTC m=+91.085813419" watchObservedRunningTime="2026-06-15 05:49:08.720619685 +0000 UTC m=+91.087164736"
Jun 15 05:49:09.701612 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:09.701574    2564 generic.go:356] "Generic (PLEG): container finished" podID="70d9d755-3947-4657-9cb3-f86f1108c503" containerID="e76d8b80c4e06229defb59214ff3144b4db121d1be7c41f6e31d728995db8384" exitCode=0
Jun 15 05:49:09.702170 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:09.701663    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v78lm" event={"ID":"70d9d755-3947-4657-9cb3-f86f1108c503","Type":"ContainerDied","Data":"e76d8b80c4e06229defb59214ff3144b4db121d1be7c41f6e31d728995db8384"}
Jun 15 05:49:09.713266 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:09.713244    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-694c955b9-657c9"
Jun 15 05:49:10.709845 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:10.709800    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v78lm" event={"ID":"70d9d755-3947-4657-9cb3-f86f1108c503","Type":"ContainerStarted","Data":"b10c40ca6a941f4a02032887cc89227303dff2faacbffe87bcabbe486495fd1a"}
Jun 15 05:49:10.710334 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:10.709898    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v78lm" event={"ID":"70d9d755-3947-4657-9cb3-f86f1108c503","Type":"ContainerStarted","Data":"2a567db4e7023657830519cb3360e48604e2c02a7da15c7754ded4e1d6d5088e"}
Jun 15 05:49:10.741672 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:10.741614    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-v78lm" podStartSLOduration=5.750399069 podStartE2EDuration="6.741595693s" totalImagesPullingTime="906.852208ms" totalInitContainerRuntime="84.344416ms" isStatefulPod=true podCreationTimestamp="2026-06-15 05:49:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:10.740333822 +0000 UTC m=+93.106878888" watchObservedRunningTime="2026-06-15 05:49:10.741595693 +0000 UTC m=+93.108140744"
Jun 15 05:49:13.303372 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:13.303337    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-98f645c89-cjthz"]
Jun 15 05:49:15.529383 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:15.529349    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jg5zt"
Jun 15 05:49:20.974383 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:20.974350    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fcbc854d6-lwbgg"]
Jun 15 05:49:38.327687 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:38.327640    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-98f645c89-cjthz" podUID="f919e023-d50d-4b4b-bb00-28e41fd896dd" containerName="registry" containerID="cri-o://d7adf409c41ef9cfe5a6f3afefa5d0e7001c4452ee7f1a5be743cee6721ad30b" gracePeriod=30
Jun 15 05:49:38.601812 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:38.601722    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-98f645c89-cjthz"
Jun 15 05:49:38.676889 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:38.676842    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f919e023-d50d-4b4b-bb00-28e41fd896dd-image-registry-private-configuration\") pod \"f919e023-d50d-4b4b-bb00-28e41fd896dd\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") "
Jun 15 05:49:38.677021 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:38.676921    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f919e023-d50d-4b4b-bb00-28e41fd896dd-trusted-ca\") pod \"f919e023-d50d-4b4b-bb00-28e41fd896dd\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") "
Jun 15 05:49:38.677021 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:38.676950    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f919e023-d50d-4b4b-bb00-28e41fd896dd-installation-pull-secrets\") pod \"f919e023-d50d-4b4b-bb00-28e41fd896dd\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") "
Jun 15 05:49:38.677021 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:38.676968    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f919e023-d50d-4b4b-bb00-28e41fd896dd-registry-certificates\") pod \"f919e023-d50d-4b4b-bb00-28e41fd896dd\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") "
Jun 15 05:49:38.677021 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:38.677016    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f919e023-d50d-4b4b-bb00-28e41fd896dd-ca-trust-extracted\") pod \"f919e023-d50d-4b4b-bb00-28e41fd896dd\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") "
Jun 15 05:49:38.677190 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:38.677059    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f919e023-d50d-4b4b-bb00-28e41fd896dd-bound-sa-token\") pod \"f919e023-d50d-4b4b-bb00-28e41fd896dd\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") "
Jun 15 05:49:38.677190 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:38.677110    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tfqv\" (UniqueName: \"kubernetes.io/projected/f919e023-d50d-4b4b-bb00-28e41fd896dd-kube-api-access-8tfqv\") pod \"f919e023-d50d-4b4b-bb00-28e41fd896dd\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") "
Jun 15 05:49:38.677190 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:38.677134    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f919e023-d50d-4b4b-bb00-28e41fd896dd-registry-tls\") pod \"f919e023-d50d-4b4b-bb00-28e41fd896dd\" (UID: \"f919e023-d50d-4b4b-bb00-28e41fd896dd\") "
Jun 15 05:49:38.677448 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:38.677352    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f919e023-d50d-4b4b-bb00-28e41fd896dd-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f919e023-d50d-4b4b-bb00-28e41fd896dd" (UID: "f919e023-d50d-4b4b-bb00-28e41fd896dd"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 05:49:38.677722 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:38.677675    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f919e023-d50d-4b4b-bb00-28e41fd896dd-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f919e023-d50d-4b4b-bb00-28e41fd896dd" (UID: "f919e023-d50d-4b4b-bb00-28e41fd896dd"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 05:49:38.679551 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:38.679478    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f919e023-d50d-4b4b-bb00-28e41fd896dd-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f919e023-d50d-4b4b-bb00-28e41fd896dd" (UID: "f919e023-d50d-4b4b-bb00-28e41fd896dd"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 05:49:38.679551 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:38.679527    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f919e023-d50d-4b4b-bb00-28e41fd896dd-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f919e023-d50d-4b4b-bb00-28e41fd896dd" (UID: "f919e023-d50d-4b4b-bb00-28e41fd896dd"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 05:49:38.679727 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:38.679705    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f919e023-d50d-4b4b-bb00-28e41fd896dd-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f919e023-d50d-4b4b-bb00-28e41fd896dd" (UID: "f919e023-d50d-4b4b-bb00-28e41fd896dd"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 05:49:38.679990 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:38.679970    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f919e023-d50d-4b4b-bb00-28e41fd896dd-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f919e023-d50d-4b4b-bb00-28e41fd896dd" (UID: "f919e023-d50d-4b4b-bb00-28e41fd896dd"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 05:49:38.680068 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:38.680044    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f919e023-d50d-4b4b-bb00-28e41fd896dd-kube-api-access-8tfqv" (OuterVolumeSpecName: "kube-api-access-8tfqv") pod "f919e023-d50d-4b4b-bb00-28e41fd896dd" (UID: "f919e023-d50d-4b4b-bb00-28e41fd896dd"). InnerVolumeSpecName "kube-api-access-8tfqv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 05:49:38.686143 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:38.686117    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f919e023-d50d-4b4b-bb00-28e41fd896dd-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f919e023-d50d-4b4b-bb00-28e41fd896dd" (UID: "f919e023-d50d-4b4b-bb00-28e41fd896dd"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 05:49:38.777932 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:38.777907    2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f919e023-d50d-4b4b-bb00-28e41fd896dd-bound-sa-token\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 05:49:38.777932 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:38.777929    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tfqv\" (UniqueName: \"kubernetes.io/projected/f919e023-d50d-4b4b-bb00-28e41fd896dd-kube-api-access-8tfqv\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 05:49:38.778076 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:38.777939    2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f919e023-d50d-4b4b-bb00-28e41fd896dd-registry-tls\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 05:49:38.778076 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:38.777948    2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f919e023-d50d-4b4b-bb00-28e41fd896dd-image-registry-private-configuration\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 05:49:38.778076 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:38.777957    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f919e023-d50d-4b4b-bb00-28e41fd896dd-trusted-ca\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 05:49:38.778076 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:38.777965    2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f919e023-d50d-4b4b-bb00-28e41fd896dd-installation-pull-secrets\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 05:49:38.778076 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:38.777973    2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f919e023-d50d-4b4b-bb00-28e41fd896dd-registry-certificates\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 05:49:38.778076 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:38.777981    2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f919e023-d50d-4b4b-bb00-28e41fd896dd-ca-trust-extracted\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 05:49:38.817048 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:38.817022    2564 generic.go:356] "Generic (PLEG): container finished" podID="f919e023-d50d-4b4b-bb00-28e41fd896dd" containerID="d7adf409c41ef9cfe5a6f3afefa5d0e7001c4452ee7f1a5be743cee6721ad30b" exitCode=0
Jun 15 05:49:38.817149 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:38.817069    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-98f645c89-cjthz"
Jun 15 05:49:38.817149 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:38.817078    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-98f645c89-cjthz" event={"ID":"f919e023-d50d-4b4b-bb00-28e41fd896dd","Type":"ContainerDied","Data":"d7adf409c41ef9cfe5a6f3afefa5d0e7001c4452ee7f1a5be743cee6721ad30b"}
Jun 15 05:49:38.817149 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:38.817117    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-98f645c89-cjthz" event={"ID":"f919e023-d50d-4b4b-bb00-28e41fd896dd","Type":"ContainerDied","Data":"a80f7b6afcc85e9883b654aea42aba6da7c7b5f9fae184a52fc5975a65a1505d"}
Jun 15 05:49:38.817149 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:38.817136    2564 scope.go:117] "RemoveContainer" containerID="d7adf409c41ef9cfe5a6f3afefa5d0e7001c4452ee7f1a5be743cee6721ad30b"
Jun 15 05:49:38.825518 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:38.825502    2564 scope.go:117] "RemoveContainer" containerID="d7adf409c41ef9cfe5a6f3afefa5d0e7001c4452ee7f1a5be743cee6721ad30b"
Jun 15 05:49:38.825798 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:49:38.825760    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7adf409c41ef9cfe5a6f3afefa5d0e7001c4452ee7f1a5be743cee6721ad30b\": container with ID starting with d7adf409c41ef9cfe5a6f3afefa5d0e7001c4452ee7f1a5be743cee6721ad30b not found: ID does not exist" containerID="d7adf409c41ef9cfe5a6f3afefa5d0e7001c4452ee7f1a5be743cee6721ad30b"
Jun 15 05:49:38.825890 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:38.825810    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7adf409c41ef9cfe5a6f3afefa5d0e7001c4452ee7f1a5be743cee6721ad30b"} err="failed to get container status \"d7adf409c41ef9cfe5a6f3afefa5d0e7001c4452ee7f1a5be743cee6721ad30b\": rpc error: code = NotFound desc = could not find container \"d7adf409c41ef9cfe5a6f3afefa5d0e7001c4452ee7f1a5be743cee6721ad30b\": container with ID starting with d7adf409c41ef9cfe5a6f3afefa5d0e7001c4452ee7f1a5be743cee6721ad30b not found: ID does not exist"
Jun 15 05:49:38.840339 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:38.840316    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-98f645c89-cjthz"]
Jun 15 05:49:38.843912 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:38.843893    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-98f645c89-cjthz"]
Jun 15 05:49:40.135991 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:40.135964    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f919e023-d50d-4b4b-bb00-28e41fd896dd" path="/var/lib/kubelet/pods/f919e023-d50d-4b4b-bb00-28e41fd896dd/volumes"
Jun 15 05:49:46.001681 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:46.001612    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6fcbc854d6-lwbgg" podUID="c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d" containerName="console" containerID="cri-o://3b8cbbc3040a9fd7ffe4eabe2974201d017faea6a43b2303ce3917c940c75adf" gracePeriod=15
Jun 15 05:49:46.271490 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:46.271429    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fcbc854d6-lwbgg"
Jun 15 05:49:46.339131 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:46.339104    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d-oauth-serving-cert\") pod \"c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d\" (UID: \"c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d\") "
Jun 15 05:49:46.339291 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:46.339156    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d-service-ca\") pod \"c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d\" (UID: \"c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d\") "
Jun 15 05:49:46.339291 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:46.339182    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d-console-oauth-config\") pod \"c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d\" (UID: \"c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d\") "
Jun 15 05:49:46.339291 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:46.339223    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d-console-config\") pod \"c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d\" (UID: \"c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d\") "
Jun 15 05:49:46.339291 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:46.339284    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmhq8\" (UniqueName: \"kubernetes.io/projected/c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d-kube-api-access-lmhq8\") pod \"c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d\" (UID: \"c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d\") "
Jun 15 05:49:46.339490 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:46.339310    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d-console-serving-cert\") pod \"c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d\" (UID: \"c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d\") "
Jun 15 05:49:46.339563 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:46.339542    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d" (UID: "c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 05:49:46.339643 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:46.339621    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d-service-ca" (OuterVolumeSpecName: "service-ca") pod "c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d" (UID: "c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 05:49:46.339711 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:46.339683    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d-console-config" (OuterVolumeSpecName: "console-config") pod "c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d" (UID: "c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 05:49:46.341469 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:46.341440    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d-kube-api-access-lmhq8" (OuterVolumeSpecName: "kube-api-access-lmhq8") pod "c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d" (UID: "c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d"). InnerVolumeSpecName "kube-api-access-lmhq8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 05:49:46.341572 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:46.341473    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d" (UID: "c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 05:49:46.341572 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:46.341483    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d" (UID: "c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 05:49:46.440079 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:46.440049    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d-service-ca\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 05:49:46.440079 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:46.440074    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d-console-oauth-config\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 05:49:46.440079 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:46.440085    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d-console-config\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 05:49:46.440261 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:46.440094    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmhq8\" (UniqueName: \"kubernetes.io/projected/c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d-kube-api-access-lmhq8\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 05:49:46.440261 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:46.440103    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d-console-serving-cert\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 05:49:46.440261 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:46.440115    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d-oauth-serving-cert\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 05:49:46.850762 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:46.850725    2564 generic.go:356] "Generic (PLEG): container finished" podID="c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d" containerID="3b8cbbc3040a9fd7ffe4eabe2974201d017faea6a43b2303ce3917c940c75adf" exitCode=0
Jun 15 05:49:46.850924 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:46.850772    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fcbc854d6-lwbgg"
Jun 15 05:49:46.850924 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:46.850817    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fcbc854d6-lwbgg" event={"ID":"c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d","Type":"ContainerDied","Data":"3b8cbbc3040a9fd7ffe4eabe2974201d017faea6a43b2303ce3917c940c75adf"}
Jun 15 05:49:46.850924 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:46.850900    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fcbc854d6-lwbgg" event={"ID":"c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d","Type":"ContainerDied","Data":"f20817c87c4ae04613fc76c053b2d787b966f863f69612a670f4fb2b76d25829"}
Jun 15 05:49:46.850924 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:46.850923    2564 scope.go:117] "RemoveContainer" containerID="3b8cbbc3040a9fd7ffe4eabe2974201d017faea6a43b2303ce3917c940c75adf"
Jun 15 05:49:46.863742 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:46.863719    2564 scope.go:117] "RemoveContainer" containerID="3b8cbbc3040a9fd7ffe4eabe2974201d017faea6a43b2303ce3917c940c75adf"
Jun 15 05:49:46.864008 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:49:46.863987    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b8cbbc3040a9fd7ffe4eabe2974201d017faea6a43b2303ce3917c940c75adf\": container with ID starting with 3b8cbbc3040a9fd7ffe4eabe2974201d017faea6a43b2303ce3917c940c75adf not found: ID does not exist" containerID="3b8cbbc3040a9fd7ffe4eabe2974201d017faea6a43b2303ce3917c940c75adf"
Jun 15 05:49:46.864086 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:46.864016    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b8cbbc3040a9fd7ffe4eabe2974201d017faea6a43b2303ce3917c940c75adf"} err="failed to get container status \"3b8cbbc3040a9fd7ffe4eabe2974201d017faea6a43b2303ce3917c940c75adf\": rpc error: code = NotFound desc = could not find container \"3b8cbbc3040a9fd7ffe4eabe2974201d017faea6a43b2303ce3917c940c75adf\": container with ID starting with 3b8cbbc3040a9fd7ffe4eabe2974201d017faea6a43b2303ce3917c940c75adf not found: ID does not exist"
Jun 15 05:49:46.879877 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:46.879838    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fcbc854d6-lwbgg"]
Jun 15 05:49:46.884907 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:46.884877    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6fcbc854d6-lwbgg"]
Jun 15 05:49:47.855531 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:47.855451    2564 generic.go:356] "Generic (PLEG): container finished" podID="5d1c36b4-80f4-46a1-bfb2-6323cb64f65e" containerID="dad3f3e6262defb2ebc313972739a7869279e375e3250b7c3dd27ef8754b0435" exitCode=0
Jun 15 05:49:47.855969 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:47.855527    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-kkp9q" event={"ID":"5d1c36b4-80f4-46a1-bfb2-6323cb64f65e","Type":"ContainerDied","Data":"dad3f3e6262defb2ebc313972739a7869279e375e3250b7c3dd27ef8754b0435"}
Jun 15 05:49:47.855969 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:47.855888    2564 scope.go:117] "RemoveContainer" containerID="dad3f3e6262defb2ebc313972739a7869279e375e3250b7c3dd27ef8754b0435"
Jun 15 05:49:48.135784 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:48.135714    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d" path="/var/lib/kubelet/pods/c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d/volumes"
Jun 15 05:49:48.861418 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:48.861388    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-kkp9q" event={"ID":"5d1c36b4-80f4-46a1-bfb2-6323cb64f65e","Type":"ContainerStarted","Data":"b4e74353106a765e87e2ebd3f1637be75664cc185814bd89fd6c3ad82f830abb"}
Jun 15 05:49:52.876850 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:52.876773    2564 generic.go:356] "Generic (PLEG): container finished" podID="de5e4b97-769f-4d62-8aea-b9cdf3bca1a7" containerID="120eff3d9783920a756ec25841c626e3a986d7bc90e9301c7787201c70e5b3ae" exitCode=0
Jun 15 05:49:52.877262 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:52.876849    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-vbmdw" event={"ID":"de5e4b97-769f-4d62-8aea-b9cdf3bca1a7","Type":"ContainerDied","Data":"120eff3d9783920a756ec25841c626e3a986d7bc90e9301c7787201c70e5b3ae"}
Jun 15 05:49:52.877262 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:52.877238    2564 scope.go:117] "RemoveContainer" containerID="120eff3d9783920a756ec25841c626e3a986d7bc90e9301c7787201c70e5b3ae"
Jun 15 05:49:52.878451 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:52.878430    2564 generic.go:356] "Generic (PLEG): container finished" podID="e30f3f9f-2bc5-4603-9343-e3bbdd26fd7d" containerID="bd954bd21f84c2b0921d2b57a0aa6b64cfcb37c727b1a9b952b5305e4a9b7fdb" exitCode=0
Jun 15 05:49:52.878539 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:52.878501    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pwv4p" event={"ID":"e30f3f9f-2bc5-4603-9343-e3bbdd26fd7d","Type":"ContainerDied","Data":"bd954bd21f84c2b0921d2b57a0aa6b64cfcb37c727b1a9b952b5305e4a9b7fdb"}
Jun 15 05:49:52.878770 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:52.878757    2564 scope.go:117] "RemoveContainer" containerID="bd954bd21f84c2b0921d2b57a0aa6b64cfcb37c727b1a9b952b5305e4a9b7fdb"
Jun 15 05:49:53.883526 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:53.883491    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-vbmdw" event={"ID":"de5e4b97-769f-4d62-8aea-b9cdf3bca1a7","Type":"ContainerStarted","Data":"9753404d64a55fd337569d35f856edf675bf69c3738cb541e0f8e5d08b7b9d36"}
Jun 15 05:49:53.885210 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:49:53.885185    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pwv4p" event={"ID":"e30f3f9f-2bc5-4603-9343-e3bbdd26fd7d","Type":"ContainerStarted","Data":"095e03eefd429189c05f71bae3f8d9fd1e3536c3b21616237e5b567573102be3"}
Jun 15 05:50:32.972623 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:32.972586    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6dc7649465-khcrf"]
Jun 15 05:50:32.973138 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:32.972904    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f919e023-d50d-4b4b-bb00-28e41fd896dd" containerName="registry"
Jun 15 05:50:32.973138 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:32.972916    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f919e023-d50d-4b4b-bb00-28e41fd896dd" containerName="registry"
Jun 15 05:50:32.973138 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:32.972925    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d" containerName="console"
Jun 15 05:50:32.973138 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:32.972931    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d" containerName="console"
Jun 15 05:50:32.973138 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:32.972982    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2b55ca1-f430-4ffc-9fc4-48b8ff1b7a8d" containerName="console"
Jun 15 05:50:32.973138 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:32.972991    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f919e023-d50d-4b4b-bb00-28e41fd896dd" containerName="registry"
Jun 15 05:50:32.976064 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:32.976045    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dc7649465-khcrf"
Jun 15 05:50:32.979987 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:32.979943    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jun 15 05:50:32.983482 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:32.983179    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jun 15 05:50:32.983547 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:32.983499    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qvwbv\""
Jun 15 05:50:32.984334 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:32.984312    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jun 15 05:50:32.984875 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:32.984788    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jun 15 05:50:32.985071 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:32.985053    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jun 15 05:50:32.990645 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:32.990624    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dc7649465-khcrf"]
Jun 15 05:50:32.996047 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:32.996024    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgcfm\" (UniqueName: \"kubernetes.io/projected/c6da44d8-2431-4593-8d40-fef66c0d9a14-kube-api-access-sgcfm\") pod \"console-6dc7649465-khcrf\" (UID: \"c6da44d8-2431-4593-8d40-fef66c0d9a14\") " pod="openshift-console/console-6dc7649465-khcrf"
Jun 15 05:50:32.996139 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:32.996127    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6da44d8-2431-4593-8d40-fef66c0d9a14-console-serving-cert\") pod \"console-6dc7649465-khcrf\" (UID: \"c6da44d8-2431-4593-8d40-fef66c0d9a14\") " pod="openshift-console/console-6dc7649465-khcrf"
Jun 15 05:50:32.996185 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:32.996164    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6da44d8-2431-4593-8d40-fef66c0d9a14-trusted-ca-bundle\") pod \"console-6dc7649465-khcrf\" (UID: \"c6da44d8-2431-4593-8d40-fef66c0d9a14\") " pod="openshift-console/console-6dc7649465-khcrf"
Jun 15 05:50:32.996229 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:32.996185    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6da44d8-2431-4593-8d40-fef66c0d9a14-service-ca\") pod \"console-6dc7649465-khcrf\" (UID: \"c6da44d8-2431-4593-8d40-fef66c0d9a14\") " pod="openshift-console/console-6dc7649465-khcrf"
Jun 15 05:50:32.996273 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:32.996250    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6da44d8-2431-4593-8d40-fef66c0d9a14-console-config\") pod \"console-6dc7649465-khcrf\" (UID: \"c6da44d8-2431-4593-8d40-fef66c0d9a14\") " pod="openshift-console/console-6dc7649465-khcrf"
Jun 15 05:50:32.996308 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:32.996275    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6da44d8-2431-4593-8d40-fef66c0d9a14-oauth-serving-cert\") pod \"console-6dc7649465-khcrf\" (UID: \"c6da44d8-2431-4593-8d40-fef66c0d9a14\") " pod="openshift-console/console-6dc7649465-khcrf"
Jun 15 05:50:32.996353 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:32.996338    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6da44d8-2431-4593-8d40-fef66c0d9a14-console-oauth-config\") pod \"console-6dc7649465-khcrf\" (UID: \"c6da44d8-2431-4593-8d40-fef66c0d9a14\") " pod="openshift-console/console-6dc7649465-khcrf"
Jun 15 05:50:33.002008 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:33.001989    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jun 15 05:50:33.097567 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:33.097537    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6da44d8-2431-4593-8d40-fef66c0d9a14-console-config\") pod \"console-6dc7649465-khcrf\" (UID: \"c6da44d8-2431-4593-8d40-fef66c0d9a14\") " pod="openshift-console/console-6dc7649465-khcrf"
Jun 15 05:50:33.097567 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:33.097572    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6da44d8-2431-4593-8d40-fef66c0d9a14-oauth-serving-cert\") pod \"console-6dc7649465-khcrf\" (UID: \"c6da44d8-2431-4593-8d40-fef66c0d9a14\") " pod="openshift-console/console-6dc7649465-khcrf"
Jun 15 05:50:33.097796 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:33.097612    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6da44d8-2431-4593-8d40-fef66c0d9a14-console-oauth-config\") pod \"console-6dc7649465-khcrf\" (UID: \"c6da44d8-2431-4593-8d40-fef66c0d9a14\") " pod="openshift-console/console-6dc7649465-khcrf"
Jun 15 05:50:33.097796 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:33.097655    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgcfm\" (UniqueName: \"kubernetes.io/projected/c6da44d8-2431-4593-8d40-fef66c0d9a14-kube-api-access-sgcfm\") pod \"console-6dc7649465-khcrf\" (UID: \"c6da44d8-2431-4593-8d40-fef66c0d9a14\") " pod="openshift-console/console-6dc7649465-khcrf"
Jun 15 05:50:33.097796 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:33.097690    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6da44d8-2431-4593-8d40-fef66c0d9a14-console-serving-cert\") pod \"console-6dc7649465-khcrf\" (UID: \"c6da44d8-2431-4593-8d40-fef66c0d9a14\") " pod="openshift-console/console-6dc7649465-khcrf"
Jun 15 05:50:33.097796 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:33.097725    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6da44d8-2431-4593-8d40-fef66c0d9a14-trusted-ca-bundle\") pod \"console-6dc7649465-khcrf\" (UID: \"c6da44d8-2431-4593-8d40-fef66c0d9a14\") " pod="openshift-console/console-6dc7649465-khcrf"
Jun 15 05:50:33.097796 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:33.097748    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6da44d8-2431-4593-8d40-fef66c0d9a14-service-ca\") pod \"console-6dc7649465-khcrf\" (UID: \"c6da44d8-2431-4593-8d40-fef66c0d9a14\") " pod="openshift-console/console-6dc7649465-khcrf"
Jun 15 05:50:33.098423 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:33.098400    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6da44d8-2431-4593-8d40-fef66c0d9a14-oauth-serving-cert\") pod \"console-6dc7649465-khcrf\" (UID: \"c6da44d8-2431-4593-8d40-fef66c0d9a14\") " pod="openshift-console/console-6dc7649465-khcrf"
Jun 15 05:50:33.098522 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:33.098428    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6da44d8-2431-4593-8d40-fef66c0d9a14-service-ca\") pod \"console-6dc7649465-khcrf\" (UID: \"c6da44d8-2431-4593-8d40-fef66c0d9a14\") " pod="openshift-console/console-6dc7649465-khcrf"
Jun 15 05:50:33.098522 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:33.098438    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6da44d8-2431-4593-8d40-fef66c0d9a14-console-config\") pod \"console-6dc7649465-khcrf\" (UID: \"c6da44d8-2431-4593-8d40-fef66c0d9a14\") " pod="openshift-console/console-6dc7649465-khcrf"
Jun 15 05:50:33.099010 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:33.098986    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6da44d8-2431-4593-8d40-fef66c0d9a14-trusted-ca-bundle\") pod \"console-6dc7649465-khcrf\" (UID: \"c6da44d8-2431-4593-8d40-fef66c0d9a14\") " pod="openshift-console/console-6dc7649465-khcrf"
Jun 15 05:50:33.100296 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:33.100280    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6da44d8-2431-4593-8d40-fef66c0d9a14-console-serving-cert\") pod \"console-6dc7649465-khcrf\" (UID: \"c6da44d8-2431-4593-8d40-fef66c0d9a14\") " pod="openshift-console/console-6dc7649465-khcrf"
Jun 15 05:50:33.100377 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:33.100328    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6da44d8-2431-4593-8d40-fef66c0d9a14-console-oauth-config\") pod \"console-6dc7649465-khcrf\" (UID: \"c6da44d8-2431-4593-8d40-fef66c0d9a14\") " pod="openshift-console/console-6dc7649465-khcrf"
Jun 15 05:50:33.112344 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:33.112314    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgcfm\" (UniqueName: \"kubernetes.io/projected/c6da44d8-2431-4593-8d40-fef66c0d9a14-kube-api-access-sgcfm\") pod \"console-6dc7649465-khcrf\" (UID: \"c6da44d8-2431-4593-8d40-fef66c0d9a14\") " pod="openshift-console/console-6dc7649465-khcrf"
Jun 15 05:50:33.286608 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:33.286528    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dc7649465-khcrf"
Jun 15 05:50:33.433227 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:33.433182    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dc7649465-khcrf"]
Jun 15 05:50:33.436132 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:50:33.436099    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6da44d8_2431_4593_8d40_fef66c0d9a14.slice/crio-bb2f22fdca81b5c7a719573abceef14ecf12cfca107edbb110f1977b6f863141 WatchSource:0}: Error finding container bb2f22fdca81b5c7a719573abceef14ecf12cfca107edbb110f1977b6f863141: Status 404 returned error can't find the container with id bb2f22fdca81b5c7a719573abceef14ecf12cfca107edbb110f1977b6f863141
Jun 15 05:50:34.043051 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:34.043012    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dc7649465-khcrf" event={"ID":"c6da44d8-2431-4593-8d40-fef66c0d9a14","Type":"ContainerStarted","Data":"1543ca70cb88dc574cf83b2c6a248019ea0b04d08f82ff5f4fe980f2c8db2564"}
Jun 15 05:50:34.043461 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:34.043073    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dc7649465-khcrf" event={"ID":"c6da44d8-2431-4593-8d40-fef66c0d9a14","Type":"ContainerStarted","Data":"bb2f22fdca81b5c7a719573abceef14ecf12cfca107edbb110f1977b6f863141"}
Jun 15 05:50:34.073929 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:34.073877    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6dc7649465-khcrf" podStartSLOduration=2.0738487230000002 podStartE2EDuration="2.073848723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:50:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:50:34.071947804 +0000 UTC m=+176.438492873" watchObservedRunningTime="2026-06-15 05:50:34.073848723 +0000 UTC m=+176.440393771"
Jun 15 05:50:43.287032 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:43.286998    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6dc7649465-khcrf"
Jun 15 05:50:43.287460 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:43.287051    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6dc7649465-khcrf"
Jun 15 05:50:43.291713 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:43.291693    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6dc7649465-khcrf"
Jun 15 05:50:44.083735 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:50:44.083709    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6dc7649465-khcrf"
Jun 15 05:51:57.734057 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:51:57.733978    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b5f557867-8p7qj"]
Jun 15 05:51:57.737292 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:51:57.737267    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b5f557867-8p7qj"
Jun 15 05:51:57.754709 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:51:57.754682    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b5f557867-8p7qj"]
Jun 15 05:51:57.807419 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:51:57.807395    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rghl\" (UniqueName: \"kubernetes.io/projected/73504953-8917-4ec6-b06d-92bfaa234bea-kube-api-access-9rghl\") pod \"console-5b5f557867-8p7qj\" (UID: \"73504953-8917-4ec6-b06d-92bfaa234bea\") " pod="openshift-console/console-5b5f557867-8p7qj"
Jun 15 05:51:57.807419 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:51:57.807422    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73504953-8917-4ec6-b06d-92bfaa234bea-service-ca\") pod \"console-5b5f557867-8p7qj\" (UID: \"73504953-8917-4ec6-b06d-92bfaa234bea\") " pod="openshift-console/console-5b5f557867-8p7qj"
Jun 15 05:51:57.807607 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:51:57.807446    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73504953-8917-4ec6-b06d-92bfaa234bea-oauth-serving-cert\") pod \"console-5b5f557867-8p7qj\" (UID: \"73504953-8917-4ec6-b06d-92bfaa234bea\") " pod="openshift-console/console-5b5f557867-8p7qj"
Jun 15 05:51:57.807607 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:51:57.807465    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73504953-8917-4ec6-b06d-92bfaa234bea-console-oauth-config\") pod \"console-5b5f557867-8p7qj\" (UID: \"73504953-8917-4ec6-b06d-92bfaa234bea\") " pod="openshift-console/console-5b5f557867-8p7qj"
Jun 15 05:51:57.807607 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:51:57.807531    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73504953-8917-4ec6-b06d-92bfaa234bea-console-config\") pod \"console-5b5f557867-8p7qj\" (UID: \"73504953-8917-4ec6-b06d-92bfaa234bea\") " pod="openshift-console/console-5b5f557867-8p7qj"
Jun 15 05:51:57.807607 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:51:57.807554    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73504953-8917-4ec6-b06d-92bfaa234bea-console-serving-cert\") pod \"console-5b5f557867-8p7qj\" (UID: \"73504953-8917-4ec6-b06d-92bfaa234bea\") " pod="openshift-console/console-5b5f557867-8p7qj"
Jun 15 05:51:57.807607 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:51:57.807576    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73504953-8917-4ec6-b06d-92bfaa234bea-trusted-ca-bundle\") pod \"console-5b5f557867-8p7qj\" (UID: \"73504953-8917-4ec6-b06d-92bfaa234bea\") " pod="openshift-console/console-5b5f557867-8p7qj"
Jun 15 05:51:57.908123 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:51:57.908093    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73504953-8917-4ec6-b06d-92bfaa234bea-oauth-serving-cert\") pod \"console-5b5f557867-8p7qj\" (UID: \"73504953-8917-4ec6-b06d-92bfaa234bea\") " pod="openshift-console/console-5b5f557867-8p7qj"
Jun 15 05:51:57.908123 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:51:57.908124    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73504953-8917-4ec6-b06d-92bfaa234bea-console-oauth-config\") pod \"console-5b5f557867-8p7qj\" (UID: \"73504953-8917-4ec6-b06d-92bfaa234bea\") " pod="openshift-console/console-5b5f557867-8p7qj"
Jun 15 05:51:57.908331 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:51:57.908158    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73504953-8917-4ec6-b06d-92bfaa234bea-console-config\") pod \"console-5b5f557867-8p7qj\" (UID: \"73504953-8917-4ec6-b06d-92bfaa234bea\") " pod="openshift-console/console-5b5f557867-8p7qj"
Jun 15 05:51:57.908331 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:51:57.908183    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73504953-8917-4ec6-b06d-92bfaa234bea-console-serving-cert\") pod \"console-5b5f557867-8p7qj\" (UID: \"73504953-8917-4ec6-b06d-92bfaa234bea\") " pod="openshift-console/console-5b5f557867-8p7qj"
Jun 15 05:51:57.908331 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:51:57.908215    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73504953-8917-4ec6-b06d-92bfaa234bea-trusted-ca-bundle\") pod \"console-5b5f557867-8p7qj\" (UID: \"73504953-8917-4ec6-b06d-92bfaa234bea\") " pod="openshift-console/console-5b5f557867-8p7qj"
Jun 15 05:51:57.908479 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:51:57.908329    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rghl\" (UniqueName: \"kubernetes.io/projected/73504953-8917-4ec6-b06d-92bfaa234bea-kube-api-access-9rghl\") pod \"console-5b5f557867-8p7qj\" (UID: \"73504953-8917-4ec6-b06d-92bfaa234bea\") " pod="openshift-console/console-5b5f557867-8p7qj"
Jun 15 05:51:57.908479 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:51:57.908364    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73504953-8917-4ec6-b06d-92bfaa234bea-service-ca\") pod \"console-5b5f557867-8p7qj\" (UID: \"73504953-8917-4ec6-b06d-92bfaa234bea\") " pod="openshift-console/console-5b5f557867-8p7qj"
Jun 15 05:51:57.909099 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:51:57.908946    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73504953-8917-4ec6-b06d-92bfaa234bea-oauth-serving-cert\") pod \"console-5b5f557867-8p7qj\" (UID: \"73504953-8917-4ec6-b06d-92bfaa234bea\") " pod="openshift-console/console-5b5f557867-8p7qj"
Jun 15 05:51:57.909213 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:51:57.909114    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73504953-8917-4ec6-b06d-92bfaa234bea-console-config\") pod \"console-5b5f557867-8p7qj\" (UID: \"73504953-8917-4ec6-b06d-92bfaa234bea\") " pod="openshift-console/console-5b5f557867-8p7qj"
Jun 15 05:51:57.909213 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:51:57.909138    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73504953-8917-4ec6-b06d-92bfaa234bea-trusted-ca-bundle\") pod \"console-5b5f557867-8p7qj\" (UID: \"73504953-8917-4ec6-b06d-92bfaa234bea\") " pod="openshift-console/console-5b5f557867-8p7qj"
Jun 15 05:51:57.909213 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:51:57.909080    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73504953-8917-4ec6-b06d-92bfaa234bea-service-ca\") pod \"console-5b5f557867-8p7qj\" (UID: \"73504953-8917-4ec6-b06d-92bfaa234bea\") " pod="openshift-console/console-5b5f557867-8p7qj"
Jun 15 05:51:57.910829 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:51:57.910805    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73504953-8917-4ec6-b06d-92bfaa234bea-console-serving-cert\") pod \"console-5b5f557867-8p7qj\" (UID: \"73504953-8917-4ec6-b06d-92bfaa234bea\") " pod="openshift-console/console-5b5f557867-8p7qj"
Jun 15 05:51:57.910955 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:51:57.910837    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73504953-8917-4ec6-b06d-92bfaa234bea-console-oauth-config\") pod \"console-5b5f557867-8p7qj\" (UID: \"73504953-8917-4ec6-b06d-92bfaa234bea\") " pod="openshift-console/console-5b5f557867-8p7qj"
Jun 15 05:51:57.918266 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:51:57.918246    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rghl\" (UniqueName: \"kubernetes.io/projected/73504953-8917-4ec6-b06d-92bfaa234bea-kube-api-access-9rghl\") pod \"console-5b5f557867-8p7qj\" (UID: \"73504953-8917-4ec6-b06d-92bfaa234bea\") " pod="openshift-console/console-5b5f557867-8p7qj"
Jun 15 05:51:58.046955 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:51:58.046872    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b5f557867-8p7qj"
Jun 15 05:51:58.189229 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:51:58.189191    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b5f557867-8p7qj"]
Jun 15 05:51:58.196870 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:51:58.196833    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73504953_8917_4ec6_b06d_92bfaa234bea.slice/crio-269e7035cd9f63f8cfd698a5f1bf5c17970048fa2ad8ccdb28d3b35a770d1a42 WatchSource:0}: Error finding container 269e7035cd9f63f8cfd698a5f1bf5c17970048fa2ad8ccdb28d3b35a770d1a42: Status 404 returned error can't find the container with id 269e7035cd9f63f8cfd698a5f1bf5c17970048fa2ad8ccdb28d3b35a770d1a42
Jun 15 05:51:58.341031 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:51:58.340942    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b5f557867-8p7qj" event={"ID":"73504953-8917-4ec6-b06d-92bfaa234bea","Type":"ContainerStarted","Data":"980efbf23444e68501f3a7684efd20831cfedfe1e54e1c09b88cf5ed983c67ab"}
Jun 15 05:51:58.341031 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:51:58.340995    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b5f557867-8p7qj" event={"ID":"73504953-8917-4ec6-b06d-92bfaa234bea","Type":"ContainerStarted","Data":"269e7035cd9f63f8cfd698a5f1bf5c17970048fa2ad8ccdb28d3b35a770d1a42"}
Jun 15 05:51:58.366006 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:51:58.365960    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b5f557867-8p7qj" podStartSLOduration=1.365946095 podStartE2EDuration="1.365946095s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:51:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:51:58.363159556 +0000 UTC m=+260.729704606" watchObservedRunningTime="2026-06-15 05:51:58.365946095 +0000 UTC m=+260.732491145"
Jun 15 05:52:08.047482 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:08.047445    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b5f557867-8p7qj"
Jun 15 05:52:08.047845 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:08.047509    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b5f557867-8p7qj"
Jun 15 05:52:08.051980 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:08.051954    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b5f557867-8p7qj"
Jun 15 05:52:08.381335 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:08.381257    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b5f557867-8p7qj"
Jun 15 05:52:08.442767 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:08.442732    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dc7649465-khcrf"]
Jun 15 05:52:33.469069 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:33.469010    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6dc7649465-khcrf" podUID="c6da44d8-2431-4593-8d40-fef66c0d9a14" containerName="console" containerID="cri-o://1543ca70cb88dc574cf83b2c6a248019ea0b04d08f82ff5f4fe980f2c8db2564" gracePeriod=15
Jun 15 05:52:33.703839 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:33.703818    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dc7649465-khcrf"
Jun 15 05:52:33.771731 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:33.771665    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6da44d8-2431-4593-8d40-fef66c0d9a14-oauth-serving-cert\") pod \"c6da44d8-2431-4593-8d40-fef66c0d9a14\" (UID: \"c6da44d8-2431-4593-8d40-fef66c0d9a14\") "
Jun 15 05:52:33.771731 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:33.771699    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6da44d8-2431-4593-8d40-fef66c0d9a14-service-ca\") pod \"c6da44d8-2431-4593-8d40-fef66c0d9a14\" (UID: \"c6da44d8-2431-4593-8d40-fef66c0d9a14\") "
Jun 15 05:52:33.771731 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:33.771721    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6da44d8-2431-4593-8d40-fef66c0d9a14-trusted-ca-bundle\") pod \"c6da44d8-2431-4593-8d40-fef66c0d9a14\" (UID: \"c6da44d8-2431-4593-8d40-fef66c0d9a14\") "
Jun 15 05:52:33.771981 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:33.771739    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6da44d8-2431-4593-8d40-fef66c0d9a14-console-serving-cert\") pod \"c6da44d8-2431-4593-8d40-fef66c0d9a14\" (UID: \"c6da44d8-2431-4593-8d40-fef66c0d9a14\") "
Jun 15 05:52:33.771981 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:33.771767    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6da44d8-2431-4593-8d40-fef66c0d9a14-console-config\") pod \"c6da44d8-2431-4593-8d40-fef66c0d9a14\" (UID: \"c6da44d8-2431-4593-8d40-fef66c0d9a14\") "
Jun 15 05:52:33.771981 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:33.771796    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgcfm\" (UniqueName: \"kubernetes.io/projected/c6da44d8-2431-4593-8d40-fef66c0d9a14-kube-api-access-sgcfm\") pod \"c6da44d8-2431-4593-8d40-fef66c0d9a14\" (UID: \"c6da44d8-2431-4593-8d40-fef66c0d9a14\") "
Jun 15 05:52:33.771981 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:33.771893    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6da44d8-2431-4593-8d40-fef66c0d9a14-console-oauth-config\") pod \"c6da44d8-2431-4593-8d40-fef66c0d9a14\" (UID: \"c6da44d8-2431-4593-8d40-fef66c0d9a14\") "
Jun 15 05:52:33.772208 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:33.772183    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6da44d8-2431-4593-8d40-fef66c0d9a14-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c6da44d8-2431-4593-8d40-fef66c0d9a14" (UID: "c6da44d8-2431-4593-8d40-fef66c0d9a14"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 05:52:33.772293 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:33.772181    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6da44d8-2431-4593-8d40-fef66c0d9a14-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c6da44d8-2431-4593-8d40-fef66c0d9a14" (UID: "c6da44d8-2431-4593-8d40-fef66c0d9a14"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 05:52:33.772293 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:33.772204    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6da44d8-2431-4593-8d40-fef66c0d9a14-service-ca" (OuterVolumeSpecName: "service-ca") pod "c6da44d8-2431-4593-8d40-fef66c0d9a14" (UID: "c6da44d8-2431-4593-8d40-fef66c0d9a14"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 05:52:33.772293 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:33.772251    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6da44d8-2431-4593-8d40-fef66c0d9a14-console-config" (OuterVolumeSpecName: "console-config") pod "c6da44d8-2431-4593-8d40-fef66c0d9a14" (UID: "c6da44d8-2431-4593-8d40-fef66c0d9a14"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 05:52:33.774025 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:33.774000    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6da44d8-2431-4593-8d40-fef66c0d9a14-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c6da44d8-2431-4593-8d40-fef66c0d9a14" (UID: "c6da44d8-2431-4593-8d40-fef66c0d9a14"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 05:52:33.774134 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:33.774114    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6da44d8-2431-4593-8d40-fef66c0d9a14-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c6da44d8-2431-4593-8d40-fef66c0d9a14" (UID: "c6da44d8-2431-4593-8d40-fef66c0d9a14"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 05:52:33.774184 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:33.774128    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6da44d8-2431-4593-8d40-fef66c0d9a14-kube-api-access-sgcfm" (OuterVolumeSpecName: "kube-api-access-sgcfm") pod "c6da44d8-2431-4593-8d40-fef66c0d9a14" (UID: "c6da44d8-2431-4593-8d40-fef66c0d9a14"). InnerVolumeSpecName "kube-api-access-sgcfm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 05:52:33.872626 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:33.872585    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6da44d8-2431-4593-8d40-fef66c0d9a14-console-oauth-config\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 05:52:33.872626 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:33.872621    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6da44d8-2431-4593-8d40-fef66c0d9a14-oauth-serving-cert\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 05:52:33.872626 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:33.872635    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6da44d8-2431-4593-8d40-fef66c0d9a14-service-ca\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 05:52:33.872805 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:33.872647    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6da44d8-2431-4593-8d40-fef66c0d9a14-trusted-ca-bundle\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 05:52:33.872805 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:33.872659    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6da44d8-2431-4593-8d40-fef66c0d9a14-console-serving-cert\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 05:52:33.872805 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:33.872669    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6da44d8-2431-4593-8d40-fef66c0d9a14-console-config\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 05:52:33.872805 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:33.872681    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgcfm\" (UniqueName: \"kubernetes.io/projected/c6da44d8-2431-4593-8d40-fef66c0d9a14-kube-api-access-sgcfm\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 05:52:34.471441 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:34.471364    2564 generic.go:356] "Generic (PLEG): container finished" podID="c6da44d8-2431-4593-8d40-fef66c0d9a14" containerID="1543ca70cb88dc574cf83b2c6a248019ea0b04d08f82ff5f4fe980f2c8db2564" exitCode=0
Jun 15 05:52:34.471441 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:34.471402    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dc7649465-khcrf"
Jun 15 05:52:34.471441 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:34.471426    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dc7649465-khcrf" event={"ID":"c6da44d8-2431-4593-8d40-fef66c0d9a14","Type":"ContainerDied","Data":"1543ca70cb88dc574cf83b2c6a248019ea0b04d08f82ff5f4fe980f2c8db2564"}
Jun 15 05:52:34.471949 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:34.471471    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dc7649465-khcrf" event={"ID":"c6da44d8-2431-4593-8d40-fef66c0d9a14","Type":"ContainerDied","Data":"bb2f22fdca81b5c7a719573abceef14ecf12cfca107edbb110f1977b6f863141"}
Jun 15 05:52:34.471949 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:34.471499    2564 scope.go:117] "RemoveContainer" containerID="1543ca70cb88dc574cf83b2c6a248019ea0b04d08f82ff5f4fe980f2c8db2564"
Jun 15 05:52:34.479684 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:34.479647    2564 scope.go:117] "RemoveContainer" containerID="1543ca70cb88dc574cf83b2c6a248019ea0b04d08f82ff5f4fe980f2c8db2564"
Jun 15 05:52:34.479950 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:52:34.479922    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1543ca70cb88dc574cf83b2c6a248019ea0b04d08f82ff5f4fe980f2c8db2564\": container with ID starting with 1543ca70cb88dc574cf83b2c6a248019ea0b04d08f82ff5f4fe980f2c8db2564 not found: ID does not exist" containerID="1543ca70cb88dc574cf83b2c6a248019ea0b04d08f82ff5f4fe980f2c8db2564"
Jun 15 05:52:34.480039 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:34.479956    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1543ca70cb88dc574cf83b2c6a248019ea0b04d08f82ff5f4fe980f2c8db2564"} err="failed to get container status \"1543ca70cb88dc574cf83b2c6a248019ea0b04d08f82ff5f4fe980f2c8db2564\": rpc error: code = NotFound desc = could not find container \"1543ca70cb88dc574cf83b2c6a248019ea0b04d08f82ff5f4fe980f2c8db2564\": container with ID starting with 1543ca70cb88dc574cf83b2c6a248019ea0b04d08f82ff5f4fe980f2c8db2564 not found: ID does not exist"
Jun 15 05:52:34.503954 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:34.503935    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dc7649465-khcrf"]
Jun 15 05:52:34.510235 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:34.510214    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6dc7649465-khcrf"]
Jun 15 05:52:36.135043 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:36.135010    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6da44d8-2431-4593-8d40-fef66c0d9a14" path="/var/lib/kubelet/pods/c6da44d8-2431-4593-8d40-fef66c0d9a14/volumes"
Jun 15 05:52:38.069509 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:38.069484    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kn9gn_8bf514ab-857d-416e-b51f-2235f4cb429d/console-operator/1.log"
Jun 15 05:52:38.073553 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:38.073525    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kn9gn_8bf514ab-857d-416e-b51f-2235f4cb429d/console-operator/1.log"
Jun 15 05:52:38.079603 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:52:38.079585    2564 kubelet.go:1648] "Image garbage collection succeeded"
Jun 15 05:53:43.186652 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:43.186620    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6685d4df84-c2mcp"]
Jun 15 05:53:43.187096 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:43.186910    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6da44d8-2431-4593-8d40-fef66c0d9a14" containerName="console"
Jun 15 05:53:43.187096 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:43.186934    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6da44d8-2431-4593-8d40-fef66c0d9a14" containerName="console"
Jun 15 05:53:43.187096 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:43.186985    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6da44d8-2431-4593-8d40-fef66c0d9a14" containerName="console"
Jun 15 05:53:43.189661 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:43.189644    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6685d4df84-c2mcp"
Jun 15 05:53:43.193708 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:43.193685    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Jun 15 05:53:43.193883 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:43.193789    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-5vzfs\""
Jun 15 05:53:43.193951 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:43.193932    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Jun 15 05:53:43.194008 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:43.193968    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Jun 15 05:53:43.201993 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:43.201972    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6685d4df84-c2mcp"]
Jun 15 05:53:43.278972 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:43.278950    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/627d4b26-bb25-456b-9077-5673a829c487-certificates\") pod \"custom-metrics-autoscaler-operator-6685d4df84-c2mcp\" (UID: \"627d4b26-bb25-456b-9077-5673a829c487\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6685d4df84-c2mcp"
Jun 15 05:53:43.279097 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:43.278987    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmzpd\" (UniqueName: \"kubernetes.io/projected/627d4b26-bb25-456b-9077-5673a829c487-kube-api-access-fmzpd\") pod \"custom-metrics-autoscaler-operator-6685d4df84-c2mcp\" (UID: \"627d4b26-bb25-456b-9077-5673a829c487\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6685d4df84-c2mcp"
Jun 15 05:53:43.379986 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:43.379960    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/627d4b26-bb25-456b-9077-5673a829c487-certificates\") pod \"custom-metrics-autoscaler-operator-6685d4df84-c2mcp\" (UID: \"627d4b26-bb25-456b-9077-5673a829c487\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6685d4df84-c2mcp"
Jun 15 05:53:43.380118 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:43.380002    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmzpd\" (UniqueName: \"kubernetes.io/projected/627d4b26-bb25-456b-9077-5673a829c487-kube-api-access-fmzpd\") pod \"custom-metrics-autoscaler-operator-6685d4df84-c2mcp\" (UID: \"627d4b26-bb25-456b-9077-5673a829c487\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6685d4df84-c2mcp"
Jun 15 05:53:43.382432 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:43.382401    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/627d4b26-bb25-456b-9077-5673a829c487-certificates\") pod \"custom-metrics-autoscaler-operator-6685d4df84-c2mcp\" (UID: \"627d4b26-bb25-456b-9077-5673a829c487\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6685d4df84-c2mcp"
Jun 15 05:53:43.396465 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:43.396440    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmzpd\" (UniqueName: \"kubernetes.io/projected/627d4b26-bb25-456b-9077-5673a829c487-kube-api-access-fmzpd\") pod \"custom-metrics-autoscaler-operator-6685d4df84-c2mcp\" (UID: \"627d4b26-bb25-456b-9077-5673a829c487\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6685d4df84-c2mcp"
Jun 15 05:53:43.499789 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:43.499720    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6685d4df84-c2mcp"
Jun 15 05:53:43.639112 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:43.639083    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6685d4df84-c2mcp"]
Jun 15 05:53:43.642266 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:53:43.642241    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod627d4b26_bb25_456b_9077_5673a829c487.slice/crio-5993df2b853d9273cfaafabeaff9f5e68275eda129232424f8a6422eafcdddbb WatchSource:0}: Error finding container 5993df2b853d9273cfaafabeaff9f5e68275eda129232424f8a6422eafcdddbb: Status 404 returned error can't find the container with id 5993df2b853d9273cfaafabeaff9f5e68275eda129232424f8a6422eafcdddbb
Jun 15 05:53:43.643932 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:43.643916    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 15 05:53:43.718043 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:43.718007    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6685d4df84-c2mcp" event={"ID":"627d4b26-bb25-456b-9077-5673a829c487","Type":"ContainerStarted","Data":"5993df2b853d9273cfaafabeaff9f5e68275eda129232424f8a6422eafcdddbb"}
Jun 15 05:53:47.618967 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:47.618935    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-674595557b-zddjf"]
Jun 15 05:53:47.622143 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:47.622128    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-674595557b-zddjf"
Jun 15 05:53:47.625330 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:47.625313    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\""
Jun 15 05:53:47.625437 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:47.625339    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Jun 15 05:53:47.625437 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:47.625372    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-7rjhz\""
Jun 15 05:53:47.635281 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:47.635261    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-674595557b-zddjf"]
Jun 15 05:53:47.716106 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:47.716069    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/265ccf76-68a0-4a0a-98c2-11fc66dca196-certificates\") pod \"keda-operator-674595557b-zddjf\" (UID: \"265ccf76-68a0-4a0a-98c2-11fc66dca196\") " pod="openshift-keda/keda-operator-674595557b-zddjf"
Jun 15 05:53:47.716236 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:47.716114    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hkbm\" (UniqueName: \"kubernetes.io/projected/265ccf76-68a0-4a0a-98c2-11fc66dca196-kube-api-access-5hkbm\") pod \"keda-operator-674595557b-zddjf\" (UID: \"265ccf76-68a0-4a0a-98c2-11fc66dca196\") " pod="openshift-keda/keda-operator-674595557b-zddjf"
Jun 15 05:53:47.716236 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:47.716176    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/265ccf76-68a0-4a0a-98c2-11fc66dca196-cabundle0\") pod \"keda-operator-674595557b-zddjf\" (UID: \"265ccf76-68a0-4a0a-98c2-11fc66dca196\") " pod="openshift-keda/keda-operator-674595557b-zddjf"
Jun 15 05:53:47.739902 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:47.739854    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6685d4df84-c2mcp" event={"ID":"627d4b26-bb25-456b-9077-5673a829c487","Type":"ContainerStarted","Data":"ed81c961cda24ac344589829686a229fcb50aa1c16319cb51922f3d46a77f962"}
Jun 15 05:53:47.740020 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:47.740004    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6685d4df84-c2mcp"
Jun 15 05:53:47.762556 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:47.762513    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-6685d4df84-c2mcp" podStartSLOduration=1.287616646 podStartE2EDuration="4.762499412s" totalImagesPullingTime="3.474882766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:53:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:53:47.761057973 +0000 UTC m=+370.127603036" watchObservedRunningTime="2026-06-15 05:53:47.762499412 +0000 UTC m=+370.129044462"
Jun 15 05:53:47.817268 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:47.817239    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/265ccf76-68a0-4a0a-98c2-11fc66dca196-certificates\") pod \"keda-operator-674595557b-zddjf\" (UID: \"265ccf76-68a0-4a0a-98c2-11fc66dca196\") " pod="openshift-keda/keda-operator-674595557b-zddjf"
Jun 15 05:53:47.817406 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:47.817275    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hkbm\" (UniqueName: \"kubernetes.io/projected/265ccf76-68a0-4a0a-98c2-11fc66dca196-kube-api-access-5hkbm\") pod \"keda-operator-674595557b-zddjf\" (UID: \"265ccf76-68a0-4a0a-98c2-11fc66dca196\") " pod="openshift-keda/keda-operator-674595557b-zddjf"
Jun 15 05:53:47.817468 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:53:47.817400    2564 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found
Jun 15 05:53:47.817468 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:53:47.817424    2564 secret.go:281] references non-existent secret key: ca.crt
Jun 15 05:53:47.817468 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:47.817408    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/265ccf76-68a0-4a0a-98c2-11fc66dca196-cabundle0\") pod \"keda-operator-674595557b-zddjf\" (UID: \"265ccf76-68a0-4a0a-98c2-11fc66dca196\") " pod="openshift-keda/keda-operator-674595557b-zddjf"
Jun 15 05:53:47.817468 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:53:47.817435    2564 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Jun 15 05:53:47.817468 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:53:47.817450    2564 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-674595557b-zddjf: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
Jun 15 05:53:47.817703 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:53:47.817501    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/265ccf76-68a0-4a0a-98c2-11fc66dca196-certificates podName:265ccf76-68a0-4a0a-98c2-11fc66dca196 nodeName:}" failed. No retries permitted until 2026-06-15 05:53:48.317483324 +0000 UTC m=+370.684028366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/265ccf76-68a0-4a0a-98c2-11fc66dca196-certificates") pod "keda-operator-674595557b-zddjf" (UID: "265ccf76-68a0-4a0a-98c2-11fc66dca196") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
Jun 15 05:53:47.818217 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:47.818196    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/265ccf76-68a0-4a0a-98c2-11fc66dca196-cabundle0\") pod \"keda-operator-674595557b-zddjf\" (UID: \"265ccf76-68a0-4a0a-98c2-11fc66dca196\") " pod="openshift-keda/keda-operator-674595557b-zddjf"
Jun 15 05:53:47.830804 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:47.830722    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hkbm\" (UniqueName: \"kubernetes.io/projected/265ccf76-68a0-4a0a-98c2-11fc66dca196-kube-api-access-5hkbm\") pod \"keda-operator-674595557b-zddjf\" (UID: \"265ccf76-68a0-4a0a-98c2-11fc66dca196\") " pod="openshift-keda/keda-operator-674595557b-zddjf"
Jun 15 05:53:47.979529 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:47.979499    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-68788fbd9b-hvmw8"]
Jun 15 05:53:47.982692 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:47.982675    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-68788fbd9b-hvmw8"
Jun 15 05:53:47.985466 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:47.985445    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\""
Jun 15 05:53:47.993184 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:47.993161    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-68788fbd9b-hvmw8"]
Jun 15 05:53:48.019481 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:48.019452    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdtn2\" (UniqueName: \"kubernetes.io/projected/9c147b6b-c80e-4dc9-9aff-088f462dc42a-kube-api-access-rdtn2\") pod \"keda-metrics-apiserver-68788fbd9b-hvmw8\" (UID: \"9c147b6b-c80e-4dc9-9aff-088f462dc42a\") " pod="openshift-keda/keda-metrics-apiserver-68788fbd9b-hvmw8"
Jun 15 05:53:48.019598 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:48.019556    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/9c147b6b-c80e-4dc9-9aff-088f462dc42a-certificates\") pod \"keda-metrics-apiserver-68788fbd9b-hvmw8\" (UID: \"9c147b6b-c80e-4dc9-9aff-088f462dc42a\") " pod="openshift-keda/keda-metrics-apiserver-68788fbd9b-hvmw8"
Jun 15 05:53:48.019663 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:48.019598    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/9c147b6b-c80e-4dc9-9aff-088f462dc42a-temp-vol\") pod \"keda-metrics-apiserver-68788fbd9b-hvmw8\" (UID: \"9c147b6b-c80e-4dc9-9aff-088f462dc42a\") " pod="openshift-keda/keda-metrics-apiserver-68788fbd9b-hvmw8"
Jun 15 05:53:48.121011 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:48.120977    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/9c147b6b-c80e-4dc9-9aff-088f462dc42a-temp-vol\") pod \"keda-metrics-apiserver-68788fbd9b-hvmw8\" (UID: \"9c147b6b-c80e-4dc9-9aff-088f462dc42a\") " pod="openshift-keda/keda-metrics-apiserver-68788fbd9b-hvmw8"
Jun 15 05:53:48.121131 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:48.121022    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdtn2\" (UniqueName: \"kubernetes.io/projected/9c147b6b-c80e-4dc9-9aff-088f462dc42a-kube-api-access-rdtn2\") pod \"keda-metrics-apiserver-68788fbd9b-hvmw8\" (UID: \"9c147b6b-c80e-4dc9-9aff-088f462dc42a\") " pod="openshift-keda/keda-metrics-apiserver-68788fbd9b-hvmw8"
Jun 15 05:53:48.121131 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:48.121112    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/9c147b6b-c80e-4dc9-9aff-088f462dc42a-certificates\") pod \"keda-metrics-apiserver-68788fbd9b-hvmw8\" (UID: \"9c147b6b-c80e-4dc9-9aff-088f462dc42a\") " pod="openshift-keda/keda-metrics-apiserver-68788fbd9b-hvmw8"
Jun 15 05:53:48.121242 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:53:48.121228    2564 secret.go:281] references non-existent secret key: tls.crt
Jun 15 05:53:48.121278 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:53:48.121251    2564 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
Jun 15 05:53:48.121278 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:53:48.121269    2564 projected.go:266] Couldn't get secret openshift-keda/keda-metrics-apiserver-certs: secret "keda-metrics-apiserver-certs" not found
Jun 15 05:53:48.121344 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:53:48.121286    2564 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-68788fbd9b-hvmw8: [references non-existent secret key: tls.crt, secret "keda-metrics-apiserver-certs" not found]
Jun 15 05:53:48.121344 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:53:48.121342    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c147b6b-c80e-4dc9-9aff-088f462dc42a-certificates podName:9c147b6b-c80e-4dc9-9aff-088f462dc42a nodeName:}" failed. No retries permitted until 2026-06-15 05:53:48.621325944 +0000 UTC m=+370.987870980 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/9c147b6b-c80e-4dc9-9aff-088f462dc42a-certificates") pod "keda-metrics-apiserver-68788fbd9b-hvmw8" (UID: "9c147b6b-c80e-4dc9-9aff-088f462dc42a") : [references non-existent secret key: tls.crt, secret "keda-metrics-apiserver-certs" not found]
Jun 15 05:53:48.121438 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:48.121347    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/9c147b6b-c80e-4dc9-9aff-088f462dc42a-temp-vol\") pod \"keda-metrics-apiserver-68788fbd9b-hvmw8\" (UID: \"9c147b6b-c80e-4dc9-9aff-088f462dc42a\") " pod="openshift-keda/keda-metrics-apiserver-68788fbd9b-hvmw8"
Jun 15 05:53:48.141832 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:48.141786    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdtn2\" (UniqueName: \"kubernetes.io/projected/9c147b6b-c80e-4dc9-9aff-088f462dc42a-kube-api-access-rdtn2\") pod \"keda-metrics-apiserver-68788fbd9b-hvmw8\" (UID: \"9c147b6b-c80e-4dc9-9aff-088f462dc42a\") " pod="openshift-keda/keda-metrics-apiserver-68788fbd9b-hvmw8"
Jun 15 05:53:48.322521 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:48.322436    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/265ccf76-68a0-4a0a-98c2-11fc66dca196-certificates\") pod \"keda-operator-674595557b-zddjf\" (UID: \"265ccf76-68a0-4a0a-98c2-11fc66dca196\") " pod="openshift-keda/keda-operator-674595557b-zddjf"
Jun 15 05:53:48.322651 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:53:48.322551    2564 secret.go:281] references non-existent secret key: ca.crt
Jun 15 05:53:48.322651 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:53:48.322563    2564 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Jun 15 05:53:48.322651 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:53:48.322571    2564 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-674595557b-zddjf: references non-existent secret key: ca.crt
Jun 15 05:53:48.322651 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:53:48.322621    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/265ccf76-68a0-4a0a-98c2-11fc66dca196-certificates podName:265ccf76-68a0-4a0a-98c2-11fc66dca196 nodeName:}" failed. No retries permitted until 2026-06-15 05:53:49.322602005 +0000 UTC m=+371.689147033 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/265ccf76-68a0-4a0a-98c2-11fc66dca196-certificates") pod "keda-operator-674595557b-zddjf" (UID: "265ccf76-68a0-4a0a-98c2-11fc66dca196") : references non-existent secret key: ca.crt
Jun 15 05:53:48.624761 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:48.624673    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/9c147b6b-c80e-4dc9-9aff-088f462dc42a-certificates\") pod \"keda-metrics-apiserver-68788fbd9b-hvmw8\" (UID: \"9c147b6b-c80e-4dc9-9aff-088f462dc42a\") " pod="openshift-keda/keda-metrics-apiserver-68788fbd9b-hvmw8"
Jun 15 05:53:48.625130 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:53:48.624791    2564 secret.go:281] references non-existent secret key: tls.crt
Jun 15 05:53:48.625130 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:53:48.624804    2564 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
Jun 15 05:53:48.625130 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:53:48.624820    2564 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-68788fbd9b-hvmw8: references non-existent secret key: tls.crt
Jun 15 05:53:48.625130 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:53:48.624891    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c147b6b-c80e-4dc9-9aff-088f462dc42a-certificates podName:9c147b6b-c80e-4dc9-9aff-088f462dc42a nodeName:}" failed. No retries permitted until 2026-06-15 05:53:49.624877952 +0000 UTC m=+371.991422996 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/9c147b6b-c80e-4dc9-9aff-088f462dc42a-certificates") pod "keda-metrics-apiserver-68788fbd9b-hvmw8" (UID: "9c147b6b-c80e-4dc9-9aff-088f462dc42a") : references non-existent secret key: tls.crt
Jun 15 05:53:49.331326 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:49.331290    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/265ccf76-68a0-4a0a-98c2-11fc66dca196-certificates\") pod \"keda-operator-674595557b-zddjf\" (UID: \"265ccf76-68a0-4a0a-98c2-11fc66dca196\") " pod="openshift-keda/keda-operator-674595557b-zddjf"
Jun 15 05:53:49.333774 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:49.333733    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/265ccf76-68a0-4a0a-98c2-11fc66dca196-certificates\") pod \"keda-operator-674595557b-zddjf\" (UID: \"265ccf76-68a0-4a0a-98c2-11fc66dca196\") " pod="openshift-keda/keda-operator-674595557b-zddjf"
Jun 15 05:53:49.432070 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:49.432041    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-674595557b-zddjf"
Jun 15 05:53:49.587376 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:49.587348    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-674595557b-zddjf"]
Jun 15 05:53:49.590043 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:53:49.590017    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod265ccf76_68a0_4a0a_98c2_11fc66dca196.slice/crio-03d17970c35788b1fc5930ecd82f7da3d968b46aaec5296b2d8a52075f47c575 WatchSource:0}: Error finding container 03d17970c35788b1fc5930ecd82f7da3d968b46aaec5296b2d8a52075f47c575: Status 404 returned error can't find the container with id 03d17970c35788b1fc5930ecd82f7da3d968b46aaec5296b2d8a52075f47c575
Jun 15 05:53:49.634701 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:49.634675    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/9c147b6b-c80e-4dc9-9aff-088f462dc42a-certificates\") pod \"keda-metrics-apiserver-68788fbd9b-hvmw8\" (UID: \"9c147b6b-c80e-4dc9-9aff-088f462dc42a\") " pod="openshift-keda/keda-metrics-apiserver-68788fbd9b-hvmw8"
Jun 15 05:53:49.637199 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:49.637181    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/9c147b6b-c80e-4dc9-9aff-088f462dc42a-certificates\") pod \"keda-metrics-apiserver-68788fbd9b-hvmw8\" (UID: \"9c147b6b-c80e-4dc9-9aff-088f462dc42a\") " pod="openshift-keda/keda-metrics-apiserver-68788fbd9b-hvmw8"
Jun 15 05:53:49.749935 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:49.749904    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-674595557b-zddjf" event={"ID":"265ccf76-68a0-4a0a-98c2-11fc66dca196","Type":"ContainerStarted","Data":"03d17970c35788b1fc5930ecd82f7da3d968b46aaec5296b2d8a52075f47c575"}
Jun 15 05:53:49.793216 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:49.793179    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-68788fbd9b-hvmw8"
Jun 15 05:53:49.931943 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:49.931912    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-68788fbd9b-hvmw8"]
Jun 15 05:53:49.934922 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:53:49.934874    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c147b6b_c80e_4dc9_9aff_088f462dc42a.slice/crio-e483f50ffccd389c2bb1fa6ed5cf0ce73fd2739da249541d51577491f7d333ca WatchSource:0}: Error finding container e483f50ffccd389c2bb1fa6ed5cf0ce73fd2739da249541d51577491f7d333ca: Status 404 returned error can't find the container with id e483f50ffccd389c2bb1fa6ed5cf0ce73fd2739da249541d51577491f7d333ca
Jun 15 05:53:50.756297 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:50.756264    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-68788fbd9b-hvmw8" event={"ID":"9c147b6b-c80e-4dc9-9aff-088f462dc42a","Type":"ContainerStarted","Data":"e483f50ffccd389c2bb1fa6ed5cf0ce73fd2739da249541d51577491f7d333ca"}
Jun 15 05:53:53.771530 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:53.771487    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-68788fbd9b-hvmw8" event={"ID":"9c147b6b-c80e-4dc9-9aff-088f462dc42a","Type":"ContainerStarted","Data":"b2b2ab9c4395a5fa2ace8e0c7d3e586c5060cb2e17d9f61bd4e5562c1d68de9e"}
Jun 15 05:53:53.772013 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:53.771660    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-68788fbd9b-hvmw8"
Jun 15 05:53:53.773168 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:53.773140    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-674595557b-zddjf" event={"ID":"265ccf76-68a0-4a0a-98c2-11fc66dca196","Type":"ContainerStarted","Data":"bf969bdfdf5784d40c003cd3fd9ed0bfc87b147e01daa45ad3616d38314cdcd5"}
Jun 15 05:53:53.773305 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:53.773272    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-674595557b-zddjf"
Jun 15 05:53:53.797296 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:53.797237    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-68788fbd9b-hvmw8" podStartSLOduration=3.500000562 podStartE2EDuration="6.797219407s" totalImagesPullingTime="3.297218845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:53:53.796094414 +0000 UTC m=+376.162639479" watchObservedRunningTime="2026-06-15 05:53:53.797219407 +0000 UTC m=+376.163764458"
Jun 15 05:53:53.817041 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:53:53.816995    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-674595557b-zddjf" podStartSLOduration=3.176464743 podStartE2EDuration="6.816980109s" totalImagesPullingTime="3.640515366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:53:53.816409482 +0000 UTC m=+376.182954533" watchObservedRunningTime="2026-06-15 05:53:53.816980109 +0000 UTC m=+376.183525207"
Jun 15 05:54:04.782156 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:54:04.782118    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-68788fbd9b-hvmw8"
Jun 15 05:54:08.746642 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:54:08.746610    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6685d4df84-c2mcp"
Jun 15 05:54:14.779913 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:54:14.779876    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-674595557b-zddjf"
Jun 15 05:55:03.338538 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:55:03.338451    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-84fc959947-z945b"]
Jun 15 05:55:03.341763 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:55:03.341739    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-84fc959947-z945b"
Jun 15 05:55:03.344721 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:55:03.344696    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-dnct4\""
Jun 15 05:55:03.345056 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:55:03.345037    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jun 15 05:55:03.345603 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:55:03.345586    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
Jun 15 05:55:03.345640 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:55:03.345622    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jun 15 05:55:03.356493 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:55:03.356472    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-84fc959947-z945b"]
Jun 15 05:55:03.412819 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:55:03.412791    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blmst\" (UniqueName: \"kubernetes.io/projected/3f7dd90d-675d-4ba2-8e6f-4ca3f54f01b7-kube-api-access-blmst\") pod \"llmisvc-controller-manager-84fc959947-z945b\" (UID: \"3f7dd90d-675d-4ba2-8e6f-4ca3f54f01b7\") " pod="kserve/llmisvc-controller-manager-84fc959947-z945b"
Jun 15 05:55:03.413005 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:55:03.412826    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f7dd90d-675d-4ba2-8e6f-4ca3f54f01b7-cert\") pod \"llmisvc-controller-manager-84fc959947-z945b\" (UID: \"3f7dd90d-675d-4ba2-8e6f-4ca3f54f01b7\") " pod="kserve/llmisvc-controller-manager-84fc959947-z945b"
Jun 15 05:55:03.514114 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:55:03.514082    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blmst\" (UniqueName: \"kubernetes.io/projected/3f7dd90d-675d-4ba2-8e6f-4ca3f54f01b7-kube-api-access-blmst\") pod \"llmisvc-controller-manager-84fc959947-z945b\" (UID: \"3f7dd90d-675d-4ba2-8e6f-4ca3f54f01b7\") " pod="kserve/llmisvc-controller-manager-84fc959947-z945b"
Jun 15 05:55:03.514114 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:55:03.514123    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f7dd90d-675d-4ba2-8e6f-4ca3f54f01b7-cert\") pod \"llmisvc-controller-manager-84fc959947-z945b\" (UID: \"3f7dd90d-675d-4ba2-8e6f-4ca3f54f01b7\") " pod="kserve/llmisvc-controller-manager-84fc959947-z945b"
Jun 15 05:55:03.514362 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:55:03.514260    2564 secret.go:189] Couldn't get secret kserve/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jun 15 05:55:03.514362 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:55:03.514332    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f7dd90d-675d-4ba2-8e6f-4ca3f54f01b7-cert podName:3f7dd90d-675d-4ba2-8e6f-4ca3f54f01b7 nodeName:}" failed. No retries permitted until 2026-06-15 05:55:04.014309736 +0000 UTC m=+446.380854777 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3f7dd90d-675d-4ba2-8e6f-4ca3f54f01b7-cert") pod "llmisvc-controller-manager-84fc959947-z945b" (UID: "3f7dd90d-675d-4ba2-8e6f-4ca3f54f01b7") : secret "llmisvc-webhook-server-cert" not found
Jun 15 05:55:03.527040 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:55:03.527014    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blmst\" (UniqueName: \"kubernetes.io/projected/3f7dd90d-675d-4ba2-8e6f-4ca3f54f01b7-kube-api-access-blmst\") pod \"llmisvc-controller-manager-84fc959947-z945b\" (UID: \"3f7dd90d-675d-4ba2-8e6f-4ca3f54f01b7\") " pod="kserve/llmisvc-controller-manager-84fc959947-z945b"
Jun 15 05:55:04.018259 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:55:04.018223    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f7dd90d-675d-4ba2-8e6f-4ca3f54f01b7-cert\") pod \"llmisvc-controller-manager-84fc959947-z945b\" (UID: \"3f7dd90d-675d-4ba2-8e6f-4ca3f54f01b7\") " pod="kserve/llmisvc-controller-manager-84fc959947-z945b"
Jun 15 05:55:04.020772 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:55:04.020740    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f7dd90d-675d-4ba2-8e6f-4ca3f54f01b7-cert\") pod \"llmisvc-controller-manager-84fc959947-z945b\" (UID: \"3f7dd90d-675d-4ba2-8e6f-4ca3f54f01b7\") " pod="kserve/llmisvc-controller-manager-84fc959947-z945b"
Jun 15 05:55:04.251728 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:55:04.251690    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-84fc959947-z945b"
Jun 15 05:55:04.387064 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:55:04.387039    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-84fc959947-z945b"]
Jun 15 05:55:04.389137 ip-10-0-131-82 kubenswrapper[2564]: W0615 05:55:04.389112    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3f7dd90d_675d_4ba2_8e6f_4ca3f54f01b7.slice/crio-10973d88f8dc79b6a3214cd072346df09fbd555bb03eea2ee12ec5c717c0891a WatchSource:0}: Error finding container 10973d88f8dc79b6a3214cd072346df09fbd555bb03eea2ee12ec5c717c0891a: Status 404 returned error can't find the container with id 10973d88f8dc79b6a3214cd072346df09fbd555bb03eea2ee12ec5c717c0891a
Jun 15 05:55:05.058723 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:55:05.058691    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-84fc959947-z945b" event={"ID":"3f7dd90d-675d-4ba2-8e6f-4ca3f54f01b7","Type":"ContainerStarted","Data":"10973d88f8dc79b6a3214cd072346df09fbd555bb03eea2ee12ec5c717c0891a"}
Jun 15 05:55:08.072160 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:55:08.072126    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-84fc959947-z945b" event={"ID":"3f7dd90d-675d-4ba2-8e6f-4ca3f54f01b7","Type":"ContainerStarted","Data":"be2010413fec6e669bc897e35e52bb4bc96e9abbaa01dd58490d62ec0ba21ec5"}
Jun 15 05:55:08.072535 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:55:08.072263    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-84fc959947-z945b"
Jun 15 05:55:08.102510 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:55:08.102455    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-84fc959947-z945b" podStartSLOduration=2.3606055870000002 podStartE2EDuration="5.102439478s" totalImagesPullingTime="2.741833891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:55:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:55:08.101398236 +0000 UTC m=+450.467943287" watchObservedRunningTime="2026-06-15 05:55:08.102439478 +0000 UTC m=+450.468984526"
Jun 15 05:55:39.078341 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:55:39.078314    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-84fc959947-z945b"
Jun 15 05:55:46.530478 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:55:46.530445    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b5f557867-8p7qj"]
Jun 15 05:56:11.552342 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:56:11.552300    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5b5f557867-8p7qj" podUID="73504953-8917-4ec6-b06d-92bfaa234bea" containerName="console" containerID="cri-o://980efbf23444e68501f3a7684efd20831cfedfe1e54e1c09b88cf5ed983c67ab" gracePeriod=15
Jun 15 05:56:11.801017 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:56:11.800990    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b5f557867-8p7qj"
Jun 15 05:56:11.849597 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:56:11.849537    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73504953-8917-4ec6-b06d-92bfaa234bea-console-oauth-config\") pod \"73504953-8917-4ec6-b06d-92bfaa234bea\" (UID: \"73504953-8917-4ec6-b06d-92bfaa234bea\") "
Jun 15 05:56:11.849597 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:56:11.849590    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73504953-8917-4ec6-b06d-92bfaa234bea-trusted-ca-bundle\") pod \"73504953-8917-4ec6-b06d-92bfaa234bea\" (UID: \"73504953-8917-4ec6-b06d-92bfaa234bea\") "
Jun 15 05:56:11.849774 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:56:11.849634    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rghl\" (UniqueName: \"kubernetes.io/projected/73504953-8917-4ec6-b06d-92bfaa234bea-kube-api-access-9rghl\") pod \"73504953-8917-4ec6-b06d-92bfaa234bea\" (UID: \"73504953-8917-4ec6-b06d-92bfaa234bea\") "
Jun 15 05:56:11.849774 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:56:11.849651    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73504953-8917-4ec6-b06d-92bfaa234bea-oauth-serving-cert\") pod \"73504953-8917-4ec6-b06d-92bfaa234bea\" (UID: \"73504953-8917-4ec6-b06d-92bfaa234bea\") "
Jun 15 05:56:11.849774 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:56:11.849673    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73504953-8917-4ec6-b06d-92bfaa234bea-console-serving-cert\") pod \"73504953-8917-4ec6-b06d-92bfaa234bea\" (UID: \"73504953-8917-4ec6-b06d-92bfaa234bea\") "
Jun 15 05:56:11.849774 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:56:11.849713    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73504953-8917-4ec6-b06d-92bfaa234bea-service-ca\") pod \"73504953-8917-4ec6-b06d-92bfaa234bea\" (UID: \"73504953-8917-4ec6-b06d-92bfaa234bea\") "
Jun 15 05:56:11.849774 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:56:11.849748    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73504953-8917-4ec6-b06d-92bfaa234bea-console-config\") pod \"73504953-8917-4ec6-b06d-92bfaa234bea\" (UID: \"73504953-8917-4ec6-b06d-92bfaa234bea\") "
Jun 15 05:56:11.850160 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:56:11.850128    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73504953-8917-4ec6-b06d-92bfaa234bea-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "73504953-8917-4ec6-b06d-92bfaa234bea" (UID: "73504953-8917-4ec6-b06d-92bfaa234bea"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 05:56:11.850256 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:56:11.850212    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73504953-8917-4ec6-b06d-92bfaa234bea-service-ca" (OuterVolumeSpecName: "service-ca") pod "73504953-8917-4ec6-b06d-92bfaa234bea" (UID: "73504953-8917-4ec6-b06d-92bfaa234bea"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 05:56:11.850256 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:56:11.850232    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73504953-8917-4ec6-b06d-92bfaa234bea-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "73504953-8917-4ec6-b06d-92bfaa234bea" (UID: "73504953-8917-4ec6-b06d-92bfaa234bea"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 05:56:11.850511 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:56:11.850428    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73504953-8917-4ec6-b06d-92bfaa234bea-console-config" (OuterVolumeSpecName: "console-config") pod "73504953-8917-4ec6-b06d-92bfaa234bea" (UID: "73504953-8917-4ec6-b06d-92bfaa234bea"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 05:56:11.851901 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:56:11.851853    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73504953-8917-4ec6-b06d-92bfaa234bea-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "73504953-8917-4ec6-b06d-92bfaa234bea" (UID: "73504953-8917-4ec6-b06d-92bfaa234bea"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 05:56:11.851901 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:56:11.851889    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73504953-8917-4ec6-b06d-92bfaa234bea-kube-api-access-9rghl" (OuterVolumeSpecName: "kube-api-access-9rghl") pod "73504953-8917-4ec6-b06d-92bfaa234bea" (UID: "73504953-8917-4ec6-b06d-92bfaa234bea"). InnerVolumeSpecName "kube-api-access-9rghl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 05:56:11.852031 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:56:11.852010    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73504953-8917-4ec6-b06d-92bfaa234bea-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "73504953-8917-4ec6-b06d-92bfaa234bea" (UID: "73504953-8917-4ec6-b06d-92bfaa234bea"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 05:56:11.950431 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:56:11.950402    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73504953-8917-4ec6-b06d-92bfaa234bea-oauth-serving-cert\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 05:56:11.950431 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:56:11.950427    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73504953-8917-4ec6-b06d-92bfaa234bea-console-serving-cert\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 05:56:11.950431 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:56:11.950438    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73504953-8917-4ec6-b06d-92bfaa234bea-service-ca\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 05:56:11.950634 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:56:11.950447    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73504953-8917-4ec6-b06d-92bfaa234bea-console-config\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 05:56:11.950634 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:56:11.950455    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73504953-8917-4ec6-b06d-92bfaa234bea-console-oauth-config\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 05:56:11.950634 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:56:11.950464    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73504953-8917-4ec6-b06d-92bfaa234bea-trusted-ca-bundle\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 05:56:11.950634 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:56:11.950473    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rghl\" (UniqueName: \"kubernetes.io/projected/73504953-8917-4ec6-b06d-92bfaa234bea-kube-api-access-9rghl\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 05:56:12.334468 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:56:12.334440    2564 generic.go:356] "Generic (PLEG): container finished" podID="73504953-8917-4ec6-b06d-92bfaa234bea" containerID="980efbf23444e68501f3a7684efd20831cfedfe1e54e1c09b88cf5ed983c67ab" exitCode=0
Jun 15 05:56:12.334632 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:56:12.334480    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b5f557867-8p7qj"
Jun 15 05:56:12.334632 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:56:12.334487    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b5f557867-8p7qj" event={"ID":"73504953-8917-4ec6-b06d-92bfaa234bea","Type":"ContainerDied","Data":"980efbf23444e68501f3a7684efd20831cfedfe1e54e1c09b88cf5ed983c67ab"}
Jun 15 05:56:12.334632 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:56:12.334525    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b5f557867-8p7qj" event={"ID":"73504953-8917-4ec6-b06d-92bfaa234bea","Type":"ContainerDied","Data":"269e7035cd9f63f8cfd698a5f1bf5c17970048fa2ad8ccdb28d3b35a770d1a42"}
Jun 15 05:56:12.334632 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:56:12.334545    2564 scope.go:117] "RemoveContainer" containerID="980efbf23444e68501f3a7684efd20831cfedfe1e54e1c09b88cf5ed983c67ab"
Jun 15 05:56:12.342663 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:56:12.342646    2564 scope.go:117] "RemoveContainer" containerID="980efbf23444e68501f3a7684efd20831cfedfe1e54e1c09b88cf5ed983c67ab"
Jun 15 05:56:12.342944 ip-10-0-131-82 kubenswrapper[2564]: E0615 05:56:12.342926    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"980efbf23444e68501f3a7684efd20831cfedfe1e54e1c09b88cf5ed983c67ab\": container with ID starting with 980efbf23444e68501f3a7684efd20831cfedfe1e54e1c09b88cf5ed983c67ab not found: ID does not exist" containerID="980efbf23444e68501f3a7684efd20831cfedfe1e54e1c09b88cf5ed983c67ab"
Jun 15 05:56:12.342992 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:56:12.342954    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"980efbf23444e68501f3a7684efd20831cfedfe1e54e1c09b88cf5ed983c67ab"} err="failed to get container status \"980efbf23444e68501f3a7684efd20831cfedfe1e54e1c09b88cf5ed983c67ab\": rpc error: code = NotFound desc = could not find container \"980efbf23444e68501f3a7684efd20831cfedfe1e54e1c09b88cf5ed983c67ab\": container with ID starting with 980efbf23444e68501f3a7684efd20831cfedfe1e54e1c09b88cf5ed983c67ab not found: ID does not exist"
Jun 15 05:56:12.356831 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:56:12.356806    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b5f557867-8p7qj"]
Jun 15 05:56:12.361508 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:56:12.361488    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b5f557867-8p7qj"]
Jun 15 05:56:14.136465 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:56:14.136432    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73504953-8917-4ec6-b06d-92bfaa234bea" path="/var/lib/kubelet/pods/73504953-8917-4ec6-b06d-92bfaa234bea/volumes"
Jun 15 05:57:38.102308 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:57:38.102278    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kn9gn_8bf514ab-857d-416e-b51f-2235f4cb429d/console-operator/1.log"
Jun 15 05:57:38.104137 ip-10-0-131-82 kubenswrapper[2564]: I0615 05:57:38.104117    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kn9gn_8bf514ab-857d-416e-b51f-2235f4cb429d/console-operator/1.log"
Jun 15 06:02:38.127877 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:02:38.127832    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kn9gn_8bf514ab-857d-416e-b51f-2235f4cb429d/console-operator/1.log"
Jun 15 06:02:38.128346 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:02:38.128105    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kn9gn_8bf514ab-857d-416e-b51f-2235f4cb429d/console-operator/1.log"
Jun 15 06:07:38.152881 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:07:38.152836    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kn9gn_8bf514ab-857d-416e-b51f-2235f4cb429d/console-operator/1.log"
Jun 15 06:07:38.154392 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:07:38.154370    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kn9gn_8bf514ab-857d-416e-b51f-2235f4cb429d/console-operator/1.log"
Jun 15 06:12:38.175850 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:12:38.175820    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kn9gn_8bf514ab-857d-416e-b51f-2235f4cb429d/console-operator/1.log"
Jun 15 06:12:38.183968 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:12:38.183939    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kn9gn_8bf514ab-857d-416e-b51f-2235f4cb429d/console-operator/1.log"
Jun 15 06:17:38.205453 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:17:38.205423    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kn9gn_8bf514ab-857d-416e-b51f-2235f4cb429d/console-operator/1.log"
Jun 15 06:17:38.210629 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:17:38.210603    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kn9gn_8bf514ab-857d-416e-b51f-2235f4cb429d/console-operator/1.log"
Jun 15 06:22:38.231967 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:22:38.231934    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kn9gn_8bf514ab-857d-416e-b51f-2235f4cb429d/console-operator/1.log"
Jun 15 06:22:38.234870 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:22:38.234837    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kn9gn_8bf514ab-857d-416e-b51f-2235f4cb429d/console-operator/1.log"
Jun 15 06:26:34.676373 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:26:34.676300    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq"]
Jun 15 06:26:34.676828 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:26:34.676604    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73504953-8917-4ec6-b06d-92bfaa234bea" containerName="console"
Jun 15 06:26:34.676828 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:26:34.676614    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="73504953-8917-4ec6-b06d-92bfaa234bea" containerName="console"
Jun 15 06:26:34.676828 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:26:34.676680    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="73504953-8917-4ec6-b06d-92bfaa234bea" containerName="console"
Jun 15 06:26:34.679710 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:26:34.679691    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq"
Jun 15 06:26:34.682933 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:26:34.682911    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-predictive-lightgbm-predictor-serving-cert\""
Jun 15 06:26:34.683049 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:26:34.682950    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jun 15 06:26:34.683049 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:26:34.682950    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-predictive-lightgbm-kube-rbac-proxy-sar-config\""
Jun 15 06:26:34.683176 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:26:34.683112    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-q7vt7\""
Jun 15 06:26:34.684154 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:26:34.684135    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jun 15 06:26:34.684267 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:26:34.684140    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jun 15 06:26:34.684267 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:26:34.684170    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jun 15 06:26:34.692391 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:26:34.692367    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq"]
Jun 15 06:26:34.761557 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:26:34.761510    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7074d192-e32e-41d8-825d-dcfa06741765-proxy-tls\") pod \"isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq\" (UID: \"7074d192-e32e-41d8-825d-dcfa06741765\") " pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq"
Jun 15 06:26:34.761557 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:26:34.761564    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7074d192-e32e-41d8-825d-dcfa06741765-cabundle-cert\") pod \"isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq\" (UID: \"7074d192-e32e-41d8-825d-dcfa06741765\") " pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq"
Jun 15 06:26:34.761805 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:26:34.761593    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7074d192-e32e-41d8-825d-dcfa06741765-kserve-provision-location\") pod \"isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq\" (UID: \"7074d192-e32e-41d8-825d-dcfa06741765\") " pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq"
Jun 15 06:26:34.761805 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:26:34.761620    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7074d192-e32e-41d8-825d-dcfa06741765-kube-rbac-proxy-sar-config\") pod \"isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq\" (UID: \"7074d192-e32e-41d8-825d-dcfa06741765\") " pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq"
Jun 15 06:26:34.761805 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:26:34.761651    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf7x8\" (UniqueName: \"kubernetes.io/projected/7074d192-e32e-41d8-825d-dcfa06741765-kube-api-access-rf7x8\") pod \"isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq\" (UID: \"7074d192-e32e-41d8-825d-dcfa06741765\") " pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq"
Jun 15 06:26:34.862825 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:26:34.862786    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7074d192-e32e-41d8-825d-dcfa06741765-proxy-tls\") pod \"isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq\" (UID: \"7074d192-e32e-41d8-825d-dcfa06741765\") " pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq"
Jun 15 06:26:34.863035 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:26:34.862840    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7074d192-e32e-41d8-825d-dcfa06741765-cabundle-cert\") pod \"isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq\" (UID: \"7074d192-e32e-41d8-825d-dcfa06741765\") " pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq"
Jun 15 06:26:34.863035 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:26:34.862914    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7074d192-e32e-41d8-825d-dcfa06741765-kserve-provision-location\") pod \"isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq\" (UID: \"7074d192-e32e-41d8-825d-dcfa06741765\") " pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq"
Jun 15 06:26:34.863035 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:26:34.862939    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7074d192-e32e-41d8-825d-dcfa06741765-kube-rbac-proxy-sar-config\") pod \"isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq\" (UID: \"7074d192-e32e-41d8-825d-dcfa06741765\") " pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq"
Jun 15 06:26:34.863035 ip-10-0-131-82 kubenswrapper[2564]: E0615 06:26:34.862974    2564 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-serving-cert: secret "isvc-predictive-lightgbm-predictor-serving-cert" not found
Jun 15 06:26:34.863035 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:26:34.862989    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf7x8\" (UniqueName: \"kubernetes.io/projected/7074d192-e32e-41d8-825d-dcfa06741765-kube-api-access-rf7x8\") pod \"isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq\" (UID: \"7074d192-e32e-41d8-825d-dcfa06741765\") " pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq"
Jun 15 06:26:34.863403 ip-10-0-131-82 kubenswrapper[2564]: E0615 06:26:34.863058    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7074d192-e32e-41d8-825d-dcfa06741765-proxy-tls podName:7074d192-e32e-41d8-825d-dcfa06741765 nodeName:}" failed. No retries permitted until 2026-06-15 06:26:35.363038806 +0000 UTC m=+2337.729584045 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/7074d192-e32e-41d8-825d-dcfa06741765-proxy-tls") pod "isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq" (UID: "7074d192-e32e-41d8-825d-dcfa06741765") : secret "isvc-predictive-lightgbm-predictor-serving-cert" not found
Jun 15 06:26:34.863403 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:26:34.863297    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7074d192-e32e-41d8-825d-dcfa06741765-kserve-provision-location\") pod \"isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq\" (UID: \"7074d192-e32e-41d8-825d-dcfa06741765\") " pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq"
Jun 15 06:26:34.863575 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:26:34.863556    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7074d192-e32e-41d8-825d-dcfa06741765-cabundle-cert\") pod \"isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq\" (UID: \"7074d192-e32e-41d8-825d-dcfa06741765\") " pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq"
Jun 15 06:26:34.863613 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:26:34.863590    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7074d192-e32e-41d8-825d-dcfa06741765-kube-rbac-proxy-sar-config\") pod \"isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq\" (UID: \"7074d192-e32e-41d8-825d-dcfa06741765\") " pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq"
Jun 15 06:26:34.872385 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:26:34.872358    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf7x8\" (UniqueName: \"kubernetes.io/projected/7074d192-e32e-41d8-825d-dcfa06741765-kube-api-access-rf7x8\") pod \"isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq\" (UID: \"7074d192-e32e-41d8-825d-dcfa06741765\") " pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq"
Jun 15 06:26:35.366797 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:26:35.366765    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7074d192-e32e-41d8-825d-dcfa06741765-proxy-tls\") pod \"isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq\" (UID: \"7074d192-e32e-41d8-825d-dcfa06741765\") " pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq"
Jun 15 06:26:35.369262 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:26:35.369239    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7074d192-e32e-41d8-825d-dcfa06741765-proxy-tls\") pod \"isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq\" (UID: \"7074d192-e32e-41d8-825d-dcfa06741765\") " pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq"
Jun 15 06:26:35.592450 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:26:35.592417    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq"
Jun 15 06:26:35.727007 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:26:35.726976    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq"]
Jun 15 06:26:35.730027 ip-10-0-131-82 kubenswrapper[2564]: W0615 06:26:35.729996    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7074d192_e32e_41d8_825d_dcfa06741765.slice/crio-60ab2651f436cc33301c3a5d7dbeaac44c4dbb27c5c25df89cd62959f8da2283 WatchSource:0}: Error finding container 60ab2651f436cc33301c3a5d7dbeaac44c4dbb27c5c25df89cd62959f8da2283: Status 404 returned error can't find the container with id 60ab2651f436cc33301c3a5d7dbeaac44c4dbb27c5c25df89cd62959f8da2283
Jun 15 06:26:35.732368 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:26:35.732349    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 15 06:26:36.708280 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:26:36.708244    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq" event={"ID":"7074d192-e32e-41d8-825d-dcfa06741765","Type":"ContainerStarted","Data":"60ab2651f436cc33301c3a5d7dbeaac44c4dbb27c5c25df89cd62959f8da2283"}
Jun 15 06:26:39.773158 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:26:39.773138    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jun 15 06:26:40.726974 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:26:40.726936    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq" event={"ID":"7074d192-e32e-41d8-825d-dcfa06741765","Type":"ContainerStarted","Data":"216f149376a09e69bc368f6f5cb541a772e63636beb11f5dc6d2f635ab8db6c1"}
Jun 15 06:26:43.741372 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:26:43.741332    2564 generic.go:356] "Generic (PLEG): container finished" podID="7074d192-e32e-41d8-825d-dcfa06741765" containerID="216f149376a09e69bc368f6f5cb541a772e63636beb11f5dc6d2f635ab8db6c1" exitCode=0
Jun 15 06:26:43.741774 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:26:43.741406    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq" event={"ID":"7074d192-e32e-41d8-825d-dcfa06741765","Type":"ContainerDied","Data":"216f149376a09e69bc368f6f5cb541a772e63636beb11f5dc6d2f635ab8db6c1"}
Jun 15 06:27:06.859745 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:27:06.859700    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq" event={"ID":"7074d192-e32e-41d8-825d-dcfa06741765","Type":"ContainerStarted","Data":"3ab3398d3c3a032f20b8fbdd4dfb7c607c75fe2b1e1baa3626fef8f67125fedc"}
Jun 15 06:27:09.874289 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:27:09.874252    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq" event={"ID":"7074d192-e32e-41d8-825d-dcfa06741765","Type":"ContainerStarted","Data":"28d922f30eb9cafe29069b25c86826252d088aec8d514a2a08c60a58bce92c21"}
Jun 15 06:27:09.874656 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:27:09.874331    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq"
Jun 15 06:27:09.895039 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:27:09.894996    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq" podStartSLOduration=3.018134172 podStartE2EDuration="35.894984574s" totalImagesPullingTime="29.146832163s" totalInitContainerRuntime="3.730018239s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:26:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:27:09.893987754 +0000 UTC m=+2372.260532840" watchObservedRunningTime="2026-06-15 06:27:09.894984574 +0000 UTC m=+2372.261529624"
Jun 15 06:27:10.878606 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:27:10.878580    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq"
Jun 15 06:27:10.879799 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:27:10.879771    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq" podUID="7074d192-e32e-41d8-825d-dcfa06741765" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Jun 15 06:27:11.882953 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:27:11.882910    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq" podUID="7074d192-e32e-41d8-825d-dcfa06741765" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Jun 15 06:27:16.887589 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:27:16.887556    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq"
Jun 15 06:27:16.888262 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:27:16.888231    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq" podUID="7074d192-e32e-41d8-825d-dcfa06741765" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Jun 15 06:27:26.888175 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:27:26.888120    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq" podUID="7074d192-e32e-41d8-825d-dcfa06741765" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Jun 15 06:27:36.888668 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:27:36.888627    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq" podUID="7074d192-e32e-41d8-825d-dcfa06741765" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Jun 15 06:27:38.258034 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:27:38.258006    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kn9gn_8bf514ab-857d-416e-b51f-2235f4cb429d/console-operator/1.log"
Jun 15 06:27:38.259411 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:27:38.259392    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kn9gn_8bf514ab-857d-416e-b51f-2235f4cb429d/console-operator/1.log"
Jun 15 06:27:46.889166 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:27:46.889079    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq" podUID="7074d192-e32e-41d8-825d-dcfa06741765" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Jun 15 06:27:56.888787 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:27:56.888739    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq" podUID="7074d192-e32e-41d8-825d-dcfa06741765" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Jun 15 06:28:06.888167 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:06.888126    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq" podUID="7074d192-e32e-41d8-825d-dcfa06741765" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Jun 15 06:28:16.888096 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:16.888054    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq" podUID="7074d192-e32e-41d8-825d-dcfa06741765" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Jun 15 06:28:26.889664 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:26.889634    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq"
Jun 15 06:28:35.085895 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:35.085840    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq"]
Jun 15 06:28:35.086388 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:35.086222    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq" podUID="7074d192-e32e-41d8-825d-dcfa06741765" containerName="kserve-container" containerID="cri-o://3ab3398d3c3a032f20b8fbdd4dfb7c607c75fe2b1e1baa3626fef8f67125fedc" gracePeriod=30
Jun 15 06:28:35.086388 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:35.086223    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq" podUID="7074d192-e32e-41d8-825d-dcfa06741765" containerName="kube-rbac-proxy" containerID="cri-o://28d922f30eb9cafe29069b25c86826252d088aec8d514a2a08c60a58bce92c21" gracePeriod=30
Jun 15 06:28:35.180590 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:35.180554    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh"]
Jun 15 06:28:35.184221 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:35.184204    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh"
Jun 15 06:28:35.186551 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:35.186530    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-predictive-sklearn-v2-kube-rbac-proxy-sar-config\""
Jun 15 06:28:35.186643 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:35.186567    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-predictive-sklearn-v2-predictor-serving-cert\""
Jun 15 06:28:35.193800 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:35.193778    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh"]
Jun 15 06:28:35.231258 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:35.231233    2564 generic.go:356] "Generic (PLEG): container finished" podID="7074d192-e32e-41d8-825d-dcfa06741765" containerID="28d922f30eb9cafe29069b25c86826252d088aec8d514a2a08c60a58bce92c21" exitCode=2
Jun 15 06:28:35.231392 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:35.231306    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq" event={"ID":"7074d192-e32e-41d8-825d-dcfa06741765","Type":"ContainerDied","Data":"28d922f30eb9cafe29069b25c86826252d088aec8d514a2a08c60a58bce92c21"}
Jun 15 06:28:35.260774 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:35.260752    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6fwm\" (UniqueName: \"kubernetes.io/projected/6f8c58e0-0a37-4238-b4e7-54052333c2c4-kube-api-access-p6fwm\") pod \"isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh\" (UID: \"6f8c58e0-0a37-4238-b4e7-54052333c2c4\") " pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh"
Jun 15 06:28:35.260923 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:35.260791    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6f8c58e0-0a37-4238-b4e7-54052333c2c4-cabundle-cert\") pod \"isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh\" (UID: \"6f8c58e0-0a37-4238-b4e7-54052333c2c4\") " pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh"
Jun 15 06:28:35.260923 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:35.260837    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6f8c58e0-0a37-4238-b4e7-54052333c2c4-proxy-tls\") pod \"isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh\" (UID: \"6f8c58e0-0a37-4238-b4e7-54052333c2c4\") " pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh"
Jun 15 06:28:35.260923 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:35.260920    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6f8c58e0-0a37-4238-b4e7-54052333c2c4-kube-rbac-proxy-sar-config\") pod \"isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh\" (UID: \"6f8c58e0-0a37-4238-b4e7-54052333c2c4\") " pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh"
Jun 15 06:28:35.261067 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:35.260947    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6f8c58e0-0a37-4238-b4e7-54052333c2c4-kserve-provision-location\") pod \"isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh\" (UID: \"6f8c58e0-0a37-4238-b4e7-54052333c2c4\") " pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh"
Jun 15 06:28:35.361673 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:35.361603    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6f8c58e0-0a37-4238-b4e7-54052333c2c4-kube-rbac-proxy-sar-config\") pod \"isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh\" (UID: \"6f8c58e0-0a37-4238-b4e7-54052333c2c4\") " pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh"
Jun 15 06:28:35.361673 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:35.361634    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6f8c58e0-0a37-4238-b4e7-54052333c2c4-kserve-provision-location\") pod \"isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh\" (UID: \"6f8c58e0-0a37-4238-b4e7-54052333c2c4\") " pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh"
Jun 15 06:28:35.361673 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:35.361672    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6fwm\" (UniqueName: \"kubernetes.io/projected/6f8c58e0-0a37-4238-b4e7-54052333c2c4-kube-api-access-p6fwm\") pod \"isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh\" (UID: \"6f8c58e0-0a37-4238-b4e7-54052333c2c4\") " pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh"
Jun 15 06:28:35.361945 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:35.361695    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6f8c58e0-0a37-4238-b4e7-54052333c2c4-cabundle-cert\") pod \"isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh\" (UID: \"6f8c58e0-0a37-4238-b4e7-54052333c2c4\") " pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh"
Jun 15 06:28:35.361945 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:35.361740    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6f8c58e0-0a37-4238-b4e7-54052333c2c4-proxy-tls\") pod \"isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh\" (UID: \"6f8c58e0-0a37-4238-b4e7-54052333c2c4\") " pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh"
Jun 15 06:28:35.362212 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:35.362181    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6f8c58e0-0a37-4238-b4e7-54052333c2c4-kserve-provision-location\") pod \"isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh\" (UID: \"6f8c58e0-0a37-4238-b4e7-54052333c2c4\") " pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh"
Jun 15 06:28:35.362409 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:35.362389    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6f8c58e0-0a37-4238-b4e7-54052333c2c4-kube-rbac-proxy-sar-config\") pod \"isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh\" (UID: \"6f8c58e0-0a37-4238-b4e7-54052333c2c4\") " pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh"
Jun 15 06:28:35.362482 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:35.362433    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6f8c58e0-0a37-4238-b4e7-54052333c2c4-cabundle-cert\") pod \"isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh\" (UID: \"6f8c58e0-0a37-4238-b4e7-54052333c2c4\") " pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh"
Jun 15 06:28:35.364423 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:35.364403    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6f8c58e0-0a37-4238-b4e7-54052333c2c4-proxy-tls\") pod \"isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh\" (UID: \"6f8c58e0-0a37-4238-b4e7-54052333c2c4\") " pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh"
Jun 15 06:28:35.375349 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:35.375326    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6fwm\" (UniqueName: \"kubernetes.io/projected/6f8c58e0-0a37-4238-b4e7-54052333c2c4-kube-api-access-p6fwm\") pod \"isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh\" (UID: \"6f8c58e0-0a37-4238-b4e7-54052333c2c4\") " pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh"
Jun 15 06:28:35.495635 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:35.495601    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh"
Jun 15 06:28:35.630280 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:35.630252    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh"]
Jun 15 06:28:35.632598 ip-10-0-131-82 kubenswrapper[2564]: W0615 06:28:35.632574    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f8c58e0_0a37_4238_b4e7_54052333c2c4.slice/crio-0db4a1789dfb98abcef7922b193a20c6fb81054e883e6f1ca34a87d0636d72ef WatchSource:0}: Error finding container 0db4a1789dfb98abcef7922b193a20c6fb81054e883e6f1ca34a87d0636d72ef: Status 404 returned error can't find the container with id 0db4a1789dfb98abcef7922b193a20c6fb81054e883e6f1ca34a87d0636d72ef
Jun 15 06:28:36.236782 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:36.236744    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh" event={"ID":"6f8c58e0-0a37-4238-b4e7-54052333c2c4","Type":"ContainerStarted","Data":"46db4a4edd7d228cf2599e3be240107c131daff8e0fa0cb355521530c4c936df"}
Jun 15 06:28:36.237204 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:36.236800    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh" event={"ID":"6f8c58e0-0a37-4238-b4e7-54052333c2c4","Type":"ContainerStarted","Data":"0db4a1789dfb98abcef7922b193a20c6fb81054e883e6f1ca34a87d0636d72ef"}
Jun 15 06:28:36.884019 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:36.883977    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq" podUID="7074d192-e32e-41d8-825d-dcfa06741765" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.30:8643/healthz\": dial tcp 10.132.0.30:8643: connect: connection refused"
Jun 15 06:28:36.888293 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:36.888269    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq" podUID="7074d192-e32e-41d8-825d-dcfa06741765" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Jun 15 06:28:40.232568 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:40.232545    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq"
Jun 15 06:28:40.254071 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:40.253990    2564 generic.go:356] "Generic (PLEG): container finished" podID="7074d192-e32e-41d8-825d-dcfa06741765" containerID="3ab3398d3c3a032f20b8fbdd4dfb7c607c75fe2b1e1baa3626fef8f67125fedc" exitCode=0
Jun 15 06:28:40.254198 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:40.254078    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq"
Jun 15 06:28:40.254198 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:40.254092    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq" event={"ID":"7074d192-e32e-41d8-825d-dcfa06741765","Type":"ContainerDied","Data":"3ab3398d3c3a032f20b8fbdd4dfb7c607c75fe2b1e1baa3626fef8f67125fedc"}
Jun 15 06:28:40.254198 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:40.254146    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq" event={"ID":"7074d192-e32e-41d8-825d-dcfa06741765","Type":"ContainerDied","Data":"60ab2651f436cc33301c3a5d7dbeaac44c4dbb27c5c25df89cd62959f8da2283"}
Jun 15 06:28:40.254198 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:40.254183    2564 scope.go:117] "RemoveContainer" containerID="28d922f30eb9cafe29069b25c86826252d088aec8d514a2a08c60a58bce92c21"
Jun 15 06:28:40.255941 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:40.255917    2564 generic.go:356] "Generic (PLEG): container finished" podID="6f8c58e0-0a37-4238-b4e7-54052333c2c4" containerID="46db4a4edd7d228cf2599e3be240107c131daff8e0fa0cb355521530c4c936df" exitCode=0
Jun 15 06:28:40.256050 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:40.256017    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh" event={"ID":"6f8c58e0-0a37-4238-b4e7-54052333c2c4","Type":"ContainerDied","Data":"46db4a4edd7d228cf2599e3be240107c131daff8e0fa0cb355521530c4c936df"}
Jun 15 06:28:40.264941 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:40.264922    2564 scope.go:117] "RemoveContainer" containerID="3ab3398d3c3a032f20b8fbdd4dfb7c607c75fe2b1e1baa3626fef8f67125fedc"
Jun 15 06:28:40.273552 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:40.273530    2564 scope.go:117] "RemoveContainer" containerID="216f149376a09e69bc368f6f5cb541a772e63636beb11f5dc6d2f635ab8db6c1"
Jun 15 06:28:40.286219 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:40.286203    2564 scope.go:117] "RemoveContainer" containerID="28d922f30eb9cafe29069b25c86826252d088aec8d514a2a08c60a58bce92c21"
Jun 15 06:28:40.286512 ip-10-0-131-82 kubenswrapper[2564]: E0615 06:28:40.286492    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28d922f30eb9cafe29069b25c86826252d088aec8d514a2a08c60a58bce92c21\": container with ID starting with 28d922f30eb9cafe29069b25c86826252d088aec8d514a2a08c60a58bce92c21 not found: ID does not exist" containerID="28d922f30eb9cafe29069b25c86826252d088aec8d514a2a08c60a58bce92c21"
Jun 15 06:28:40.286563 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:40.286519    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28d922f30eb9cafe29069b25c86826252d088aec8d514a2a08c60a58bce92c21"} err="failed to get container status \"28d922f30eb9cafe29069b25c86826252d088aec8d514a2a08c60a58bce92c21\": rpc error: code = NotFound desc = could not find container \"28d922f30eb9cafe29069b25c86826252d088aec8d514a2a08c60a58bce92c21\": container with ID starting with 28d922f30eb9cafe29069b25c86826252d088aec8d514a2a08c60a58bce92c21 not found: ID does not exist"
Jun 15 06:28:40.286563 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:40.286538    2564 scope.go:117] "RemoveContainer" containerID="3ab3398d3c3a032f20b8fbdd4dfb7c607c75fe2b1e1baa3626fef8f67125fedc"
Jun 15 06:28:40.286770 ip-10-0-131-82 kubenswrapper[2564]: E0615 06:28:40.286749    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ab3398d3c3a032f20b8fbdd4dfb7c607c75fe2b1e1baa3626fef8f67125fedc\": container with ID starting with 3ab3398d3c3a032f20b8fbdd4dfb7c607c75fe2b1e1baa3626fef8f67125fedc not found: ID does not exist" containerID="3ab3398d3c3a032f20b8fbdd4dfb7c607c75fe2b1e1baa3626fef8f67125fedc"
Jun 15 06:28:40.286811 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:40.286778    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ab3398d3c3a032f20b8fbdd4dfb7c607c75fe2b1e1baa3626fef8f67125fedc"} err="failed to get container status \"3ab3398d3c3a032f20b8fbdd4dfb7c607c75fe2b1e1baa3626fef8f67125fedc\": rpc error: code = NotFound desc = could not find container \"3ab3398d3c3a032f20b8fbdd4dfb7c607c75fe2b1e1baa3626fef8f67125fedc\": container with ID starting with 3ab3398d3c3a032f20b8fbdd4dfb7c607c75fe2b1e1baa3626fef8f67125fedc not found: ID does not exist"
Jun 15 06:28:40.286811 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:40.286793    2564 scope.go:117] "RemoveContainer" containerID="216f149376a09e69bc368f6f5cb541a772e63636beb11f5dc6d2f635ab8db6c1"
Jun 15 06:28:40.287043 ip-10-0-131-82 kubenswrapper[2564]: E0615 06:28:40.287023    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"216f149376a09e69bc368f6f5cb541a772e63636beb11f5dc6d2f635ab8db6c1\": container with ID starting with 216f149376a09e69bc368f6f5cb541a772e63636beb11f5dc6d2f635ab8db6c1 not found: ID does not exist" containerID="216f149376a09e69bc368f6f5cb541a772e63636beb11f5dc6d2f635ab8db6c1"
Jun 15 06:28:40.287089 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:40.287049    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"216f149376a09e69bc368f6f5cb541a772e63636beb11f5dc6d2f635ab8db6c1"} err="failed to get container status \"216f149376a09e69bc368f6f5cb541a772e63636beb11f5dc6d2f635ab8db6c1\": rpc error: code = NotFound desc = could not find container \"216f149376a09e69bc368f6f5cb541a772e63636beb11f5dc6d2f635ab8db6c1\": container with ID starting with 216f149376a09e69bc368f6f5cb541a772e63636beb11f5dc6d2f635ab8db6c1 not found: ID does not exist"
Jun 15 06:28:40.304971 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:40.304953    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7074d192-e32e-41d8-825d-dcfa06741765-cabundle-cert\") pod \"7074d192-e32e-41d8-825d-dcfa06741765\" (UID: \"7074d192-e32e-41d8-825d-dcfa06741765\") "
Jun 15 06:28:40.305062 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:40.304987    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rf7x8\" (UniqueName: \"kubernetes.io/projected/7074d192-e32e-41d8-825d-dcfa06741765-kube-api-access-rf7x8\") pod \"7074d192-e32e-41d8-825d-dcfa06741765\" (UID: \"7074d192-e32e-41d8-825d-dcfa06741765\") "
Jun 15 06:28:40.305062 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:40.305010    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7074d192-e32e-41d8-825d-dcfa06741765-kube-rbac-proxy-sar-config\") pod \"7074d192-e32e-41d8-825d-dcfa06741765\" (UID: \"7074d192-e32e-41d8-825d-dcfa06741765\") "
Jun 15 06:28:40.305062 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:40.305055    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7074d192-e32e-41d8-825d-dcfa06741765-kserve-provision-location\") pod \"7074d192-e32e-41d8-825d-dcfa06741765\" (UID: \"7074d192-e32e-41d8-825d-dcfa06741765\") "
Jun 15 06:28:40.305264 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:40.305075    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7074d192-e32e-41d8-825d-dcfa06741765-proxy-tls\") pod \"7074d192-e32e-41d8-825d-dcfa06741765\" (UID: \"7074d192-e32e-41d8-825d-dcfa06741765\") "
Jun 15 06:28:40.305367 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:40.305341    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7074d192-e32e-41d8-825d-dcfa06741765-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "7074d192-e32e-41d8-825d-dcfa06741765" (UID: "7074d192-e32e-41d8-825d-dcfa06741765"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 06:28:40.305468 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:40.305405    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7074d192-e32e-41d8-825d-dcfa06741765-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "7074d192-e32e-41d8-825d-dcfa06741765" (UID: "7074d192-e32e-41d8-825d-dcfa06741765"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 06:28:40.305918 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:40.305895    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7074d192-e32e-41d8-825d-dcfa06741765-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "7074d192-e32e-41d8-825d-dcfa06741765" (UID: "7074d192-e32e-41d8-825d-dcfa06741765"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:28:40.307314 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:40.307297    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7074d192-e32e-41d8-825d-dcfa06741765-kube-api-access-rf7x8" (OuterVolumeSpecName: "kube-api-access-rf7x8") pod "7074d192-e32e-41d8-825d-dcfa06741765" (UID: "7074d192-e32e-41d8-825d-dcfa06741765"). InnerVolumeSpecName "kube-api-access-rf7x8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 06:28:40.307594 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:40.307569    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7074d192-e32e-41d8-825d-dcfa06741765-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "7074d192-e32e-41d8-825d-dcfa06741765" (UID: "7074d192-e32e-41d8-825d-dcfa06741765"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 06:28:40.406704 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:40.406671    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rf7x8\" (UniqueName: \"kubernetes.io/projected/7074d192-e32e-41d8-825d-dcfa06741765-kube-api-access-rf7x8\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:28:40.406704 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:40.406698    2564 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7074d192-e32e-41d8-825d-dcfa06741765-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:28:40.406704 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:40.406710    2564 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7074d192-e32e-41d8-825d-dcfa06741765-kserve-provision-location\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:28:40.406930 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:40.406719    2564 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7074d192-e32e-41d8-825d-dcfa06741765-proxy-tls\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:28:40.406930 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:40.406728    2564 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7074d192-e32e-41d8-825d-dcfa06741765-cabundle-cert\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:28:40.577984 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:40.577950    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq"]
Jun 15 06:28:40.582770 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:40.582746    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-predictive-lightgbm-predictor-ff56bcbb5-fbxtq"]
Jun 15 06:28:41.264469 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:41.264437    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh" event={"ID":"6f8c58e0-0a37-4238-b4e7-54052333c2c4","Type":"ContainerStarted","Data":"add53f09e74e4d0e043e8a0bf4a0bbb3d5e49d60307f2f885206d5b0bfec09a7"}
Jun 15 06:28:41.264875 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:41.264493    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh" event={"ID":"6f8c58e0-0a37-4238-b4e7-54052333c2c4","Type":"ContainerStarted","Data":"3ea76a616480c880ca2b9d69075681f383aa8eaa0d3c3cb7b09ef69094978230"}
Jun 15 06:28:41.264875 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:41.264825    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh"
Jun 15 06:28:41.264969 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:41.264897    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh"
Jun 15 06:28:42.136879 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:42.136841    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7074d192-e32e-41d8-825d-dcfa06741765" path="/var/lib/kubelet/pods/7074d192-e32e-41d8-825d-dcfa06741765/volumes"
Jun 15 06:28:47.273351 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:47.273318    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh"
Jun 15 06:28:47.309792 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:28:47.309720    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh" podStartSLOduration=8.554912087 podStartE2EDuration="12.309703397s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.75479131s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:28:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:28:41.284851683 +0000 UTC m=+2463.651396735" watchObservedRunningTime="2026-06-15 06:28:47.309703397 +0000 UTC m=+2469.676248447"
Jun 15 06:29:17.274934 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:29:17.274819    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh" podUID="6f8c58e0-0a37-4238-b4e7-54052333c2c4" containerName="kserve-container" probeResult="failure" output="Get \"http://10.132.0.31:8080/v2/models/isvc-predictive-sklearn-v2/ready\": dial tcp 10.132.0.31:8080: connect: connection refused"
Jun 15 06:29:27.274822 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:29:27.274779    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh" podUID="6f8c58e0-0a37-4238-b4e7-54052333c2c4" containerName="kserve-container" probeResult="failure" output="Get \"http://10.132.0.31:8080/v2/models/isvc-predictive-sklearn-v2/ready\": dial tcp 10.132.0.31:8080: connect: connection refused"
Jun 15 06:29:37.274508 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:29:37.274417    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh" podUID="6f8c58e0-0a37-4238-b4e7-54052333c2c4" containerName="kserve-container" probeResult="failure" output="Get \"http://10.132.0.31:8080/v2/models/isvc-predictive-sklearn-v2/ready\": dial tcp 10.132.0.31:8080: connect: connection refused"
Jun 15 06:29:47.273820 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:29:47.273765    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh" podUID="6f8c58e0-0a37-4238-b4e7-54052333c2c4" containerName="kserve-container" probeResult="failure" output="Get \"http://10.132.0.31:8080/v2/models/isvc-predictive-sklearn-v2/ready\": dial tcp 10.132.0.31:8080: connect: connection refused"
Jun 15 06:29:57.277344 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:29:57.277307    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh"
Jun 15 06:30:05.408731 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:05.408694    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh"]
Jun 15 06:30:05.409203 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:05.409011    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh" podUID="6f8c58e0-0a37-4238-b4e7-54052333c2c4" containerName="kserve-container" containerID="cri-o://3ea76a616480c880ca2b9d69075681f383aa8eaa0d3c3cb7b09ef69094978230" gracePeriod=30
Jun 15 06:30:05.409203 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:05.409055    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh" podUID="6f8c58e0-0a37-4238-b4e7-54052333c2c4" containerName="kube-rbac-proxy" containerID="cri-o://add53f09e74e4d0e043e8a0bf4a0bbb3d5e49d60307f2f885206d5b0bfec09a7" gracePeriod=30
Jun 15 06:30:05.496167 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:05.496131    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m"]
Jun 15 06:30:05.496461 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:05.496447    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7074d192-e32e-41d8-825d-dcfa06741765" containerName="kserve-container"
Jun 15 06:30:05.496502 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:05.496465    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7074d192-e32e-41d8-825d-dcfa06741765" containerName="kserve-container"
Jun 15 06:30:05.496502 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:05.496481    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7074d192-e32e-41d8-825d-dcfa06741765" containerName="kube-rbac-proxy"
Jun 15 06:30:05.496502 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:05.496487    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7074d192-e32e-41d8-825d-dcfa06741765" containerName="kube-rbac-proxy"
Jun 15 06:30:05.496502 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:05.496501    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7074d192-e32e-41d8-825d-dcfa06741765" containerName="storage-initializer"
Jun 15 06:30:05.496616 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:05.496507    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7074d192-e32e-41d8-825d-dcfa06741765" containerName="storage-initializer"
Jun 15 06:30:05.496616 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:05.496567    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7074d192-e32e-41d8-825d-dcfa06741765" containerName="kserve-container"
Jun 15 06:30:05.496616 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:05.496575    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7074d192-e32e-41d8-825d-dcfa06741765" containerName="kube-rbac-proxy"
Jun 15 06:30:05.499775 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:05.499759    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m"
Jun 15 06:30:05.502281 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:05.502263    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-predictive-xgboost-v2-kube-rbac-proxy-sar-config\""
Jun 15 06:30:05.502281 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:05.502281    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-predictive-xgboost-v2-predictor-serving-cert\""
Jun 15 06:30:05.509990 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:05.509967    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m"]
Jun 15 06:30:05.559642 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:05.559611    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whmw2\" (UniqueName: \"kubernetes.io/projected/54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f-kube-api-access-whmw2\") pod \"isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m\" (UID: \"54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f\") " pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m"
Jun 15 06:30:05.559783 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:05.559652    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f-cabundle-cert\") pod \"isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m\" (UID: \"54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f\") " pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m"
Jun 15 06:30:05.559783 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:05.559679    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f-kserve-provision-location\") pod \"isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m\" (UID: \"54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f\") " pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m"
Jun 15 06:30:05.559783 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:05.559747    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f-kube-rbac-proxy-sar-config\") pod \"isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m\" (UID: \"54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f\") " pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m"
Jun 15 06:30:05.559936 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:05.559786    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f-proxy-tls\") pod \"isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m\" (UID: \"54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f\") " pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m"
Jun 15 06:30:05.623334 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:05.623301    2564 generic.go:356] "Generic (PLEG): container finished" podID="6f8c58e0-0a37-4238-b4e7-54052333c2c4" containerID="add53f09e74e4d0e043e8a0bf4a0bbb3d5e49d60307f2f885206d5b0bfec09a7" exitCode=2
Jun 15 06:30:05.623334 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:05.623334    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh" event={"ID":"6f8c58e0-0a37-4238-b4e7-54052333c2c4","Type":"ContainerDied","Data":"add53f09e74e4d0e043e8a0bf4a0bbb3d5e49d60307f2f885206d5b0bfec09a7"}
Jun 15 06:30:05.660678 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:05.660615    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f-kube-rbac-proxy-sar-config\") pod \"isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m\" (UID: \"54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f\") " pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m"
Jun 15 06:30:05.660678 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:05.660651    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f-proxy-tls\") pod \"isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m\" (UID: \"54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f\") " pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m"
Jun 15 06:30:05.660831 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:05.660699    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whmw2\" (UniqueName: \"kubernetes.io/projected/54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f-kube-api-access-whmw2\") pod \"isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m\" (UID: \"54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f\") " pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m"
Jun 15 06:30:05.660831 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:05.660722    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f-cabundle-cert\") pod \"isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m\" (UID: \"54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f\") " pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m"
Jun 15 06:30:05.660831 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:05.660748    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f-kserve-provision-location\") pod \"isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m\" (UID: \"54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f\") " pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m"
Jun 15 06:30:05.661179 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:05.661159    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f-kserve-provision-location\") pod \"isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m\" (UID: \"54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f\") " pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m"
Jun 15 06:30:05.661371 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:05.661349    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f-kube-rbac-proxy-sar-config\") pod \"isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m\" (UID: \"54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f\") " pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m"
Jun 15 06:30:05.661426 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:05.661412    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f-cabundle-cert\") pod \"isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m\" (UID: \"54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f\") " pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m"
Jun 15 06:30:05.663387 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:05.663366    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f-proxy-tls\") pod \"isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m\" (UID: \"54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f\") " pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m"
Jun 15 06:30:05.669321 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:05.669301    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whmw2\" (UniqueName: \"kubernetes.io/projected/54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f-kube-api-access-whmw2\") pod \"isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m\" (UID: \"54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f\") " pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m"
Jun 15 06:30:05.809613 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:05.809581    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m"
Jun 15 06:30:05.939914 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:05.939889    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m"]
Jun 15 06:30:05.941882 ip-10-0-131-82 kubenswrapper[2564]: W0615 06:30:05.941840    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54dc2ae6_a02e_46f6_bb40_cc85ae14eb2f.slice/crio-678d0de6d045aab5ef620dab95b493acde51118f61050662f02db916d6588c2b WatchSource:0}: Error finding container 678d0de6d045aab5ef620dab95b493acde51118f61050662f02db916d6588c2b: Status 404 returned error can't find the container with id 678d0de6d045aab5ef620dab95b493acde51118f61050662f02db916d6588c2b
Jun 15 06:30:06.628812 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:06.628780    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m" event={"ID":"54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f","Type":"ContainerStarted","Data":"187bf6a8c2efbc0dc5355d6402324a72b97fc4e5885d9cd68042fa265268fc9f"}
Jun 15 06:30:06.629226 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:06.628841    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m" event={"ID":"54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f","Type":"ContainerStarted","Data":"678d0de6d045aab5ef620dab95b493acde51118f61050662f02db916d6588c2b"}
Jun 15 06:30:07.269386 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:07.269339    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh" podUID="6f8c58e0-0a37-4238-b4e7-54052333c2c4" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.31:8643/healthz\": dial tcp 10.132.0.31:8643: connect: connection refused"
Jun 15 06:30:07.274766 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:07.274736    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh" podUID="6f8c58e0-0a37-4238-b4e7-54052333c2c4" containerName="kserve-container" probeResult="failure" output="Get \"http://10.132.0.31:8080/v2/models/isvc-predictive-sklearn-v2/ready\": dial tcp 10.132.0.31:8080: connect: connection refused"
Jun 15 06:30:10.050177 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:10.050153    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh"
Jun 15 06:30:10.200451 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:10.200420    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6f8c58e0-0a37-4238-b4e7-54052333c2c4-cabundle-cert\") pod \"6f8c58e0-0a37-4238-b4e7-54052333c2c4\" (UID: \"6f8c58e0-0a37-4238-b4e7-54052333c2c4\") "
Jun 15 06:30:10.200614 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:10.200470    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6fwm\" (UniqueName: \"kubernetes.io/projected/6f8c58e0-0a37-4238-b4e7-54052333c2c4-kube-api-access-p6fwm\") pod \"6f8c58e0-0a37-4238-b4e7-54052333c2c4\" (UID: \"6f8c58e0-0a37-4238-b4e7-54052333c2c4\") "
Jun 15 06:30:10.200614 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:10.200511    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6f8c58e0-0a37-4238-b4e7-54052333c2c4-proxy-tls\") pod \"6f8c58e0-0a37-4238-b4e7-54052333c2c4\" (UID: \"6f8c58e0-0a37-4238-b4e7-54052333c2c4\") "
Jun 15 06:30:10.200614 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:10.200536    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6f8c58e0-0a37-4238-b4e7-54052333c2c4-kserve-provision-location\") pod \"6f8c58e0-0a37-4238-b4e7-54052333c2c4\" (UID: \"6f8c58e0-0a37-4238-b4e7-54052333c2c4\") "
Jun 15 06:30:10.200614 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:10.200599    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6f8c58e0-0a37-4238-b4e7-54052333c2c4-kube-rbac-proxy-sar-config\") pod \"6f8c58e0-0a37-4238-b4e7-54052333c2c4\" (UID: \"6f8c58e0-0a37-4238-b4e7-54052333c2c4\") "
Jun 15 06:30:10.200803 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:10.200722    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f8c58e0-0a37-4238-b4e7-54052333c2c4-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "6f8c58e0-0a37-4238-b4e7-54052333c2c4" (UID: "6f8c58e0-0a37-4238-b4e7-54052333c2c4"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 06:30:10.200983 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:10.200956    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f8c58e0-0a37-4238-b4e7-54052333c2c4-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "6f8c58e0-0a37-4238-b4e7-54052333c2c4" (UID: "6f8c58e0-0a37-4238-b4e7-54052333c2c4"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:30:10.201055 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:10.201011    2564 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6f8c58e0-0a37-4238-b4e7-54052333c2c4-cabundle-cert\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:30:10.201055 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:10.201016    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f8c58e0-0a37-4238-b4e7-54052333c2c4-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "6f8c58e0-0a37-4238-b4e7-54052333c2c4" (UID: "6f8c58e0-0a37-4238-b4e7-54052333c2c4"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 06:30:10.202736 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:10.202718    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f8c58e0-0a37-4238-b4e7-54052333c2c4-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "6f8c58e0-0a37-4238-b4e7-54052333c2c4" (UID: "6f8c58e0-0a37-4238-b4e7-54052333c2c4"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 06:30:10.202838 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:10.202818    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f8c58e0-0a37-4238-b4e7-54052333c2c4-kube-api-access-p6fwm" (OuterVolumeSpecName: "kube-api-access-p6fwm") pod "6f8c58e0-0a37-4238-b4e7-54052333c2c4" (UID: "6f8c58e0-0a37-4238-b4e7-54052333c2c4"). InnerVolumeSpecName "kube-api-access-p6fwm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 06:30:10.302261 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:10.302231    2564 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6f8c58e0-0a37-4238-b4e7-54052333c2c4-proxy-tls\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:30:10.302261 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:10.302258    2564 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6f8c58e0-0a37-4238-b4e7-54052333c2c4-kserve-provision-location\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:30:10.302420 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:10.302267    2564 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6f8c58e0-0a37-4238-b4e7-54052333c2c4-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:30:10.302420 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:10.302277    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6fwm\" (UniqueName: \"kubernetes.io/projected/6f8c58e0-0a37-4238-b4e7-54052333c2c4-kube-api-access-p6fwm\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:30:10.647102 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:10.647073    2564 generic.go:356] "Generic (PLEG): container finished" podID="54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f" containerID="187bf6a8c2efbc0dc5355d6402324a72b97fc4e5885d9cd68042fa265268fc9f" exitCode=0
Jun 15 06:30:10.647279 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:10.647147    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m" event={"ID":"54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f","Type":"ContainerDied","Data":"187bf6a8c2efbc0dc5355d6402324a72b97fc4e5885d9cd68042fa265268fc9f"}
Jun 15 06:30:10.649085 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:10.649064    2564 generic.go:356] "Generic (PLEG): container finished" podID="6f8c58e0-0a37-4238-b4e7-54052333c2c4" containerID="3ea76a616480c880ca2b9d69075681f383aa8eaa0d3c3cb7b09ef69094978230" exitCode=0
Jun 15 06:30:10.649156 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:10.649110    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh"
Jun 15 06:30:10.649156 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:10.649114    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh" event={"ID":"6f8c58e0-0a37-4238-b4e7-54052333c2c4","Type":"ContainerDied","Data":"3ea76a616480c880ca2b9d69075681f383aa8eaa0d3c3cb7b09ef69094978230"}
Jun 15 06:30:10.649280 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:10.649164    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh" event={"ID":"6f8c58e0-0a37-4238-b4e7-54052333c2c4","Type":"ContainerDied","Data":"0db4a1789dfb98abcef7922b193a20c6fb81054e883e6f1ca34a87d0636d72ef"}
Jun 15 06:30:10.649280 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:10.649189    2564 scope.go:117] "RemoveContainer" containerID="add53f09e74e4d0e043e8a0bf4a0bbb3d5e49d60307f2f885206d5b0bfec09a7"
Jun 15 06:30:10.658207 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:10.658187    2564 scope.go:117] "RemoveContainer" containerID="3ea76a616480c880ca2b9d69075681f383aa8eaa0d3c3cb7b09ef69094978230"
Jun 15 06:30:10.665934 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:10.665919    2564 scope.go:117] "RemoveContainer" containerID="46db4a4edd7d228cf2599e3be240107c131daff8e0fa0cb355521530c4c936df"
Jun 15 06:30:10.675149 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:10.675130    2564 scope.go:117] "RemoveContainer" containerID="add53f09e74e4d0e043e8a0bf4a0bbb3d5e49d60307f2f885206d5b0bfec09a7"
Jun 15 06:30:10.675384 ip-10-0-131-82 kubenswrapper[2564]: E0615 06:30:10.675366    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"add53f09e74e4d0e043e8a0bf4a0bbb3d5e49d60307f2f885206d5b0bfec09a7\": container with ID starting with add53f09e74e4d0e043e8a0bf4a0bbb3d5e49d60307f2f885206d5b0bfec09a7 not found: ID does not exist" containerID="add53f09e74e4d0e043e8a0bf4a0bbb3d5e49d60307f2f885206d5b0bfec09a7"
Jun 15 06:30:10.675425 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:10.675391    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"add53f09e74e4d0e043e8a0bf4a0bbb3d5e49d60307f2f885206d5b0bfec09a7"} err="failed to get container status \"add53f09e74e4d0e043e8a0bf4a0bbb3d5e49d60307f2f885206d5b0bfec09a7\": rpc error: code = NotFound desc = could not find container \"add53f09e74e4d0e043e8a0bf4a0bbb3d5e49d60307f2f885206d5b0bfec09a7\": container with ID starting with add53f09e74e4d0e043e8a0bf4a0bbb3d5e49d60307f2f885206d5b0bfec09a7 not found: ID does not exist"
Jun 15 06:30:10.675425 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:10.675407    2564 scope.go:117] "RemoveContainer" containerID="3ea76a616480c880ca2b9d69075681f383aa8eaa0d3c3cb7b09ef69094978230"
Jun 15 06:30:10.675598 ip-10-0-131-82 kubenswrapper[2564]: E0615 06:30:10.675583    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ea76a616480c880ca2b9d69075681f383aa8eaa0d3c3cb7b09ef69094978230\": container with ID starting with 3ea76a616480c880ca2b9d69075681f383aa8eaa0d3c3cb7b09ef69094978230 not found: ID does not exist" containerID="3ea76a616480c880ca2b9d69075681f383aa8eaa0d3c3cb7b09ef69094978230"
Jun 15 06:30:10.675639 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:10.675602    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ea76a616480c880ca2b9d69075681f383aa8eaa0d3c3cb7b09ef69094978230"} err="failed to get container status \"3ea76a616480c880ca2b9d69075681f383aa8eaa0d3c3cb7b09ef69094978230\": rpc error: code = NotFound desc = could not find container \"3ea76a616480c880ca2b9d69075681f383aa8eaa0d3c3cb7b09ef69094978230\": container with ID starting with 3ea76a616480c880ca2b9d69075681f383aa8eaa0d3c3cb7b09ef69094978230 not found: ID does not exist"
Jun 15 06:30:10.675639 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:10.675614    2564 scope.go:117] "RemoveContainer" containerID="46db4a4edd7d228cf2599e3be240107c131daff8e0fa0cb355521530c4c936df"
Jun 15 06:30:10.675908 ip-10-0-131-82 kubenswrapper[2564]: E0615 06:30:10.675886    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46db4a4edd7d228cf2599e3be240107c131daff8e0fa0cb355521530c4c936df\": container with ID starting with 46db4a4edd7d228cf2599e3be240107c131daff8e0fa0cb355521530c4c936df not found: ID does not exist" containerID="46db4a4edd7d228cf2599e3be240107c131daff8e0fa0cb355521530c4c936df"
Jun 15 06:30:10.675956 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:10.675917    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46db4a4edd7d228cf2599e3be240107c131daff8e0fa0cb355521530c4c936df"} err="failed to get container status \"46db4a4edd7d228cf2599e3be240107c131daff8e0fa0cb355521530c4c936df\": rpc error: code = NotFound desc = could not find container \"46db4a4edd7d228cf2599e3be240107c131daff8e0fa0cb355521530c4c936df\": container with ID starting with 46db4a4edd7d228cf2599e3be240107c131daff8e0fa0cb355521530c4c936df not found: ID does not exist"
Jun 15 06:30:10.683365 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:10.683344    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh"]
Jun 15 06:30:10.688900 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:10.688879    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-predictive-sklearn-v2-predictor-745f9c8c9f-mhffh"]
Jun 15 06:30:11.656693 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:11.656663    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m" event={"ID":"54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f","Type":"ContainerStarted","Data":"8211987219b09f7b04d723b6d9b1bc83cf955a3ea6a73235468deefa22f45f55"}
Jun 15 06:30:11.657123 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:11.656712    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m" event={"ID":"54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f","Type":"ContainerStarted","Data":"b9677f2c843000ef526d8aef462c5eb56667c1e88ffd8eb0fbb3e6d2bd722288"}
Jun 15 06:30:11.657123 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:11.656910    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m"
Jun 15 06:30:11.657123 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:11.656960    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m"
Jun 15 06:30:11.676445 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:11.676395    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m" podStartSLOduration=2.848087027 podStartE2EDuration="6.676382395s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.828295368s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:30:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:30:11.675896949 +0000 UTC m=+2554.042441998" watchObservedRunningTime="2026-06-15 06:30:11.676382395 +0000 UTC m=+2554.042927444"
Jun 15 06:30:12.136518 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:12.136490    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f8c58e0-0a37-4238-b4e7-54052333c2c4" path="/var/lib/kubelet/pods/6f8c58e0-0a37-4238-b4e7-54052333c2c4/volumes"
Jun 15 06:30:17.667122 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:17.667092    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m"
Jun 15 06:30:47.668510 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:47.668431    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m" podUID="54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f" containerName="kserve-container" probeResult="failure" output="Get \"http://10.132.0.32:8080/v2/models/isvc-predictive-xgboost-v2/ready\": dial tcp 10.132.0.32:8080: connect: connection refused"
Jun 15 06:30:57.668391 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:30:57.668350    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m" podUID="54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f" containerName="kserve-container" probeResult="failure" output="Get \"http://10.132.0.32:8080/v2/models/isvc-predictive-xgboost-v2/ready\": dial tcp 10.132.0.32:8080: connect: connection refused"
Jun 15 06:31:07.668550 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:07.668508    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m" podUID="54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f" containerName="kserve-container" probeResult="failure" output="Get \"http://10.132.0.32:8080/v2/models/isvc-predictive-xgboost-v2/ready\": dial tcp 10.132.0.32:8080: connect: connection refused"
Jun 15 06:31:17.670569 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:17.670467    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m" podUID="54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f" containerName="kserve-container" probeResult="failure" output="Get \"http://10.132.0.32:8080/v2/models/isvc-predictive-xgboost-v2/ready\": dial tcp 10.132.0.32:8080: connect: connection refused"
Jun 15 06:31:27.671427 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:27.671388    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m"
Jun 15 06:31:35.516850 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:35.516817    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m"]
Jun 15 06:31:35.517341 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:35.517080    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m" podUID="54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f" containerName="kserve-container" containerID="cri-o://b9677f2c843000ef526d8aef462c5eb56667c1e88ffd8eb0fbb3e6d2bd722288" gracePeriod=30
Jun 15 06:31:35.517341 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:35.517130    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m" podUID="54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f" containerName="kube-rbac-proxy" containerID="cri-o://8211987219b09f7b04d723b6d9b1bc83cf955a3ea6a73235468deefa22f45f55" gracePeriod=30
Jun 15 06:31:35.600834 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:35.600804    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw"]
Jun 15 06:31:35.601155 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:35.601141    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f8c58e0-0a37-4238-b4e7-54052333c2c4" containerName="storage-initializer"
Jun 15 06:31:35.601205 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:35.601157    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f8c58e0-0a37-4238-b4e7-54052333c2c4" containerName="storage-initializer"
Jun 15 06:31:35.601205 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:35.601181    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f8c58e0-0a37-4238-b4e7-54052333c2c4" containerName="kserve-container"
Jun 15 06:31:35.601205 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:35.601187    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f8c58e0-0a37-4238-b4e7-54052333c2c4" containerName="kserve-container"
Jun 15 06:31:35.601205 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:35.601197    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f8c58e0-0a37-4238-b4e7-54052333c2c4" containerName="kube-rbac-proxy"
Jun 15 06:31:35.601205 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:35.601205    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f8c58e0-0a37-4238-b4e7-54052333c2c4" containerName="kube-rbac-proxy"
Jun 15 06:31:35.601355 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:35.601258    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f8c58e0-0a37-4238-b4e7-54052333c2c4" containerName="kserve-container"
Jun 15 06:31:35.601355 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:35.601265    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f8c58e0-0a37-4238-b4e7-54052333c2c4" containerName="kube-rbac-proxy"
Jun 15 06:31:35.604528 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:35.604512    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw"
Jun 15 06:31:35.606723 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:35.606702    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-predictive-lightgbm-v2-kube-rbac-proxy-sar-config\""
Jun 15 06:31:35.606845 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:35.606736    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-predictive-lightgbm-v2-predictor-serving-cert\""
Jun 15 06:31:35.615831 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:35.615811    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw"]
Jun 15 06:31:35.774133 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:35.774064    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1856f598-ec9e-4317-8aeb-0683f8cff37d-kube-rbac-proxy-sar-config\") pod \"isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw\" (UID: \"1856f598-ec9e-4317-8aeb-0683f8cff37d\") " pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw"
Jun 15 06:31:35.774133 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:35.774105    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1856f598-ec9e-4317-8aeb-0683f8cff37d-kserve-provision-location\") pod \"isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw\" (UID: \"1856f598-ec9e-4317-8aeb-0683f8cff37d\") " pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw"
Jun 15 06:31:35.774289 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:35.774145    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1856f598-ec9e-4317-8aeb-0683f8cff37d-cabundle-cert\") pod \"isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw\" (UID: \"1856f598-ec9e-4317-8aeb-0683f8cff37d\") " pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw"
Jun 15 06:31:35.774289 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:35.774193    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1856f598-ec9e-4317-8aeb-0683f8cff37d-proxy-tls\") pod \"isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw\" (UID: \"1856f598-ec9e-4317-8aeb-0683f8cff37d\") " pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw"
Jun 15 06:31:35.774289 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:35.774234    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng6lk\" (UniqueName: \"kubernetes.io/projected/1856f598-ec9e-4317-8aeb-0683f8cff37d-kube-api-access-ng6lk\") pod \"isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw\" (UID: \"1856f598-ec9e-4317-8aeb-0683f8cff37d\") " pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw"
Jun 15 06:31:35.874807 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:35.874766    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng6lk\" (UniqueName: \"kubernetes.io/projected/1856f598-ec9e-4317-8aeb-0683f8cff37d-kube-api-access-ng6lk\") pod \"isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw\" (UID: \"1856f598-ec9e-4317-8aeb-0683f8cff37d\") " pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw"
Jun 15 06:31:35.874981 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:35.874830    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1856f598-ec9e-4317-8aeb-0683f8cff37d-kube-rbac-proxy-sar-config\") pod \"isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw\" (UID: \"1856f598-ec9e-4317-8aeb-0683f8cff37d\") " pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw"
Jun 15 06:31:35.874981 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:35.874888    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1856f598-ec9e-4317-8aeb-0683f8cff37d-kserve-provision-location\") pod \"isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw\" (UID: \"1856f598-ec9e-4317-8aeb-0683f8cff37d\") " pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw"
Jun 15 06:31:35.874981 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:35.874952    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1856f598-ec9e-4317-8aeb-0683f8cff37d-cabundle-cert\") pod \"isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw\" (UID: \"1856f598-ec9e-4317-8aeb-0683f8cff37d\") " pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw"
Jun 15 06:31:35.875119 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:35.874991    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1856f598-ec9e-4317-8aeb-0683f8cff37d-proxy-tls\") pod \"isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw\" (UID: \"1856f598-ec9e-4317-8aeb-0683f8cff37d\") " pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw"
Jun 15 06:31:35.875389 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:35.875360    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1856f598-ec9e-4317-8aeb-0683f8cff37d-kserve-provision-location\") pod \"isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw\" (UID: \"1856f598-ec9e-4317-8aeb-0683f8cff37d\") " pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw"
Jun 15 06:31:35.875624 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:35.875601    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1856f598-ec9e-4317-8aeb-0683f8cff37d-kube-rbac-proxy-sar-config\") pod \"isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw\" (UID: \"1856f598-ec9e-4317-8aeb-0683f8cff37d\") " pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw"
Jun 15 06:31:35.875705 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:35.875601    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1856f598-ec9e-4317-8aeb-0683f8cff37d-cabundle-cert\") pod \"isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw\" (UID: \"1856f598-ec9e-4317-8aeb-0683f8cff37d\") " pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw"
Jun 15 06:31:35.877472 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:35.877447    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1856f598-ec9e-4317-8aeb-0683f8cff37d-proxy-tls\") pod \"isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw\" (UID: \"1856f598-ec9e-4317-8aeb-0683f8cff37d\") " pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw"
Jun 15 06:31:35.885200 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:35.885181    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng6lk\" (UniqueName: \"kubernetes.io/projected/1856f598-ec9e-4317-8aeb-0683f8cff37d-kube-api-access-ng6lk\") pod \"isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw\" (UID: \"1856f598-ec9e-4317-8aeb-0683f8cff37d\") " pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw"
Jun 15 06:31:35.914137 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:35.914114    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw"
Jun 15 06:31:36.019086 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:36.019055    2564 generic.go:356] "Generic (PLEG): container finished" podID="54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f" containerID="8211987219b09f7b04d723b6d9b1bc83cf955a3ea6a73235468deefa22f45f55" exitCode=2
Jun 15 06:31:36.019228 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:36.019117    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m" event={"ID":"54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f","Type":"ContainerDied","Data":"8211987219b09f7b04d723b6d9b1bc83cf955a3ea6a73235468deefa22f45f55"}
Jun 15 06:31:36.049435 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:36.049375    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw"]
Jun 15 06:31:36.051592 ip-10-0-131-82 kubenswrapper[2564]: W0615 06:31:36.051567    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1856f598_ec9e_4317_8aeb_0683f8cff37d.slice/crio-f2b9715f4119632921cc2964e1aa017ebce387d8b1bfbdbbc3bd32158253eff3 WatchSource:0}: Error finding container f2b9715f4119632921cc2964e1aa017ebce387d8b1bfbdbbc3bd32158253eff3: Status 404 returned error can't find the container with id f2b9715f4119632921cc2964e1aa017ebce387d8b1bfbdbbc3bd32158253eff3
Jun 15 06:31:37.024479 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:37.024446    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw" event={"ID":"1856f598-ec9e-4317-8aeb-0683f8cff37d","Type":"ContainerStarted","Data":"3865c45a3147623678e2188d9767fc74669955037020426a44b8c9d615f493c4"}
Jun 15 06:31:37.024958 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:37.024519    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw" event={"ID":"1856f598-ec9e-4317-8aeb-0683f8cff37d","Type":"ContainerStarted","Data":"f2b9715f4119632921cc2964e1aa017ebce387d8b1bfbdbbc3bd32158253eff3"}
Jun 15 06:31:37.661823 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:37.661760    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m" podUID="54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.32:8643/healthz\": dial tcp 10.132.0.32:8643: connect: connection refused"
Jun 15 06:31:37.667571 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:37.667542    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m" podUID="54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f" containerName="kserve-container" probeResult="failure" output="Get \"http://10.132.0.32:8080/v2/models/isvc-predictive-xgboost-v2/ready\": dial tcp 10.132.0.32:8080: connect: connection refused"
Jun 15 06:31:39.968636 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:39.968610    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m"
Jun 15 06:31:40.039929 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:40.039893    2564 generic.go:356] "Generic (PLEG): container finished" podID="54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f" containerID="b9677f2c843000ef526d8aef462c5eb56667c1e88ffd8eb0fbb3e6d2bd722288" exitCode=0
Jun 15 06:31:40.040105 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:40.039946    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m"
Jun 15 06:31:40.040105 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:40.039975    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m" event={"ID":"54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f","Type":"ContainerDied","Data":"b9677f2c843000ef526d8aef462c5eb56667c1e88ffd8eb0fbb3e6d2bd722288"}
Jun 15 06:31:40.040105 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:40.040035    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m" event={"ID":"54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f","Type":"ContainerDied","Data":"678d0de6d045aab5ef620dab95b493acde51118f61050662f02db916d6588c2b"}
Jun 15 06:31:40.040105 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:40.040066    2564 scope.go:117] "RemoveContainer" containerID="8211987219b09f7b04d723b6d9b1bc83cf955a3ea6a73235468deefa22f45f55"
Jun 15 06:31:40.041627 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:40.041606    2564 generic.go:356] "Generic (PLEG): container finished" podID="1856f598-ec9e-4317-8aeb-0683f8cff37d" containerID="3865c45a3147623678e2188d9767fc74669955037020426a44b8c9d615f493c4" exitCode=0
Jun 15 06:31:40.041720 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:40.041679    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw" event={"ID":"1856f598-ec9e-4317-8aeb-0683f8cff37d","Type":"ContainerDied","Data":"3865c45a3147623678e2188d9767fc74669955037020426a44b8c9d615f493c4"}
Jun 15 06:31:40.048299 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:40.048281    2564 scope.go:117] "RemoveContainer" containerID="b9677f2c843000ef526d8aef462c5eb56667c1e88ffd8eb0fbb3e6d2bd722288"
Jun 15 06:31:40.055971 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:40.055951    2564 scope.go:117] "RemoveContainer" containerID="187bf6a8c2efbc0dc5355d6402324a72b97fc4e5885d9cd68042fa265268fc9f"
Jun 15 06:31:40.067219 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:40.067204    2564 scope.go:117] "RemoveContainer" containerID="8211987219b09f7b04d723b6d9b1bc83cf955a3ea6a73235468deefa22f45f55"
Jun 15 06:31:40.067480 ip-10-0-131-82 kubenswrapper[2564]: E0615 06:31:40.067462    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8211987219b09f7b04d723b6d9b1bc83cf955a3ea6a73235468deefa22f45f55\": container with ID starting with 8211987219b09f7b04d723b6d9b1bc83cf955a3ea6a73235468deefa22f45f55 not found: ID does not exist" containerID="8211987219b09f7b04d723b6d9b1bc83cf955a3ea6a73235468deefa22f45f55"
Jun 15 06:31:40.067565 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:40.067490    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8211987219b09f7b04d723b6d9b1bc83cf955a3ea6a73235468deefa22f45f55"} err="failed to get container status \"8211987219b09f7b04d723b6d9b1bc83cf955a3ea6a73235468deefa22f45f55\": rpc error: code = NotFound desc = could not find container \"8211987219b09f7b04d723b6d9b1bc83cf955a3ea6a73235468deefa22f45f55\": container with ID starting with 8211987219b09f7b04d723b6d9b1bc83cf955a3ea6a73235468deefa22f45f55 not found: ID does not exist"
Jun 15 06:31:40.067565 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:40.067513    2564 scope.go:117] "RemoveContainer" containerID="b9677f2c843000ef526d8aef462c5eb56667c1e88ffd8eb0fbb3e6d2bd722288"
Jun 15 06:31:40.067744 ip-10-0-131-82 kubenswrapper[2564]: E0615 06:31:40.067723    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9677f2c843000ef526d8aef462c5eb56667c1e88ffd8eb0fbb3e6d2bd722288\": container with ID starting with b9677f2c843000ef526d8aef462c5eb56667c1e88ffd8eb0fbb3e6d2bd722288 not found: ID does not exist" containerID="b9677f2c843000ef526d8aef462c5eb56667c1e88ffd8eb0fbb3e6d2bd722288"
Jun 15 06:31:40.067781 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:40.067751    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9677f2c843000ef526d8aef462c5eb56667c1e88ffd8eb0fbb3e6d2bd722288"} err="failed to get container status \"b9677f2c843000ef526d8aef462c5eb56667c1e88ffd8eb0fbb3e6d2bd722288\": rpc error: code = NotFound desc = could not find container \"b9677f2c843000ef526d8aef462c5eb56667c1e88ffd8eb0fbb3e6d2bd722288\": container with ID starting with b9677f2c843000ef526d8aef462c5eb56667c1e88ffd8eb0fbb3e6d2bd722288 not found: ID does not exist"
Jun 15 06:31:40.067781 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:40.067767    2564 scope.go:117] "RemoveContainer" containerID="187bf6a8c2efbc0dc5355d6402324a72b97fc4e5885d9cd68042fa265268fc9f"
Jun 15 06:31:40.068031 ip-10-0-131-82 kubenswrapper[2564]: E0615 06:31:40.068014    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"187bf6a8c2efbc0dc5355d6402324a72b97fc4e5885d9cd68042fa265268fc9f\": container with ID starting with 187bf6a8c2efbc0dc5355d6402324a72b97fc4e5885d9cd68042fa265268fc9f not found: ID does not exist" containerID="187bf6a8c2efbc0dc5355d6402324a72b97fc4e5885d9cd68042fa265268fc9f"
Jun 15 06:31:40.068087 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:40.068035    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"187bf6a8c2efbc0dc5355d6402324a72b97fc4e5885d9cd68042fa265268fc9f"} err="failed to get container status \"187bf6a8c2efbc0dc5355d6402324a72b97fc4e5885d9cd68042fa265268fc9f\": rpc error: code = NotFound desc = could not find container \"187bf6a8c2efbc0dc5355d6402324a72b97fc4e5885d9cd68042fa265268fc9f\": container with ID starting with 187bf6a8c2efbc0dc5355d6402324a72b97fc4e5885d9cd68042fa265268fc9f not found: ID does not exist"
Jun 15 06:31:40.111956 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:40.111931    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f-kube-rbac-proxy-sar-config\") pod \"54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f\" (UID: \"54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f\") "
Jun 15 06:31:40.112033 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:40.111983    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f-cabundle-cert\") pod \"54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f\" (UID: \"54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f\") "
Jun 15 06:31:40.112033 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:40.112019    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f-proxy-tls\") pod \"54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f\" (UID: \"54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f\") "
Jun 15 06:31:40.112239 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:40.112220    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f-kserve-provision-location\") pod \"54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f\" (UID: \"54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f\") "
Jun 15 06:31:40.112298 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:40.112272    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whmw2\" (UniqueName: \"kubernetes.io/projected/54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f-kube-api-access-whmw2\") pod \"54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f\" (UID: \"54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f\") "
Jun 15 06:31:40.112343 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:40.112306    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f" (UID: "54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 06:31:40.112390 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:40.112350    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f" (UID: "54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 06:31:40.112526 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:40.112505    2564 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:31:40.112526 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:40.112516    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f" (UID: "54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:31:40.112698 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:40.112529    2564 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f-cabundle-cert\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:31:40.114505 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:40.114468    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f-kube-api-access-whmw2" (OuterVolumeSpecName: "kube-api-access-whmw2") pod "54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f" (UID: "54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f"). InnerVolumeSpecName "kube-api-access-whmw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 06:31:40.114606 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:40.114582    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f" (UID: "54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 06:31:40.213357 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:40.213326    2564 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f-proxy-tls\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:31:40.213357 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:40.213353    2564 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f-kserve-provision-location\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:31:40.213554 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:40.213365    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whmw2\" (UniqueName: \"kubernetes.io/projected/54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f-kube-api-access-whmw2\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:31:40.358102 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:40.358028    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m"]
Jun 15 06:31:40.362319 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:40.362296    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-predictive-xgboost-v2-predictor-868ff5dd6d-7fs4m"]
Jun 15 06:31:41.048611 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:41.048572    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw" event={"ID":"1856f598-ec9e-4317-8aeb-0683f8cff37d","Type":"ContainerStarted","Data":"c7dd4fc50071df9391c959aa94ff8f0ee03c7668e930c87383c3017426e96165"}
Jun 15 06:31:41.049049 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:41.048641    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw" event={"ID":"1856f598-ec9e-4317-8aeb-0683f8cff37d","Type":"ContainerStarted","Data":"480172682e61c603f221cdbfe7a3612dc819ebde303a683d218d49d9a5b0cae1"}
Jun 15 06:31:41.049049 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:41.048855    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw"
Jun 15 06:31:41.071818 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:41.071737    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw" podStartSLOduration=2.323727324 podStartE2EDuration="6.071724106s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.747996782s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:31:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:31:41.06945819 +0000 UTC m=+2643.436003267" watchObservedRunningTime="2026-06-15 06:31:41.071724106 +0000 UTC m=+2643.438269216"
Jun 15 06:31:42.053396 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:42.053370    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw"
Jun 15 06:31:42.136360 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:42.136331    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f" path="/var/lib/kubelet/pods/54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f/volumes"
Jun 15 06:31:48.062352 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:31:48.062319    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw"
Jun 15 06:32:18.064211 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:32:18.064130    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw" podUID="1856f598-ec9e-4317-8aeb-0683f8cff37d" containerName="kserve-container" probeResult="failure" output="Get \"http://10.132.0.33:8080/v2/models/isvc-predictive-lightgbm-v2/ready\": dial tcp 10.132.0.33:8080: connect: connection refused"
Jun 15 06:32:28.063818 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:32:28.063779    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw" podUID="1856f598-ec9e-4317-8aeb-0683f8cff37d" containerName="kserve-container" probeResult="failure" output="Get \"http://10.132.0.33:8080/v2/models/isvc-predictive-lightgbm-v2/ready\": dial tcp 10.132.0.33:8080: connect: connection refused"
Jun 15 06:32:38.063588 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:32:38.063507    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw" podUID="1856f598-ec9e-4317-8aeb-0683f8cff37d" containerName="kserve-container" probeResult="failure" output="Get \"http://10.132.0.33:8080/v2/models/isvc-predictive-lightgbm-v2/ready\": dial tcp 10.132.0.33:8080: connect: connection refused"
Jun 15 06:32:38.284122 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:32:38.284093    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kn9gn_8bf514ab-857d-416e-b51f-2235f4cb429d/console-operator/1.log"
Jun 15 06:32:38.285568 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:32:38.285540    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kn9gn_8bf514ab-857d-416e-b51f-2235f4cb429d/console-operator/1.log"
Jun 15 06:32:48.063347 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:32:48.063307    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw" podUID="1856f598-ec9e-4317-8aeb-0683f8cff37d" containerName="kserve-container" probeResult="failure" output="Get \"http://10.132.0.33:8080/v2/models/isvc-predictive-lightgbm-v2/ready\": dial tcp 10.132.0.33:8080: connect: connection refused"
Jun 15 06:32:58.066406 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:32:58.066374    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw"
Jun 15 06:33:05.737194 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:33:05.737160    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw"]
Jun 15 06:33:05.737717 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:33:05.737390    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw" podUID="1856f598-ec9e-4317-8aeb-0683f8cff37d" containerName="kserve-container" containerID="cri-o://480172682e61c603f221cdbfe7a3612dc819ebde303a683d218d49d9a5b0cae1" gracePeriod=30
Jun 15 06:33:05.737717 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:33:05.737433    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw" podUID="1856f598-ec9e-4317-8aeb-0683f8cff37d" containerName="kube-rbac-proxy" containerID="cri-o://c7dd4fc50071df9391c959aa94ff8f0ee03c7668e930c87383c3017426e96165" gracePeriod=30
Jun 15 06:33:06.401687 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:33:06.401655    2564 generic.go:356] "Generic (PLEG): container finished" podID="1856f598-ec9e-4317-8aeb-0683f8cff37d" containerID="c7dd4fc50071df9391c959aa94ff8f0ee03c7668e930c87383c3017426e96165" exitCode=2
Jun 15 06:33:06.401879 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:33:06.401711    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw" event={"ID":"1856f598-ec9e-4317-8aeb-0683f8cff37d","Type":"ContainerDied","Data":"c7dd4fc50071df9391c959aa94ff8f0ee03c7668e930c87383c3017426e96165"}
Jun 15 06:33:08.057548 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:33:08.057499    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw" podUID="1856f598-ec9e-4317-8aeb-0683f8cff37d" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.33:8643/healthz\": dial tcp 10.132.0.33:8643: connect: connection refused"
Jun 15 06:33:08.063016 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:33:08.062982    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw" podUID="1856f598-ec9e-4317-8aeb-0683f8cff37d" containerName="kserve-container" probeResult="failure" output="Get \"http://10.132.0.33:8080/v2/models/isvc-predictive-lightgbm-v2/ready\": dial tcp 10.132.0.33:8080: connect: connection refused"
Jun 15 06:33:11.426146 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:33:11.426111    2564 generic.go:356] "Generic (PLEG): container finished" podID="1856f598-ec9e-4317-8aeb-0683f8cff37d" containerID="480172682e61c603f221cdbfe7a3612dc819ebde303a683d218d49d9a5b0cae1" exitCode=0
Jun 15 06:33:11.426575 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:33:11.426185    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw" event={"ID":"1856f598-ec9e-4317-8aeb-0683f8cff37d","Type":"ContainerDied","Data":"480172682e61c603f221cdbfe7a3612dc819ebde303a683d218d49d9a5b0cae1"}
Jun 15 06:33:11.481451 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:33:11.481425    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw"
Jun 15 06:33:11.558093 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:33:11.558056    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1856f598-ec9e-4317-8aeb-0683f8cff37d-kserve-provision-location\") pod \"1856f598-ec9e-4317-8aeb-0683f8cff37d\" (UID: \"1856f598-ec9e-4317-8aeb-0683f8cff37d\") "
Jun 15 06:33:11.558270 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:33:11.558128    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ng6lk\" (UniqueName: \"kubernetes.io/projected/1856f598-ec9e-4317-8aeb-0683f8cff37d-kube-api-access-ng6lk\") pod \"1856f598-ec9e-4317-8aeb-0683f8cff37d\" (UID: \"1856f598-ec9e-4317-8aeb-0683f8cff37d\") "
Jun 15 06:33:11.558270 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:33:11.558160    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1856f598-ec9e-4317-8aeb-0683f8cff37d-cabundle-cert\") pod \"1856f598-ec9e-4317-8aeb-0683f8cff37d\" (UID: \"1856f598-ec9e-4317-8aeb-0683f8cff37d\") "
Jun 15 06:33:11.558270 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:33:11.558204    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1856f598-ec9e-4317-8aeb-0683f8cff37d-kube-rbac-proxy-sar-config\") pod \"1856f598-ec9e-4317-8aeb-0683f8cff37d\" (UID: \"1856f598-ec9e-4317-8aeb-0683f8cff37d\") "
Jun 15 06:33:11.558270 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:33:11.558235    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1856f598-ec9e-4317-8aeb-0683f8cff37d-proxy-tls\") pod \"1856f598-ec9e-4317-8aeb-0683f8cff37d\" (UID: \"1856f598-ec9e-4317-8aeb-0683f8cff37d\") "
Jun 15 06:33:11.558540 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:33:11.558454    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1856f598-ec9e-4317-8aeb-0683f8cff37d-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "1856f598-ec9e-4317-8aeb-0683f8cff37d" (UID: "1856f598-ec9e-4317-8aeb-0683f8cff37d"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:33:11.558653 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:33:11.558632    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1856f598-ec9e-4317-8aeb-0683f8cff37d-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "1856f598-ec9e-4317-8aeb-0683f8cff37d" (UID: "1856f598-ec9e-4317-8aeb-0683f8cff37d"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 06:33:11.558695 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:33:11.558630    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1856f598-ec9e-4317-8aeb-0683f8cff37d-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "1856f598-ec9e-4317-8aeb-0683f8cff37d" (UID: "1856f598-ec9e-4317-8aeb-0683f8cff37d"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 06:33:11.560364 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:33:11.560341    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1856f598-ec9e-4317-8aeb-0683f8cff37d-kube-api-access-ng6lk" (OuterVolumeSpecName: "kube-api-access-ng6lk") pod "1856f598-ec9e-4317-8aeb-0683f8cff37d" (UID: "1856f598-ec9e-4317-8aeb-0683f8cff37d"). InnerVolumeSpecName "kube-api-access-ng6lk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 06:33:11.560499 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:33:11.560475    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1856f598-ec9e-4317-8aeb-0683f8cff37d-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "1856f598-ec9e-4317-8aeb-0683f8cff37d" (UID: "1856f598-ec9e-4317-8aeb-0683f8cff37d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 06:33:11.659668 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:33:11.659634    2564 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1856f598-ec9e-4317-8aeb-0683f8cff37d-kserve-provision-location\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:33:11.659668 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:33:11.659665    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ng6lk\" (UniqueName: \"kubernetes.io/projected/1856f598-ec9e-4317-8aeb-0683f8cff37d-kube-api-access-ng6lk\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:33:11.659668 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:33:11.659674    2564 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1856f598-ec9e-4317-8aeb-0683f8cff37d-cabundle-cert\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:33:11.659944 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:33:11.659685    2564 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1856f598-ec9e-4317-8aeb-0683f8cff37d-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:33:11.659944 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:33:11.659697    2564 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1856f598-ec9e-4317-8aeb-0683f8cff37d-proxy-tls\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:33:12.433179 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:33:12.433082    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw" event={"ID":"1856f598-ec9e-4317-8aeb-0683f8cff37d","Type":"ContainerDied","Data":"f2b9715f4119632921cc2964e1aa017ebce387d8b1bfbdbbc3bd32158253eff3"}
Jun 15 06:33:12.433179 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:33:12.433144    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw"
Jun 15 06:33:12.433179 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:33:12.433174    2564 scope.go:117] "RemoveContainer" containerID="c7dd4fc50071df9391c959aa94ff8f0ee03c7668e930c87383c3017426e96165"
Jun 15 06:33:12.441658 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:33:12.441637    2564 scope.go:117] "RemoveContainer" containerID="480172682e61c603f221cdbfe7a3612dc819ebde303a683d218d49d9a5b0cae1"
Jun 15 06:33:12.449341 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:33:12.449319    2564 scope.go:117] "RemoveContainer" containerID="3865c45a3147623678e2188d9767fc74669955037020426a44b8c9d615f493c4"
Jun 15 06:33:12.454784 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:33:12.454749    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw"]
Jun 15 06:33:12.458847 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:33:12.458823    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-predictive-lightgbm-v2-predictor-545b7cc587-4rxxw"]
Jun 15 06:33:14.136771 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:33:14.136741    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1856f598-ec9e-4317-8aeb-0683f8cff37d" path="/var/lib/kubelet/pods/1856f598-ec9e-4317-8aeb-0683f8cff37d/volumes"
Jun 15 06:37:38.312942 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:37:38.312915    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kn9gn_8bf514ab-857d-416e-b51f-2235f4cb429d/console-operator/1.log"
Jun 15 06:37:38.314611 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:37:38.314589    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kn9gn_8bf514ab-857d-416e-b51f-2235f4cb429d/console-operator/1.log"
Jun 15 06:40:16.313381 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.313299    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh"]
Jun 15 06:40:16.313810 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.313666    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f" containerName="storage-initializer"
Jun 15 06:40:16.313810 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.313680    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f" containerName="storage-initializer"
Jun 15 06:40:16.313810 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.313691    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f" containerName="kserve-container"
Jun 15 06:40:16.313810 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.313698    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f" containerName="kserve-container"
Jun 15 06:40:16.313810 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.313711    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f" containerName="kube-rbac-proxy"
Jun 15 06:40:16.313810 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.313717    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f" containerName="kube-rbac-proxy"
Jun 15 06:40:16.313810 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.313726    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1856f598-ec9e-4317-8aeb-0683f8cff37d" containerName="kserve-container"
Jun 15 06:40:16.313810 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.313734    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1856f598-ec9e-4317-8aeb-0683f8cff37d" containerName="kserve-container"
Jun 15 06:40:16.313810 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.313751    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1856f598-ec9e-4317-8aeb-0683f8cff37d" containerName="storage-initializer"
Jun 15 06:40:16.313810 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.313756    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1856f598-ec9e-4317-8aeb-0683f8cff37d" containerName="storage-initializer"
Jun 15 06:40:16.313810 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.313763    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1856f598-ec9e-4317-8aeb-0683f8cff37d" containerName="kube-rbac-proxy"
Jun 15 06:40:16.313810 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.313768    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1856f598-ec9e-4317-8aeb-0683f8cff37d" containerName="kube-rbac-proxy"
Jun 15 06:40:16.314312 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.313819    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f" containerName="kserve-container"
Jun 15 06:40:16.314312 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.313825    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="54dc2ae6-a02e-46f6-bb40-cc85ae14eb2f" containerName="kube-rbac-proxy"
Jun 15 06:40:16.314312 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.313833    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1856f598-ec9e-4317-8aeb-0683f8cff37d" containerName="kube-rbac-proxy"
Jun 15 06:40:16.314312 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.313839    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1856f598-ec9e-4317-8aeb-0683f8cff37d" containerName="kserve-container"
Jun 15 06:40:16.317117 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.317099    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh"
Jun 15 06:40:16.319736 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.319714    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-tensorflow-predictor-serving-cert\""
Jun 15 06:40:16.319851 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.319721    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-tensorflow-kube-rbac-proxy-sar-config\""
Jun 15 06:40:16.319952 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.319928    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jun 15 06:40:16.320007 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.319952    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-q7vt7\""
Jun 15 06:40:16.320882 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.320841    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jun 15 06:40:16.320882 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.320853    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jun 15 06:40:16.321003 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.320881    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jun 15 06:40:16.327662 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.327643    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh"]
Jun 15 06:40:16.392871 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.392791    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4c962063-ad39-4f30-85a5-b3aef7904b54-kube-rbac-proxy-sar-config\") pod \"isvc-tensorflow-predictor-547dfc5669-2wzkh\" (UID: \"4c962063-ad39-4f30-85a5-b3aef7904b54\") " pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh"
Jun 15 06:40:16.393026 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.392889    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6275z\" (UniqueName: \"kubernetes.io/projected/4c962063-ad39-4f30-85a5-b3aef7904b54-kube-api-access-6275z\") pod \"isvc-tensorflow-predictor-547dfc5669-2wzkh\" (UID: \"4c962063-ad39-4f30-85a5-b3aef7904b54\") " pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh"
Jun 15 06:40:16.393026 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.392910    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4c962063-ad39-4f30-85a5-b3aef7904b54-kserve-provision-location\") pod \"isvc-tensorflow-predictor-547dfc5669-2wzkh\" (UID: \"4c962063-ad39-4f30-85a5-b3aef7904b54\") " pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh"
Jun 15 06:40:16.393026 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.392989    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4c962063-ad39-4f30-85a5-b3aef7904b54-proxy-tls\") pod \"isvc-tensorflow-predictor-547dfc5669-2wzkh\" (UID: \"4c962063-ad39-4f30-85a5-b3aef7904b54\") " pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh"
Jun 15 06:40:16.393137 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.393043    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4c962063-ad39-4f30-85a5-b3aef7904b54-cabundle-cert\") pod \"isvc-tensorflow-predictor-547dfc5669-2wzkh\" (UID: \"4c962063-ad39-4f30-85a5-b3aef7904b54\") " pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh"
Jun 15 06:40:16.494121 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.494087    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4c962063-ad39-4f30-85a5-b3aef7904b54-cabundle-cert\") pod \"isvc-tensorflow-predictor-547dfc5669-2wzkh\" (UID: \"4c962063-ad39-4f30-85a5-b3aef7904b54\") " pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh"
Jun 15 06:40:16.494278 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.494132    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4c962063-ad39-4f30-85a5-b3aef7904b54-kube-rbac-proxy-sar-config\") pod \"isvc-tensorflow-predictor-547dfc5669-2wzkh\" (UID: \"4c962063-ad39-4f30-85a5-b3aef7904b54\") " pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh"
Jun 15 06:40:16.494278 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.494262    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6275z\" (UniqueName: \"kubernetes.io/projected/4c962063-ad39-4f30-85a5-b3aef7904b54-kube-api-access-6275z\") pod \"isvc-tensorflow-predictor-547dfc5669-2wzkh\" (UID: \"4c962063-ad39-4f30-85a5-b3aef7904b54\") " pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh"
Jun 15 06:40:16.494414 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.494302    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4c962063-ad39-4f30-85a5-b3aef7904b54-kserve-provision-location\") pod \"isvc-tensorflow-predictor-547dfc5669-2wzkh\" (UID: \"4c962063-ad39-4f30-85a5-b3aef7904b54\") " pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh"
Jun 15 06:40:16.494414 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.494356    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4c962063-ad39-4f30-85a5-b3aef7904b54-proxy-tls\") pod \"isvc-tensorflow-predictor-547dfc5669-2wzkh\" (UID: \"4c962063-ad39-4f30-85a5-b3aef7904b54\") " pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh"
Jun 15 06:40:16.494644 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.494623    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4c962063-ad39-4f30-85a5-b3aef7904b54-kserve-provision-location\") pod \"isvc-tensorflow-predictor-547dfc5669-2wzkh\" (UID: \"4c962063-ad39-4f30-85a5-b3aef7904b54\") " pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh"
Jun 15 06:40:16.494828 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.494809    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4c962063-ad39-4f30-85a5-b3aef7904b54-cabundle-cert\") pod \"isvc-tensorflow-predictor-547dfc5669-2wzkh\" (UID: \"4c962063-ad39-4f30-85a5-b3aef7904b54\") " pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh"
Jun 15 06:40:16.494901 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.494810    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4c962063-ad39-4f30-85a5-b3aef7904b54-kube-rbac-proxy-sar-config\") pod \"isvc-tensorflow-predictor-547dfc5669-2wzkh\" (UID: \"4c962063-ad39-4f30-85a5-b3aef7904b54\") " pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh"
Jun 15 06:40:16.496920 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.496901    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4c962063-ad39-4f30-85a5-b3aef7904b54-proxy-tls\") pod \"isvc-tensorflow-predictor-547dfc5669-2wzkh\" (UID: \"4c962063-ad39-4f30-85a5-b3aef7904b54\") " pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh"
Jun 15 06:40:16.503797 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.503777    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6275z\" (UniqueName: \"kubernetes.io/projected/4c962063-ad39-4f30-85a5-b3aef7904b54-kube-api-access-6275z\") pod \"isvc-tensorflow-predictor-547dfc5669-2wzkh\" (UID: \"4c962063-ad39-4f30-85a5-b3aef7904b54\") " pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh"
Jun 15 06:40:16.627899 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.627805    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh"
Jun 15 06:40:16.764459 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:16.764434    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh"]
Jun 15 06:40:16.767050 ip-10-0-131-82 kubenswrapper[2564]: W0615 06:40:16.767020    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c962063_ad39_4f30_85a5_b3aef7904b54.slice/crio-f96b69b5f85d6bba617dad9c632d047d11f524243469911d60812e548e143d94 WatchSource:0}: Error finding container f96b69b5f85d6bba617dad9c632d047d11f524243469911d60812e548e143d94: Status 404 returned error can't find the container with id f96b69b5f85d6bba617dad9c632d047d11f524243469911d60812e548e143d94
Jun 15 06:40:17.165500 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:17.165458    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh" event={"ID":"4c962063-ad39-4f30-85a5-b3aef7904b54","Type":"ContainerStarted","Data":"5bb81d99a66b71a0fe9e9566f65c4633985074190f770025e132a6a6a2833c68"}
Jun 15 06:40:17.165656 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:17.165537    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh" event={"ID":"4c962063-ad39-4f30-85a5-b3aef7904b54","Type":"ContainerStarted","Data":"f96b69b5f85d6bba617dad9c632d047d11f524243469911d60812e548e143d94"}
Jun 15 06:40:22.188195 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:22.188158    2564 generic.go:356] "Generic (PLEG): container finished" podID="4c962063-ad39-4f30-85a5-b3aef7904b54" containerID="5bb81d99a66b71a0fe9e9566f65c4633985074190f770025e132a6a6a2833c68" exitCode=0
Jun 15 06:40:22.188657 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:22.188204    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh" event={"ID":"4c962063-ad39-4f30-85a5-b3aef7904b54","Type":"ContainerDied","Data":"5bb81d99a66b71a0fe9e9566f65c4633985074190f770025e132a6a6a2833c68"}
Jun 15 06:40:22.189412 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:22.189393    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 15 06:40:27.216155 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:27.216113    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh" event={"ID":"4c962063-ad39-4f30-85a5-b3aef7904b54","Type":"ContainerStarted","Data":"0a13c7ecde1b0a8371f74dec6a658f5791bc68c46067be724b09d34df0686657"}
Jun 15 06:40:27.216662 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:27.216273    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh" event={"ID":"4c962063-ad39-4f30-85a5-b3aef7904b54","Type":"ContainerStarted","Data":"bf76f790be880a1f1b261d9a72532d83b8631b6b58a2d49584ceb93fa10e4cbb"}
Jun 15 06:40:27.217848 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:27.217815    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh"
Jun 15 06:40:27.217989 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:27.217921    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh"
Jun 15 06:40:27.219305 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:27.219257    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh" podUID="4c962063-ad39-4f30-85a5-b3aef7904b54" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused"
Jun 15 06:40:28.220379 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:28.220340    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh" podUID="4c962063-ad39-4f30-85a5-b3aef7904b54" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused"
Jun 15 06:40:33.224702 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:33.224669    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh"
Jun 15 06:40:33.225196 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:33.225169    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh" podUID="4c962063-ad39-4f30-85a5-b3aef7904b54" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused"
Jun 15 06:40:33.249466 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:33.249420    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh" podStartSLOduration=8.342674637 podStartE2EDuration="17.249405724s" totalImagesPullingTime="4.141992431s" totalInitContainerRuntime="4.764738656s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:40:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:40:27.262544613 +0000 UTC m=+3169.629089663" watchObservedRunningTime="2026-06-15 06:40:33.249405724 +0000 UTC m=+3175.615950774"
Jun 15 06:40:43.226138 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:43.226109    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh"
Jun 15 06:40:57.775906 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:57.775853    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh"]
Jun 15 06:40:57.776357 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:57.776156    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh" podUID="4c962063-ad39-4f30-85a5-b3aef7904b54" containerName="kserve-container" containerID="cri-o://bf76f790be880a1f1b261d9a72532d83b8631b6b58a2d49584ceb93fa10e4cbb" gracePeriod=30
Jun 15 06:40:57.776357 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:57.776217    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh" podUID="4c962063-ad39-4f30-85a5-b3aef7904b54" containerName="kube-rbac-proxy" containerID="cri-o://0a13c7ecde1b0a8371f74dec6a658f5791bc68c46067be724b09d34df0686657" gracePeriod=30
Jun 15 06:40:57.844019 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:57.843980    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk"]
Jun 15 06:40:57.847506 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:57.847489    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk"
Jun 15 06:40:57.850147 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:57.850124    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-tensorflow-runtime-predictor-serving-cert\""
Jun 15 06:40:57.850228 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:57.850161    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-tensorflow-runtime-kube-rbac-proxy-sar-config\""
Jun 15 06:40:57.860199 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:57.860173    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk"]
Jun 15 06:40:57.939304 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:57.939268    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wrmz\" (UniqueName: \"kubernetes.io/projected/a51d91a4-9927-4f1b-aff7-4b73c90301db-kube-api-access-5wrmz\") pod \"isvc-tensorflow-runtime-predictor-855cfcd677-vwptk\" (UID: \"a51d91a4-9927-4f1b-aff7-4b73c90301db\") " pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk"
Jun 15 06:40:57.939304 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:57.939307    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a51d91a4-9927-4f1b-aff7-4b73c90301db-kserve-provision-location\") pod \"isvc-tensorflow-runtime-predictor-855cfcd677-vwptk\" (UID: \"a51d91a4-9927-4f1b-aff7-4b73c90301db\") " pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk"
Jun 15 06:40:57.939498 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:57.939334    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a51d91a4-9927-4f1b-aff7-4b73c90301db-kube-rbac-proxy-sar-config\") pod \"isvc-tensorflow-runtime-predictor-855cfcd677-vwptk\" (UID: \"a51d91a4-9927-4f1b-aff7-4b73c90301db\") " pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk"
Jun 15 06:40:57.939498 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:57.939458    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a51d91a4-9927-4f1b-aff7-4b73c90301db-proxy-tls\") pod \"isvc-tensorflow-runtime-predictor-855cfcd677-vwptk\" (UID: \"a51d91a4-9927-4f1b-aff7-4b73c90301db\") " pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk"
Jun 15 06:40:57.939498 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:57.939489    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a51d91a4-9927-4f1b-aff7-4b73c90301db-cabundle-cert\") pod \"isvc-tensorflow-runtime-predictor-855cfcd677-vwptk\" (UID: \"a51d91a4-9927-4f1b-aff7-4b73c90301db\") " pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk"
Jun 15 06:40:58.040187 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:58.040089    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wrmz\" (UniqueName: \"kubernetes.io/projected/a51d91a4-9927-4f1b-aff7-4b73c90301db-kube-api-access-5wrmz\") pod \"isvc-tensorflow-runtime-predictor-855cfcd677-vwptk\" (UID: \"a51d91a4-9927-4f1b-aff7-4b73c90301db\") " pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk"
Jun 15 06:40:58.040187 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:58.040128    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a51d91a4-9927-4f1b-aff7-4b73c90301db-kserve-provision-location\") pod \"isvc-tensorflow-runtime-predictor-855cfcd677-vwptk\" (UID: \"a51d91a4-9927-4f1b-aff7-4b73c90301db\") " pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk"
Jun 15 06:40:58.040187 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:58.040155    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a51d91a4-9927-4f1b-aff7-4b73c90301db-kube-rbac-proxy-sar-config\") pod \"isvc-tensorflow-runtime-predictor-855cfcd677-vwptk\" (UID: \"a51d91a4-9927-4f1b-aff7-4b73c90301db\") " pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk"
Jun 15 06:40:58.040454 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:58.040211    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a51d91a4-9927-4f1b-aff7-4b73c90301db-proxy-tls\") pod \"isvc-tensorflow-runtime-predictor-855cfcd677-vwptk\" (UID: \"a51d91a4-9927-4f1b-aff7-4b73c90301db\") " pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk"
Jun 15 06:40:58.040454 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:58.040230    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a51d91a4-9927-4f1b-aff7-4b73c90301db-cabundle-cert\") pod \"isvc-tensorflow-runtime-predictor-855cfcd677-vwptk\" (UID: \"a51d91a4-9927-4f1b-aff7-4b73c90301db\") " pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk"
Jun 15 06:40:58.040454 ip-10-0-131-82 kubenswrapper[2564]: E0615 06:40:58.040369    2564 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-serving-cert: secret "isvc-tensorflow-runtime-predictor-serving-cert" not found
Jun 15 06:40:58.040454 ip-10-0-131-82 kubenswrapper[2564]: E0615 06:40:58.040452    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a51d91a4-9927-4f1b-aff7-4b73c90301db-proxy-tls podName:a51d91a4-9927-4f1b-aff7-4b73c90301db nodeName:}" failed. No retries permitted until 2026-06-15 06:40:58.540429658 +0000 UTC m=+3200.906974687 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/a51d91a4-9927-4f1b-aff7-4b73c90301db-proxy-tls") pod "isvc-tensorflow-runtime-predictor-855cfcd677-vwptk" (UID: "a51d91a4-9927-4f1b-aff7-4b73c90301db") : secret "isvc-tensorflow-runtime-predictor-serving-cert" not found
Jun 15 06:40:58.040622 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:58.040544    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a51d91a4-9927-4f1b-aff7-4b73c90301db-kserve-provision-location\") pod \"isvc-tensorflow-runtime-predictor-855cfcd677-vwptk\" (UID: \"a51d91a4-9927-4f1b-aff7-4b73c90301db\") " pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk"
Jun 15 06:40:58.040924 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:58.040901    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a51d91a4-9927-4f1b-aff7-4b73c90301db-kube-rbac-proxy-sar-config\") pod \"isvc-tensorflow-runtime-predictor-855cfcd677-vwptk\" (UID: \"a51d91a4-9927-4f1b-aff7-4b73c90301db\") " pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk"
Jun 15 06:40:58.041012 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:58.040987    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a51d91a4-9927-4f1b-aff7-4b73c90301db-cabundle-cert\") pod \"isvc-tensorflow-runtime-predictor-855cfcd677-vwptk\" (UID: \"a51d91a4-9927-4f1b-aff7-4b73c90301db\") " pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk"
Jun 15 06:40:58.051721 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:58.051695    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wrmz\" (UniqueName: \"kubernetes.io/projected/a51d91a4-9927-4f1b-aff7-4b73c90301db-kube-api-access-5wrmz\") pod \"isvc-tensorflow-runtime-predictor-855cfcd677-vwptk\" (UID: \"a51d91a4-9927-4f1b-aff7-4b73c90301db\") " pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk"
Jun 15 06:40:58.221182 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:58.221138    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh" podUID="4c962063-ad39-4f30-85a5-b3aef7904b54" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.34:8643/healthz\": dial tcp 10.132.0.34:8643: connect: connection refused"
Jun 15 06:40:58.358906 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:58.358789    2564 generic.go:356] "Generic (PLEG): container finished" podID="4c962063-ad39-4f30-85a5-b3aef7904b54" containerID="0a13c7ecde1b0a8371f74dec6a658f5791bc68c46067be724b09d34df0686657" exitCode=2
Jun 15 06:40:58.358906 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:58.358883    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh" event={"ID":"4c962063-ad39-4f30-85a5-b3aef7904b54","Type":"ContainerDied","Data":"0a13c7ecde1b0a8371f74dec6a658f5791bc68c46067be724b09d34df0686657"}
Jun 15 06:40:58.545290 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:58.545250    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a51d91a4-9927-4f1b-aff7-4b73c90301db-proxy-tls\") pod \"isvc-tensorflow-runtime-predictor-855cfcd677-vwptk\" (UID: \"a51d91a4-9927-4f1b-aff7-4b73c90301db\") " pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk"
Jun 15 06:40:58.547885 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:58.547848    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a51d91a4-9927-4f1b-aff7-4b73c90301db-proxy-tls\") pod \"isvc-tensorflow-runtime-predictor-855cfcd677-vwptk\" (UID: \"a51d91a4-9927-4f1b-aff7-4b73c90301db\") " pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk"
Jun 15 06:40:58.757501 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:58.757466    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk"
Jun 15 06:40:58.892905 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:58.892877    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk"]
Jun 15 06:40:58.895753 ip-10-0-131-82 kubenswrapper[2564]: W0615 06:40:58.895727    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda51d91a4_9927_4f1b_aff7_4b73c90301db.slice/crio-7d2d2babbf8aa747179df752bd7ec1d478846425eda46b8c198b3d85e089bbe1 WatchSource:0}: Error finding container 7d2d2babbf8aa747179df752bd7ec1d478846425eda46b8c198b3d85e089bbe1: Status 404 returned error can't find the container with id 7d2d2babbf8aa747179df752bd7ec1d478846425eda46b8c198b3d85e089bbe1
Jun 15 06:40:59.365452 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:59.365416    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk" event={"ID":"a51d91a4-9927-4f1b-aff7-4b73c90301db","Type":"ContainerStarted","Data":"bea15303837fc67bcb8447e985376f32504373d10b2a6523e8efea5f1d7fe1a5"}
Jun 15 06:40:59.365659 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:40:59.365481    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk" event={"ID":"a51d91a4-9927-4f1b-aff7-4b73c90301db","Type":"ContainerStarted","Data":"7d2d2babbf8aa747179df752bd7ec1d478846425eda46b8c198b3d85e089bbe1"}
Jun 15 06:41:03.220632 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:03.220591    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh" podUID="4c962063-ad39-4f30-85a5-b3aef7904b54" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.34:8643/healthz\": dial tcp 10.132.0.34:8643: connect: connection refused"
Jun 15 06:41:03.385688 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:03.385658    2564 generic.go:356] "Generic (PLEG): container finished" podID="a51d91a4-9927-4f1b-aff7-4b73c90301db" containerID="bea15303837fc67bcb8447e985376f32504373d10b2a6523e8efea5f1d7fe1a5" exitCode=0
Jun 15 06:41:03.385852 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:03.385712    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk" event={"ID":"a51d91a4-9927-4f1b-aff7-4b73c90301db","Type":"ContainerDied","Data":"bea15303837fc67bcb8447e985376f32504373d10b2a6523e8efea5f1d7fe1a5"}
Jun 15 06:41:04.392355 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:04.392317    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk" event={"ID":"a51d91a4-9927-4f1b-aff7-4b73c90301db","Type":"ContainerStarted","Data":"060f7e2787c5c92984e356bf5a9eec4227ea69c9b027aadc6e616509c4b0ebbc"}
Jun 15 06:41:04.392804 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:04.392381    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk" event={"ID":"a51d91a4-9927-4f1b-aff7-4b73c90301db","Type":"ContainerStarted","Data":"e80bd8f069b955cc3db5538a731d3cbe39896dddc77d2c3f866506e8ffb3afb5"}
Jun 15 06:41:04.392804 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:04.392687    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk"
Jun 15 06:41:04.392804 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:04.392731    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk"
Jun 15 06:41:04.394143 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:04.394115    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk" podUID="a51d91a4-9927-4f1b-aff7-4b73c90301db" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Jun 15 06:41:04.417799 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:04.417733    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk" podStartSLOduration=3.253008561 podStartE2EDuration="7.417717484s" totalImagesPullingTime="0s" totalInitContainerRuntime="4.164708923s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:40:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:41:04.415742318 +0000 UTC m=+3206.782287370" watchObservedRunningTime="2026-06-15 06:41:04.417717484 +0000 UTC m=+3206.784262534"
Jun 15 06:41:05.397830 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:05.397785    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk" podUID="a51d91a4-9927-4f1b-aff7-4b73c90301db" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Jun 15 06:41:08.221460 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:08.221408    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh" podUID="4c962063-ad39-4f30-85a5-b3aef7904b54" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.34:8643/healthz\": dial tcp 10.132.0.34:8643: connect: connection refused"
Jun 15 06:41:08.221904 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:08.221546    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh"
Jun 15 06:41:10.402048 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:10.402020    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk"
Jun 15 06:41:10.402540 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:10.402512    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk" podUID="a51d91a4-9927-4f1b-aff7-4b73c90301db" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Jun 15 06:41:13.220932 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:13.220883    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh" podUID="4c962063-ad39-4f30-85a5-b3aef7904b54" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.34:8643/healthz\": dial tcp 10.132.0.34:8643: connect: connection refused"
Jun 15 06:41:18.221687 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:18.221592    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh" podUID="4c962063-ad39-4f30-85a5-b3aef7904b54" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.34:8643/healthz\": dial tcp 10.132.0.34:8643: connect: connection refused"
Jun 15 06:41:20.403167 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:20.403127    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk"
Jun 15 06:41:23.221247 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:23.221198    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh" podUID="4c962063-ad39-4f30-85a5-b3aef7904b54" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.34:8643/healthz\": dial tcp 10.132.0.34:8643: connect: connection refused"
Jun 15 06:41:28.221455 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:28.221410    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh" podUID="4c962063-ad39-4f30-85a5-b3aef7904b54" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.34:8643/healthz\": dial tcp 10.132.0.34:8643: connect: connection refused"
Jun 15 06:41:28.432080 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:28.432052    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh"
Jun 15 06:41:28.510988 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:28.510902    2564 generic.go:356] "Generic (PLEG): container finished" podID="4c962063-ad39-4f30-85a5-b3aef7904b54" containerID="bf76f790be880a1f1b261d9a72532d83b8631b6b58a2d49584ceb93fa10e4cbb" exitCode=137
Jun 15 06:41:28.510988 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:28.510964    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh"
Jun 15 06:41:28.511163 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:28.510987    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh" event={"ID":"4c962063-ad39-4f30-85a5-b3aef7904b54","Type":"ContainerDied","Data":"bf76f790be880a1f1b261d9a72532d83b8631b6b58a2d49584ceb93fa10e4cbb"}
Jun 15 06:41:28.511163 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:28.511049    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh" event={"ID":"4c962063-ad39-4f30-85a5-b3aef7904b54","Type":"ContainerDied","Data":"f96b69b5f85d6bba617dad9c632d047d11f524243469911d60812e548e143d94"}
Jun 15 06:41:28.511163 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:28.511077    2564 scope.go:117] "RemoveContainer" containerID="0a13c7ecde1b0a8371f74dec6a658f5791bc68c46067be724b09d34df0686657"
Jun 15 06:41:28.519323 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:28.519301    2564 scope.go:117] "RemoveContainer" containerID="bf76f790be880a1f1b261d9a72532d83b8631b6b58a2d49584ceb93fa10e4cbb"
Jun 15 06:41:28.527019 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:28.526999    2564 scope.go:117] "RemoveContainer" containerID="5bb81d99a66b71a0fe9e9566f65c4633985074190f770025e132a6a6a2833c68"
Jun 15 06:41:28.534732 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:28.534714    2564 scope.go:117] "RemoveContainer" containerID="0a13c7ecde1b0a8371f74dec6a658f5791bc68c46067be724b09d34df0686657"
Jun 15 06:41:28.535032 ip-10-0-131-82 kubenswrapper[2564]: E0615 06:41:28.535009    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a13c7ecde1b0a8371f74dec6a658f5791bc68c46067be724b09d34df0686657\": container with ID starting with 0a13c7ecde1b0a8371f74dec6a658f5791bc68c46067be724b09d34df0686657 not found: ID does not exist" containerID="0a13c7ecde1b0a8371f74dec6a658f5791bc68c46067be724b09d34df0686657"
Jun 15 06:41:28.535085 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:28.535044    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a13c7ecde1b0a8371f74dec6a658f5791bc68c46067be724b09d34df0686657"} err="failed to get container status \"0a13c7ecde1b0a8371f74dec6a658f5791bc68c46067be724b09d34df0686657\": rpc error: code = NotFound desc = could not find container \"0a13c7ecde1b0a8371f74dec6a658f5791bc68c46067be724b09d34df0686657\": container with ID starting with 0a13c7ecde1b0a8371f74dec6a658f5791bc68c46067be724b09d34df0686657 not found: ID does not exist"
Jun 15 06:41:28.535085 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:28.535063    2564 scope.go:117] "RemoveContainer" containerID="bf76f790be880a1f1b261d9a72532d83b8631b6b58a2d49584ceb93fa10e4cbb"
Jun 15 06:41:28.535301 ip-10-0-131-82 kubenswrapper[2564]: E0615 06:41:28.535284    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf76f790be880a1f1b261d9a72532d83b8631b6b58a2d49584ceb93fa10e4cbb\": container with ID starting with bf76f790be880a1f1b261d9a72532d83b8631b6b58a2d49584ceb93fa10e4cbb not found: ID does not exist" containerID="bf76f790be880a1f1b261d9a72532d83b8631b6b58a2d49584ceb93fa10e4cbb"
Jun 15 06:41:28.535351 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:28.535306    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf76f790be880a1f1b261d9a72532d83b8631b6b58a2d49584ceb93fa10e4cbb"} err="failed to get container status \"bf76f790be880a1f1b261d9a72532d83b8631b6b58a2d49584ceb93fa10e4cbb\": rpc error: code = NotFound desc = could not find container \"bf76f790be880a1f1b261d9a72532d83b8631b6b58a2d49584ceb93fa10e4cbb\": container with ID starting with bf76f790be880a1f1b261d9a72532d83b8631b6b58a2d49584ceb93fa10e4cbb not found: ID does not exist"
Jun 15 06:41:28.535351 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:28.535323    2564 scope.go:117] "RemoveContainer" containerID="5bb81d99a66b71a0fe9e9566f65c4633985074190f770025e132a6a6a2833c68"
Jun 15 06:41:28.535593 ip-10-0-131-82 kubenswrapper[2564]: E0615 06:41:28.535572    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bb81d99a66b71a0fe9e9566f65c4633985074190f770025e132a6a6a2833c68\": container with ID starting with 5bb81d99a66b71a0fe9e9566f65c4633985074190f770025e132a6a6a2833c68 not found: ID does not exist" containerID="5bb81d99a66b71a0fe9e9566f65c4633985074190f770025e132a6a6a2833c68"
Jun 15 06:41:28.535650 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:28.535601    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bb81d99a66b71a0fe9e9566f65c4633985074190f770025e132a6a6a2833c68"} err="failed to get container status \"5bb81d99a66b71a0fe9e9566f65c4633985074190f770025e132a6a6a2833c68\": rpc error: code = NotFound desc = could not find container \"5bb81d99a66b71a0fe9e9566f65c4633985074190f770025e132a6a6a2833c68\": container with ID starting with 5bb81d99a66b71a0fe9e9566f65c4633985074190f770025e132a6a6a2833c68 not found: ID does not exist"
Jun 15 06:41:28.600091 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:28.600052    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4c962063-ad39-4f30-85a5-b3aef7904b54-kube-rbac-proxy-sar-config\") pod \"4c962063-ad39-4f30-85a5-b3aef7904b54\" (UID: \"4c962063-ad39-4f30-85a5-b3aef7904b54\") "
Jun 15 06:41:28.600324 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:28.600099    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4c962063-ad39-4f30-85a5-b3aef7904b54-kserve-provision-location\") pod \"4c962063-ad39-4f30-85a5-b3aef7904b54\" (UID: \"4c962063-ad39-4f30-85a5-b3aef7904b54\") "
Jun 15 06:41:28.600324 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:28.600128    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6275z\" (UniqueName: \"kubernetes.io/projected/4c962063-ad39-4f30-85a5-b3aef7904b54-kube-api-access-6275z\") pod \"4c962063-ad39-4f30-85a5-b3aef7904b54\" (UID: \"4c962063-ad39-4f30-85a5-b3aef7904b54\") "
Jun 15 06:41:28.600324 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:28.600254    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4c962063-ad39-4f30-85a5-b3aef7904b54-proxy-tls\") pod \"4c962063-ad39-4f30-85a5-b3aef7904b54\" (UID: \"4c962063-ad39-4f30-85a5-b3aef7904b54\") "
Jun 15 06:41:28.600490 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:28.600364    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4c962063-ad39-4f30-85a5-b3aef7904b54-cabundle-cert\") pod \"4c962063-ad39-4f30-85a5-b3aef7904b54\" (UID: \"4c962063-ad39-4f30-85a5-b3aef7904b54\") "
Jun 15 06:41:28.600541 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:28.600487    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c962063-ad39-4f30-85a5-b3aef7904b54-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "4c962063-ad39-4f30-85a5-b3aef7904b54" (UID: "4c962063-ad39-4f30-85a5-b3aef7904b54"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 06:41:28.600668 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:28.600643    2564 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4c962063-ad39-4f30-85a5-b3aef7904b54-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:41:28.600783 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:28.600712    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c962063-ad39-4f30-85a5-b3aef7904b54-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "4c962063-ad39-4f30-85a5-b3aef7904b54" (UID: "4c962063-ad39-4f30-85a5-b3aef7904b54"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 06:41:28.602458 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:28.602425    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c962063-ad39-4f30-85a5-b3aef7904b54-kube-api-access-6275z" (OuterVolumeSpecName: "kube-api-access-6275z") pod "4c962063-ad39-4f30-85a5-b3aef7904b54" (UID: "4c962063-ad39-4f30-85a5-b3aef7904b54"). InnerVolumeSpecName "kube-api-access-6275z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 06:41:28.602564 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:28.602534    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c962063-ad39-4f30-85a5-b3aef7904b54-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "4c962063-ad39-4f30-85a5-b3aef7904b54" (UID: "4c962063-ad39-4f30-85a5-b3aef7904b54"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 06:41:28.610913 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:28.610884    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c962063-ad39-4f30-85a5-b3aef7904b54-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "4c962063-ad39-4f30-85a5-b3aef7904b54" (UID: "4c962063-ad39-4f30-85a5-b3aef7904b54"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:41:28.701334 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:28.701290    2564 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4c962063-ad39-4f30-85a5-b3aef7904b54-proxy-tls\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:41:28.701334 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:28.701334    2564 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4c962063-ad39-4f30-85a5-b3aef7904b54-cabundle-cert\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:41:28.701547 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:28.701351    2564 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4c962063-ad39-4f30-85a5-b3aef7904b54-kserve-provision-location\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:41:28.701547 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:28.701363    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6275z\" (UniqueName: \"kubernetes.io/projected/4c962063-ad39-4f30-85a5-b3aef7904b54-kube-api-access-6275z\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:41:28.841213 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:28.841163    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh"]
Jun 15 06:41:28.846117 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:28.845854    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-2wzkh"]
Jun 15 06:41:30.136476 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:30.136439    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c962063-ad39-4f30-85a5-b3aef7904b54" path="/var/lib/kubelet/pods/4c962063-ad39-4f30-85a5-b3aef7904b54/volumes"
Jun 15 06:41:39.053758 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:39.053719    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk"]
Jun 15 06:41:39.054253 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:39.054112    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk" podUID="a51d91a4-9927-4f1b-aff7-4b73c90301db" containerName="kserve-container" containerID="cri-o://e80bd8f069b955cc3db5538a731d3cbe39896dddc77d2c3f866506e8ffb3afb5" gracePeriod=30
Jun 15 06:41:39.054253 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:39.054123    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk" podUID="a51d91a4-9927-4f1b-aff7-4b73c90301db" containerName="kube-rbac-proxy" containerID="cri-o://060f7e2787c5c92984e356bf5a9eec4227ea69c9b027aadc6e616509c4b0ebbc" gracePeriod=30
Jun 15 06:41:39.140473 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:39.140433    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww"]
Jun 15 06:41:39.140803 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:39.140790    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c962063-ad39-4f30-85a5-b3aef7904b54" containerName="storage-initializer"
Jun 15 06:41:39.140846 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:39.140806    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c962063-ad39-4f30-85a5-b3aef7904b54" containerName="storage-initializer"
Jun 15 06:41:39.140846 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:39.140816    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c962063-ad39-4f30-85a5-b3aef7904b54" containerName="kserve-container"
Jun 15 06:41:39.140846 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:39.140822    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c962063-ad39-4f30-85a5-b3aef7904b54" containerName="kserve-container"
Jun 15 06:41:39.140846 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:39.140828    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c962063-ad39-4f30-85a5-b3aef7904b54" containerName="kube-rbac-proxy"
Jun 15 06:41:39.140846 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:39.140835    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c962063-ad39-4f30-85a5-b3aef7904b54" containerName="kube-rbac-proxy"
Jun 15 06:41:39.141052 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:39.140926    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c962063-ad39-4f30-85a5-b3aef7904b54" containerName="kube-rbac-proxy"
Jun 15 06:41:39.141052 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:39.140936    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c962063-ad39-4f30-85a5-b3aef7904b54" containerName="kserve-container"
Jun 15 06:41:39.145424 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:39.145402    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww"
Jun 15 06:41:39.147995 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:39.147974    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-triton-predictor-serving-cert\""
Jun 15 06:41:39.148110 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:39.147992    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-triton-kube-rbac-proxy-sar-config\""
Jun 15 06:41:39.154805 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:39.154778    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww"]
Jun 15 06:41:39.189463 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:39.189427    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29-kserve-provision-location\") pod \"isvc-triton-predictor-5d7db58676-w7cww\" (UID: \"8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww"
Jun 15 06:41:39.189633 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:39.189471    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29-proxy-tls\") pod \"isvc-triton-predictor-5d7db58676-w7cww\" (UID: \"8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww"
Jun 15 06:41:39.189633 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:39.189533    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29-cabundle-cert\") pod \"isvc-triton-predictor-5d7db58676-w7cww\" (UID: \"8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww"
Jun 15 06:41:39.189633 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:39.189570    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b9l5\" (UniqueName: \"kubernetes.io/projected/8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29-kube-api-access-4b9l5\") pod \"isvc-triton-predictor-5d7db58676-w7cww\" (UID: \"8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww"
Jun 15 06:41:39.189633 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:39.189602    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29-kube-rbac-proxy-sar-config\") pod \"isvc-triton-predictor-5d7db58676-w7cww\" (UID: \"8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww"
Jun 15 06:41:39.290296 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:39.290252    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29-cabundle-cert\") pod \"isvc-triton-predictor-5d7db58676-w7cww\" (UID: \"8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww"
Jun 15 06:41:39.290296 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:39.290297    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b9l5\" (UniqueName: \"kubernetes.io/projected/8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29-kube-api-access-4b9l5\") pod \"isvc-triton-predictor-5d7db58676-w7cww\" (UID: \"8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww"
Jun 15 06:41:39.290544 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:39.290319    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29-kube-rbac-proxy-sar-config\") pod \"isvc-triton-predictor-5d7db58676-w7cww\" (UID: \"8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww"
Jun 15 06:41:39.290544 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:39.290364    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29-kserve-provision-location\") pod \"isvc-triton-predictor-5d7db58676-w7cww\" (UID: \"8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww"
Jun 15 06:41:39.290544 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:39.290398    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29-proxy-tls\") pod \"isvc-triton-predictor-5d7db58676-w7cww\" (UID: \"8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww"
Jun 15 06:41:39.290824 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:39.290802    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29-kserve-provision-location\") pod \"isvc-triton-predictor-5d7db58676-w7cww\" (UID: \"8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww"
Jun 15 06:41:39.291006 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:39.290988    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29-kube-rbac-proxy-sar-config\") pod \"isvc-triton-predictor-5d7db58676-w7cww\" (UID: \"8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww"
Jun 15 06:41:39.291006 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:39.290997    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29-cabundle-cert\") pod \"isvc-triton-predictor-5d7db58676-w7cww\" (UID: \"8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww"
Jun 15 06:41:39.292956 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:39.292938    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29-proxy-tls\") pod \"isvc-triton-predictor-5d7db58676-w7cww\" (UID: \"8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww"
Jun 15 06:41:39.301006 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:39.300979    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b9l5\" (UniqueName: \"kubernetes.io/projected/8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29-kube-api-access-4b9l5\") pod \"isvc-triton-predictor-5d7db58676-w7cww\" (UID: \"8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww"
Jun 15 06:41:39.456811 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:39.456771    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww"
Jun 15 06:41:39.564185 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:39.564151    2564 generic.go:356] "Generic (PLEG): container finished" podID="a51d91a4-9927-4f1b-aff7-4b73c90301db" containerID="060f7e2787c5c92984e356bf5a9eec4227ea69c9b027aadc6e616509c4b0ebbc" exitCode=2
Jun 15 06:41:39.564356 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:39.564236    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk" event={"ID":"a51d91a4-9927-4f1b-aff7-4b73c90301db","Type":"ContainerDied","Data":"060f7e2787c5c92984e356bf5a9eec4227ea69c9b027aadc6e616509c4b0ebbc"}
Jun 15 06:41:39.593903 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:39.593813    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww"]
Jun 15 06:41:39.596053 ip-10-0-131-82 kubenswrapper[2564]: W0615 06:41:39.596028    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e1bbb56_ccd8_4cf8_bb5e_9f5fcfc83a29.slice/crio-25f215fae1d7b1c5414a16df0c48341cfdca4b4897ab67270ace4646a8a9ad3a WatchSource:0}: Error finding container 25f215fae1d7b1c5414a16df0c48341cfdca4b4897ab67270ace4646a8a9ad3a: Status 404 returned error can't find the container with id 25f215fae1d7b1c5414a16df0c48341cfdca4b4897ab67270ace4646a8a9ad3a
Jun 15 06:41:40.398977 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:40.398921    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk" podUID="a51d91a4-9927-4f1b-aff7-4b73c90301db" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.35:8643/healthz\": dial tcp 10.132.0.35:8643: connect: connection refused"
Jun 15 06:41:40.569970 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:40.569935    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww" event={"ID":"8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29","Type":"ContainerStarted","Data":"8ca96edb6b54b8a88c13ef6b95ed426e8cd88ff600b1ec902b0bb5e65cb5bc10"}
Jun 15 06:41:40.570139 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:40.569998    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww" event={"ID":"8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29","Type":"ContainerStarted","Data":"25f215fae1d7b1c5414a16df0c48341cfdca4b4897ab67270ace4646a8a9ad3a"}
Jun 15 06:41:44.591361 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:44.591317    2564 generic.go:356] "Generic (PLEG): container finished" podID="8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29" containerID="8ca96edb6b54b8a88c13ef6b95ed426e8cd88ff600b1ec902b0bb5e65cb5bc10" exitCode=0
Jun 15 06:41:44.591766 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:44.591383    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww" event={"ID":"8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29","Type":"ContainerDied","Data":"8ca96edb6b54b8a88c13ef6b95ed426e8cd88ff600b1ec902b0bb5e65cb5bc10"}
Jun 15 06:41:45.398391 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:45.398347    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk" podUID="a51d91a4-9927-4f1b-aff7-4b73c90301db" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.35:8643/healthz\": dial tcp 10.132.0.35:8643: connect: connection refused"
Jun 15 06:41:50.398173 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:50.398123    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk" podUID="a51d91a4-9927-4f1b-aff7-4b73c90301db" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.35:8643/healthz\": dial tcp 10.132.0.35:8643: connect: connection refused"
Jun 15 06:41:50.398642 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:50.398276    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk"
Jun 15 06:41:55.399318 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:41:55.398745    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk" podUID="a51d91a4-9927-4f1b-aff7-4b73c90301db" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.35:8643/healthz\": dial tcp 10.132.0.35:8643: connect: connection refused"
Jun 15 06:42:00.398089 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:42:00.398033    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk" podUID="a51d91a4-9927-4f1b-aff7-4b73c90301db" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.35:8643/healthz\": dial tcp 10.132.0.35:8643: connect: connection refused"
Jun 15 06:42:05.398321 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:42:05.398269    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk" podUID="a51d91a4-9927-4f1b-aff7-4b73c90301db" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.35:8643/healthz\": dial tcp 10.132.0.35:8643: connect: connection refused"
Jun 15 06:42:09.788685 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:42:09.788634    2564 generic.go:356] "Generic (PLEG): container finished" podID="a51d91a4-9927-4f1b-aff7-4b73c90301db" containerID="e80bd8f069b955cc3db5538a731d3cbe39896dddc77d2c3f866506e8ffb3afb5" exitCode=137
Jun 15 06:42:09.789203 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:42:09.788709    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk" event={"ID":"a51d91a4-9927-4f1b-aff7-4b73c90301db","Type":"ContainerDied","Data":"e80bd8f069b955cc3db5538a731d3cbe39896dddc77d2c3f866506e8ffb3afb5"}
Jun 15 06:42:09.789203 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:42:09.788783    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk" event={"ID":"a51d91a4-9927-4f1b-aff7-4b73c90301db","Type":"ContainerDied","Data":"7d2d2babbf8aa747179df752bd7ec1d478846425eda46b8c198b3d85e089bbe1"}
Jun 15 06:42:09.789203 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:42:09.788809    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d2d2babbf8aa747179df752bd7ec1d478846425eda46b8c198b3d85e089bbe1"
Jun 15 06:42:09.794154 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:42:09.794124    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk"
Jun 15 06:42:09.974129 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:42:09.974090    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wrmz\" (UniqueName: \"kubernetes.io/projected/a51d91a4-9927-4f1b-aff7-4b73c90301db-kube-api-access-5wrmz\") pod \"a51d91a4-9927-4f1b-aff7-4b73c90301db\" (UID: \"a51d91a4-9927-4f1b-aff7-4b73c90301db\") "
Jun 15 06:42:09.974333 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:42:09.974146    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a51d91a4-9927-4f1b-aff7-4b73c90301db-proxy-tls\") pod \"a51d91a4-9927-4f1b-aff7-4b73c90301db\" (UID: \"a51d91a4-9927-4f1b-aff7-4b73c90301db\") "
Jun 15 06:42:09.974333 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:42:09.974186    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a51d91a4-9927-4f1b-aff7-4b73c90301db-kserve-provision-location\") pod \"a51d91a4-9927-4f1b-aff7-4b73c90301db\" (UID: \"a51d91a4-9927-4f1b-aff7-4b73c90301db\") "
Jun 15 06:42:09.974892 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:42:09.974556    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a51d91a4-9927-4f1b-aff7-4b73c90301db-kube-rbac-proxy-sar-config\") pod \"a51d91a4-9927-4f1b-aff7-4b73c90301db\" (UID: \"a51d91a4-9927-4f1b-aff7-4b73c90301db\") "
Jun 15 06:42:09.974892 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:42:09.974641    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a51d91a4-9927-4f1b-aff7-4b73c90301db-cabundle-cert\") pod \"a51d91a4-9927-4f1b-aff7-4b73c90301db\" (UID: \"a51d91a4-9927-4f1b-aff7-4b73c90301db\") "
Jun 15 06:42:09.975272 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:42:09.975124    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a51d91a4-9927-4f1b-aff7-4b73c90301db-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "a51d91a4-9927-4f1b-aff7-4b73c90301db" (UID: "a51d91a4-9927-4f1b-aff7-4b73c90301db"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 06:42:09.975272 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:42:09.975237    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a51d91a4-9927-4f1b-aff7-4b73c90301db-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "a51d91a4-9927-4f1b-aff7-4b73c90301db" (UID: "a51d91a4-9927-4f1b-aff7-4b73c90301db"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 06:42:09.977742 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:42:09.977705    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a51d91a4-9927-4f1b-aff7-4b73c90301db-kube-api-access-5wrmz" (OuterVolumeSpecName: "kube-api-access-5wrmz") pod "a51d91a4-9927-4f1b-aff7-4b73c90301db" (UID: "a51d91a4-9927-4f1b-aff7-4b73c90301db"). InnerVolumeSpecName "kube-api-access-5wrmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 06:42:09.977901 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:42:09.977881    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a51d91a4-9927-4f1b-aff7-4b73c90301db-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "a51d91a4-9927-4f1b-aff7-4b73c90301db" (UID: "a51d91a4-9927-4f1b-aff7-4b73c90301db"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 06:42:09.988789 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:42:09.988341    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a51d91a4-9927-4f1b-aff7-4b73c90301db-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "a51d91a4-9927-4f1b-aff7-4b73c90301db" (UID: "a51d91a4-9927-4f1b-aff7-4b73c90301db"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:42:10.076106 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:42:10.076069    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wrmz\" (UniqueName: \"kubernetes.io/projected/a51d91a4-9927-4f1b-aff7-4b73c90301db-kube-api-access-5wrmz\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:42:10.076106 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:42:10.076107    2564 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a51d91a4-9927-4f1b-aff7-4b73c90301db-proxy-tls\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:42:10.076354 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:42:10.076119    2564 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a51d91a4-9927-4f1b-aff7-4b73c90301db-kserve-provision-location\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:42:10.076354 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:42:10.076134    2564 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a51d91a4-9927-4f1b-aff7-4b73c90301db-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:42:10.076354 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:42:10.076148    2564 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a51d91a4-9927-4f1b-aff7-4b73c90301db-cabundle-cert\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:42:10.795174 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:42:10.795140    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk"
Jun 15 06:42:10.817827 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:42:10.817781    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk"]
Jun 15 06:42:10.822622 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:42:10.822589    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-tensorflow-runtime-predictor-855cfcd677-vwptk"]
Jun 15 06:42:12.140616 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:42:12.140574    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a51d91a4-9927-4f1b-aff7-4b73c90301db" path="/var/lib/kubelet/pods/a51d91a4-9927-4f1b-aff7-4b73c90301db/volumes"
Jun 15 06:43:38.186876 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:38.186829    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kn9gn_8bf514ab-857d-416e-b51f-2235f4cb429d/console-operator/1.log"
Jun 15 06:43:38.187401 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:38.186830    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kn9gn_8bf514ab-857d-416e-b51f-2235f4cb429d/console-operator/1.log"
Jun 15 06:43:39.249446 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:39.249411    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww" event={"ID":"8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29","Type":"ContainerStarted","Data":"399c1de6aacde791bff8734ddad5b62965f7c4b111b8bbef9547d2e07f79319a"}
Jun 15 06:43:39.249823 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:39.249473    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww" event={"ID":"8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29","Type":"ContainerStarted","Data":"6371eafa98d127b14acf95f7eb7a0ca6945a848a947293653791d7355acc263d"}
Jun 15 06:43:40.253599 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:40.253555    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww"
Jun 15 06:43:40.283021 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:40.282970    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww" podStartSLOduration=2.954423984 podStartE2EDuration="2m1.282953894s" totalImagesPullingTime="1m54.412723445s" totalInitContainerRuntime="3.915806465s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:41:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:43:40.282251682 +0000 UTC m=+3362.648796733" watchObservedRunningTime="2026-06-15 06:43:40.282953894 +0000 UTC m=+3362.649498945"
Jun 15 06:43:41.257523 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:41.257492    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww"
Jun 15 06:43:41.258639 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:41.258612    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww" podUID="8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:8080: connect: connection refused"
Jun 15 06:43:42.261158 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:42.261108    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww" podUID="8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:8080: connect: connection refused"
Jun 15 06:43:47.265643 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:47.265611    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww"
Jun 15 06:43:47.266358 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:47.266339    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww"
Jun 15 06:43:52.705970 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:52.705933    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww"]
Jun 15 06:43:52.706380 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:52.706164    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww" podUID="8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29" containerName="kserve-container" containerID="cri-o://6371eafa98d127b14acf95f7eb7a0ca6945a848a947293653791d7355acc263d" gracePeriod=30
Jun 15 06:43:52.706380 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:52.706211    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww" podUID="8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29" containerName="kube-rbac-proxy" containerID="cri-o://399c1de6aacde791bff8734ddad5b62965f7c4b111b8bbef9547d2e07f79319a" gracePeriod=30
Jun 15 06:43:52.819820 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:52.819791    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn"]
Jun 15 06:43:52.820156 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:52.820142    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a51d91a4-9927-4f1b-aff7-4b73c90301db" containerName="kube-rbac-proxy"
Jun 15 06:43:52.820203 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:52.820158    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a51d91a4-9927-4f1b-aff7-4b73c90301db" containerName="kube-rbac-proxy"
Jun 15 06:43:52.820203 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:52.820168    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a51d91a4-9927-4f1b-aff7-4b73c90301db" containerName="kserve-container"
Jun 15 06:43:52.820203 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:52.820174    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a51d91a4-9927-4f1b-aff7-4b73c90301db" containerName="kserve-container"
Jun 15 06:43:52.820203 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:52.820186    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a51d91a4-9927-4f1b-aff7-4b73c90301db" containerName="storage-initializer"
Jun 15 06:43:52.820203 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:52.820192    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a51d91a4-9927-4f1b-aff7-4b73c90301db" containerName="storage-initializer"
Jun 15 06:43:52.820374 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:52.820241    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a51d91a4-9927-4f1b-aff7-4b73c90301db" containerName="kserve-container"
Jun 15 06:43:52.820374 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:52.820251    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a51d91a4-9927-4f1b-aff7-4b73c90301db" containerName="kube-rbac-proxy"
Jun 15 06:43:52.836960 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:52.836934    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn"]
Jun 15 06:43:52.837110 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:52.837060    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn"
Jun 15 06:43:52.839959 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:52.839939    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-predictor-serving-cert\""
Jun 15 06:43:52.840067 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:52.839945    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-kube-rbac-proxy-sar-config\""
Jun 15 06:43:52.980422 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:52.980322    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c6d38198-2d5b-4616-85fc-740f9e7abb27-kserve-provision-location\") pod \"isvc-xgboost-predictor-7566d65bf7-q7prn\" (UID: \"c6d38198-2d5b-4616-85fc-740f9e7abb27\") " pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn"
Jun 15 06:43:52.980422 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:52.980368    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c6d38198-2d5b-4616-85fc-740f9e7abb27-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-predictor-7566d65bf7-q7prn\" (UID: \"c6d38198-2d5b-4616-85fc-740f9e7abb27\") " pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn"
Jun 15 06:43:52.980422 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:52.980392    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c6d38198-2d5b-4616-85fc-740f9e7abb27-cabundle-cert\") pod \"isvc-xgboost-predictor-7566d65bf7-q7prn\" (UID: \"c6d38198-2d5b-4616-85fc-740f9e7abb27\") " pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn"
Jun 15 06:43:52.980693 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:52.980456    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8nnh\" (UniqueName: \"kubernetes.io/projected/c6d38198-2d5b-4616-85fc-740f9e7abb27-kube-api-access-p8nnh\") pod \"isvc-xgboost-predictor-7566d65bf7-q7prn\" (UID: \"c6d38198-2d5b-4616-85fc-740f9e7abb27\") " pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn"
Jun 15 06:43:52.980693 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:52.980500    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c6d38198-2d5b-4616-85fc-740f9e7abb27-proxy-tls\") pod \"isvc-xgboost-predictor-7566d65bf7-q7prn\" (UID: \"c6d38198-2d5b-4616-85fc-740f9e7abb27\") " pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn"
Jun 15 06:43:53.081415 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:53.081377    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c6d38198-2d5b-4616-85fc-740f9e7abb27-kserve-provision-location\") pod \"isvc-xgboost-predictor-7566d65bf7-q7prn\" (UID: \"c6d38198-2d5b-4616-85fc-740f9e7abb27\") " pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn"
Jun 15 06:43:53.081415 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:53.081419    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c6d38198-2d5b-4616-85fc-740f9e7abb27-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-predictor-7566d65bf7-q7prn\" (UID: \"c6d38198-2d5b-4616-85fc-740f9e7abb27\") " pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn"
Jun 15 06:43:53.081754 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:53.081440    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c6d38198-2d5b-4616-85fc-740f9e7abb27-cabundle-cert\") pod \"isvc-xgboost-predictor-7566d65bf7-q7prn\" (UID: \"c6d38198-2d5b-4616-85fc-740f9e7abb27\") " pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn"
Jun 15 06:43:53.081754 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:53.081467    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8nnh\" (UniqueName: \"kubernetes.io/projected/c6d38198-2d5b-4616-85fc-740f9e7abb27-kube-api-access-p8nnh\") pod \"isvc-xgboost-predictor-7566d65bf7-q7prn\" (UID: \"c6d38198-2d5b-4616-85fc-740f9e7abb27\") " pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn"
Jun 15 06:43:53.081754 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:53.081492    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c6d38198-2d5b-4616-85fc-740f9e7abb27-proxy-tls\") pod \"isvc-xgboost-predictor-7566d65bf7-q7prn\" (UID: \"c6d38198-2d5b-4616-85fc-740f9e7abb27\") " pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn"
Jun 15 06:43:53.081966 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:53.081921    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c6d38198-2d5b-4616-85fc-740f9e7abb27-kserve-provision-location\") pod \"isvc-xgboost-predictor-7566d65bf7-q7prn\" (UID: \"c6d38198-2d5b-4616-85fc-740f9e7abb27\") " pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn"
Jun 15 06:43:53.082212 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:53.082180    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c6d38198-2d5b-4616-85fc-740f9e7abb27-cabundle-cert\") pod \"isvc-xgboost-predictor-7566d65bf7-q7prn\" (UID: \"c6d38198-2d5b-4616-85fc-740f9e7abb27\") " pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn"
Jun 15 06:43:53.082502 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:53.082249    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c6d38198-2d5b-4616-85fc-740f9e7abb27-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-predictor-7566d65bf7-q7prn\" (UID: \"c6d38198-2d5b-4616-85fc-740f9e7abb27\") " pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn"
Jun 15 06:43:53.084278 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:53.084255    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c6d38198-2d5b-4616-85fc-740f9e7abb27-proxy-tls\") pod \"isvc-xgboost-predictor-7566d65bf7-q7prn\" (UID: \"c6d38198-2d5b-4616-85fc-740f9e7abb27\") " pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn"
Jun 15 06:43:53.093282 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:53.093258    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8nnh\" (UniqueName: \"kubernetes.io/projected/c6d38198-2d5b-4616-85fc-740f9e7abb27-kube-api-access-p8nnh\") pod \"isvc-xgboost-predictor-7566d65bf7-q7prn\" (UID: \"c6d38198-2d5b-4616-85fc-740f9e7abb27\") " pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn"
Jun 15 06:43:53.149461 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:53.149421    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn"
Jun 15 06:43:53.310053 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:53.310019    2564 generic.go:356] "Generic (PLEG): container finished" podID="8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29" containerID="399c1de6aacde791bff8734ddad5b62965f7c4b111b8bbef9547d2e07f79319a" exitCode=2
Jun 15 06:43:53.310207 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:53.310075    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww" event={"ID":"8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29","Type":"ContainerDied","Data":"399c1de6aacde791bff8734ddad5b62965f7c4b111b8bbef9547d2e07f79319a"}
Jun 15 06:43:53.325325 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:53.325276    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn"]
Jun 15 06:43:53.327672 ip-10-0-131-82 kubenswrapper[2564]: W0615 06:43:53.327643    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6d38198_2d5b_4616_85fc_740f9e7abb27.slice/crio-a7820e14f7d1e7327b80fa9742e31b67bb9700c6d20ff888e1bbfd0dbc111e70 WatchSource:0}: Error finding container a7820e14f7d1e7327b80fa9742e31b67bb9700c6d20ff888e1bbfd0dbc111e70: Status 404 returned error can't find the container with id a7820e14f7d1e7327b80fa9742e31b67bb9700c6d20ff888e1bbfd0dbc111e70
Jun 15 06:43:54.316876 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:54.316821    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn" event={"ID":"c6d38198-2d5b-4616-85fc-740f9e7abb27","Type":"ContainerStarted","Data":"710c8ff11a77fc734100df61e9548c0bd75bf74957a92ab53025b6af0fe13140"}
Jun 15 06:43:54.317381 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:54.316903    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn" event={"ID":"c6d38198-2d5b-4616-85fc-740f9e7abb27","Type":"ContainerStarted","Data":"a7820e14f7d1e7327b80fa9742e31b67bb9700c6d20ff888e1bbfd0dbc111e70"}
Jun 15 06:43:55.863114 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:55.863084    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww"
Jun 15 06:43:56.006788 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:56.006681    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29-proxy-tls\") pod \"8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29\" (UID: \"8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29\") "
Jun 15 06:43:56.006788 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:56.006736    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4b9l5\" (UniqueName: \"kubernetes.io/projected/8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29-kube-api-access-4b9l5\") pod \"8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29\" (UID: \"8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29\") "
Jun 15 06:43:56.006788 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:56.006768    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29-kube-rbac-proxy-sar-config\") pod \"8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29\" (UID: \"8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29\") "
Jun 15 06:43:56.007129 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:56.006949    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29-kserve-provision-location\") pod \"8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29\" (UID: \"8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29\") "
Jun 15 06:43:56.007129 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:56.007005    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29-cabundle-cert\") pod \"8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29\" (UID: \"8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29\") "
Jun 15 06:43:56.007238 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:56.007171    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29" (UID: "8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 06:43:56.007292 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:56.007280    2564 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:43:56.007365 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:56.007337    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29" (UID: "8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 06:43:56.007482 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:56.007368    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29" (UID: "8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:43:56.009554 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:56.009533    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29" (UID: "8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 06:43:56.009554 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:56.009542    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29-kube-api-access-4b9l5" (OuterVolumeSpecName: "kube-api-access-4b9l5") pod "8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29" (UID: "8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29"). InnerVolumeSpecName "kube-api-access-4b9l5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 06:43:56.108174 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:56.108138    2564 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29-proxy-tls\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:43:56.108174 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:56.108170    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4b9l5\" (UniqueName: \"kubernetes.io/projected/8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29-kube-api-access-4b9l5\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:43:56.108174 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:56.108180    2564 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29-kserve-provision-location\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:43:56.108412 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:56.108190    2564 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29-cabundle-cert\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:43:56.327349 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:56.327260    2564 generic.go:356] "Generic (PLEG): container finished" podID="8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29" containerID="6371eafa98d127b14acf95f7eb7a0ca6945a848a947293653791d7355acc263d" exitCode=0
Jun 15 06:43:56.327349 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:56.327314    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww"
Jun 15 06:43:56.327349 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:56.327339    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww" event={"ID":"8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29","Type":"ContainerDied","Data":"6371eafa98d127b14acf95f7eb7a0ca6945a848a947293653791d7355acc263d"}
Jun 15 06:43:56.327559 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:56.327398    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww" event={"ID":"8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29","Type":"ContainerDied","Data":"25f215fae1d7b1c5414a16df0c48341cfdca4b4897ab67270ace4646a8a9ad3a"}
Jun 15 06:43:56.327559 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:56.327428    2564 scope.go:117] "RemoveContainer" containerID="399c1de6aacde791bff8734ddad5b62965f7c4b111b8bbef9547d2e07f79319a"
Jun 15 06:43:56.335777 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:56.335753    2564 scope.go:117] "RemoveContainer" containerID="6371eafa98d127b14acf95f7eb7a0ca6945a848a947293653791d7355acc263d"
Jun 15 06:43:56.343679 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:56.343660    2564 scope.go:117] "RemoveContainer" containerID="8ca96edb6b54b8a88c13ef6b95ed426e8cd88ff600b1ec902b0bb5e65cb5bc10"
Jun 15 06:43:56.351449 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:56.351428    2564 scope.go:117] "RemoveContainer" containerID="399c1de6aacde791bff8734ddad5b62965f7c4b111b8bbef9547d2e07f79319a"
Jun 15 06:43:56.351744 ip-10-0-131-82 kubenswrapper[2564]: E0615 06:43:56.351709    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"399c1de6aacde791bff8734ddad5b62965f7c4b111b8bbef9547d2e07f79319a\": container with ID starting with 399c1de6aacde791bff8734ddad5b62965f7c4b111b8bbef9547d2e07f79319a not found: ID does not exist" containerID="399c1de6aacde791bff8734ddad5b62965f7c4b111b8bbef9547d2e07f79319a"
Jun 15 06:43:56.351810 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:56.351758    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"399c1de6aacde791bff8734ddad5b62965f7c4b111b8bbef9547d2e07f79319a"} err="failed to get container status \"399c1de6aacde791bff8734ddad5b62965f7c4b111b8bbef9547d2e07f79319a\": rpc error: code = NotFound desc = could not find container \"399c1de6aacde791bff8734ddad5b62965f7c4b111b8bbef9547d2e07f79319a\": container with ID starting with 399c1de6aacde791bff8734ddad5b62965f7c4b111b8bbef9547d2e07f79319a not found: ID does not exist"
Jun 15 06:43:56.351810 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:56.351784    2564 scope.go:117] "RemoveContainer" containerID="6371eafa98d127b14acf95f7eb7a0ca6945a848a947293653791d7355acc263d"
Jun 15 06:43:56.352064 ip-10-0-131-82 kubenswrapper[2564]: E0615 06:43:56.352043    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6371eafa98d127b14acf95f7eb7a0ca6945a848a947293653791d7355acc263d\": container with ID starting with 6371eafa98d127b14acf95f7eb7a0ca6945a848a947293653791d7355acc263d not found: ID does not exist" containerID="6371eafa98d127b14acf95f7eb7a0ca6945a848a947293653791d7355acc263d"
Jun 15 06:43:56.352121 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:56.352071    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6371eafa98d127b14acf95f7eb7a0ca6945a848a947293653791d7355acc263d"} err="failed to get container status \"6371eafa98d127b14acf95f7eb7a0ca6945a848a947293653791d7355acc263d\": rpc error: code = NotFound desc = could not find container \"6371eafa98d127b14acf95f7eb7a0ca6945a848a947293653791d7355acc263d\": container with ID starting with 6371eafa98d127b14acf95f7eb7a0ca6945a848a947293653791d7355acc263d not found: ID does not exist"
Jun 15 06:43:56.352121 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:56.352087    2564 scope.go:117] "RemoveContainer" containerID="8ca96edb6b54b8a88c13ef6b95ed426e8cd88ff600b1ec902b0bb5e65cb5bc10"
Jun 15 06:43:56.352312 ip-10-0-131-82 kubenswrapper[2564]: E0615 06:43:56.352292    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ca96edb6b54b8a88c13ef6b95ed426e8cd88ff600b1ec902b0bb5e65cb5bc10\": container with ID starting with 8ca96edb6b54b8a88c13ef6b95ed426e8cd88ff600b1ec902b0bb5e65cb5bc10 not found: ID does not exist" containerID="8ca96edb6b54b8a88c13ef6b95ed426e8cd88ff600b1ec902b0bb5e65cb5bc10"
Jun 15 06:43:56.352354 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:56.352318    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ca96edb6b54b8a88c13ef6b95ed426e8cd88ff600b1ec902b0bb5e65cb5bc10"} err="failed to get container status \"8ca96edb6b54b8a88c13ef6b95ed426e8cd88ff600b1ec902b0bb5e65cb5bc10\": rpc error: code = NotFound desc = could not find container \"8ca96edb6b54b8a88c13ef6b95ed426e8cd88ff600b1ec902b0bb5e65cb5bc10\": container with ID starting with 8ca96edb6b54b8a88c13ef6b95ed426e8cd88ff600b1ec902b0bb5e65cb5bc10 not found: ID does not exist"
Jun 15 06:43:56.353217 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:56.353200    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww"]
Jun 15 06:43:56.358471 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:56.358451    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-w7cww"]
Jun 15 06:43:57.334229 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:57.334199    2564 generic.go:356] "Generic (PLEG): container finished" podID="c6d38198-2d5b-4616-85fc-740f9e7abb27" containerID="710c8ff11a77fc734100df61e9548c0bd75bf74957a92ab53025b6af0fe13140" exitCode=0
Jun 15 06:43:57.334589 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:57.334266    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn" event={"ID":"c6d38198-2d5b-4616-85fc-740f9e7abb27","Type":"ContainerDied","Data":"710c8ff11a77fc734100df61e9548c0bd75bf74957a92ab53025b6af0fe13140"}
Jun 15 06:43:58.143773 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:43:58.143726    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29" path="/var/lib/kubelet/pods/8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29/volumes"
Jun 15 06:44:18.442430 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:44:18.442398    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn" event={"ID":"c6d38198-2d5b-4616-85fc-740f9e7abb27","Type":"ContainerStarted","Data":"9c49d4a6445f69ba62b818f2cb2b48a8f423f6f2f5a232ab8b5399962a05adeb"}
Jun 15 06:44:18.442831 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:44:18.442458    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn" event={"ID":"c6d38198-2d5b-4616-85fc-740f9e7abb27","Type":"ContainerStarted","Data":"1f0390efa96bbd70527efe07a2850594ff8fccac086f252075ea84032b69c571"}
Jun 15 06:44:18.442831 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:44:18.442690    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn"
Jun 15 06:44:18.465345 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:44:18.465289    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn" podStartSLOduration=2.299236829 podStartE2EDuration="26.465276272s" totalImagesPullingTime="20.48121178s" totalInitContainerRuntime="3.684827663s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:43:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:44:18.46329892 +0000 UTC m=+3400.829843970" watchObservedRunningTime="2026-06-15 06:44:18.465276272 +0000 UTC m=+3400.831821324"
Jun 15 06:44:19.447021 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:44:19.446991    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn"
Jun 15 06:44:19.448105 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:44:19.448080    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn" podUID="c6d38198-2d5b-4616-85fc-740f9e7abb27" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused"
Jun 15 06:44:20.450835 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:44:20.450796    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn" podUID="c6d38198-2d5b-4616-85fc-740f9e7abb27" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused"
Jun 15 06:44:25.455158 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:44:25.455129    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn"
Jun 15 06:44:25.455683 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:44:25.455655    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn" podUID="c6d38198-2d5b-4616-85fc-740f9e7abb27" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused"
Jun 15 06:44:35.455930 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:44:35.455885    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn" podUID="c6d38198-2d5b-4616-85fc-740f9e7abb27" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused"
Jun 15 06:44:45.455777 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:44:45.455736    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn" podUID="c6d38198-2d5b-4616-85fc-740f9e7abb27" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused"
Jun 15 06:44:55.455707 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:44:55.455661    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn" podUID="c6d38198-2d5b-4616-85fc-740f9e7abb27" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused"
Jun 15 06:45:05.456441 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:05.456398    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn" podUID="c6d38198-2d5b-4616-85fc-740f9e7abb27" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused"
Jun 15 06:45:15.456585 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:15.456542    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn" podUID="c6d38198-2d5b-4616-85fc-740f9e7abb27" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused"
Jun 15 06:45:25.456889 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:25.456845    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn"
Jun 15 06:45:33.002819 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:33.002786    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn"]
Jun 15 06:45:33.003227 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:33.003078    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn" podUID="c6d38198-2d5b-4616-85fc-740f9e7abb27" containerName="kserve-container" containerID="cri-o://1f0390efa96bbd70527efe07a2850594ff8fccac086f252075ea84032b69c571" gracePeriod=30
Jun 15 06:45:33.003227 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:33.003139    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn" podUID="c6d38198-2d5b-4616-85fc-740f9e7abb27" containerName="kube-rbac-proxy" containerID="cri-o://9c49d4a6445f69ba62b818f2cb2b48a8f423f6f2f5a232ab8b5399962a05adeb" gracePeriod=30
Jun 15 06:45:33.767802 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:33.767771    2564 generic.go:356] "Generic (PLEG): container finished" podID="c6d38198-2d5b-4616-85fc-740f9e7abb27" containerID="9c49d4a6445f69ba62b818f2cb2b48a8f423f6f2f5a232ab8b5399962a05adeb" exitCode=2
Jun 15 06:45:33.767995 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:33.767850    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn" event={"ID":"c6d38198-2d5b-4616-85fc-740f9e7abb27","Type":"ContainerDied","Data":"9c49d4a6445f69ba62b818f2cb2b48a8f423f6f2f5a232ab8b5399962a05adeb"}
Jun 15 06:45:35.452027 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:35.451976    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn" podUID="c6d38198-2d5b-4616-85fc-740f9e7abb27" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.37:8643/healthz\": dial tcp 10.132.0.37:8643: connect: connection refused"
Jun 15 06:45:35.456349 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:35.456317    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn" podUID="c6d38198-2d5b-4616-85fc-740f9e7abb27" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused"
Jun 15 06:45:36.560204 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:36.560175    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn"
Jun 15 06:45:36.621675 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:36.621640    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c6d38198-2d5b-4616-85fc-740f9e7abb27-cabundle-cert\") pod \"c6d38198-2d5b-4616-85fc-740f9e7abb27\" (UID: \"c6d38198-2d5b-4616-85fc-740f9e7abb27\") "
Jun 15 06:45:36.621882 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:36.621682    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c6d38198-2d5b-4616-85fc-740f9e7abb27-kserve-provision-location\") pod \"c6d38198-2d5b-4616-85fc-740f9e7abb27\" (UID: \"c6d38198-2d5b-4616-85fc-740f9e7abb27\") "
Jun 15 06:45:36.621882 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:36.621737    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8nnh\" (UniqueName: \"kubernetes.io/projected/c6d38198-2d5b-4616-85fc-740f9e7abb27-kube-api-access-p8nnh\") pod \"c6d38198-2d5b-4616-85fc-740f9e7abb27\" (UID: \"c6d38198-2d5b-4616-85fc-740f9e7abb27\") "
Jun 15 06:45:36.621882 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:36.621830    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c6d38198-2d5b-4616-85fc-740f9e7abb27-proxy-tls\") pod \"c6d38198-2d5b-4616-85fc-740f9e7abb27\" (UID: \"c6d38198-2d5b-4616-85fc-740f9e7abb27\") "
Jun 15 06:45:36.622066 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:36.621935    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c6d38198-2d5b-4616-85fc-740f9e7abb27-kube-rbac-proxy-sar-config\") pod \"c6d38198-2d5b-4616-85fc-740f9e7abb27\" (UID: \"c6d38198-2d5b-4616-85fc-740f9e7abb27\") "
Jun 15 06:45:36.622126 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:36.622066    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6d38198-2d5b-4616-85fc-740f9e7abb27-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "c6d38198-2d5b-4616-85fc-740f9e7abb27" (UID: "c6d38198-2d5b-4616-85fc-740f9e7abb27"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 06:45:36.622126 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:36.622093    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6d38198-2d5b-4616-85fc-740f9e7abb27-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "c6d38198-2d5b-4616-85fc-740f9e7abb27" (UID: "c6d38198-2d5b-4616-85fc-740f9e7abb27"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:45:36.622228 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:36.622184    2564 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c6d38198-2d5b-4616-85fc-740f9e7abb27-cabundle-cert\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:45:36.622228 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:36.622199    2564 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c6d38198-2d5b-4616-85fc-740f9e7abb27-kserve-provision-location\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:45:36.622308 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:36.622290    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6d38198-2d5b-4616-85fc-740f9e7abb27-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "c6d38198-2d5b-4616-85fc-740f9e7abb27" (UID: "c6d38198-2d5b-4616-85fc-740f9e7abb27"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 06:45:36.624103 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:36.624073    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6d38198-2d5b-4616-85fc-740f9e7abb27-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "c6d38198-2d5b-4616-85fc-740f9e7abb27" (UID: "c6d38198-2d5b-4616-85fc-740f9e7abb27"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 06:45:36.624103 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:36.624082    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6d38198-2d5b-4616-85fc-740f9e7abb27-kube-api-access-p8nnh" (OuterVolumeSpecName: "kube-api-access-p8nnh") pod "c6d38198-2d5b-4616-85fc-740f9e7abb27" (UID: "c6d38198-2d5b-4616-85fc-740f9e7abb27"). InnerVolumeSpecName "kube-api-access-p8nnh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 06:45:36.722726 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:36.722632    2564 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c6d38198-2d5b-4616-85fc-740f9e7abb27-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:45:36.722726 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:36.722666    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8nnh\" (UniqueName: \"kubernetes.io/projected/c6d38198-2d5b-4616-85fc-740f9e7abb27-kube-api-access-p8nnh\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:45:36.722726 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:36.722677    2564 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c6d38198-2d5b-4616-85fc-740f9e7abb27-proxy-tls\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:45:36.783907 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:36.783854    2564 generic.go:356] "Generic (PLEG): container finished" podID="c6d38198-2d5b-4616-85fc-740f9e7abb27" containerID="1f0390efa96bbd70527efe07a2850594ff8fccac086f252075ea84032b69c571" exitCode=0
Jun 15 06:45:36.783907 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:36.783888    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn" event={"ID":"c6d38198-2d5b-4616-85fc-740f9e7abb27","Type":"ContainerDied","Data":"1f0390efa96bbd70527efe07a2850594ff8fccac086f252075ea84032b69c571"}
Jun 15 06:45:36.784168 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:36.783937    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn"
Jun 15 06:45:36.784168 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:36.783959    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn" event={"ID":"c6d38198-2d5b-4616-85fc-740f9e7abb27","Type":"ContainerDied","Data":"a7820e14f7d1e7327b80fa9742e31b67bb9700c6d20ff888e1bbfd0dbc111e70"}
Jun 15 06:45:36.784168 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:36.783988    2564 scope.go:117] "RemoveContainer" containerID="9c49d4a6445f69ba62b818f2cb2b48a8f423f6f2f5a232ab8b5399962a05adeb"
Jun 15 06:45:36.792789 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:36.792772    2564 scope.go:117] "RemoveContainer" containerID="1f0390efa96bbd70527efe07a2850594ff8fccac086f252075ea84032b69c571"
Jun 15 06:45:36.800281 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:36.800261    2564 scope.go:117] "RemoveContainer" containerID="710c8ff11a77fc734100df61e9548c0bd75bf74957a92ab53025b6af0fe13140"
Jun 15 06:45:36.808293 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:36.808270    2564 scope.go:117] "RemoveContainer" containerID="9c49d4a6445f69ba62b818f2cb2b48a8f423f6f2f5a232ab8b5399962a05adeb"
Jun 15 06:45:36.808624 ip-10-0-131-82 kubenswrapper[2564]: E0615 06:45:36.808607    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c49d4a6445f69ba62b818f2cb2b48a8f423f6f2f5a232ab8b5399962a05adeb\": container with ID starting with 9c49d4a6445f69ba62b818f2cb2b48a8f423f6f2f5a232ab8b5399962a05adeb not found: ID does not exist" containerID="9c49d4a6445f69ba62b818f2cb2b48a8f423f6f2f5a232ab8b5399962a05adeb"
Jun 15 06:45:36.808713 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:36.808633    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c49d4a6445f69ba62b818f2cb2b48a8f423f6f2f5a232ab8b5399962a05adeb"} err="failed to get container status \"9c49d4a6445f69ba62b818f2cb2b48a8f423f6f2f5a232ab8b5399962a05adeb\": rpc error: code = NotFound desc = could not find container \"9c49d4a6445f69ba62b818f2cb2b48a8f423f6f2f5a232ab8b5399962a05adeb\": container with ID starting with 9c49d4a6445f69ba62b818f2cb2b48a8f423f6f2f5a232ab8b5399962a05adeb not found: ID does not exist"
Jun 15 06:45:36.808713 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:36.808652    2564 scope.go:117] "RemoveContainer" containerID="1f0390efa96bbd70527efe07a2850594ff8fccac086f252075ea84032b69c571"
Jun 15 06:45:36.808938 ip-10-0-131-82 kubenswrapper[2564]: E0615 06:45:36.808916    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f0390efa96bbd70527efe07a2850594ff8fccac086f252075ea84032b69c571\": container with ID starting with 1f0390efa96bbd70527efe07a2850594ff8fccac086f252075ea84032b69c571 not found: ID does not exist" containerID="1f0390efa96bbd70527efe07a2850594ff8fccac086f252075ea84032b69c571"
Jun 15 06:45:36.808997 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:36.808947    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f0390efa96bbd70527efe07a2850594ff8fccac086f252075ea84032b69c571"} err="failed to get container status \"1f0390efa96bbd70527efe07a2850594ff8fccac086f252075ea84032b69c571\": rpc error: code = NotFound desc = could not find container \"1f0390efa96bbd70527efe07a2850594ff8fccac086f252075ea84032b69c571\": container with ID starting with 1f0390efa96bbd70527efe07a2850594ff8fccac086f252075ea84032b69c571 not found: ID does not exist"
Jun 15 06:45:36.808997 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:36.808966    2564 scope.go:117] "RemoveContainer" containerID="710c8ff11a77fc734100df61e9548c0bd75bf74957a92ab53025b6af0fe13140"
Jun 15 06:45:36.809090 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:36.809036    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn"]
Jun 15 06:45:36.809223 ip-10-0-131-82 kubenswrapper[2564]: E0615 06:45:36.809207    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"710c8ff11a77fc734100df61e9548c0bd75bf74957a92ab53025b6af0fe13140\": container with ID starting with 710c8ff11a77fc734100df61e9548c0bd75bf74957a92ab53025b6af0fe13140 not found: ID does not exist" containerID="710c8ff11a77fc734100df61e9548c0bd75bf74957a92ab53025b6af0fe13140"
Jun 15 06:45:36.809263 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:36.809228    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"710c8ff11a77fc734100df61e9548c0bd75bf74957a92ab53025b6af0fe13140"} err="failed to get container status \"710c8ff11a77fc734100df61e9548c0bd75bf74957a92ab53025b6af0fe13140\": rpc error: code = NotFound desc = could not find container \"710c8ff11a77fc734100df61e9548c0bd75bf74957a92ab53025b6af0fe13140\": container with ID starting with 710c8ff11a77fc734100df61e9548c0bd75bf74957a92ab53025b6af0fe13140 not found: ID does not exist"
Jun 15 06:45:36.812909 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:36.812886    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-predictor-7566d65bf7-q7prn"]
Jun 15 06:45:38.136816 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:45:38.136771    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6d38198-2d5b-4616-85fc-740f9e7abb27" path="/var/lib/kubelet/pods/c6d38198-2d5b-4616-85fc-740f9e7abb27/volumes"
Jun 15 06:47:13.451369 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.451334    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg"]
Jun 15 06:47:13.451825 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.451659    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6d38198-2d5b-4616-85fc-740f9e7abb27" containerName="kube-rbac-proxy"
Jun 15 06:47:13.451825 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.451675    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6d38198-2d5b-4616-85fc-740f9e7abb27" containerName="kube-rbac-proxy"
Jun 15 06:47:13.451825 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.451690    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6d38198-2d5b-4616-85fc-740f9e7abb27" containerName="storage-initializer"
Jun 15 06:47:13.451825 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.451697    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6d38198-2d5b-4616-85fc-740f9e7abb27" containerName="storage-initializer"
Jun 15 06:47:13.451825 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.451710    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29" containerName="storage-initializer"
Jun 15 06:47:13.451825 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.451718    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29" containerName="storage-initializer"
Jun 15 06:47:13.451825 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.451728    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29" containerName="kserve-container"
Jun 15 06:47:13.451825 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.451736    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29" containerName="kserve-container"
Jun 15 06:47:13.451825 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.451757    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6d38198-2d5b-4616-85fc-740f9e7abb27" containerName="kserve-container"
Jun 15 06:47:13.451825 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.451765    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6d38198-2d5b-4616-85fc-740f9e7abb27" containerName="kserve-container"
Jun 15 06:47:13.451825 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.451784    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29" containerName="kube-rbac-proxy"
Jun 15 06:47:13.451825 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.451791    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29" containerName="kube-rbac-proxy"
Jun 15 06:47:13.452210 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.451847    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29" containerName="kserve-container"
Jun 15 06:47:13.452210 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.451854    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e1bbb56-ccd8-4cf8-bb5e-9f5fcfc83a29" containerName="kube-rbac-proxy"
Jun 15 06:47:13.452210 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.451880    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6d38198-2d5b-4616-85fc-740f9e7abb27" containerName="kube-rbac-proxy"
Jun 15 06:47:13.452210 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.451888    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6d38198-2d5b-4616-85fc-740f9e7abb27" containerName="kserve-container"
Jun 15 06:47:13.455008 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.454987    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg"
Jun 15 06:47:13.457437 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.457411    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-q7vt7\""
Jun 15 06:47:13.457572 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.457473    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jun 15 06:47:13.457572 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.457450    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-runtime-predictor-serving-cert\""
Jun 15 06:47:13.457572 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.457507    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jun 15 06:47:13.457771 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.457602    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-runtime-kube-rbac-proxy-sar-config\""
Jun 15 06:47:13.458382 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.458368    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jun 15 06:47:13.458441 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.458421    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jun 15 06:47:13.465487 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.465465    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg"]
Jun 15 06:47:13.607752 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.607714    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e-kserve-provision-location\") pod \"isvc-xgboost-runtime-predictor-54dd488c85-xz8hg\" (UID: \"232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e\") " pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg"
Jun 15 06:47:13.607752 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.607752    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-runtime-predictor-54dd488c85-xz8hg\" (UID: \"232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e\") " pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg"
Jun 15 06:47:13.608031 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.607772    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e-cabundle-cert\") pod \"isvc-xgboost-runtime-predictor-54dd488c85-xz8hg\" (UID: \"232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e\") " pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg"
Jun 15 06:47:13.608031 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.607816    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e-proxy-tls\") pod \"isvc-xgboost-runtime-predictor-54dd488c85-xz8hg\" (UID: \"232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e\") " pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg"
Jun 15 06:47:13.608031 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.607920    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qj7p\" (UniqueName: \"kubernetes.io/projected/232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e-kube-api-access-5qj7p\") pod \"isvc-xgboost-runtime-predictor-54dd488c85-xz8hg\" (UID: \"232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e\") " pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg"
Jun 15 06:47:13.708843 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.708735    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e-kserve-provision-location\") pod \"isvc-xgboost-runtime-predictor-54dd488c85-xz8hg\" (UID: \"232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e\") " pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg"
Jun 15 06:47:13.708843 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.708776    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-runtime-predictor-54dd488c85-xz8hg\" (UID: \"232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e\") " pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg"
Jun 15 06:47:13.708843 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.708794    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e-cabundle-cert\") pod \"isvc-xgboost-runtime-predictor-54dd488c85-xz8hg\" (UID: \"232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e\") " pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg"
Jun 15 06:47:13.709160 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.708848    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e-proxy-tls\") pod \"isvc-xgboost-runtime-predictor-54dd488c85-xz8hg\" (UID: \"232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e\") " pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg"
Jun 15 06:47:13.709160 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.708971    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qj7p\" (UniqueName: \"kubernetes.io/projected/232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e-kube-api-access-5qj7p\") pod \"isvc-xgboost-runtime-predictor-54dd488c85-xz8hg\" (UID: \"232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e\") " pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg"
Jun 15 06:47:13.709360 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.709330    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e-kserve-provision-location\") pod \"isvc-xgboost-runtime-predictor-54dd488c85-xz8hg\" (UID: \"232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e\") " pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg"
Jun 15 06:47:13.709559 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.709531    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e-cabundle-cert\") pod \"isvc-xgboost-runtime-predictor-54dd488c85-xz8hg\" (UID: \"232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e\") " pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg"
Jun 15 06:47:13.709633 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.709584    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-runtime-predictor-54dd488c85-xz8hg\" (UID: \"232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e\") " pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg"
Jun 15 06:47:13.711512 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.711491    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e-proxy-tls\") pod \"isvc-xgboost-runtime-predictor-54dd488c85-xz8hg\" (UID: \"232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e\") " pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg"
Jun 15 06:47:13.718449 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.718423    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qj7p\" (UniqueName: \"kubernetes.io/projected/232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e-kube-api-access-5qj7p\") pod \"isvc-xgboost-runtime-predictor-54dd488c85-xz8hg\" (UID: \"232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e\") " pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg"
Jun 15 06:47:13.765584 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.765546    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg"
Jun 15 06:47:13.901300 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:13.901127    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg"]
Jun 15 06:47:13.904054 ip-10-0-131-82 kubenswrapper[2564]: W0615 06:47:13.904022    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod232aeb7d_1d9c_4ef0_8abd_e720bcb2d53e.slice/crio-7e7c273234416e539665725efaa1631727aee13a17b447cb7423dd6bad726f7c WatchSource:0}: Error finding container 7e7c273234416e539665725efaa1631727aee13a17b447cb7423dd6bad726f7c: Status 404 returned error can't find the container with id 7e7c273234416e539665725efaa1631727aee13a17b447cb7423dd6bad726f7c
Jun 15 06:47:14.202017 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:14.201974    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg" event={"ID":"232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e","Type":"ContainerStarted","Data":"45b91d42c9be51510cdee804365a3f51d643da4e2ff9b73085e5119f745172f5"}
Jun 15 06:47:14.202190 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:14.202061    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg" event={"ID":"232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e","Type":"ContainerStarted","Data":"7e7c273234416e539665725efaa1631727aee13a17b447cb7423dd6bad726f7c"}
Jun 15 06:47:18.222523 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:18.222486    2564 generic.go:356] "Generic (PLEG): container finished" podID="232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e" containerID="45b91d42c9be51510cdee804365a3f51d643da4e2ff9b73085e5119f745172f5" exitCode=0
Jun 15 06:47:18.222931 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:18.222559    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg" event={"ID":"232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e","Type":"ContainerDied","Data":"45b91d42c9be51510cdee804365a3f51d643da4e2ff9b73085e5119f745172f5"}
Jun 15 06:47:19.229489 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:19.229455    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg" event={"ID":"232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e","Type":"ContainerStarted","Data":"f2737cced3fd4f8e114cedd4e7d700425663c953e1909514efe24e120617d659"}
Jun 15 06:47:19.230006 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:19.229515    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg" event={"ID":"232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e","Type":"ContainerStarted","Data":"cbaa2d1c6017185869467f6db6bd559d27e8b0d9bdce05a3fcb66f28826f0bea"}
Jun 15 06:47:19.230006 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:19.229699    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg"
Jun 15 06:47:19.252559 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:19.252506    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg" podStartSLOduration=2.359558443 podStartE2EDuration="6.252491693s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.89293325s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:47:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:47:19.252034197 +0000 UTC m=+3581.618579252" watchObservedRunningTime="2026-06-15 06:47:19.252491693 +0000 UTC m=+3581.619036744"
Jun 15 06:47:20.234013 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:20.233982    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg"
Jun 15 06:47:20.235147 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:20.235122    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg" podUID="232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Jun 15 06:47:21.239187 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:21.239148    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg" podUID="232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Jun 15 06:47:26.243461 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:26.243425    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg"
Jun 15 06:47:26.244000 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:26.243970    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg" podUID="232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Jun 15 06:47:36.244246 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:36.244205    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg" podUID="232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Jun 15 06:47:38.462105 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:38.462073    2564 scope.go:117] "RemoveContainer" containerID="060f7e2787c5c92984e356bf5a9eec4227ea69c9b027aadc6e616509c4b0ebbc"
Jun 15 06:47:38.470077 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:38.470055    2564 scope.go:117] "RemoveContainer" containerID="e80bd8f069b955cc3db5538a731d3cbe39896dddc77d2c3f866506e8ffb3afb5"
Jun 15 06:47:38.479151 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:38.479131    2564 scope.go:117] "RemoveContainer" containerID="bea15303837fc67bcb8447e985376f32504373d10b2a6523e8efea5f1d7fe1a5"
Jun 15 06:47:46.243990 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:46.243948    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg" podUID="232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Jun 15 06:47:56.244535 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:47:56.244490    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg" podUID="232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Jun 15 06:48:06.244468 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:06.244426    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg" podUID="232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Jun 15 06:48:16.244278 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:16.244239    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg" podUID="232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Jun 15 06:48:26.245075 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:26.245041    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg"
Jun 15 06:48:33.737530 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:33.737494    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg"]
Jun 15 06:48:33.737958 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:33.737779    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg" podUID="232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e" containerName="kserve-container" containerID="cri-o://cbaa2d1c6017185869467f6db6bd559d27e8b0d9bdce05a3fcb66f28826f0bea" gracePeriod=30
Jun 15 06:48:33.737958 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:33.737824    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg" podUID="232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e" containerName="kube-rbac-proxy" containerID="cri-o://f2737cced3fd4f8e114cedd4e7d700425663c953e1909514efe24e120617d659" gracePeriod=30
Jun 15 06:48:34.549009 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:34.548977    2564 generic.go:356] "Generic (PLEG): container finished" podID="232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e" containerID="f2737cced3fd4f8e114cedd4e7d700425663c953e1909514efe24e120617d659" exitCode=2
Jun 15 06:48:34.549197 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:34.549044    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg" event={"ID":"232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e","Type":"ContainerDied","Data":"f2737cced3fd4f8e114cedd4e7d700425663c953e1909514efe24e120617d659"}
Jun 15 06:48:36.244030 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:36.243980    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg" podUID="232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.38:8643/healthz\": dial tcp 10.132.0.38:8643: connect: connection refused"
Jun 15 06:48:36.244668 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:36.244629    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg" podUID="232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Jun 15 06:48:37.186153 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:37.186123    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg"
Jun 15 06:48:37.305469 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:37.305397    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e-proxy-tls\") pod \"232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e\" (UID: \"232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e\") "
Jun 15 06:48:37.305469 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:37.305450    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e-cabundle-cert\") pod \"232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e\" (UID: \"232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e\") "
Jun 15 06:48:37.305975 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:37.305490    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e-kserve-provision-location\") pod \"232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e\" (UID: \"232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e\") "
Jun 15 06:48:37.305975 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:37.305514    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qj7p\" (UniqueName: \"kubernetes.io/projected/232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e-kube-api-access-5qj7p\") pod \"232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e\" (UID: \"232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e\") "
Jun 15 06:48:37.305975 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:37.305539    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e-kube-rbac-proxy-sar-config\") pod \"232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e\" (UID: \"232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e\") "
Jun 15 06:48:37.305975 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:37.305757    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e" (UID: "232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 06:48:37.305975 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:37.305821    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e" (UID: "232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:48:37.305975 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:37.305950    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e" (UID: "232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 06:48:37.307495 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:37.307468    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e" (UID: "232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 06:48:37.307688 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:37.307667    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e-kube-api-access-5qj7p" (OuterVolumeSpecName: "kube-api-access-5qj7p") pod "232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e" (UID: "232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e"). InnerVolumeSpecName "kube-api-access-5qj7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 06:48:37.406771 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:37.406747    2564 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e-proxy-tls\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:48:37.406771 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:37.406771    2564 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e-cabundle-cert\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:48:37.406956 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:37.406780    2564 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e-kserve-provision-location\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:48:37.406956 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:37.406790    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qj7p\" (UniqueName: \"kubernetes.io/projected/232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e-kube-api-access-5qj7p\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:48:37.406956 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:37.406799    2564 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:48:37.563968 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:37.563880    2564 generic.go:356] "Generic (PLEG): container finished" podID="232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e" containerID="cbaa2d1c6017185869467f6db6bd559d27e8b0d9bdce05a3fcb66f28826f0bea" exitCode=0
Jun 15 06:48:37.563968 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:37.563903    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg" event={"ID":"232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e","Type":"ContainerDied","Data":"cbaa2d1c6017185869467f6db6bd559d27e8b0d9bdce05a3fcb66f28826f0bea"}
Jun 15 06:48:37.563968 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:37.563931    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg"
Jun 15 06:48:37.563968 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:37.563969    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg" event={"ID":"232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e","Type":"ContainerDied","Data":"7e7c273234416e539665725efaa1631727aee13a17b447cb7423dd6bad726f7c"}
Jun 15 06:48:37.564235 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:37.564004    2564 scope.go:117] "RemoveContainer" containerID="f2737cced3fd4f8e114cedd4e7d700425663c953e1909514efe24e120617d659"
Jun 15 06:48:37.572473 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:37.572454    2564 scope.go:117] "RemoveContainer" containerID="cbaa2d1c6017185869467f6db6bd559d27e8b0d9bdce05a3fcb66f28826f0bea"
Jun 15 06:48:37.579816 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:37.579801    2564 scope.go:117] "RemoveContainer" containerID="45b91d42c9be51510cdee804365a3f51d643da4e2ff9b73085e5119f745172f5"
Jun 15 06:48:37.586785 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:37.586769    2564 scope.go:117] "RemoveContainer" containerID="f2737cced3fd4f8e114cedd4e7d700425663c953e1909514efe24e120617d659"
Jun 15 06:48:37.587070 ip-10-0-131-82 kubenswrapper[2564]: E0615 06:48:37.587047    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2737cced3fd4f8e114cedd4e7d700425663c953e1909514efe24e120617d659\": container with ID starting with f2737cced3fd4f8e114cedd4e7d700425663c953e1909514efe24e120617d659 not found: ID does not exist" containerID="f2737cced3fd4f8e114cedd4e7d700425663c953e1909514efe24e120617d659"
Jun 15 06:48:37.587183 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:37.587077    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2737cced3fd4f8e114cedd4e7d700425663c953e1909514efe24e120617d659"} err="failed to get container status \"f2737cced3fd4f8e114cedd4e7d700425663c953e1909514efe24e120617d659\": rpc error: code = NotFound desc = could not find container \"f2737cced3fd4f8e114cedd4e7d700425663c953e1909514efe24e120617d659\": container with ID starting with f2737cced3fd4f8e114cedd4e7d700425663c953e1909514efe24e120617d659 not found: ID does not exist"
Jun 15 06:48:37.587183 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:37.587094    2564 scope.go:117] "RemoveContainer" containerID="cbaa2d1c6017185869467f6db6bd559d27e8b0d9bdce05a3fcb66f28826f0bea"
Jun 15 06:48:37.587344 ip-10-0-131-82 kubenswrapper[2564]: E0615 06:48:37.587325    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbaa2d1c6017185869467f6db6bd559d27e8b0d9bdce05a3fcb66f28826f0bea\": container with ID starting with cbaa2d1c6017185869467f6db6bd559d27e8b0d9bdce05a3fcb66f28826f0bea not found: ID does not exist" containerID="cbaa2d1c6017185869467f6db6bd559d27e8b0d9bdce05a3fcb66f28826f0bea"
Jun 15 06:48:37.587407 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:37.587354    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbaa2d1c6017185869467f6db6bd559d27e8b0d9bdce05a3fcb66f28826f0bea"} err="failed to get container status \"cbaa2d1c6017185869467f6db6bd559d27e8b0d9bdce05a3fcb66f28826f0bea\": rpc error: code = NotFound desc = could not find container \"cbaa2d1c6017185869467f6db6bd559d27e8b0d9bdce05a3fcb66f28826f0bea\": container with ID starting with cbaa2d1c6017185869467f6db6bd559d27e8b0d9bdce05a3fcb66f28826f0bea not found: ID does not exist"
Jun 15 06:48:37.587407 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:37.587378    2564 scope.go:117] "RemoveContainer" containerID="45b91d42c9be51510cdee804365a3f51d643da4e2ff9b73085e5119f745172f5"
Jun 15 06:48:37.587655 ip-10-0-131-82 kubenswrapper[2564]: E0615 06:48:37.587634    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45b91d42c9be51510cdee804365a3f51d643da4e2ff9b73085e5119f745172f5\": container with ID starting with 45b91d42c9be51510cdee804365a3f51d643da4e2ff9b73085e5119f745172f5 not found: ID does not exist" containerID="45b91d42c9be51510cdee804365a3f51d643da4e2ff9b73085e5119f745172f5"
Jun 15 06:48:37.587737 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:37.587662    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45b91d42c9be51510cdee804365a3f51d643da4e2ff9b73085e5119f745172f5"} err="failed to get container status \"45b91d42c9be51510cdee804365a3f51d643da4e2ff9b73085e5119f745172f5\": rpc error: code = NotFound desc = could not find container \"45b91d42c9be51510cdee804365a3f51d643da4e2ff9b73085e5119f745172f5\": container with ID starting with 45b91d42c9be51510cdee804365a3f51d643da4e2ff9b73085e5119f745172f5 not found: ID does not exist"
Jun 15 06:48:37.589951 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:37.589918    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg"]
Jun 15 06:48:37.594953 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:37.594931    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-runtime-predictor-54dd488c85-xz8hg"]
Jun 15 06:48:38.138136 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:38.138105    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e" path="/var/lib/kubelet/pods/232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e/volumes"
Jun 15 06:48:38.211241 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:38.211215    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kn9gn_8bf514ab-857d-416e-b51f-2235f4cb429d/console-operator/1.log"
Jun 15 06:48:38.211808 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:48:38.211788    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kn9gn_8bf514ab-857d-416e-b51f-2235f4cb429d/console-operator/1.log"
Jun 15 06:49:33.864458 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:33.864427    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94"]
Jun 15 06:49:33.864972 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:33.864736    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e" containerName="storage-initializer"
Jun 15 06:49:33.864972 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:33.864747    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e" containerName="storage-initializer"
Jun 15 06:49:33.864972 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:33.864756    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e" containerName="kube-rbac-proxy"
Jun 15 06:49:33.864972 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:33.864761    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e" containerName="kube-rbac-proxy"
Jun 15 06:49:33.864972 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:33.864769    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e" containerName="kserve-container"
Jun 15 06:49:33.864972 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:33.864775    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e" containerName="kserve-container"
Jun 15 06:49:33.864972 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:33.864821    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e" containerName="kube-rbac-proxy"
Jun 15 06:49:33.864972 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:33.864828    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="232aeb7d-1d9c-4ef0-8abd-e720bcb2d53e" containerName="kserve-container"
Jun 15 06:49:33.868091 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:33.868074    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94"
Jun 15 06:49:33.870972 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:33.870806    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jun 15 06:49:33.870972 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:33.870945    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jun 15 06:49:33.870972 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:33.870968    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jun 15 06:49:33.871294 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:33.871027    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-v2-kube-rbac-proxy-sar-config\""
Jun 15 06:49:33.871294 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:33.870972    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-v2-predictor-serving-cert\""
Jun 15 06:49:33.871294 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:33.870968    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-q7vt7\""
Jun 15 06:49:33.871294 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:33.871297    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jun 15 06:49:33.877628 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:33.877601    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94"]
Jun 15 06:49:34.040741 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:34.040698    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/db219b5c-dbd0-438c-a838-dd7186d554ae-cabundle-cert\") pod \"isvc-xgboost-v2-predictor-fcc668bc-kxl94\" (UID: \"db219b5c-dbd0-438c-a838-dd7186d554ae\") " pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94"
Jun 15 06:49:34.040741 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:34.040744    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/db219b5c-dbd0-438c-a838-dd7186d554ae-proxy-tls\") pod \"isvc-xgboost-v2-predictor-fcc668bc-kxl94\" (UID: \"db219b5c-dbd0-438c-a838-dd7186d554ae\") " pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94"
Jun 15 06:49:34.041007 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:34.040800    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/db219b5c-dbd0-438c-a838-dd7186d554ae-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-v2-predictor-fcc668bc-kxl94\" (UID: \"db219b5c-dbd0-438c-a838-dd7186d554ae\") " pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94"
Jun 15 06:49:34.041007 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:34.040828    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g288\" (UniqueName: \"kubernetes.io/projected/db219b5c-dbd0-438c-a838-dd7186d554ae-kube-api-access-8g288\") pod \"isvc-xgboost-v2-predictor-fcc668bc-kxl94\" (UID: \"db219b5c-dbd0-438c-a838-dd7186d554ae\") " pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94"
Jun 15 06:49:34.041007 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:34.040892    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/db219b5c-dbd0-438c-a838-dd7186d554ae-kserve-provision-location\") pod \"isvc-xgboost-v2-predictor-fcc668bc-kxl94\" (UID: \"db219b5c-dbd0-438c-a838-dd7186d554ae\") " pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94"
Jun 15 06:49:34.141977 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:34.141943    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/db219b5c-dbd0-438c-a838-dd7186d554ae-proxy-tls\") pod \"isvc-xgboost-v2-predictor-fcc668bc-kxl94\" (UID: \"db219b5c-dbd0-438c-a838-dd7186d554ae\") " pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94"
Jun 15 06:49:34.142174 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:34.142004    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/db219b5c-dbd0-438c-a838-dd7186d554ae-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-v2-predictor-fcc668bc-kxl94\" (UID: \"db219b5c-dbd0-438c-a838-dd7186d554ae\") " pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94"
Jun 15 06:49:34.142174 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:34.142036    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g288\" (UniqueName: \"kubernetes.io/projected/db219b5c-dbd0-438c-a838-dd7186d554ae-kube-api-access-8g288\") pod \"isvc-xgboost-v2-predictor-fcc668bc-kxl94\" (UID: \"db219b5c-dbd0-438c-a838-dd7186d554ae\") " pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94"
Jun 15 06:49:34.142174 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:34.142051    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/db219b5c-dbd0-438c-a838-dd7186d554ae-kserve-provision-location\") pod \"isvc-xgboost-v2-predictor-fcc668bc-kxl94\" (UID: \"db219b5c-dbd0-438c-a838-dd7186d554ae\") " pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94"
Jun 15 06:49:34.142174 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:34.142075    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/db219b5c-dbd0-438c-a838-dd7186d554ae-cabundle-cert\") pod \"isvc-xgboost-v2-predictor-fcc668bc-kxl94\" (UID: \"db219b5c-dbd0-438c-a838-dd7186d554ae\") " pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94"
Jun 15 06:49:34.142561 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:34.142536    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/db219b5c-dbd0-438c-a838-dd7186d554ae-kserve-provision-location\") pod \"isvc-xgboost-v2-predictor-fcc668bc-kxl94\" (UID: \"db219b5c-dbd0-438c-a838-dd7186d554ae\") " pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94"
Jun 15 06:49:34.142830 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:34.142811    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/db219b5c-dbd0-438c-a838-dd7186d554ae-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-v2-predictor-fcc668bc-kxl94\" (UID: \"db219b5c-dbd0-438c-a838-dd7186d554ae\") " pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94"
Jun 15 06:49:34.142898 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:34.142843    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/db219b5c-dbd0-438c-a838-dd7186d554ae-cabundle-cert\") pod \"isvc-xgboost-v2-predictor-fcc668bc-kxl94\" (UID: \"db219b5c-dbd0-438c-a838-dd7186d554ae\") " pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94"
Jun 15 06:49:34.144575 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:34.144550    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/db219b5c-dbd0-438c-a838-dd7186d554ae-proxy-tls\") pod \"isvc-xgboost-v2-predictor-fcc668bc-kxl94\" (UID: \"db219b5c-dbd0-438c-a838-dd7186d554ae\") " pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94"
Jun 15 06:49:34.151189 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:34.151165    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g288\" (UniqueName: \"kubernetes.io/projected/db219b5c-dbd0-438c-a838-dd7186d554ae-kube-api-access-8g288\") pod \"isvc-xgboost-v2-predictor-fcc668bc-kxl94\" (UID: \"db219b5c-dbd0-438c-a838-dd7186d554ae\") " pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94"
Jun 15 06:49:34.179378 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:34.179337    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94"
Jun 15 06:49:34.320647 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:34.320621    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94"]
Jun 15 06:49:34.323113 ip-10-0-131-82 kubenswrapper[2564]: W0615 06:49:34.323086    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb219b5c_dbd0_438c_a838_dd7186d554ae.slice/crio-74a9bc254183a2f0f82acc98656802513e0627e832ef728e5e466d6e18cee583 WatchSource:0}: Error finding container 74a9bc254183a2f0f82acc98656802513e0627e832ef728e5e466d6e18cee583: Status 404 returned error can't find the container with id 74a9bc254183a2f0f82acc98656802513e0627e832ef728e5e466d6e18cee583
Jun 15 06:49:34.792266 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:34.792230    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94" event={"ID":"db219b5c-dbd0-438c-a838-dd7186d554ae","Type":"ContainerStarted","Data":"27b97f240dea0ff7f2aa1903aec6d8abbaa5e5e5da007739940eb382b533f591"}
Jun 15 06:49:34.792434 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:34.792293    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94" event={"ID":"db219b5c-dbd0-438c-a838-dd7186d554ae","Type":"ContainerStarted","Data":"74a9bc254183a2f0f82acc98656802513e0627e832ef728e5e466d6e18cee583"}
Jun 15 06:49:38.810149 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:38.810108    2564 generic.go:356] "Generic (PLEG): container finished" podID="db219b5c-dbd0-438c-a838-dd7186d554ae" containerID="27b97f240dea0ff7f2aa1903aec6d8abbaa5e5e5da007739940eb382b533f591" exitCode=0
Jun 15 06:49:38.810543 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:38.810158    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94" event={"ID":"db219b5c-dbd0-438c-a838-dd7186d554ae","Type":"ContainerDied","Data":"27b97f240dea0ff7f2aa1903aec6d8abbaa5e5e5da007739940eb382b533f591"}
Jun 15 06:49:39.816717 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:39.816684    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94" event={"ID":"db219b5c-dbd0-438c-a838-dd7186d554ae","Type":"ContainerStarted","Data":"56d5a72ec22f83f30e71786f3df1f192e607bef89a6357423d28ab00a13c0e3e"}
Jun 15 06:49:39.817223 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:39.816746    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94" event={"ID":"db219b5c-dbd0-438c-a838-dd7186d554ae","Type":"ContainerStarted","Data":"0a60e11266509ec6898c6e5d3cb05347dec7464a5193bbc8d144396f49fc7d0e"}
Jun 15 06:49:39.817223 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:39.816948    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94"
Jun 15 06:49:39.836703 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:39.836657    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94" podStartSLOduration=3.287463621 podStartE2EDuration="6.836644095s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.549180474s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:49:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:49:39.835983672 +0000 UTC m=+3722.202528723" watchObservedRunningTime="2026-06-15 06:49:39.836644095 +0000 UTC m=+3722.203189136"
Jun 15 06:49:40.820448 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:40.820420    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94"
Jun 15 06:49:40.821538 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:40.821512    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94" podUID="db219b5c-dbd0-438c-a838-dd7186d554ae" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Jun 15 06:49:41.825708 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:41.825670    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94" podUID="db219b5c-dbd0-438c-a838-dd7186d554ae" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Jun 15 06:49:46.830146 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:46.830114    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94"
Jun 15 06:49:46.830656 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:46.830630    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94" podUID="db219b5c-dbd0-438c-a838-dd7186d554ae" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Jun 15 06:49:56.831491 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:49:56.831446    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94" podUID="db219b5c-dbd0-438c-a838-dd7186d554ae" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Jun 15 06:50:06.830612 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:06.830564    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94" podUID="db219b5c-dbd0-438c-a838-dd7186d554ae" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Jun 15 06:50:16.830984 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:16.830892    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94" podUID="db219b5c-dbd0-438c-a838-dd7186d554ae" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Jun 15 06:50:26.830673 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:26.830625    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94" podUID="db219b5c-dbd0-438c-a838-dd7186d554ae" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Jun 15 06:50:36.831448 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:36.831419    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94"
Jun 15 06:50:43.971436 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:43.971399    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94"]
Jun 15 06:50:43.971907 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:43.971773    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94" podUID="db219b5c-dbd0-438c-a838-dd7186d554ae" containerName="kserve-container" containerID="cri-o://0a60e11266509ec6898c6e5d3cb05347dec7464a5193bbc8d144396f49fc7d0e" gracePeriod=30
Jun 15 06:50:43.972013 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:43.971960    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94" podUID="db219b5c-dbd0-438c-a838-dd7186d554ae" containerName="kube-rbac-proxy" containerID="cri-o://56d5a72ec22f83f30e71786f3df1f192e607bef89a6357423d28ab00a13c0e3e" gracePeriod=30
Jun 15 06:50:44.089390 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:44.089362    2564 generic.go:356] "Generic (PLEG): container finished" podID="db219b5c-dbd0-438c-a838-dd7186d554ae" containerID="56d5a72ec22f83f30e71786f3df1f192e607bef89a6357423d28ab00a13c0e3e" exitCode=2
Jun 15 06:50:44.089523 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:44.089435    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94" event={"ID":"db219b5c-dbd0-438c-a838-dd7186d554ae","Type":"ContainerDied","Data":"56d5a72ec22f83f30e71786f3df1f192e607bef89a6357423d28ab00a13c0e3e"}
Jun 15 06:50:46.826877 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:46.826818    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94" podUID="db219b5c-dbd0-438c-a838-dd7186d554ae" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.39:8643/healthz\": dial tcp 10.132.0.39:8643: connect: connection refused"
Jun 15 06:50:46.831141 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:46.831115    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94" podUID="db219b5c-dbd0-438c-a838-dd7186d554ae" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Jun 15 06:50:47.519408 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:47.519379    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94"
Jun 15 06:50:47.637927 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:47.637903    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8g288\" (UniqueName: \"kubernetes.io/projected/db219b5c-dbd0-438c-a838-dd7186d554ae-kube-api-access-8g288\") pod \"db219b5c-dbd0-438c-a838-dd7186d554ae\" (UID: \"db219b5c-dbd0-438c-a838-dd7186d554ae\") "
Jun 15 06:50:47.638081 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:47.637952    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/db219b5c-dbd0-438c-a838-dd7186d554ae-kserve-provision-location\") pod \"db219b5c-dbd0-438c-a838-dd7186d554ae\" (UID: \"db219b5c-dbd0-438c-a838-dd7186d554ae\") "
Jun 15 06:50:47.638081 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:47.637993    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/db219b5c-dbd0-438c-a838-dd7186d554ae-proxy-tls\") pod \"db219b5c-dbd0-438c-a838-dd7186d554ae\" (UID: \"db219b5c-dbd0-438c-a838-dd7186d554ae\") "
Jun 15 06:50:47.638081 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:47.638019    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/db219b5c-dbd0-438c-a838-dd7186d554ae-cabundle-cert\") pod \"db219b5c-dbd0-438c-a838-dd7186d554ae\" (UID: \"db219b5c-dbd0-438c-a838-dd7186d554ae\") "
Jun 15 06:50:47.638081 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:47.638040    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/db219b5c-dbd0-438c-a838-dd7186d554ae-kube-rbac-proxy-sar-config\") pod \"db219b5c-dbd0-438c-a838-dd7186d554ae\" (UID: \"db219b5c-dbd0-438c-a838-dd7186d554ae\") "
Jun 15 06:50:47.638389 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:47.638364    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db219b5c-dbd0-438c-a838-dd7186d554ae-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "db219b5c-dbd0-438c-a838-dd7186d554ae" (UID: "db219b5c-dbd0-438c-a838-dd7186d554ae"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:50:47.638460 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:47.638397    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db219b5c-dbd0-438c-a838-dd7186d554ae-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "db219b5c-dbd0-438c-a838-dd7186d554ae" (UID: "db219b5c-dbd0-438c-a838-dd7186d554ae"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 06:50:47.638460 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:47.638439    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db219b5c-dbd0-438c-a838-dd7186d554ae-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "db219b5c-dbd0-438c-a838-dd7186d554ae" (UID: "db219b5c-dbd0-438c-a838-dd7186d554ae"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 06:50:47.640211 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:47.640188    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db219b5c-dbd0-438c-a838-dd7186d554ae-kube-api-access-8g288" (OuterVolumeSpecName: "kube-api-access-8g288") pod "db219b5c-dbd0-438c-a838-dd7186d554ae" (UID: "db219b5c-dbd0-438c-a838-dd7186d554ae"). InnerVolumeSpecName "kube-api-access-8g288". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 06:50:47.640328 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:47.640208    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db219b5c-dbd0-438c-a838-dd7186d554ae-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "db219b5c-dbd0-438c-a838-dd7186d554ae" (UID: "db219b5c-dbd0-438c-a838-dd7186d554ae"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 06:50:47.738814 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:47.738786    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8g288\" (UniqueName: \"kubernetes.io/projected/db219b5c-dbd0-438c-a838-dd7186d554ae-kube-api-access-8g288\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:50:47.738814 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:47.738812    2564 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/db219b5c-dbd0-438c-a838-dd7186d554ae-kserve-provision-location\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:50:47.738989 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:47.738823    2564 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/db219b5c-dbd0-438c-a838-dd7186d554ae-proxy-tls\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:50:47.738989 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:47.738833    2564 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/db219b5c-dbd0-438c-a838-dd7186d554ae-cabundle-cert\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:50:47.738989 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:47.738841    2564 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/db219b5c-dbd0-438c-a838-dd7186d554ae-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-82.ec2.internal\" DevicePath \"\""
Jun 15 06:50:48.108289 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:48.108197    2564 generic.go:356] "Generic (PLEG): container finished" podID="db219b5c-dbd0-438c-a838-dd7186d554ae" containerID="0a60e11266509ec6898c6e5d3cb05347dec7464a5193bbc8d144396f49fc7d0e" exitCode=0
Jun 15 06:50:48.108289 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:48.108239    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94" event={"ID":"db219b5c-dbd0-438c-a838-dd7186d554ae","Type":"ContainerDied","Data":"0a60e11266509ec6898c6e5d3cb05347dec7464a5193bbc8d144396f49fc7d0e"}
Jun 15 06:50:48.108289 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:48.108261    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94"
Jun 15 06:50:48.108289 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:48.108284    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94" event={"ID":"db219b5c-dbd0-438c-a838-dd7186d554ae","Type":"ContainerDied","Data":"74a9bc254183a2f0f82acc98656802513e0627e832ef728e5e466d6e18cee583"}
Jun 15 06:50:48.109049 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:48.108312    2564 scope.go:117] "RemoveContainer" containerID="56d5a72ec22f83f30e71786f3df1f192e607bef89a6357423d28ab00a13c0e3e"
Jun 15 06:50:48.117369 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:48.117350    2564 scope.go:117] "RemoveContainer" containerID="0a60e11266509ec6898c6e5d3cb05347dec7464a5193bbc8d144396f49fc7d0e"
Jun 15 06:50:48.124881 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:48.124838    2564 scope.go:117] "RemoveContainer" containerID="27b97f240dea0ff7f2aa1903aec6d8abbaa5e5e5da007739940eb382b533f591"
Jun 15 06:50:48.134363 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:48.134041    2564 scope.go:117] "RemoveContainer" containerID="56d5a72ec22f83f30e71786f3df1f192e607bef89a6357423d28ab00a13c0e3e"
Jun 15 06:50:48.134487 ip-10-0-131-82 kubenswrapper[2564]: E0615 06:50:48.134440    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56d5a72ec22f83f30e71786f3df1f192e607bef89a6357423d28ab00a13c0e3e\": container with ID starting with 56d5a72ec22f83f30e71786f3df1f192e607bef89a6357423d28ab00a13c0e3e not found: ID does not exist" containerID="56d5a72ec22f83f30e71786f3df1f192e607bef89a6357423d28ab00a13c0e3e"
Jun 15 06:50:48.134548 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:48.134479    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56d5a72ec22f83f30e71786f3df1f192e607bef89a6357423d28ab00a13c0e3e"} err="failed to get container status \"56d5a72ec22f83f30e71786f3df1f192e607bef89a6357423d28ab00a13c0e3e\": rpc error: code = NotFound desc = could not find container \"56d5a72ec22f83f30e71786f3df1f192e607bef89a6357423d28ab00a13c0e3e\": container with ID starting with 56d5a72ec22f83f30e71786f3df1f192e607bef89a6357423d28ab00a13c0e3e not found: ID does not exist"
Jun 15 06:50:48.134548 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:48.134506    2564 scope.go:117] "RemoveContainer" containerID="0a60e11266509ec6898c6e5d3cb05347dec7464a5193bbc8d144396f49fc7d0e"
Jun 15 06:50:48.137251 ip-10-0-131-82 kubenswrapper[2564]: E0615 06:50:48.137221    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a60e11266509ec6898c6e5d3cb05347dec7464a5193bbc8d144396f49fc7d0e\": container with ID starting with 0a60e11266509ec6898c6e5d3cb05347dec7464a5193bbc8d144396f49fc7d0e not found: ID does not exist" containerID="0a60e11266509ec6898c6e5d3cb05347dec7464a5193bbc8d144396f49fc7d0e"
Jun 15 06:50:48.137484 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:48.137436    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a60e11266509ec6898c6e5d3cb05347dec7464a5193bbc8d144396f49fc7d0e"} err="failed to get container status \"0a60e11266509ec6898c6e5d3cb05347dec7464a5193bbc8d144396f49fc7d0e\": rpc error: code = NotFound desc = could not find container \"0a60e11266509ec6898c6e5d3cb05347dec7464a5193bbc8d144396f49fc7d0e\": container with ID starting with 0a60e11266509ec6898c6e5d3cb05347dec7464a5193bbc8d144396f49fc7d0e not found: ID does not exist"
Jun 15 06:50:48.137628 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:48.137614    2564 scope.go:117] "RemoveContainer" containerID="27b97f240dea0ff7f2aa1903aec6d8abbaa5e5e5da007739940eb382b533f591"
Jun 15 06:50:48.138702 ip-10-0-131-82 kubenswrapper[2564]: E0615 06:50:48.138672    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27b97f240dea0ff7f2aa1903aec6d8abbaa5e5e5da007739940eb382b533f591\": container with ID starting with 27b97f240dea0ff7f2aa1903aec6d8abbaa5e5e5da007739940eb382b533f591 not found: ID does not exist" containerID="27b97f240dea0ff7f2aa1903aec6d8abbaa5e5e5da007739940eb382b533f591"
Jun 15 06:50:48.138812 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:48.138712    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27b97f240dea0ff7f2aa1903aec6d8abbaa5e5e5da007739940eb382b533f591"} err="failed to get container status \"27b97f240dea0ff7f2aa1903aec6d8abbaa5e5e5da007739940eb382b533f591\": rpc error: code = NotFound desc = could not find container \"27b97f240dea0ff7f2aa1903aec6d8abbaa5e5e5da007739940eb382b533f591\": container with ID starting with 27b97f240dea0ff7f2aa1903aec6d8abbaa5e5e5da007739940eb382b533f591 not found: ID does not exist"
Jun 15 06:50:48.142201 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:48.142183    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94"]
Jun 15 06:50:48.142283 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:48.142214    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-v2-predictor-fcc668bc-kxl94"]
Jun 15 06:50:50.136296 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:50:50.136263    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db219b5c-dbd0-438c-a838-dd7186d554ae" path="/var/lib/kubelet/pods/db219b5c-dbd0-438c-a838-dd7186d554ae/volumes"
Jun 15 06:53:38.236515 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:53:38.236443    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kn9gn_8bf514ab-857d-416e-b51f-2235f4cb429d/console-operator/1.log"
Jun 15 06:53:38.239793 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:53:38.239773    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kn9gn_8bf514ab-857d-416e-b51f-2235f4cb429d/console-operator/1.log"
Jun 15 06:57:48.389570 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:48.389500    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xl66m_80312796-b102-426c-a974-354e77b12b12/global-pull-secret-syncer/0.log"
Jun 15 06:57:48.517525 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:48.517490    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kkfqp_13b42759-3601-4360-a714-779f88b86a52/konnectivity-agent/0.log"
Jun 15 06:57:48.582979 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:48.582943    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-82.ec2.internal_f628656103b87af6a4969bd9cbf47555/haproxy/0.log"
Jun 15 06:57:53.171181 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:53.171149    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-9jqt9_03282db6-9df2-4e5f-b462-d7d252ccef87/cluster-monitoring-operator/0.log"
Jun 15 06:57:53.463217 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:53.463148    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v78lm_70d9d755-3947-4657-9cb3-f86f1108c503/node-exporter/0.log"
Jun 15 06:57:53.487012 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:53.486965    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v78lm_70d9d755-3947-4657-9cb3-f86f1108c503/kube-rbac-proxy/0.log"
Jun 15 06:57:53.510832 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:53.510812    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v78lm_70d9d755-3947-4657-9cb3-f86f1108c503/init-textfile/0.log"
Jun 15 06:57:53.988470 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:53.988438    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-45lk7_f3e2de53-0de1-4e9f-8365-ed9df2069272/prometheus-operator-admission-webhook/0.log"
Jun 15 06:57:55.683892 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:55.683834    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-gbgcf_6b663716-76fa-4580-afdb-73c283d06ac2/networking-console-plugin/0.log"
Jun 15 06:57:56.154127 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:56.154099    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kn9gn_8bf514ab-857d-416e-b51f-2235f4cb429d/console-operator/1.log"
Jun 15 06:57:56.158906 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:56.158886    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kn9gn_8bf514ab-857d-416e-b51f-2235f4cb429d/console-operator/2.log"
Jun 15 06:57:56.497536 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:56.497440    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-w2k28/perf-node-gather-daemonset-7gpb5"]
Jun 15 06:57:56.498434 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:56.498409    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db219b5c-dbd0-438c-a838-dd7186d554ae" containerName="kube-rbac-proxy"
Jun 15 06:57:56.498571 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:56.498561    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="db219b5c-dbd0-438c-a838-dd7186d554ae" containerName="kube-rbac-proxy"
Jun 15 06:57:56.498698 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:56.498689    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db219b5c-dbd0-438c-a838-dd7186d554ae" containerName="kserve-container"
Jun 15 06:57:56.498774 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:56.498765    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="db219b5c-dbd0-438c-a838-dd7186d554ae" containerName="kserve-container"
Jun 15 06:57:56.498848 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:56.498839    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db219b5c-dbd0-438c-a838-dd7186d554ae" containerName="storage-initializer"
Jun 15 06:57:56.498950 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:56.498940    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="db219b5c-dbd0-438c-a838-dd7186d554ae" containerName="storage-initializer"
Jun 15 06:57:56.499227 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:56.499212    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="db219b5c-dbd0-438c-a838-dd7186d554ae" containerName="kube-rbac-proxy"
Jun 15 06:57:56.499337 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:56.499328    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="db219b5c-dbd0-438c-a838-dd7186d554ae" containerName="kserve-container"
Jun 15 06:57:56.503155 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:56.503127    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w2k28/perf-node-gather-daemonset-7gpb5"
Jun 15 06:57:56.505934 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:56.505916    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w2k28\"/\"openshift-service-ca.crt\""
Jun 15 06:57:56.507165 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:56.507146    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w2k28\"/\"kube-root-ca.crt\""
Jun 15 06:57:56.507165 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:56.507158    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-w2k28\"/\"default-dockercfg-5kg2k\""
Jun 15 06:57:56.509206 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:56.509181    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w2k28/perf-node-gather-daemonset-7gpb5"]
Jun 15 06:57:56.521154 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:56.521132    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1007e97e-888f-44da-a38f-5331f5e38688-proc\") pod \"perf-node-gather-daemonset-7gpb5\" (UID: \"1007e97e-888f-44da-a38f-5331f5e38688\") " pod="openshift-must-gather-w2k28/perf-node-gather-daemonset-7gpb5"
Jun 15 06:57:56.521263 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:56.521164    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1007e97e-888f-44da-a38f-5331f5e38688-lib-modules\") pod \"perf-node-gather-daemonset-7gpb5\" (UID: \"1007e97e-888f-44da-a38f-5331f5e38688\") " pod="openshift-must-gather-w2k28/perf-node-gather-daemonset-7gpb5"
Jun 15 06:57:56.521263 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:56.521182    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1007e97e-888f-44da-a38f-5331f5e38688-sys\") pod \"perf-node-gather-daemonset-7gpb5\" (UID: \"1007e97e-888f-44da-a38f-5331f5e38688\") " pod="openshift-must-gather-w2k28/perf-node-gather-daemonset-7gpb5"
Jun 15 06:57:56.521263 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:56.521196    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stzp9\" (UniqueName: \"kubernetes.io/projected/1007e97e-888f-44da-a38f-5331f5e38688-kube-api-access-stzp9\") pod \"perf-node-gather-daemonset-7gpb5\" (UID: \"1007e97e-888f-44da-a38f-5331f5e38688\") " pod="openshift-must-gather-w2k28/perf-node-gather-daemonset-7gpb5"
Jun 15 06:57:56.521421 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:56.521331    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1007e97e-888f-44da-a38f-5331f5e38688-podres\") pod \"perf-node-gather-daemonset-7gpb5\" (UID: \"1007e97e-888f-44da-a38f-5331f5e38688\") " pod="openshift-must-gather-w2k28/perf-node-gather-daemonset-7gpb5"
Jun 15 06:57:56.622050 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:56.622018    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1007e97e-888f-44da-a38f-5331f5e38688-proc\") pod \"perf-node-gather-daemonset-7gpb5\" (UID: \"1007e97e-888f-44da-a38f-5331f5e38688\") " pod="openshift-must-gather-w2k28/perf-node-gather-daemonset-7gpb5"
Jun 15 06:57:56.622234 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:56.622055    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1007e97e-888f-44da-a38f-5331f5e38688-lib-modules\") pod \"perf-node-gather-daemonset-7gpb5\" (UID: \"1007e97e-888f-44da-a38f-5331f5e38688\") " pod="openshift-must-gather-w2k28/perf-node-gather-daemonset-7gpb5"
Jun 15 06:57:56.622234 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:56.622075    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1007e97e-888f-44da-a38f-5331f5e38688-sys\") pod \"perf-node-gather-daemonset-7gpb5\" (UID: \"1007e97e-888f-44da-a38f-5331f5e38688\") " pod="openshift-must-gather-w2k28/perf-node-gather-daemonset-7gpb5"
Jun 15 06:57:56.622234 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:56.622092    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stzp9\" (UniqueName: \"kubernetes.io/projected/1007e97e-888f-44da-a38f-5331f5e38688-kube-api-access-stzp9\") pod \"perf-node-gather-daemonset-7gpb5\" (UID: \"1007e97e-888f-44da-a38f-5331f5e38688\") " pod="openshift-must-gather-w2k28/perf-node-gather-daemonset-7gpb5"
Jun 15 06:57:56.622234 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:56.622142    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1007e97e-888f-44da-a38f-5331f5e38688-podres\") pod \"perf-node-gather-daemonset-7gpb5\" (UID: \"1007e97e-888f-44da-a38f-5331f5e38688\") " pod="openshift-must-gather-w2k28/perf-node-gather-daemonset-7gpb5"
Jun 15 06:57:56.622234 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:56.622167    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1007e97e-888f-44da-a38f-5331f5e38688-sys\") pod \"perf-node-gather-daemonset-7gpb5\" (UID: \"1007e97e-888f-44da-a38f-5331f5e38688\") " pod="openshift-must-gather-w2k28/perf-node-gather-daemonset-7gpb5"
Jun 15 06:57:56.622234 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:56.622165    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1007e97e-888f-44da-a38f-5331f5e38688-proc\") pod \"perf-node-gather-daemonset-7gpb5\" (UID: \"1007e97e-888f-44da-a38f-5331f5e38688\") " pod="openshift-must-gather-w2k28/perf-node-gather-daemonset-7gpb5"
Jun 15 06:57:56.622234 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:56.622204    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1007e97e-888f-44da-a38f-5331f5e38688-lib-modules\") pod \"perf-node-gather-daemonset-7gpb5\" (UID: \"1007e97e-888f-44da-a38f-5331f5e38688\") " pod="openshift-must-gather-w2k28/perf-node-gather-daemonset-7gpb5"
Jun 15 06:57:56.622234 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:56.622239    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1007e97e-888f-44da-a38f-5331f5e38688-podres\") pod \"perf-node-gather-daemonset-7gpb5\" (UID: \"1007e97e-888f-44da-a38f-5331f5e38688\") " pod="openshift-must-gather-w2k28/perf-node-gather-daemonset-7gpb5"
Jun 15 06:57:56.632209 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:56.632188    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stzp9\" (UniqueName: \"kubernetes.io/projected/1007e97e-888f-44da-a38f-5331f5e38688-kube-api-access-stzp9\") pod \"perf-node-gather-daemonset-7gpb5\" (UID: \"1007e97e-888f-44da-a38f-5331f5e38688\") " pod="openshift-must-gather-w2k28/perf-node-gather-daemonset-7gpb5"
Jun 15 06:57:56.691593 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:56.691568    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-657c9_2db45f44-748c-40ad-9c89-05ab2816c8f7/download-server/0.log"
Jun 15 06:57:56.813396 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:56.813323    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w2k28/perf-node-gather-daemonset-7gpb5"
Jun 15 06:57:56.944639 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:56.944602    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w2k28/perf-node-gather-daemonset-7gpb5"]
Jun 15 06:57:56.947501 ip-10-0-131-82 kubenswrapper[2564]: W0615 06:57:56.947465    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1007e97e_888f_44da_a38f_5331f5e38688.slice/crio-fd6bb2545f5739b94ec35e36f80086a5e0ae0a0c0e01eee85590836cdec8d95d WatchSource:0}: Error finding container fd6bb2545f5739b94ec35e36f80086a5e0ae0a0c0e01eee85590836cdec8d95d: Status 404 returned error can't find the container with id fd6bb2545f5739b94ec35e36f80086a5e0ae0a0c0e01eee85590836cdec8d95d
Jun 15 06:57:57.259125 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:57.259091    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-bd4ccd799-zwmqd_39c1a446-4af7-43a2-8a43-35bf376df260/volume-data-source-validator/0.log"
Jun 15 06:57:57.852541 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:57.852510    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w2k28/perf-node-gather-daemonset-7gpb5" event={"ID":"1007e97e-888f-44da-a38f-5331f5e38688","Type":"ContainerStarted","Data":"64e632e9663420e758061786bf37435cd3b16376cba915ca659676c826f14c02"}
Jun 15 06:57:57.852958 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:57.852560    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w2k28/perf-node-gather-daemonset-7gpb5" event={"ID":"1007e97e-888f-44da-a38f-5331f5e38688","Type":"ContainerStarted","Data":"fd6bb2545f5739b94ec35e36f80086a5e0ae0a0c0e01eee85590836cdec8d95d"}
Jun 15 06:57:57.852958 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:57.852624    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-w2k28/perf-node-gather-daemonset-7gpb5"
Jun 15 06:57:57.873292 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:57.873244    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-w2k28/perf-node-gather-daemonset-7gpb5" podStartSLOduration=1.8732313550000002 podStartE2EDuration="1.873231355s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 06:57:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:57:57.872114561 +0000 UTC m=+4220.238659611" watchObservedRunningTime="2026-06-15 06:57:57.873231355 +0000 UTC m=+4220.239776417"
Jun 15 06:57:58.289199 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:58.289165    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qndls_4df2971e-f461-424e-a003-dcfbc0eba623/dns/0.log"
Jun 15 06:57:58.312105 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:58.312075    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qndls_4df2971e-f461-424e-a003-dcfbc0eba623/kube-rbac-proxy/0.log"
Jun 15 06:57:58.389122 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:58.389092    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qdcqb_9ff3747f-c776-4f08-b35b-6d886f1e3cfc/dns-node-resolver/0.log"
Jun 15 06:57:58.930201 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:58.930173    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8v9wt_01d7cf7a-bc4a-43be-a3b0-10d8e29e8735/node-ca/0.log"
Jun 15 06:57:59.761187 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:57:59.761161    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67dff766cb-95zdt_fc17a9a3-092b-4007-b1dc-5860349dc4a0/router/0.log"
Jun 15 06:58:00.116137 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:58:00.116063    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-42blt_caf71ecd-2952-4e38-947b-9e18f1341517/serve-healthcheck-canary/0.log"
Jun 15 06:58:00.543205 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:58:00.543171    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-vbmdw_de5e4b97-769f-4d62-8aea-b9cdf3bca1a7/insights-operator/0.log"
Jun 15 06:58:00.543784 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:58:00.543768    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-vbmdw_de5e4b97-769f-4d62-8aea-b9cdf3bca1a7/insights-operator/1.log"
Jun 15 06:58:00.645507 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:58:00.645477    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l4gs5_c7d7f3f7-2380-4f93-96d6-59a58f32b056/kube-rbac-proxy/0.log"
Jun 15 06:58:00.668384 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:58:00.668356    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l4gs5_c7d7f3f7-2380-4f93-96d6-59a58f32b056/exporter/0.log"
Jun 15 06:58:00.694914 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:58:00.694893    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l4gs5_c7d7f3f7-2380-4f93-96d6-59a58f32b056/extractor/0.log"
Jun 15 06:58:02.910091 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:58:02.910059    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-84fc959947-z945b_3f7dd90d-675d-4ba2-8e6f-4ca3f54f01b7/manager/0.log"
Jun 15 06:58:03.866721 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:58:03.866692    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-w2k28/perf-node-gather-daemonset-7gpb5"
Jun 15 06:58:08.120803 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:58:08.120713    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-pwv4p_e30f3f9f-2bc5-4603-9343-e3bbdd26fd7d/kube-storage-version-migrator-operator/1.log"
Jun 15 06:58:08.122108 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:58:08.122084    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-pwv4p_e30f3f9f-2bc5-4603-9343-e3bbdd26fd7d/kube-storage-version-migrator-operator/0.log"
Jun 15 06:58:09.039226 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:58:09.039192    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-78lp9_d898204a-f058-4bf3-b6be-6b5edd43b362/kube-multus/0.log"
Jun 15 06:58:09.478411 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:58:09.478383    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s5nvg_365f2bf1-0391-46a7-961e-a41133c65588/kube-multus-additional-cni-plugins/0.log"
Jun 15 06:58:09.505658 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:58:09.505615    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s5nvg_365f2bf1-0391-46a7-961e-a41133c65588/egress-router-binary-copy/0.log"
Jun 15 06:58:09.532301 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:58:09.532276    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s5nvg_365f2bf1-0391-46a7-961e-a41133c65588/cni-plugins/0.log"
Jun 15 06:58:09.560651 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:58:09.560620    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s5nvg_365f2bf1-0391-46a7-961e-a41133c65588/bond-cni-plugin/0.log"
Jun 15 06:58:09.586582 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:58:09.586560    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s5nvg_365f2bf1-0391-46a7-961e-a41133c65588/routeoverride-cni/0.log"
Jun 15 06:58:09.615178 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:58:09.615148    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s5nvg_365f2bf1-0391-46a7-961e-a41133c65588/whereabouts-cni-bincopy/0.log"
Jun 15 06:58:09.641399 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:58:09.641371    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s5nvg_365f2bf1-0391-46a7-961e-a41133c65588/whereabouts-cni/0.log"
Jun 15 06:58:09.764441 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:58:09.764356    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qm5gv_ecbcc04e-289f-482a-b26e-49a2cee2e45f/network-metrics-daemon/0.log"
Jun 15 06:58:09.789818 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:58:09.789789    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qm5gv_ecbcc04e-289f-482a-b26e-49a2cee2e45f/kube-rbac-proxy/0.log"
Jun 15 06:58:10.854980 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:58:10.854948    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7qndp_4783d7d6-1895-41f7-b11a-dea0c4405bc8/ovn-controller/0.log"
Jun 15 06:58:10.875904 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:58:10.875839    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7qndp_4783d7d6-1895-41f7-b11a-dea0c4405bc8/ovn-acl-logging/0.log"
Jun 15 06:58:10.902611 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:58:10.902579    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7qndp_4783d7d6-1895-41f7-b11a-dea0c4405bc8/kube-rbac-proxy-node/0.log"
Jun 15 06:58:10.924660 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:58:10.924638    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7qndp_4783d7d6-1895-41f7-b11a-dea0c4405bc8/kube-rbac-proxy-ovn-metrics/0.log"
Jun 15 06:58:10.946570 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:58:10.946536    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7qndp_4783d7d6-1895-41f7-b11a-dea0c4405bc8/northd/0.log"
Jun 15 06:58:10.969143 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:58:10.969114    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7qndp_4783d7d6-1895-41f7-b11a-dea0c4405bc8/nbdb/0.log"
Jun 15 06:58:10.991826 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:58:10.991797    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7qndp_4783d7d6-1895-41f7-b11a-dea0c4405bc8/sbdb/0.log"
Jun 15 06:58:11.037693 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:58:11.037660    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7qndp_4783d7d6-1895-41f7-b11a-dea0c4405bc8/ovnkube-controller/0.log"
Jun 15 06:58:12.316339 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:58:12.316309    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-6947749cfc-4msss_1c426d10-8221-4f39-b21e-6e42e3c77906/check-endpoints/0.log"
Jun 15 06:58:12.401727 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:58:12.401687    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-jg5zt_2b0e234e-c49a-4504-9737-8d32181944e5/network-check-target-container/0.log"
Jun 15 06:58:13.412691 ip-10-0-131-82 kubenswrapper[2564]: I0615 06:58:13.412659    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-dp464_13e4b538-8b93-4137-aedf-11a30b014942/iptables-alerter/0.log"