Jun 02 19:40:07.047102 ip-10-0-130-103 systemd[1]: Starting Kubernetes Kubelet...
Jun 02 19:40:07.419238 ip-10-0-130-103 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 02 19:40:07.419238 ip-10-0-130-103 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jun 02 19:40:07.419238 ip-10-0-130-103 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 02 19:40:07.419238 ip-10-0-130-103 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jun 02 19:40:07.419238 ip-10-0-130-103 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 02 19:40:07.422153 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.422059    2564 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jun 02 19:40:07.426894 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426865    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 02 19:40:07.426894 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426887    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 02 19:40:07.426894 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426891    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 02 19:40:07.426894 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426896    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 02 19:40:07.426894 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426900    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 02 19:40:07.427104 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426906    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 02 19:40:07.427104 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426911    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 02 19:40:07.427104 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426915    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 02 19:40:07.427104 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426919    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 02 19:40:07.427104 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426921    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 02 19:40:07.427104 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426924    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 02 19:40:07.427104 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426927    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 02 19:40:07.427104 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426929    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 02 19:40:07.427104 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426933    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 02 19:40:07.427104 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426935    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 02 19:40:07.427104 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426938    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 02 19:40:07.427104 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426941    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 02 19:40:07.427104 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426943    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 02 19:40:07.427104 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426946    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 02 19:40:07.427104 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426949    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 02 19:40:07.427104 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426951    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 02 19:40:07.427104 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426954    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 02 19:40:07.427104 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426956    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 02 19:40:07.427104 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426959    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 02 19:40:07.427104 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426961    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 02 19:40:07.427579 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426964    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 02 19:40:07.427579 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426970    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 02 19:40:07.427579 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426973    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 02 19:40:07.427579 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426976    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 02 19:40:07.427579 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426979    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 02 19:40:07.427579 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426981    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 02 19:40:07.427579 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426984    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 02 19:40:07.427579 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426986    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 02 19:40:07.427579 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426989    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 02 19:40:07.427579 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426992    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 02 19:40:07.427579 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426994    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 02 19:40:07.427579 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426997    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 02 19:40:07.427579 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.426999    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 02 19:40:07.427579 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427002    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 02 19:40:07.427579 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427006    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 02 19:40:07.427579 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427011    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 02 19:40:07.427579 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427015    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 02 19:40:07.427579 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427018    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 02 19:40:07.427579 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427021    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 02 19:40:07.428072 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427023    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 02 19:40:07.428072 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427026    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 02 19:40:07.428072 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427029    2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 02 19:40:07.428072 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427032    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 02 19:40:07.428072 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427034    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 02 19:40:07.428072 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427037    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 02 19:40:07.428072 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427040    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 02 19:40:07.428072 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427042    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 02 19:40:07.428072 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427045    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 02 19:40:07.428072 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427047    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 02 19:40:07.428072 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427050    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 02 19:40:07.428072 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427053    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 02 19:40:07.428072 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427055    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 02 19:40:07.428072 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427058    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 02 19:40:07.428072 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427060    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 02 19:40:07.428072 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427063    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jun 02 19:40:07.428072 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427066    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 02 19:40:07.428072 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427069    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 02 19:40:07.428072 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427072    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 02 19:40:07.428072 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427075    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 02 19:40:07.428545 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427077    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 02 19:40:07.428545 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427080    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 02 19:40:07.428545 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427082    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 02 19:40:07.428545 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427085    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 02 19:40:07.428545 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427087    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 02 19:40:07.428545 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427090    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 02 19:40:07.428545 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427093    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 02 19:40:07.428545 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427096    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 02 19:40:07.428545 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427098    2564 feature_gate.go:328] unrecognized feature gate: Example
Jun 02 19:40:07.428545 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427101    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 02 19:40:07.428545 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427103    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 02 19:40:07.428545 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427106    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 02 19:40:07.428545 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427109    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 02 19:40:07.428545 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427113    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 02 19:40:07.428545 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427119    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 02 19:40:07.428545 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427122    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 02 19:40:07.428545 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427125    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 02 19:40:07.428545 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427128    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 02 19:40:07.428545 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427130    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 02 19:40:07.429015 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427133    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 02 19:40:07.429015 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427135    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 02 19:40:07.429015 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.427138    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 02 19:40:07.429368 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429357    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 02 19:40:07.429368 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429368    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 02 19:40:07.429423 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429372    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 02 19:40:07.429423 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429375    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 02 19:40:07.429423 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429377    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 02 19:40:07.429423 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429380    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 02 19:40:07.429423 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429383    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 02 19:40:07.429423 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429386    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 02 19:40:07.429423 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429389    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 02 19:40:07.429423 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429391    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 02 19:40:07.429423 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429394    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 02 19:40:07.429423 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429396    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 02 19:40:07.429423 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429399    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 02 19:40:07.429423 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429401    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 02 19:40:07.429423 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429404    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 02 19:40:07.429423 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429406    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 02 19:40:07.429423 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429409    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 02 19:40:07.429423 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429412    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 02 19:40:07.429423 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429414    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 02 19:40:07.429423 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429417    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 02 19:40:07.429423 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429419    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 02 19:40:07.429890 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429422    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 02 19:40:07.429890 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429424    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 02 19:40:07.429890 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429427    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 02 19:40:07.429890 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429431    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 02 19:40:07.429890 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429434    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 02 19:40:07.429890 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429437    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 02 19:40:07.429890 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429439    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 02 19:40:07.429890 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429442    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 02 19:40:07.429890 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429444    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 02 19:40:07.429890 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429446    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 02 19:40:07.429890 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429449    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 02 19:40:07.429890 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429452    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 02 19:40:07.429890 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429454    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 02 19:40:07.429890 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429457    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 02 19:40:07.429890 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429459    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 02 19:40:07.429890 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429462    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 02 19:40:07.429890 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429464    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 02 19:40:07.429890 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429467    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 02 19:40:07.429890 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429469    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 02 19:40:07.429890 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429471    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 02 19:40:07.430398 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429474    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 02 19:40:07.430398 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429477    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jun 02 19:40:07.430398 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429480    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 02 19:40:07.430398 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429482    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 02 19:40:07.430398 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429484    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 02 19:40:07.430398 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429487    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 02 19:40:07.430398 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429492    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 02 19:40:07.430398 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429495    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 02 19:40:07.430398 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429497    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 02 19:40:07.430398 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429500    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 02 19:40:07.430398 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429502    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 02 19:40:07.430398 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429505    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 02 19:40:07.430398 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429507    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 02 19:40:07.430398 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429511    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 02 19:40:07.430398 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429514    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 02 19:40:07.430398 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429516    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 02 19:40:07.430398 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429519    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 02 19:40:07.430398 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429522    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 02 19:40:07.430398 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429524    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 02 19:40:07.430905 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429527    2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 02 19:40:07.430905 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429529    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 02 19:40:07.430905 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429532    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 02 19:40:07.430905 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429534    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 02 19:40:07.430905 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429537    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 02 19:40:07.430905 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429539    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 02 19:40:07.430905 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429542    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 02 19:40:07.430905 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429545    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 02 19:40:07.430905 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429549    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 02 19:40:07.430905 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429553    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 02 19:40:07.430905 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429556    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 02 19:40:07.430905 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429558    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 02 19:40:07.430905 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429561    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 02 19:40:07.430905 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429563    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 02 19:40:07.430905 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429566    2564 feature_gate.go:328] unrecognized feature gate: Example
Jun 02 19:40:07.430905 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429568    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 02 19:40:07.430905 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429571    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 02 19:40:07.430905 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429573    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 02 19:40:07.430905 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429575    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 02 19:40:07.430905 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429578    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 02 19:40:07.431392 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429581    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 02 19:40:07.431392 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429583    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 02 19:40:07.431392 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429585    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 02 19:40:07.431392 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429588    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 02 19:40:07.431392 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429590    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 02 19:40:07.431392 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.429593    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 02 19:40:07.431392 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429664    2564 flags.go:64] FLAG: --address="0.0.0.0"
Jun 02 19:40:07.431392 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429674    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jun 02 19:40:07.431392 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429683    2564 flags.go:64] FLAG: --anonymous-auth="true"
Jun 02 19:40:07.431392 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429689    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jun 02 19:40:07.431392 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429697    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
Jun 02 19:40:07.431392 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429702    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jun 02 19:40:07.431392 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429707    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jun 02 19:40:07.431392 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429712    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jun 02 19:40:07.431392 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429715    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jun 02 19:40:07.431392 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429718    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jun 02 19:40:07.431392 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429722    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jun 02 19:40:07.431392 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429725    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jun 02 19:40:07.431392 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429728    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jun 02 19:40:07.431392 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429731    2564 flags.go:64] FLAG: --cgroup-root=""
Jun 02 19:40:07.431392 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429734    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
Jun 02 19:40:07.431392 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429737    2564 flags.go:64] FLAG: --client-ca-file=""
Jun 02 19:40:07.431392 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429740    2564 flags.go:64] FLAG: --cloud-config=""
Jun 02 19:40:07.432010 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429743    2564 flags.go:64] FLAG: --cloud-provider="external"
Jun 02 19:40:07.432010 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429745    2564 flags.go:64] FLAG: --cluster-dns="[]"
Jun 02 19:40:07.432010 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429750    2564 flags.go:64] FLAG: --cluster-domain=""
Jun 02 19:40:07.432010 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429753    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jun 02 19:40:07.432010 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429756    2564 flags.go:64] FLAG: --config-dir=""
Jun 02 19:40:07.432010 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429759    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jun 02 19:40:07.432010 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429762    2564 flags.go:64] FLAG: --container-log-max-files="5"
Jun 02 19:40:07.432010 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429769    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jun 02 19:40:07.432010 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429773    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jun 02 19:40:07.432010 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429776    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jun 02 19:40:07.432010 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429779    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jun 02 19:40:07.432010 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429783    2564 flags.go:64] FLAG: --contention-profiling="false"
Jun 02 19:40:07.432010 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429786    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jun 02 19:40:07.432010 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429788    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jun 02 19:40:07.432010 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429792    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
Jun 02 19:40:07.432010 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429796    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jun 02 19:40:07.432010 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429801    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jun 02 19:40:07.432010 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429804    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jun 02 19:40:07.432010 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429807    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jun 02 19:40:07.432010 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429810    2564 flags.go:64] FLAG: --enable-load-reader="false"
Jun 02 19:40:07.432010 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429827    2564 flags.go:64] FLAG: --enable-server="true"
Jun 02 19:40:07.432010 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429830    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jun 02 19:40:07.432010 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429835    2564 flags.go:64] FLAG: --event-burst="100"
Jun 02 19:40:07.432010 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429850    2564 flags.go:64] FLAG: --event-qps="50"
Jun 02 19:40:07.432010 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429853    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jun 02 19:40:07.432630 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429856    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jun 02 19:40:07.432630 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429859    2564 flags.go:64] FLAG: --eviction-hard=""
Jun 02 19:40:07.432630 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429863    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jun 02 19:40:07.432630 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429866    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jun 02 19:40:07.432630 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429869    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jun 02 19:40:07.432630 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429872    2564 flags.go:64] FLAG: --eviction-soft=""
Jun 02 19:40:07.432630 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429875    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jun 02 19:40:07.432630 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429878    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jun 02 19:40:07.432630 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429881    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jun 02 19:40:07.432630 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429884    2564 flags.go:64] FLAG: --experimental-mounter-path=""
Jun 02 19:40:07.432630 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429887    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
Jun 02 19:40:07.432630 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429889    2564 flags.go:64] FLAG: --fail-swap-on="true"
Jun 02 19:40:07.432630 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429892    2564 flags.go:64] FLAG: --feature-gates=""
Jun 02 19:40:07.432630 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429897    2564 flags.go:64] FLAG: --file-check-frequency="20s"
Jun 02 19:40:07.432630 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429900    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jun 02 19:40:07.432630 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429903    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jun 02 19:40:07.432630 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429906    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jun 02 19:40:07.432630 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429909    2564 flags.go:64] FLAG: --healthz-port="10248"
Jun 02 19:40:07.432630 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429912    2564 flags.go:64] FLAG: --help="false"
Jun 02 19:40:07.432630 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429915    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-130-103.ec2.internal"
Jun 02 19:40:07.432630 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429918    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
Jun 02 19:40:07.432630 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429921    2564 flags.go:64] FLAG: --http-check-frequency="20s"
Jun 02 19:40:07.432630 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429925    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jun 02 19:40:07.433205 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429928    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jun 02 19:40:07.433205 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429932    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jun 02 19:40:07.433205 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429935    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jun 02 19:40:07.433205 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429938    2564 flags.go:64] FLAG: --image-service-endpoint=""
Jun 02 19:40:07.433205 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429941    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jun 02 19:40:07.433205 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429945    2564 flags.go:64] FLAG: --kube-api-burst="100"
Jun 02 19:40:07.433205 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429948    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jun 02 19:40:07.433205 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429952    2564 flags.go:64] FLAG: --kube-api-qps="50"
Jun 02 19:40:07.433205 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429955    2564 flags.go:64] FLAG: --kube-reserved=""
Jun 02 19:40:07.433205 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429957    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jun 02 19:40:07.433205 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429960    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jun 02 19:40:07.433205 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429964    2564 flags.go:64] FLAG: --kubelet-cgroups=""
Jun 02 19:40:07.433205 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429966    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jun 02 19:40:07.433205 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429969    2564 flags.go:64] FLAG: --lock-file=""
Jun 02 19:40:07.433205 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429972    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jun 02 19:40:07.433205 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429974    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
Jun 02 19:40:07.433205 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429977    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jun 02 19:40:07.433205 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429983    2564 flags.go:64] FLAG: --log-json-split-stream="false"
Jun 02 19:40:07.433205 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429986    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jun 02 19:40:07.433205 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429989    2564 flags.go:64] FLAG: --log-text-split-stream="false"
Jun 02 19:40:07.433205 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429991    2564 flags.go:64] FLAG: --logging-format="text"
Jun 02 19:40:07.433205 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429994    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jun 02 19:40:07.433205 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.429998    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jun 02 19:40:07.433205 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430001    2564 flags.go:64] FLAG: --manifest-url=""
Jun 02 19:40:07.433816 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430004    2564 flags.go:64] FLAG: --manifest-url-header=""
Jun 02 19:40:07.433816 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430008    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jun 02 19:40:07.433816 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430011    2564 flags.go:64] FLAG: --max-open-files="1000000"
Jun 02 19:40:07.433816 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430015    2564 flags.go:64] FLAG: --max-pods="110"
Jun 02 19:40:07.433816 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430018    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jun 02 19:40:07.433816 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430021    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jun 02 19:40:07.433816 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430024    2564 flags.go:64] FLAG: --memory-manager-policy="None"
Jun 02 19:40:07.433816 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430027    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jun 02 19:40:07.433816 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430030    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jun 02 19:40:07.433816 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430033    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jun 02 19:40:07.433816 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430036    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jun 02 19:40:07.433816 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430043    2564 flags.go:64] FLAG: --node-status-max-images="50"
Jun 02 19:40:07.433816 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430046    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jun 02 19:40:07.433816 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430050    2564 flags.go:64] FLAG: --oom-score-adj="-999"
Jun 02 19:40:07.433816 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430053    2564 flags.go:64] FLAG: --pod-cidr=""
Jun 02 19:40:07.433816 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430056    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983"
Jun 02 19:40:07.433816 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430062    2564 flags.go:64] FLAG: --pod-manifest-path=""
Jun 02 19:40:07.433816 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430065    2564 flags.go:64] FLAG: --pod-max-pids="-1"
Jun 02 19:40:07.433816 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430068    2564 flags.go:64] FLAG: --pods-per-core="0"
Jun 02 19:40:07.433816 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430071    2564 flags.go:64] FLAG: --port="10250"
Jun 02 19:40:07.433816 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430073    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jun 02 19:40:07.433816 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430076    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02c13cc43bc19148d"
Jun 02 19:40:07.433816 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430079    2564 flags.go:64] FLAG: --qos-reserved=""
Jun 02 19:40:07.433816 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430082    2564 flags.go:64] FLAG: --read-only-port="10255"
Jun 02 19:40:07.434404 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430086    2564 flags.go:64] FLAG: --register-node="true"
Jun 02 19:40:07.434404 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430089    2564 flags.go:64] FLAG: --register-schedulable="true"
Jun 02 19:40:07.434404 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430091    2564 flags.go:64] FLAG: --register-with-taints=""
Jun 02 19:40:07.434404 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430095    2564 flags.go:64] FLAG: --registry-burst="10"
Jun 02 19:40:07.434404 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430098    2564 flags.go:64] FLAG: --registry-qps="5"
Jun 02 19:40:07.434404 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430100    2564 flags.go:64] FLAG: --reserved-cpus=""
Jun 02 19:40:07.434404 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430103    2564 flags.go:64] FLAG: --reserved-memory=""
Jun 02 19:40:07.434404 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430107    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jun 02 19:40:07.434404 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430110    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jun 02 19:40:07.434404 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430113    2564 flags.go:64] FLAG: --rotate-certificates="false"
Jun 02 19:40:07.434404 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430116    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
Jun 02 19:40:07.434404 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430119    2564 flags.go:64] FLAG: --runonce="false"
Jun 02 19:40:07.434404 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430121    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jun 02 19:40:07.434404 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430124    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jun 02 19:40:07.434404 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430127    2564 flags.go:64] FLAG: --seccomp-default="false"
Jun 02 19:40:07.434404 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430130    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
Jun 02 19:40:07.434404 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430133    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jun 02 19:40:07.434404 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430137    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jun 02 19:40:07.434404 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430140    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jun 02 19:40:07.434404 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430143    2564 flags.go:64] FLAG: --storage-driver-password="root"
Jun 02 19:40:07.434404 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430146    2564 flags.go:64] FLAG: --storage-driver-secure="false"
Jun 02 19:40:07.434404 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430149    2564 flags.go:64] FLAG: --storage-driver-table="stats"
Jun 02 19:40:07.434404 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430151    2564 flags.go:64] FLAG: --storage-driver-user="root"
Jun 02 19:40:07.434404 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430154    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jun 02 19:40:07.434404 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430158    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
Jun 02 19:40:07.434404 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430161    2564 flags.go:64] FLAG: --system-cgroups=""
Jun 02 19:40:07.435042 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430164    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jun 02 19:40:07.435042 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430169    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
Jun 02 19:40:07.435042 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430172    2564 flags.go:64] FLAG: --tls-cert-file=""
Jun 02 19:40:07.435042 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430175    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jun 02 19:40:07.435042 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430179    2564 flags.go:64] FLAG: --tls-min-version=""
Jun 02 19:40:07.435042 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430182    2564 flags.go:64] FLAG: --tls-private-key-file=""
Jun 02 19:40:07.435042 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430185    2564 flags.go:64] FLAG: --topology-manager-policy="none"
Jun 02 19:40:07.435042 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430187    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
Jun 02 19:40:07.435042 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430190    2564 flags.go:64] FLAG: --topology-manager-scope="container"
Jun 02 19:40:07.435042 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430193    2564 flags.go:64] FLAG: --v="2"
Jun 02 19:40:07.435042 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430197    2564 flags.go:64] FLAG: --version="false"
Jun 02 19:40:07.435042 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430201    2564 flags.go:64] FLAG: --vmodule=""
Jun 02 19:40:07.435042 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430206    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jun 02 19:40:07.435042 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.430209    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jun 02 19:40:07.435042 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430304    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 02 19:40:07.435042 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430313    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 02 19:40:07.435042 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430316    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 02 19:40:07.435042 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430319    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 02 19:40:07.435042 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430322    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 02 19:40:07.435042 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430325    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 02 19:40:07.435042 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430328    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 02 19:40:07.435042 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430330    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 02 19:40:07.435578 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430333    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 02 19:40:07.435578 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430335    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 02 19:40:07.435578 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430338    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 02 19:40:07.435578 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430341    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 02 19:40:07.435578 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430344    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 02 19:40:07.435578 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430346    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 02 19:40:07.435578 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430349    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 02 19:40:07.435578 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430351    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 02 19:40:07.435578 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430355    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 02 19:40:07.435578 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430357    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 02 19:40:07.435578 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430360    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 02 19:40:07.435578 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430362    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 02 19:40:07.435578 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430365    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 02 19:40:07.435578 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430367    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 02 19:40:07.435578 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430370    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 02 19:40:07.435578 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430372    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 02 19:40:07.435578 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430375    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 02 19:40:07.435578 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430377    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 02 19:40:07.435578 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430380    2564 feature_gate.go:328] unrecognized feature gate: Example
Jun 02 19:40:07.435578 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430383    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 02 19:40:07.436144 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430385    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jun 02 19:40:07.436144 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430388    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 02 19:40:07.436144 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430390    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 02 19:40:07.436144 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430393    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 02 19:40:07.436144 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430396    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 02 19:40:07.436144 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430400    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 02 19:40:07.436144 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430403    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 02 19:40:07.436144 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430406    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 02 19:40:07.436144 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430408    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 02 19:40:07.436144 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430411    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 02 19:40:07.436144 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430414    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 02 19:40:07.436144 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430418    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 02 19:40:07.436144 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430421    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 02 19:40:07.436144 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430424    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 02 19:40:07.436144 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430427    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 02 19:40:07.436144 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430430    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 02 19:40:07.436144 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430432    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 02 19:40:07.436144 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430435    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 02 19:40:07.436144 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430438    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 02 19:40:07.436626 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430440    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 02 19:40:07.436626 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430444    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 02 19:40:07.436626 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430447    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 02 19:40:07.436626 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430449    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 02 19:40:07.436626 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430452    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 02 19:40:07.436626 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430454    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 02 19:40:07.436626 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430457    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 02 19:40:07.436626 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430460    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 02 19:40:07.436626 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430462    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 02 19:40:07.436626 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430465    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 02 19:40:07.436626 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430467    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 02 19:40:07.436626 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430470    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 02 19:40:07.436626 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430472    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 02 19:40:07.436626 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430475    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 02 19:40:07.436626 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430477    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 02 19:40:07.436626 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430479    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 02 19:40:07.436626 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430482    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 02 19:40:07.436626 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430485    2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 02 19:40:07.436626 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430488    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 02 19:40:07.436626 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430490    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 02 19:40:07.437252 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430493    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 02 19:40:07.437252 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430495    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 02 19:40:07.437252 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430498    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 02 19:40:07.437252 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430500    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 02 19:40:07.437252 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430503    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 02 19:40:07.437252 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430506    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 02 19:40:07.437252 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430508    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 02 19:40:07.437252 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430511    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 02 19:40:07.437252 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430513    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 02 19:40:07.437252 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430515    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 02 19:40:07.437252 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430518    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 02 19:40:07.437252 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430520    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 02 19:40:07.437252 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430523    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 02 19:40:07.437252 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430526    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 02 19:40:07.437252 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430530    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 02 19:40:07.437252 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430534    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 02 19:40:07.437252 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430536    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 02 19:40:07.437252 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430538    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 02 19:40:07.437252 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.430541    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 02 19:40:07.437724 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.431273    2564 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Jun 02 19:40:07.438058 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.438038    2564 server.go:530] "Kubelet version" kubeletVersion="v1.33.12"
Jun 02 19:40:07.438094 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.438058    2564 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jun 02 19:40:07.438125 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438108    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 02 19:40:07.438125 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438115    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 02 19:40:07.438125 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438118    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 02 19:40:07.438125 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438122    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 02 19:40:07.438125 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438125    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 02 19:40:07.438125 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438128    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 02 19:40:07.438280 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438131    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 02 19:40:07.438280 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438134    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 02 19:40:07.438280 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438136    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 02 19:40:07.438280 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438139    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 02 19:40:07.438280 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438142    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 02 19:40:07.438280 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438145    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 02 19:40:07.438280 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438148    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 02 19:40:07.438280 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438150    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 02 19:40:07.438280 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438153    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 02 19:40:07.438280 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438156    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 02 19:40:07.438280 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438159    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 02 19:40:07.438280 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438161    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 02 19:40:07.438280 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438164    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 02 19:40:07.438280 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438166    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 02 19:40:07.438280 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438169    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 02 19:40:07.438280 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438171    2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 02 19:40:07.438280 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438174    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 02 19:40:07.438280 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438176    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 02 19:40:07.438280 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438179    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 02 19:40:07.438757 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438182    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 02 19:40:07.438757 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438184    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 02 19:40:07.438757 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438187    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 02 19:40:07.438757 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438189    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 02 19:40:07.438757 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438192    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 02 19:40:07.438757 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438194    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 02 19:40:07.438757 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438198    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 02 19:40:07.438757 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438200    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 02 19:40:07.438757 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438203    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 02 19:40:07.438757 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438205    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 02 19:40:07.438757 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438208    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 02 19:40:07.438757 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438211    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 02 19:40:07.438757 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438214    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 02 19:40:07.438757 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438216    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 02 19:40:07.438757 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438219    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 02 19:40:07.438757 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438222    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 02 19:40:07.438757 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438225    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 02 19:40:07.438757 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438227    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 02 19:40:07.438757 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438230    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 02 19:40:07.438757 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438232    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 02 19:40:07.438757 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438235    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 02 19:40:07.439309 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438238    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 02 19:40:07.439309 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438240    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 02 19:40:07.439309 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438243    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 02 19:40:07.439309 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438245    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 02 19:40:07.439309 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438248    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 02 19:40:07.439309 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438250    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 02 19:40:07.439309 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438253    2564 feature_gate.go:328] unrecognized feature gate: Example
Jun 02 19:40:07.439309 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438255    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 02 19:40:07.439309 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438258    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 02 19:40:07.439309 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438260    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 02 19:40:07.439309 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438263    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 02 19:40:07.439309 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438265    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 02 19:40:07.439309 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438268    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jun 02 19:40:07.439309 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438271    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 02 19:40:07.439309 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438273    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 02 19:40:07.439309 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438276    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 02 19:40:07.439309 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438279    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 02 19:40:07.439309 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438282    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 02 19:40:07.439309 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438285    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 02 19:40:07.439309 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438288    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 02 19:40:07.439798 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438291    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 02 19:40:07.439798 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438294    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 02 19:40:07.439798 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438297    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 02 19:40:07.439798 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438299    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 02 19:40:07.439798 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438302    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 02 19:40:07.439798 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438305    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 02 19:40:07.439798 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438308    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 02 19:40:07.439798 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438310    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 02 19:40:07.439798 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438313    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 02 19:40:07.439798 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438316    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 02 19:40:07.439798 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438318    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 02 19:40:07.439798 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438320    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 02 19:40:07.439798 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438323    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 02 19:40:07.439798 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438327    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 02 19:40:07.439798 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438331    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 02 19:40:07.439798 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438335    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 02 19:40:07.439798 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438338    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 02 19:40:07.439798 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438341    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 02 19:40:07.440256 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438344    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 02 19:40:07.440256 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438346    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 02 19:40:07.440256 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.438352    2564 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Jun 02 19:40:07.440256 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438450    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 02 19:40:07.440256 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438454    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 02 19:40:07.440256 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438457    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 02 19:40:07.440256 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438461    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 02 19:40:07.440256 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438463    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 02 19:40:07.440256 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438466    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 02 19:40:07.440256 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438469    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 02 19:40:07.440256 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438472    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 02 19:40:07.440256 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438474    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 02 19:40:07.440256 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438477    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 02 19:40:07.440256 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438480    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 02 19:40:07.440256 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438483    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 02 19:40:07.440256 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438485    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 02 19:40:07.440660 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438488    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 02 19:40:07.440660 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438491    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 02 19:40:07.440660 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438493    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 02 19:40:07.440660 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438496    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 02 19:40:07.440660 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438500    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 02 19:40:07.440660 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438502    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 02 19:40:07.440660 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438505    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 02 19:40:07.440660 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438507    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 02 19:40:07.440660 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438511    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 02 19:40:07.440660 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438515    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 02 19:40:07.440660 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438518    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 02 19:40:07.440660 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438521    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 02 19:40:07.440660 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438524    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 02 19:40:07.440660 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438527    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 02 19:40:07.440660 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438529    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 02 19:40:07.440660 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438532    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 02 19:40:07.440660 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438534    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 02 19:40:07.440660 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438537    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 02 19:40:07.440660 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438539    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 02 19:40:07.441179 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438542    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 02 19:40:07.441179 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438545    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 02 19:40:07.441179 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438547    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 02 19:40:07.441179 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438550    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 02 19:40:07.441179 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438552    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 02 19:40:07.441179 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438555    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 02 19:40:07.441179 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438557    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 02 19:40:07.441179 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438560    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 02 19:40:07.441179 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438562    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 02 19:40:07.441179 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438565    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 02 19:40:07.441179 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438567    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 02 19:40:07.441179 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438570    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 02 19:40:07.441179 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438573    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 02 19:40:07.441179 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438575    2564 feature_gate.go:328] unrecognized feature gate: Example
Jun 02 19:40:07.441179 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438578    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 02 19:40:07.441179 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438580    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 02 19:40:07.441179 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438583    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 02 19:40:07.441179 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438586    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 02 19:40:07.441179 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438589    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 02 19:40:07.441179 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438591    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 02 19:40:07.441671 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438594    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 02 19:40:07.441671 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438596    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 02 19:40:07.441671 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438599    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 02 19:40:07.441671 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438601    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 02 19:40:07.441671 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438603    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 02 19:40:07.441671 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438606    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 02 19:40:07.441671 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438608    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 02 19:40:07.441671 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438611    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 02 19:40:07.441671 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438614    2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 02 19:40:07.441671 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438616    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 02 19:40:07.441671 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438620    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 02 19:40:07.441671 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438623    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 02 19:40:07.441671 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438626    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 02 19:40:07.441671 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438629    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 02 19:40:07.441671 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438631    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 02 19:40:07.441671 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438634    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 02 19:40:07.441671 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438636    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 02 19:40:07.441671 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438639    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 02 19:40:07.441671 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438641    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 02 19:40:07.441671 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438644    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 02 19:40:07.442273 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438646    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 02 19:40:07.442273 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438649    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 02 19:40:07.442273 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438651    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 02 19:40:07.442273 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438654    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 02 19:40:07.442273 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438657    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 02 19:40:07.442273 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438659    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 02 19:40:07.442273 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438662    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jun 02 19:40:07.442273 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438664    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 02 19:40:07.442273 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438667    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 02 19:40:07.442273 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438670    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 02 19:40:07.442273 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438672    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 02 19:40:07.442273 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438674    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 02 19:40:07.442273 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438677    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 02 19:40:07.442273 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:07.438679    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 02 19:40:07.442273 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.438684    2564 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Jun 02 19:40:07.442273 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.439552    2564 server.go:962] "Client rotation is on, will bootstrap in background"
Jun 02 19:40:07.442944 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.442819    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jun 02 19:40:07.444101 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.444090    2564 server.go:1019] "Starting client certificate rotation"
Jun 02 19:40:07.444205 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.444188    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 02 19:40:07.445053 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.445042    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 02 19:40:07.472533 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.472508    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 02 19:40:07.476494 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.476470    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 02 19:40:07.491363 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.491344    2564 log.go:25] "Validated CRI v1 runtime API"
Jun 02 19:40:07.498710 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.498692    2564 log.go:25] "Validated CRI v1 image API"
Jun 02 19:40:07.501566 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.501548    2564 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jun 02 19:40:07.504878 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.504859    2564 fs.go:135] Filesystem UUIDs: map[63fcdd2c-2a46-4d18-a885-10286a682a17:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d39258da-6ea0-4355-94df-4bca445e652b:/dev/nvme0n1p3]
Jun 02 19:40:07.504943 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.504879    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jun 02 19:40:07.506967 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.506945    2564 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 02 19:40:07.509303 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.509172    2564 manager.go:217] Machine: {Timestamp:2026-06-02 19:40:07.508655982 +0000 UTC m=+0.363076266 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098227 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24e7ac455a64314cc0eaa5bbb01f05 SystemUUID:ec24e7ac-455a-6431-4cc0-eaa5bbb01f05 BootID:a73b66a6-1ca2-4b4f-8e9a-3a5064b6a970 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:11:b8:3c:3e:69 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:11:b8:3c:3e:69 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:3b:02:50:bd:62 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jun 02 19:40:07.510170 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.510159    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jun 02 19:40:07.510259 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.510247    2564 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jun 02 19:40:07.514212 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.514189    2564 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jun 02 19:40:07.514378 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.514216    2564 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-103.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jun 02 19:40:07.514423 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.514388    2564 topology_manager.go:138] "Creating topology manager with none policy"
Jun 02 19:40:07.514423 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.514397    2564 container_manager_linux.go:306] "Creating device plugin manager"
Jun 02 19:40:07.514423 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.514404    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 02 19:40:07.516175 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.516165    2564 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 02 19:40:07.517484 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.517474    2564 state_mem.go:36] "Initialized new in-memory state store"
Jun 02 19:40:07.517592 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.517584    2564 server.go:1267] "Using root directory" path="/var/lib/kubelet"
Jun 02 19:40:07.520306 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.520297    2564 kubelet.go:491] "Attempting to sync node with API server"
Jun 02 19:40:07.520344 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.520311    2564 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
Jun 02 19:40:07.520344 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.520324    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jun 02 19:40:07.520344 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.520333    2564 kubelet.go:397] "Adding apiserver pod source"
Jun 02 19:40:07.520344 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.520341    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jun 02 19:40:07.521552 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.521541    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 02 19:40:07.521595 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.521561    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 02 19:40:07.524862 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.524830    2564 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1"
Jun 02 19:40:07.527235 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.527222    2564 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jun 02 19:40:07.530084 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.530065    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jun 02 19:40:07.530084 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.530086    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jun 02 19:40:07.530191 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.530096    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jun 02 19:40:07.530191 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.530104    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jun 02 19:40:07.530191 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.530113    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jun 02 19:40:07.530191 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.530121    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jun 02 19:40:07.530191 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.530127    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jun 02 19:40:07.530191 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.530132    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jun 02 19:40:07.530191 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.530142    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jun 02 19:40:07.530191 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.530150    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jun 02 19:40:07.530191 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.530171    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jun 02 19:40:07.530191 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.530177    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jun 02 19:40:07.531151 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.531141    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jun 02 19:40:07.531187 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.531151    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jun 02 19:40:07.534387 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.534373    2564 watchdog_linux.go:99] "Systemd watchdog is not enabled"
Jun 02 19:40:07.534470 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.534408    2564 server.go:1295] "Started kubelet"
Jun 02 19:40:07.534527 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.534460    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jun 02 19:40:07.534663 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.534614    2564 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jun 02 19:40:07.534700 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.534687    2564 server_v1.go:47] "podresources" method="list" useActivePods=true
Jun 02 19:40:07.535459 ip-10-0-130-103 systemd[1]: Started Kubernetes Kubelet.
Jun 02 19:40:07.536183 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.536166    2564 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jun 02 19:40:07.536400 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.536389    2564 server.go:317] "Adding debug handlers to kubelet server"
Jun 02 19:40:07.536731 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.536712    2564 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-103.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jun 02 19:40:07.536799 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:07.536735    2564 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jun 02 19:40:07.536799 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:07.536770    2564 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-103.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jun 02 19:40:07.547531 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:07.547508    2564 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jun 02 19:40:07.547799 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.547730    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jun 02 19:40:07.547993 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:07.546865    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-103.ec2.internal.18b55aee5ed13a59  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-103.ec2.internal,UID:ip-10-0-130-103.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-103.ec2.internal,},FirstTimestamp:2026-06-02 19:40:07.534385753 +0000 UTC m=+0.388806037,LastTimestamp:2026-06-02 19:40:07.534385753 +0000 UTC m=+0.388806037,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-103.ec2.internal,}"
Jun 02 19:40:07.548316 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.548296    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jun 02 19:40:07.548447 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.548432    2564 volume_manager.go:295] "The desired_state_of_world populator starts"
Jun 02 19:40:07.548528 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.548518    2564 volume_manager.go:297] "Starting Kubelet Volume Manager"
Jun 02 19:40:07.548677 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.548661    2564 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
Jun 02 19:40:07.548753 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.548717    2564 reconstruct.go:97] "Volume reconstruction finished"
Jun 02 19:40:07.548753 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.548729    2564 reconciler.go:26] "Reconciler: start to sync state"
Jun 02 19:40:07.548973 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.548957    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jun 02 19:40:07.548973 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.548973    2564 factory.go:55] Registering systemd factory
Jun 02 19:40:07.549097 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.548981    2564 factory.go:223] Registration of the systemd container factory successfully
Jun 02 19:40:07.549189 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.549176    2564 factory.go:153] Registering CRI-O factory
Jun 02 19:40:07.549227 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.549191    2564 factory.go:223] Registration of the crio container factory successfully
Jun 02 19:40:07.549227 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.549204    2564 factory.go:103] Registering Raw factory
Jun 02 19:40:07.549227 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.549212    2564 manager.go:1196] Started watching for new ooms in manager
Jun 02 19:40:07.549326 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:07.549313    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-103.ec2.internal\" not found"
Jun 02 19:40:07.549527 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.549517    2564 manager.go:319] Starting recovery of all containers
Jun 02 19:40:07.552210 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:07.552186    2564 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jun 02 19:40:07.552360 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:07.552341    2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-103.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jun 02 19:40:07.553070 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.553053    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5nwjc"
Jun 02 19:40:07.558913 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.558900    2564 manager.go:324] Recovery completed
Jun 02 19:40:07.562090 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.562074    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5nwjc"
Jun 02 19:40:07.563264 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.563252    2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 02 19:40:07.565101 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.565088    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-103.ec2.internal" event="NodeHasSufficientMemory"
Jun 02 19:40:07.565145 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.565115    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-103.ec2.internal" event="NodeHasNoDiskPressure"
Jun 02 19:40:07.565145 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.565124    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-103.ec2.internal" event="NodeHasSufficientPID"
Jun 02 19:40:07.565598 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.565584    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jun 02 19:40:07.565598 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.565597    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jun 02 19:40:07.565712 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.565614    2564 state_mem.go:36] "Initialized new in-memory state store"
Jun 02 19:40:07.567376 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:07.567320    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-103.ec2.internal.18b55aee60a5ed58  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-103.ec2.internal,UID:ip-10-0-130-103.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-103.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-103.ec2.internal,},FirstTimestamp:2026-06-02 19:40:07.565102424 +0000 UTC m=+0.419522709,LastTimestamp:2026-06-02 19:40:07.565102424 +0000 UTC m=+0.419522709,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-103.ec2.internal,}"
Jun 02 19:40:07.569543 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.569529    2564 policy_none.go:49] "None policy: Start"
Jun 02 19:40:07.569611 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.569547    2564 memory_manager.go:186] "Starting memorymanager" policy="None"
Jun 02 19:40:07.569611 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.569560    2564 state_mem.go:35] "Initializing new in-memory state store"
Jun 02 19:40:07.614437 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.614422    2564 manager.go:341] "Starting Device Plugin manager"
Jun 02 19:40:07.624219 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:07.614498    2564 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jun 02 19:40:07.624219 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.614508    2564 server.go:85] "Starting device plugin registration server"
Jun 02 19:40:07.624219 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.614736    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
Jun 02 19:40:07.624219 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.614749    2564 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jun 02 19:40:07.624219 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.614866    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jun 02 19:40:07.624219 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.614953    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jun 02 19:40:07.624219 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.614962    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jun 02 19:40:07.624219 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:07.615585    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jun 02 19:40:07.624219 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:07.615623    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-103.ec2.internal\" not found"
Jun 02 19:40:07.640549 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.640522    2564 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
Jun 02 19:40:07.641704 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.641690    2564 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
Jun 02 19:40:07.641787 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.641711    2564 status_manager.go:230] "Starting to sync pod status with apiserver"
Jun 02 19:40:07.641787 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.641731    2564 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jun 02 19:40:07.641787 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.641740    2564 kubelet.go:2451] "Starting kubelet main sync loop"
Jun 02 19:40:07.641939 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:07.641794    2564 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jun 02 19:40:07.644555 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.644538    2564 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 02 19:40:07.715583 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.715565    2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 02 19:40:07.717041 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.717027    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-103.ec2.internal" event="NodeHasSufficientMemory"
Jun 02 19:40:07.717104 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.717056    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-103.ec2.internal" event="NodeHasNoDiskPressure"
Jun 02 19:40:07.717104 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.717069    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-103.ec2.internal" event="NodeHasSufficientPID"
Jun 02 19:40:07.717104 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.717093    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-103.ec2.internal"
Jun 02 19:40:07.726345 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.726329    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-103.ec2.internal"
Jun 02 19:40:07.726397 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:07.726351    2564 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-103.ec2.internal\": node \"ip-10-0-130-103.ec2.internal\" not found"
Jun 02 19:40:07.742031 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.742011    2564 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-103.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-103.ec2.internal"]
Jun 02 19:40:07.742092 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.742075    2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 02 19:40:07.742503 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:07.742487    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-103.ec2.internal\" not found"
Jun 02 19:40:07.742903 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.742885    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-103.ec2.internal" event="NodeHasSufficientMemory"
Jun 02 19:40:07.743001 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.742914    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-103.ec2.internal" event="NodeHasNoDiskPressure"
Jun 02 19:40:07.743001 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.742926    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-103.ec2.internal" event="NodeHasSufficientPID"
Jun 02 19:40:07.744124 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.744112    2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 02 19:40:07.744289 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.744276    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-103.ec2.internal"
Jun 02 19:40:07.744324 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.744305    2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 02 19:40:07.746486 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.746463    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-103.ec2.internal" event="NodeHasSufficientMemory"
Jun 02 19:40:07.746486 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.746476    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-103.ec2.internal" event="NodeHasSufficientMemory"
Jun 02 19:40:07.746613 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.746489    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-103.ec2.internal" event="NodeHasNoDiskPressure"
Jun 02 19:40:07.746613 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.746503    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-103.ec2.internal" event="NodeHasSufficientPID"
Jun 02 19:40:07.746613 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.746504    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-103.ec2.internal" event="NodeHasNoDiskPressure"
Jun 02 19:40:07.746740 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.746692    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-103.ec2.internal" event="NodeHasSufficientPID"
Jun 02 19:40:07.747931 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.747914    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-103.ec2.internal"
Jun 02 19:40:07.748013 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.747953    2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 02 19:40:07.748751 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.748731    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-103.ec2.internal" event="NodeHasSufficientMemory"
Jun 02 19:40:07.748880 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.748763    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-103.ec2.internal" event="NodeHasNoDiskPressure"
Jun 02 19:40:07.748880 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.748787    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-103.ec2.internal" event="NodeHasSufficientPID"
Jun 02 19:40:07.749677 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.749661    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c76f033802b2eea65908f7d0ca4e5989-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-103.ec2.internal\" (UID: \"c76f033802b2eea65908f7d0ca4e5989\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-103.ec2.internal"
Jun 02 19:40:07.749737 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.749683    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c76f033802b2eea65908f7d0ca4e5989-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-103.ec2.internal\" (UID: \"c76f033802b2eea65908f7d0ca4e5989\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-103.ec2.internal"
Jun 02 19:40:07.749737 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.749723    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3d5ef594b0a6f2e96051da648ad4a60d-config\") pod \"kube-apiserver-proxy-ip-10-0-130-103.ec2.internal\" (UID: \"3d5ef594b0a6f2e96051da648ad4a60d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-103.ec2.internal"
Jun 02 19:40:07.763399 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:07.763381    2564 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-103.ec2.internal\" not found" node="ip-10-0-130-103.ec2.internal"
Jun 02 19:40:07.766756 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:07.766743    2564 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-103.ec2.internal\" not found" node="ip-10-0-130-103.ec2.internal"
Jun 02 19:40:07.843521 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:07.843502    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-103.ec2.internal\" not found"
Jun 02 19:40:07.849818 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.849800    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c76f033802b2eea65908f7d0ca4e5989-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-103.ec2.internal\" (UID: \"c76f033802b2eea65908f7d0ca4e5989\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-103.ec2.internal"
Jun 02 19:40:07.849887 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.849823    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3d5ef594b0a6f2e96051da648ad4a60d-config\") pod \"kube-apiserver-proxy-ip-10-0-130-103.ec2.internal\" (UID: \"3d5ef594b0a6f2e96051da648ad4a60d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-103.ec2.internal"
Jun 02 19:40:07.849887 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.849853    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c76f033802b2eea65908f7d0ca4e5989-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-103.ec2.internal\" (UID: \"c76f033802b2eea65908f7d0ca4e5989\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-103.ec2.internal"
Jun 02 19:40:07.849952 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.849892    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c76f033802b2eea65908f7d0ca4e5989-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-103.ec2.internal\" (UID: \"c76f033802b2eea65908f7d0ca4e5989\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-103.ec2.internal"
Jun 02 19:40:07.849952 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.849896    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c76f033802b2eea65908f7d0ca4e5989-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-103.ec2.internal\" (UID: \"c76f033802b2eea65908f7d0ca4e5989\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-103.ec2.internal"
Jun 02 19:40:07.849952 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:07.849918    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3d5ef594b0a6f2e96051da648ad4a60d-config\") pod \"kube-apiserver-proxy-ip-10-0-130-103.ec2.internal\" (UID: \"3d5ef594b0a6f2e96051da648ad4a60d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-103.ec2.internal"
Jun 02 19:40:07.944027 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:07.943956    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-103.ec2.internal\" not found"
Jun 02 19:40:08.044647 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:08.044617    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-103.ec2.internal\" not found"
Jun 02 19:40:08.066038 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:08.066016    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-103.ec2.internal"
Jun 02 19:40:08.069752 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:08.069734    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-103.ec2.internal"
Jun 02 19:40:08.145542 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:08.145500    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-103.ec2.internal\" not found"
Jun 02 19:40:08.246139 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:08.246048    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-103.ec2.internal\" not found"
Jun 02 19:40:08.346509 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:08.346479    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-103.ec2.internal\" not found"
Jun 02 19:40:08.444105 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:08.444073    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jun 02 19:40:08.444722 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:08.444220    2564 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 02 19:40:08.447221 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:08.447201    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-103.ec2.internal\" not found"
Jun 02 19:40:08.547850 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:08.547809    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-103.ec2.internal\" not found"
Jun 02 19:40:08.548021 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:08.547858    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jun 02 19:40:08.556801 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:08.556771    2564 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 02 19:40:08.564595 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:08.564562    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 19:35:07 +0000 UTC" deadline="2028-02-25 23:10:23.480201036 +0000 UTC"
Jun 02 19:40:08.564595 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:08.564594    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15195h30m14.915610074s"
Jun 02 19:40:08.579890 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:08.579869    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-g26ff"
Jun 02 19:40:08.587696 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:08.587679    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-g26ff"
Jun 02 19:40:08.642085 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:08.642055    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d5ef594b0a6f2e96051da648ad4a60d.slice/crio-20d5c23ea89547d655bdb99bc808596b64f3c2fcafd622f72c11bccfd2cc3783 WatchSource:0}: Error finding container 20d5c23ea89547d655bdb99bc808596b64f3c2fcafd622f72c11bccfd2cc3783: Status 404 returned error can't find the container with id 20d5c23ea89547d655bdb99bc808596b64f3c2fcafd622f72c11bccfd2cc3783
Jun 02 19:40:08.642330 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:08.642312    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc76f033802b2eea65908f7d0ca4e5989.slice/crio-3e74fc05537d6bf2a7dd98a3454908493cb68764c945a3de06b76532592c7148 WatchSource:0}: Error finding container 3e74fc05537d6bf2a7dd98a3454908493cb68764c945a3de06b76532592c7148: Status 404 returned error can't find the container with id 3e74fc05537d6bf2a7dd98a3454908493cb68764c945a3de06b76532592c7148
Jun 02 19:40:08.646627 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:08.646610    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 02 19:40:08.648299 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:08.648281    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-103.ec2.internal\" not found"
Jun 02 19:40:08.660922 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:08.660904    2564 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 02 19:40:08.748857 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:08.748813    2564 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-103.ec2.internal"
Jun 02 19:40:08.763266 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:08.763200    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 02 19:40:08.765165 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:08.765149    2564 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-103.ec2.internal"
Jun 02 19:40:08.773461 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:08.773446    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 02 19:40:08.900329 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:08.900305    2564 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 02 19:40:08.915924 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:08.915901    2564 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 02 19:40:09.425105 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.425078    2564 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 02 19:40:09.520994 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.520962    2564 apiserver.go:52] "Watching apiserver"
Jun 02 19:40:09.533015 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.532975    2564 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jun 02 19:40:09.533414 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.533375    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-bkv4t","openshift-multus/multus-additional-cni-plugins-wrvzk","openshift-multus/multus-zq5ll","openshift-ovn-kubernetes/ovnkube-node-79xzx","openshift-dns/node-resolver-4lnzn","openshift-image-registry/node-ca-2rvfs","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-103.ec2.internal","openshift-multus/network-metrics-daemon-xlffd","openshift-network-diagnostics/network-check-target-k5q95","openshift-network-operator/iptables-alerter-fgkb7","kube-system/konnectivity-agent-cxcr4","kube-system/kube-apiserver-proxy-ip-10-0-130-103.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhbgd"]
Jun 02 19:40:09.535955 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.535928    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlffd"
Jun 02 19:40:09.536072 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:09.536013    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xlffd" podUID="91837c0a-ed65-44e8-b6f4-461981ef22b2"
Jun 02 19:40:09.538636 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.538448    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wrvzk"
Jun 02 19:40:09.541292 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.541270    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cxcr4"
Jun 02 19:40:09.542086 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.541868    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jun 02 19:40:09.542086 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.541902    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jun 02 19:40:09.542086 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.541915    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jun 02 19:40:09.542086 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.541936    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gp5sq\""
Jun 02 19:40:09.542086 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.541873    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jun 02 19:40:09.542086 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.542030    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jun 02 19:40:09.543742 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.543419    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jun 02 19:40:09.544050 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.543823    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gglbn\""
Jun 02 19:40:09.544050 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.543970    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jun 02 19:40:09.545694 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.545672    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.547718 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.547698    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pfsp2\""
Jun 02 19:40:09.547964 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.547944    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jun 02 19:40:09.547964 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.547955    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5q95"
Jun 02 19:40:09.548076 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.547996    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jun 02 19:40:09.548076 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:09.548010    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k5q95" podUID="3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c"
Jun 02 19:40:09.550416 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.550222    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fgkb7"
Jun 02 19:40:09.550519 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.550427    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.552589 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.552570    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jun 02 19:40:09.552985 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.552966    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jun 02 19:40:09.553737 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.553719    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jun 02 19:40:09.553820 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.553773    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-n9stf\""
Jun 02 19:40:09.553904 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.553879    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jun 02 19:40:09.553958 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.553926    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jun 02 19:40:09.554076 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.554057    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jun 02 19:40:09.554076 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.554068    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jun 02 19:40:09.554236 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.554184    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jun 02 19:40:09.554308 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.554286    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kllr7\""
Jun 02 19:40:09.554308 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.554296    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2rvfs"
Jun 02 19:40:09.554513 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.554499    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jun 02 19:40:09.556937 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.556622    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4lnzn"
Jun 02 19:40:09.556937 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.556637    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-run-systemd\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.556937 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.556668    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-run-openvswitch\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.556937 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.556695    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/007be33d-35cf-421f-ac98-2a43194ee083-etc-sysconfig\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.556937 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.556717    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/007be33d-35cf-421f-ac98-2a43194ee083-etc-sysctl-conf\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.556937 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.556742    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lj6n\" (UniqueName: \"kubernetes.io/projected/23ffcdf5-086f-47b1-8e62-1963c8b8f21e-kube-api-access-5lj6n\") pod \"iptables-alerter-fgkb7\" (UID: \"23ffcdf5-086f-47b1-8e62-1963c8b8f21e\") " pod="openshift-network-operator/iptables-alerter-fgkb7"
Jun 02 19:40:09.556937 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.556767    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-systemd-units\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.556937 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.556792    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-etc-openvswitch\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.556937 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.556819    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/278707d7-17c9-4a6c-917e-1d2d056db08e-env-overrides\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.556937 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.556860    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq4tf\" (UniqueName: \"kubernetes.io/projected/278707d7-17c9-4a6c-917e-1d2d056db08e-kube-api-access-wq4tf\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.556937 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.556884    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91837c0a-ed65-44e8-b6f4-461981ef22b2-metrics-certs\") pod \"network-metrics-daemon-xlffd\" (UID: \"91837c0a-ed65-44e8-b6f4-461981ef22b2\") " pod="openshift-multus/network-metrics-daemon-xlffd"
Jun 02 19:40:09.556937 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.556906    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ce248b5e-f37f-4b11-b95d-5cef45bf2cba-konnectivity-ca\") pod \"konnectivity-agent-cxcr4\" (UID: \"ce248b5e-f37f-4b11-b95d-5cef45bf2cba\") " pod="kube-system/konnectivity-agent-cxcr4"
Jun 02 19:40:09.557604 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.556930    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/007be33d-35cf-421f-ac98-2a43194ee083-etc-systemd\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.557604 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.556957    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jun 02 19:40:09.557604 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.556974    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7b6cbcad-e6ac-4814-92f0-ab915efd8844-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wrvzk\" (UID: \"7b6cbcad-e6ac-4814-92f0-ab915efd8844\") " pod="openshift-multus/multus-additional-cni-plugins-wrvzk"
Jun 02 19:40:09.557604 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.556995    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gw8kh\""
Jun 02 19:40:09.557604 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.557009    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-run-ovn\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.557604 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.557034    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjnqk\" (UniqueName: \"kubernetes.io/projected/7b6cbcad-e6ac-4814-92f0-ab915efd8844-kube-api-access-sjnqk\") pod \"multus-additional-cni-plugins-wrvzk\" (UID: \"7b6cbcad-e6ac-4814-92f0-ab915efd8844\") " pod="openshift-multus/multus-additional-cni-plugins-wrvzk"
Jun 02 19:40:09.557604 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.557066    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/23ffcdf5-086f-47b1-8e62-1963c8b8f21e-host-slash\") pod \"iptables-alerter-fgkb7\" (UID: \"23ffcdf5-086f-47b1-8e62-1963c8b8f21e\") " pod="openshift-network-operator/iptables-alerter-fgkb7"
Jun 02 19:40:09.557604 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.557104    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7b6cbcad-e6ac-4814-92f0-ab915efd8844-system-cni-dir\") pod \"multus-additional-cni-plugins-wrvzk\" (UID: \"7b6cbcad-e6ac-4814-92f0-ab915efd8844\") " pod="openshift-multus/multus-additional-cni-plugins-wrvzk"
Jun 02 19:40:09.557604 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.557129    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7b6cbcad-e6ac-4814-92f0-ab915efd8844-os-release\") pod \"multus-additional-cni-plugins-wrvzk\" (UID: \"7b6cbcad-e6ac-4814-92f0-ab915efd8844\") " pod="openshift-multus/multus-additional-cni-plugins-wrvzk"
Jun 02 19:40:09.557604 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.557154    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.557604 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.557180    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7b6cbcad-e6ac-4814-92f0-ab915efd8844-cni-binary-copy\") pod \"multus-additional-cni-plugins-wrvzk\" (UID: \"7b6cbcad-e6ac-4814-92f0-ab915efd8844\") " pod="openshift-multus/multus-additional-cni-plugins-wrvzk"
Jun 02 19:40:09.557604 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.557206    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7b6cbcad-e6ac-4814-92f0-ab915efd8844-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wrvzk\" (UID: \"7b6cbcad-e6ac-4814-92f0-ab915efd8844\") " pod="openshift-multus/multus-additional-cni-plugins-wrvzk"
Jun 02 19:40:09.557604 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.557228    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-host-run-netns\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.557604 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.557241    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jun 02 19:40:09.557604 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.557253    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-node-log\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.557604 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.557282    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-log-socket\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.557604 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.557306    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-host-run-ovn-kubernetes\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.557604 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.557331    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-host-cni-bin\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.558525 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.557355    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/278707d7-17c9-4a6c-917e-1d2d056db08e-ovn-node-metrics-cert\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.558525 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.557375    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jun 02 19:40:09.558525 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.557380    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7b6cbcad-e6ac-4814-92f0-ab915efd8844-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wrvzk\" (UID: \"7b6cbcad-e6ac-4814-92f0-ab915efd8844\") " pod="openshift-multus/multus-additional-cni-plugins-wrvzk"
Jun 02 19:40:09.558525 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.557432    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-var-lib-openvswitch\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.558525 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.557463    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-host-cni-netd\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.558525 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.557494    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/007be33d-35cf-421f-ac98-2a43194ee083-lib-modules\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.558525 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.557560    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/007be33d-35cf-421f-ac98-2a43194ee083-var-lib-kubelet\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.558525 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.557582    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/007be33d-35cf-421f-ac98-2a43194ee083-host\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.558525 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.557631    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/007be33d-35cf-421f-ac98-2a43194ee083-etc-tuned\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.558525 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.557670    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-host-slash\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.558525 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.557704    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/278707d7-17c9-4a6c-917e-1d2d056db08e-ovnkube-script-lib\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.558525 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.557739    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh8jw\" (UniqueName: \"kubernetes.io/projected/91837c0a-ed65-44e8-b6f4-461981ef22b2-kube-api-access-fh8jw\") pod \"network-metrics-daemon-xlffd\" (UID: \"91837c0a-ed65-44e8-b6f4-461981ef22b2\") " pod="openshift-multus/network-metrics-daemon-xlffd"
Jun 02 19:40:09.558525 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.557762    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/007be33d-35cf-421f-ac98-2a43194ee083-etc-kubernetes\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.558525 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.557782    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/007be33d-35cf-421f-ac98-2a43194ee083-run\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.558525 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.557812    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn6rs\" (UniqueName: \"kubernetes.io/projected/3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c-kube-api-access-gn6rs\") pod \"network-check-target-k5q95\" (UID: \"3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c\") " pod="openshift-network-diagnostics/network-check-target-k5q95"
Jun 02 19:40:09.558525 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.557863    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-host-kubelet\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.558525 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.557930    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7b6cbcad-e6ac-4814-92f0-ab915efd8844-cnibin\") pod \"multus-additional-cni-plugins-wrvzk\" (UID: \"7b6cbcad-e6ac-4814-92f0-ab915efd8844\") " pod="openshift-multus/multus-additional-cni-plugins-wrvzk"
Jun 02 19:40:09.559373 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.557963    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/278707d7-17c9-4a6c-917e-1d2d056db08e-ovnkube-config\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.559373 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.557989    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ce248b5e-f37f-4b11-b95d-5cef45bf2cba-agent-certs\") pod \"konnectivity-agent-cxcr4\" (UID: \"ce248b5e-f37f-4b11-b95d-5cef45bf2cba\") " pod="kube-system/konnectivity-agent-cxcr4"
Jun 02 19:40:09.559373 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.558011    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/007be33d-35cf-421f-ac98-2a43194ee083-etc-sysctl-d\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.559373 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.558032    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/007be33d-35cf-421f-ac98-2a43194ee083-sys\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.559373 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.558056    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/23ffcdf5-086f-47b1-8e62-1963c8b8f21e-iptables-alerter-script\") pod \"iptables-alerter-fgkb7\" (UID: \"23ffcdf5-086f-47b1-8e62-1963c8b8f21e\") " pod="openshift-network-operator/iptables-alerter-fgkb7"
Jun 02 19:40:09.559373 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.558078    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/007be33d-35cf-421f-ac98-2a43194ee083-etc-modprobe-d\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.559373 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.558111    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/007be33d-35cf-421f-ac98-2a43194ee083-tmp\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.559373 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.558135    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46xrb\" (UniqueName: \"kubernetes.io/projected/007be33d-35cf-421f-ac98-2a43194ee083-kube-api-access-46xrb\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.559373 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.558572    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jun 02 19:40:09.560008 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.559539    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wkcq8\""
Jun 02 19:40:09.560067 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.560035    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.560151 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.560133    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jun 02 19:40:09.562370 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.562350    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhbgd"
Jun 02 19:40:09.562799 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.562771    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jun 02 19:40:09.562910 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.562875    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7hzdv\""
Jun 02 19:40:09.565277 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.565172    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jun 02 19:40:09.565277 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.565187    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jun 02 19:40:09.565417 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.565309    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ghpkn\""
Jun 02 19:40:09.565529 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.565513    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jun 02 19:40:09.588325 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.588288    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 19:35:08 +0000 UTC" deadline="2028-02-15 09:05:35.549915922 +0000 UTC"
Jun 02 19:40:09.588325 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.588317    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14941h25m25.961601941s"
Jun 02 19:40:09.645239 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.645195    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-103.ec2.internal" event={"ID":"3d5ef594b0a6f2e96051da648ad4a60d","Type":"ContainerStarted","Data":"20d5c23ea89547d655bdb99bc808596b64f3c2fcafd622f72c11bccfd2cc3783"}
Jun 02 19:40:09.646176 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.646154    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-103.ec2.internal" event={"ID":"c76f033802b2eea65908f7d0ca4e5989","Type":"ContainerStarted","Data":"3e74fc05537d6bf2a7dd98a3454908493cb68764c945a3de06b76532592c7148"}
Jun 02 19:40:09.650099 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.650079    2564 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
Jun 02 19:40:09.658568 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.658479    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ce248b5e-f37f-4b11-b95d-5cef45bf2cba-konnectivity-ca\") pod \"konnectivity-agent-cxcr4\" (UID: \"ce248b5e-f37f-4b11-b95d-5cef45bf2cba\") " pod="kube-system/konnectivity-agent-cxcr4"
Jun 02 19:40:09.658568 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.658520    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/007be33d-35cf-421f-ac98-2a43194ee083-etc-systemd\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.658568 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.658552    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-etc-kubernetes\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.658793 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.658580    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/712723c9-edc2-41d6-b805-2968f5a7a31b-registration-dir\") pod \"aws-ebs-csi-driver-node-xhbgd\" (UID: \"712723c9-edc2-41d6-b805-2968f5a7a31b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhbgd"
Jun 02 19:40:09.658793 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.658608    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/278707d7-17c9-4a6c-917e-1d2d056db08e-ovnkube-script-lib\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.658793 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.658620    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/007be33d-35cf-421f-ac98-2a43194ee083-etc-systemd\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.658793 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.658630    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/007be33d-35cf-421f-ac98-2a43194ee083-run\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.658793 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.658655    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.658793 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.658679    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-log-socket\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.658793 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.658703    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-host-run-ovn-kubernetes\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.658793 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.658714    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/007be33d-35cf-421f-ac98-2a43194ee083-run\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.658793 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.658726    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/278707d7-17c9-4a6c-917e-1d2d056db08e-ovn-node-metrics-cert\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.658793 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.658753    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-multus-socket-dir-parent\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.658793 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.658768    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-log-socket\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.658793 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.658779    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-host-var-lib-cni-bin\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.659383 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.658805    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-hostroot\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.659383 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.658812    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.659383 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.658831    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7b6cbcad-e6ac-4814-92f0-ab915efd8844-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wrvzk\" (UID: \"7b6cbcad-e6ac-4814-92f0-ab915efd8844\") " pod="openshift-multus/multus-additional-cni-plugins-wrvzk"
Jun 02 19:40:09.659383 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.658892    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-host-run-ovn-kubernetes\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.659383 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.658924    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-host-cni-netd\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.659383 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.658955    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-os-release\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.659383 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.658981    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-host-slash\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.659383 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.659006    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/830bda40-f0ea-4921-9555-49dd81e23f11-host\") pod \"node-ca-2rvfs\" (UID: \"830bda40-f0ea-4921-9555-49dd81e23f11\") " pod="openshift-image-registry/node-ca-2rvfs"
Jun 02 19:40:09.659383 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.659032    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r96b\" (UniqueName: \"kubernetes.io/projected/830bda40-f0ea-4921-9555-49dd81e23f11-kube-api-access-2r96b\") pod \"node-ca-2rvfs\" (UID: \"830bda40-f0ea-4921-9555-49dd81e23f11\") " pod="openshift-image-registry/node-ca-2rvfs"
Jun 02 19:40:09.659383 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.659057    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bcbb7e95-e1e4-4ebe-a7b8-460d29d57a26-hosts-file\") pod \"node-resolver-4lnzn\" (UID: \"bcbb7e95-e1e4-4ebe-a7b8-460d29d57a26\") " pod="openshift-dns/node-resolver-4lnzn"
Jun 02 19:40:09.659383 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.659082    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-host-run-netns\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.659383 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.659106    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/712723c9-edc2-41d6-b805-2968f5a7a31b-socket-dir\") pod \"aws-ebs-csi-driver-node-xhbgd\" (UID: \"712723c9-edc2-41d6-b805-2968f5a7a31b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhbgd"
Jun 02 19:40:09.659383 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.659134    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/278707d7-17c9-4a6c-917e-1d2d056db08e-ovnkube-config\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.659383 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.659159    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ce248b5e-f37f-4b11-b95d-5cef45bf2cba-konnectivity-ca\") pod \"konnectivity-agent-cxcr4\" (UID: \"ce248b5e-f37f-4b11-b95d-5cef45bf2cba\") " pod="kube-system/konnectivity-agent-cxcr4"
Jun 02 19:40:09.659383 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.659161    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/007be33d-35cf-421f-ac98-2a43194ee083-etc-sysctl-d\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.659383 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.659217    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/278707d7-17c9-4a6c-917e-1d2d056db08e-ovnkube-script-lib\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.659383 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.659265    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-host-cni-netd\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.660203 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.659285    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/007be33d-35cf-421f-ac98-2a43194ee083-etc-sysctl-d\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.660203 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.659385    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7b6cbcad-e6ac-4814-92f0-ab915efd8844-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wrvzk\" (UID: \"7b6cbcad-e6ac-4814-92f0-ab915efd8844\") " pod="openshift-multus/multus-additional-cni-plugins-wrvzk"
Jun 02 19:40:09.660203 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.659413    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/007be33d-35cf-421f-ac98-2a43194ee083-sys\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.660203 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.659413    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-host-slash\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.660203 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.659458    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcbb7e95-e1e4-4ebe-a7b8-460d29d57a26-tmp-dir\") pod \"node-resolver-4lnzn\" (UID: \"bcbb7e95-e1e4-4ebe-a7b8-460d29d57a26\") " pod="openshift-dns/node-resolver-4lnzn"
Jun 02 19:40:09.660203 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.659516    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/007be33d-35cf-421f-ac98-2a43194ee083-sys\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.660203 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.659534    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jun 02 19:40:09.660203 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.659570    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6vzx\" (UniqueName: \"kubernetes.io/projected/bcbb7e95-e1e4-4ebe-a7b8-460d29d57a26-kube-api-access-z6vzx\") pod \"node-resolver-4lnzn\" (UID: \"bcbb7e95-e1e4-4ebe-a7b8-460d29d57a26\") " pod="openshift-dns/node-resolver-4lnzn"
Jun 02 19:40:09.660203 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.659606    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/23ffcdf5-086f-47b1-8e62-1963c8b8f21e-iptables-alerter-script\") pod \"iptables-alerter-fgkb7\" (UID: \"23ffcdf5-086f-47b1-8e62-1963c8b8f21e\") " pod="openshift-network-operator/iptables-alerter-fgkb7"
Jun 02 19:40:09.660203 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.659644    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/007be33d-35cf-421f-ac98-2a43194ee083-etc-modprobe-d\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.660203 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.659712    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/007be33d-35cf-421f-ac98-2a43194ee083-tmp\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.660203 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.659750    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-cni-binary-copy\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.660203 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.659831    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/278707d7-17c9-4a6c-917e-1d2d056db08e-ovnkube-config\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.660203 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.659890    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-run-systemd\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.660203 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.659941    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/007be33d-35cf-421f-ac98-2a43194ee083-etc-modprobe-d\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.660203 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.659934    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-run-openvswitch\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.660203 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.659992    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-run-systemd\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.660203 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.660030    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/007be33d-35cf-421f-ac98-2a43194ee083-etc-sysconfig\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.661039 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.660060    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/007be33d-35cf-421f-ac98-2a43194ee083-var-lib-kubelet\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.661039 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.660087    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5lj6n\" (UniqueName: \"kubernetes.io/projected/23ffcdf5-086f-47b1-8e62-1963c8b8f21e-kube-api-access-5lj6n\") pod \"iptables-alerter-fgkb7\" (UID: \"23ffcdf5-086f-47b1-8e62-1963c8b8f21e\") " pod="openshift-network-operator/iptables-alerter-fgkb7"
Jun 02 19:40:09.661039 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.660095    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-run-openvswitch\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.661039 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.660140    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-systemd-units\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.661039 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.660158    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/23ffcdf5-086f-47b1-8e62-1963c8b8f21e-iptables-alerter-script\") pod \"iptables-alerter-fgkb7\" (UID: \"23ffcdf5-086f-47b1-8e62-1963c8b8f21e\") " pod="openshift-network-operator/iptables-alerter-fgkb7"
Jun 02 19:40:09.661039 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.660149    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/007be33d-35cf-421f-ac98-2a43194ee083-var-lib-kubelet\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.661039 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.660192    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-systemd-units\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.661039 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.660311    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/007be33d-35cf-421f-ac98-2a43194ee083-etc-sysconfig\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.661039 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.660342    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/278707d7-17c9-4a6c-917e-1d2d056db08e-env-overrides\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.661039 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.660368    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wq4tf\" (UniqueName: \"kubernetes.io/projected/278707d7-17c9-4a6c-917e-1d2d056db08e-kube-api-access-wq4tf\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.661039 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.660396    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-host-var-lib-kubelet\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.661039 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.660420    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/712723c9-edc2-41d6-b805-2968f5a7a31b-sys-fs\") pod \"aws-ebs-csi-driver-node-xhbgd\" (UID: \"712723c9-edc2-41d6-b805-2968f5a7a31b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhbgd"
Jun 02 19:40:09.661039 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.660676    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fh8jw\" (UniqueName: \"kubernetes.io/projected/91837c0a-ed65-44e8-b6f4-461981ef22b2-kube-api-access-fh8jw\") pod \"network-metrics-daemon-xlffd\" (UID: \"91837c0a-ed65-44e8-b6f4-461981ef22b2\") " pod="openshift-multus/network-metrics-daemon-xlffd"
Jun 02 19:40:09.661039 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.660711    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/007be33d-35cf-421f-ac98-2a43194ee083-etc-kubernetes\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.661039 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.660749    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/830bda40-f0ea-4921-9555-49dd81e23f11-serviceca\") pod \"node-ca-2rvfs\" (UID: \"830bda40-f0ea-4921-9555-49dd81e23f11\") " pod="openshift-image-registry/node-ca-2rvfs"
Jun 02 19:40:09.661039 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.660786    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/007be33d-35cf-421f-ac98-2a43194ee083-etc-kubernetes\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.661039 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.660797    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7b6cbcad-e6ac-4814-92f0-ab915efd8844-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wrvzk\" (UID: \"7b6cbcad-e6ac-4814-92f0-ab915efd8844\") " pod="openshift-multus/multus-additional-cni-plugins-wrvzk"
Jun 02 19:40:09.661800 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.660823    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-run-ovn\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.661800 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.660878    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sjnqk\" (UniqueName: \"kubernetes.io/projected/7b6cbcad-e6ac-4814-92f0-ab915efd8844-kube-api-access-sjnqk\") pod \"multus-additional-cni-plugins-wrvzk\" (UID: \"7b6cbcad-e6ac-4814-92f0-ab915efd8844\") " pod="openshift-multus/multus-additional-cni-plugins-wrvzk"
Jun 02 19:40:09.661800 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.660898    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-run-ovn\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.661800 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.660903    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/23ffcdf5-086f-47b1-8e62-1963c8b8f21e-host-slash\") pod \"iptables-alerter-fgkb7\" (UID: \"23ffcdf5-086f-47b1-8e62-1963c8b8f21e\") " pod="openshift-network-operator/iptables-alerter-fgkb7"
Jun 02 19:40:09.661800 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.660944    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7b6cbcad-e6ac-4814-92f0-ab915efd8844-cni-binary-copy\") pod \"multus-additional-cni-plugins-wrvzk\" (UID: \"7b6cbcad-e6ac-4814-92f0-ab915efd8844\") " pod="openshift-multus/multus-additional-cni-plugins-wrvzk"
Jun 02 19:40:09.661800 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.660979    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7b6cbcad-e6ac-4814-92f0-ab915efd8844-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wrvzk\" (UID: \"7b6cbcad-e6ac-4814-92f0-ab915efd8844\") " pod="openshift-multus/multus-additional-cni-plugins-wrvzk"
Jun 02 19:40:09.661800 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.660969    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7b6cbcad-e6ac-4814-92f0-ab915efd8844-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wrvzk\" (UID: \"7b6cbcad-e6ac-4814-92f0-ab915efd8844\") " pod="openshift-multus/multus-additional-cni-plugins-wrvzk"
Jun 02 19:40:09.661800 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661034    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-host-run-netns\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.661800 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661057    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-node-log\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.661800 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661082    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-host-cni-bin\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.661800 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661068    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/23ffcdf5-086f-47b1-8e62-1963c8b8f21e-host-slash\") pod \"iptables-alerter-fgkb7\" (UID: \"23ffcdf5-086f-47b1-8e62-1963c8b8f21e\") " pod="openshift-network-operator/iptables-alerter-fgkb7"
Jun 02 19:40:09.661800 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661106    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/007be33d-35cf-421f-ac98-2a43194ee083-lib-modules\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.661800 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661150    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-node-log\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.661800 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661157    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-host-cni-bin\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.661800 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661183    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7b6cbcad-e6ac-4814-92f0-ab915efd8844-system-cni-dir\") pod \"multus-additional-cni-plugins-wrvzk\" (UID: \"7b6cbcad-e6ac-4814-92f0-ab915efd8844\") " pod="openshift-multus/multus-additional-cni-plugins-wrvzk"
Jun 02 19:40:09.661800 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661216    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-host-run-netns\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.661800 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661205    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/007be33d-35cf-421f-ac98-2a43194ee083-lib-modules\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.662587 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661233    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7b6cbcad-e6ac-4814-92f0-ab915efd8844-os-release\") pod \"multus-additional-cni-plugins-wrvzk\" (UID: \"7b6cbcad-e6ac-4814-92f0-ab915efd8844\") " pod="openshift-multus/multus-additional-cni-plugins-wrvzk"
Jun 02 19:40:09.662587 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661238    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7b6cbcad-e6ac-4814-92f0-ab915efd8844-system-cni-dir\") pod \"multus-additional-cni-plugins-wrvzk\" (UID: \"7b6cbcad-e6ac-4814-92f0-ab915efd8844\") " pod="openshift-multus/multus-additional-cni-plugins-wrvzk"
Jun 02 19:40:09.662587 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661281    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-var-lib-openvswitch\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.662587 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661287    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7b6cbcad-e6ac-4814-92f0-ab915efd8844-os-release\") pod \"multus-additional-cni-plugins-wrvzk\" (UID: \"7b6cbcad-e6ac-4814-92f0-ab915efd8844\") " pod="openshift-multus/multus-additional-cni-plugins-wrvzk"
Jun 02 19:40:09.662587 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661306    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/007be33d-35cf-421f-ac98-2a43194ee083-etc-tuned\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.662587 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661327    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-var-lib-openvswitch\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.662587 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661367    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-multus-cni-dir\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.662587 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661391    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-cnibin\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.662587 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661433    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7b6cbcad-e6ac-4814-92f0-ab915efd8844-cni-binary-copy\") pod \"multus-additional-cni-plugins-wrvzk\" (UID: \"7b6cbcad-e6ac-4814-92f0-ab915efd8844\") " pod="openshift-multus/multus-additional-cni-plugins-wrvzk"
Jun 02 19:40:09.662587 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661463    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-host-run-k8s-cni-cncf-io\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.662587 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661492    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-host-var-lib-cni-multus\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.662587 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661514    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-multus-daemon-config\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.662587 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661536    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-host-run-multus-certs\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.662587 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661569    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7b6cbcad-e6ac-4814-92f0-ab915efd8844-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wrvzk\" (UID: \"7b6cbcad-e6ac-4814-92f0-ab915efd8844\") " pod="openshift-multus/multus-additional-cni-plugins-wrvzk"
Jun 02 19:40:09.662587 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661593    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gn6rs\" (UniqueName: \"kubernetes.io/projected/3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c-kube-api-access-gn6rs\") pod \"network-check-target-k5q95\" (UID: \"3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c\") " pod="openshift-network-diagnostics/network-check-target-k5q95"
Jun 02 19:40:09.662587 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661619    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-system-cni-dir\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.662587 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661644    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlmgt\" (UniqueName: \"kubernetes.io/projected/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-kube-api-access-vlmgt\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.663254 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661669    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bs8z\" (UniqueName: \"kubernetes.io/projected/712723c9-edc2-41d6-b805-2968f5a7a31b-kube-api-access-6bs8z\") pod \"aws-ebs-csi-driver-node-xhbgd\" (UID: \"712723c9-edc2-41d6-b805-2968f5a7a31b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhbgd"
Jun 02 19:40:09.663254 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661694    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-host-kubelet\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.663254 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661736    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7b6cbcad-e6ac-4814-92f0-ab915efd8844-cnibin\") pod \"multus-additional-cni-plugins-wrvzk\" (UID: \"7b6cbcad-e6ac-4814-92f0-ab915efd8844\") " pod="openshift-multus/multus-additional-cni-plugins-wrvzk"
Jun 02 19:40:09.663254 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661762    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ce248b5e-f37f-4b11-b95d-5cef45bf2cba-agent-certs\") pod \"konnectivity-agent-cxcr4\" (UID: \"ce248b5e-f37f-4b11-b95d-5cef45bf2cba\") " pod="kube-system/konnectivity-agent-cxcr4"
Jun 02 19:40:09.663254 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661786    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/712723c9-edc2-41d6-b805-2968f5a7a31b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xhbgd\" (UID: \"712723c9-edc2-41d6-b805-2968f5a7a31b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhbgd"
Jun 02 19:40:09.663254 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661812    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/712723c9-edc2-41d6-b805-2968f5a7a31b-device-dir\") pod \"aws-ebs-csi-driver-node-xhbgd\" (UID: \"712723c9-edc2-41d6-b805-2968f5a7a31b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhbgd"
Jun 02 19:40:09.663254 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661834    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7b6cbcad-e6ac-4814-92f0-ab915efd8844-cnibin\") pod \"multus-additional-cni-plugins-wrvzk\" (UID: \"7b6cbcad-e6ac-4814-92f0-ab915efd8844\") " pod="openshift-multus/multus-additional-cni-plugins-wrvzk"
Jun 02 19:40:09.663254 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661859    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-46xrb\" (UniqueName: \"kubernetes.io/projected/007be33d-35cf-421f-ac98-2a43194ee083-kube-api-access-46xrb\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.663254 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661900    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-multus-conf-dir\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.663254 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661929    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/712723c9-edc2-41d6-b805-2968f5a7a31b-etc-selinux\") pod \"aws-ebs-csi-driver-node-xhbgd\" (UID: \"712723c9-edc2-41d6-b805-2968f5a7a31b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhbgd"
Jun 02 19:40:09.663254 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661956    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/007be33d-35cf-421f-ac98-2a43194ee083-etc-sysctl-conf\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.663254 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.661979    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/007be33d-35cf-421f-ac98-2a43194ee083-host\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.663254 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.662002    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-etc-openvswitch\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.663254 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.662027    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91837c0a-ed65-44e8-b6f4-461981ef22b2-metrics-certs\") pod \"network-metrics-daemon-xlffd\" (UID: \"91837c0a-ed65-44e8-b6f4-461981ef22b2\") " pod="openshift-multus/network-metrics-daemon-xlffd"
Jun 02 19:40:09.663254 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:09.662160    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 19:40:09.663254 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:09.662246    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91837c0a-ed65-44e8-b6f4-461981ef22b2-metrics-certs podName:91837c0a-ed65-44e8-b6f4-461981ef22b2 nodeName:}" failed. No retries permitted until 2026-06-02 19:40:10.162214461 +0000 UTC m=+3.016634762 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/91837c0a-ed65-44e8-b6f4-461981ef22b2-metrics-certs") pod "network-metrics-daemon-xlffd" (UID: "91837c0a-ed65-44e8-b6f4-461981ef22b2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 19:40:09.663254 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.662291    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/007be33d-35cf-421f-ac98-2a43194ee083-etc-sysctl-conf\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.664001 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.662343    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-host-kubelet\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.664001 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.662349    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/007be33d-35cf-421f-ac98-2a43194ee083-host\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.664001 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.662390    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/278707d7-17c9-4a6c-917e-1d2d056db08e-etc-openvswitch\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.664001 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.662506    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/278707d7-17c9-4a6c-917e-1d2d056db08e-env-overrides\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.664001 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.663854    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/007be33d-35cf-421f-ac98-2a43194ee083-tmp\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.664240 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.664000    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/278707d7-17c9-4a6c-917e-1d2d056db08e-ovn-node-metrics-cert\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.664755 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.664729    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ce248b5e-f37f-4b11-b95d-5cef45bf2cba-agent-certs\") pod \"konnectivity-agent-cxcr4\" (UID: \"ce248b5e-f37f-4b11-b95d-5cef45bf2cba\") " pod="kube-system/konnectivity-agent-cxcr4"
Jun 02 19:40:09.664902 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.664884    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/007be33d-35cf-421f-ac98-2a43194ee083-etc-tuned\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.669549 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:09.669233    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 02 19:40:09.669549 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:09.669254    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 02 19:40:09.669549 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:09.669269    2564 projected.go:194] Error preparing data for projected volume kube-api-access-gn6rs for pod openshift-network-diagnostics/network-check-target-k5q95: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 19:40:09.669549 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:09.669341    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c-kube-api-access-gn6rs podName:3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c nodeName:}" failed. No retries permitted until 2026-06-02 19:40:10.169322955 +0000 UTC m=+3.023743246 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gn6rs" (UniqueName: "kubernetes.io/projected/3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c-kube-api-access-gn6rs") pod "network-check-target-k5q95" (UID: "3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 19:40:09.670450 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.670167    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjnqk\" (UniqueName: \"kubernetes.io/projected/7b6cbcad-e6ac-4814-92f0-ab915efd8844-kube-api-access-sjnqk\") pod \"multus-additional-cni-plugins-wrvzk\" (UID: \"7b6cbcad-e6ac-4814-92f0-ab915efd8844\") " pod="openshift-multus/multus-additional-cni-plugins-wrvzk"
Jun 02 19:40:09.670450 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.670244    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lj6n\" (UniqueName: \"kubernetes.io/projected/23ffcdf5-086f-47b1-8e62-1963c8b8f21e-kube-api-access-5lj6n\") pod \"iptables-alerter-fgkb7\" (UID: \"23ffcdf5-086f-47b1-8e62-1963c8b8f21e\") " pod="openshift-network-operator/iptables-alerter-fgkb7"
Jun 02 19:40:09.670450 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.670365    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh8jw\" (UniqueName: \"kubernetes.io/projected/91837c0a-ed65-44e8-b6f4-461981ef22b2-kube-api-access-fh8jw\") pod \"network-metrics-daemon-xlffd\" (UID: \"91837c0a-ed65-44e8-b6f4-461981ef22b2\") " pod="openshift-multus/network-metrics-daemon-xlffd"
Jun 02 19:40:09.671376 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.671336    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq4tf\" (UniqueName: \"kubernetes.io/projected/278707d7-17c9-4a6c-917e-1d2d056db08e-kube-api-access-wq4tf\") pod \"ovnkube-node-79xzx\" (UID: \"278707d7-17c9-4a6c-917e-1d2d056db08e\") " pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.672482 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.672454    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46xrb\" (UniqueName: \"kubernetes.io/projected/007be33d-35cf-421f-ac98-2a43194ee083-kube-api-access-46xrb\") pod \"tuned-bkv4t\" (UID: \"007be33d-35cf-421f-ac98-2a43194ee083\") " pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.763009 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.762927    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-etc-kubernetes\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.763009 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.762979    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/712723c9-edc2-41d6-b805-2968f5a7a31b-registration-dir\") pod \"aws-ebs-csi-driver-node-xhbgd\" (UID: \"712723c9-edc2-41d6-b805-2968f5a7a31b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhbgd"
Jun 02 19:40:09.763317 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.763287    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-multus-socket-dir-parent\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.763402 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.763347    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-host-var-lib-cni-bin\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.763402 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.763380    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-hostroot\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.763509 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.763405    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-etc-kubernetes\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.763509 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.763416    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-os-release\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.763509 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.763490    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/830bda40-f0ea-4921-9555-49dd81e23f11-host\") pod \"node-ca-2rvfs\" (UID: \"830bda40-f0ea-4921-9555-49dd81e23f11\") " pod="openshift-image-registry/node-ca-2rvfs"
Jun 02 19:40:09.763659 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.763527    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2r96b\" (UniqueName: \"kubernetes.io/projected/830bda40-f0ea-4921-9555-49dd81e23f11-kube-api-access-2r96b\") pod \"node-ca-2rvfs\" (UID: \"830bda40-f0ea-4921-9555-49dd81e23f11\") " pod="openshift-image-registry/node-ca-2rvfs"
Jun 02 19:40:09.763659 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.763544    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/712723c9-edc2-41d6-b805-2968f5a7a31b-registration-dir\") pod \"aws-ebs-csi-driver-node-xhbgd\" (UID: \"712723c9-edc2-41d6-b805-2968f5a7a31b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhbgd"
Jun 02 19:40:09.763659 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.763564    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bcbb7e95-e1e4-4ebe-a7b8-460d29d57a26-hosts-file\") pod \"node-resolver-4lnzn\" (UID: \"bcbb7e95-e1e4-4ebe-a7b8-460d29d57a26\") " pod="openshift-dns/node-resolver-4lnzn"
Jun 02 19:40:09.763659 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.763585    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-os-release\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.763659 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.763598    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-host-run-netns\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.763659 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.763643    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/712723c9-edc2-41d6-b805-2968f5a7a31b-socket-dir\") pod \"aws-ebs-csi-driver-node-xhbgd\" (UID: \"712723c9-edc2-41d6-b805-2968f5a7a31b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhbgd"
Jun 02 19:40:09.763981 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.763765    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-hostroot\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.763981 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.763819    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-host-run-netns\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.763981 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.763882    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/830bda40-f0ea-4921-9555-49dd81e23f11-host\") pod \"node-ca-2rvfs\" (UID: \"830bda40-f0ea-4921-9555-49dd81e23f11\") " pod="openshift-image-registry/node-ca-2rvfs"
Jun 02 19:40:09.764135 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.764079    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bcbb7e95-e1e4-4ebe-a7b8-460d29d57a26-hosts-file\") pod \"node-resolver-4lnzn\" (UID: \"bcbb7e95-e1e4-4ebe-a7b8-460d29d57a26\") " pod="openshift-dns/node-resolver-4lnzn"
Jun 02 19:40:09.767348 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.763647    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-host-var-lib-cni-bin\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.767348 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.764228    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/712723c9-edc2-41d6-b805-2968f5a7a31b-socket-dir\") pod \"aws-ebs-csi-driver-node-xhbgd\" (UID: \"712723c9-edc2-41d6-b805-2968f5a7a31b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhbgd"
Jun 02 19:40:09.767348 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.764253    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-multus-socket-dir-parent\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.767348 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.763686    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcbb7e95-e1e4-4ebe-a7b8-460d29d57a26-tmp-dir\") pod \"node-resolver-4lnzn\" (UID: \"bcbb7e95-e1e4-4ebe-a7b8-460d29d57a26\") " pod="openshift-dns/node-resolver-4lnzn"
Jun 02 19:40:09.767348 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.764402    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z6vzx\" (UniqueName: \"kubernetes.io/projected/bcbb7e95-e1e4-4ebe-a7b8-460d29d57a26-kube-api-access-z6vzx\") pod \"node-resolver-4lnzn\" (UID: \"bcbb7e95-e1e4-4ebe-a7b8-460d29d57a26\") " pod="openshift-dns/node-resolver-4lnzn"
Jun 02 19:40:09.767348 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.764445    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-cni-binary-copy\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.767348 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.764486    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-host-var-lib-kubelet\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.767348 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.764517    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/712723c9-edc2-41d6-b805-2968f5a7a31b-sys-fs\") pod \"aws-ebs-csi-driver-node-xhbgd\" (UID: \"712723c9-edc2-41d6-b805-2968f5a7a31b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhbgd"
Jun 02 19:40:09.767348 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.764549    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/830bda40-f0ea-4921-9555-49dd81e23f11-serviceca\") pod \"node-ca-2rvfs\" (UID: \"830bda40-f0ea-4921-9555-49dd81e23f11\") " pod="openshift-image-registry/node-ca-2rvfs"
Jun 02 19:40:09.767348 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.764591    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-multus-cni-dir\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.767348 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.764622    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-cnibin\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.767348 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.764660    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-host-run-k8s-cni-cncf-io\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.767348 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.764690    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-host-var-lib-cni-multus\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.767348 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.764725    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-multus-daemon-config\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.767348 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.764755    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-host-run-multus-certs\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.767348 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.764807    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-system-cni-dir\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.767348 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.764858    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vlmgt\" (UniqueName: \"kubernetes.io/projected/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-kube-api-access-vlmgt\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.767348 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.764887    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6bs8z\" (UniqueName: \"kubernetes.io/projected/712723c9-edc2-41d6-b805-2968f5a7a31b-kube-api-access-6bs8z\") pod \"aws-ebs-csi-driver-node-xhbgd\" (UID: \"712723c9-edc2-41d6-b805-2968f5a7a31b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhbgd"
Jun 02 19:40:09.768278 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.764926    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/712723c9-edc2-41d6-b805-2968f5a7a31b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xhbgd\" (UID: \"712723c9-edc2-41d6-b805-2968f5a7a31b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhbgd"
Jun 02 19:40:09.768278 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.764960    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/712723c9-edc2-41d6-b805-2968f5a7a31b-device-dir\") pod \"aws-ebs-csi-driver-node-xhbgd\" (UID: \"712723c9-edc2-41d6-b805-2968f5a7a31b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhbgd"
Jun 02 19:40:09.768278 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.764994    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-multus-conf-dir\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.768278 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.765028    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/712723c9-edc2-41d6-b805-2968f5a7a31b-etc-selinux\") pod \"aws-ebs-csi-driver-node-xhbgd\" (UID: \"712723c9-edc2-41d6-b805-2968f5a7a31b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhbgd"
Jun 02 19:40:09.768278 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.765088    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-cni-binary-copy\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.768278 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.765135    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/712723c9-edc2-41d6-b805-2968f5a7a31b-etc-selinux\") pod \"aws-ebs-csi-driver-node-xhbgd\" (UID: \"712723c9-edc2-41d6-b805-2968f5a7a31b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhbgd"
Jun 02 19:40:09.768278 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.765193    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-host-var-lib-kubelet\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.768278 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.765256    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/712723c9-edc2-41d6-b805-2968f5a7a31b-sys-fs\") pod \"aws-ebs-csi-driver-node-xhbgd\" (UID: \"712723c9-edc2-41d6-b805-2968f5a7a31b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhbgd"
Jun 02 19:40:09.768278 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.765394    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-host-run-multus-certs\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.768278 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.765473    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-multus-cni-dir\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.768278 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.765528    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-cnibin\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.768278 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.765582    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-host-run-k8s-cni-cncf-io\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.768278 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.765625    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-host-var-lib-cni-multus\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.768278 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.766125    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-multus-daemon-config\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.768278 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.766165    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/830bda40-f0ea-4921-9555-49dd81e23f11-serviceca\") pod \"node-ca-2rvfs\" (UID: \"830bda40-f0ea-4921-9555-49dd81e23f11\") " pod="openshift-image-registry/node-ca-2rvfs"
Jun 02 19:40:09.768278 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.766228    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/712723c9-edc2-41d6-b805-2968f5a7a31b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xhbgd\" (UID: \"712723c9-edc2-41d6-b805-2968f5a7a31b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhbgd"
Jun 02 19:40:09.768278 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.766291    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/712723c9-edc2-41d6-b805-2968f5a7a31b-device-dir\") pod \"aws-ebs-csi-driver-node-xhbgd\" (UID: \"712723c9-edc2-41d6-b805-2968f5a7a31b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhbgd"
Jun 02 19:40:09.768278 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.766344    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-multus-conf-dir\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.769097 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.766434    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-system-cni-dir\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.769097 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.767814    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcbb7e95-e1e4-4ebe-a7b8-460d29d57a26-tmp-dir\") pod \"node-resolver-4lnzn\" (UID: \"bcbb7e95-e1e4-4ebe-a7b8-460d29d57a26\") " pod="openshift-dns/node-resolver-4lnzn"
Jun 02 19:40:09.774128 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.774079    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6vzx\" (UniqueName: \"kubernetes.io/projected/bcbb7e95-e1e4-4ebe-a7b8-460d29d57a26-kube-api-access-z6vzx\") pod \"node-resolver-4lnzn\" (UID: \"bcbb7e95-e1e4-4ebe-a7b8-460d29d57a26\") " pod="openshift-dns/node-resolver-4lnzn"
Jun 02 19:40:09.774307 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.774284    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r96b\" (UniqueName: \"kubernetes.io/projected/830bda40-f0ea-4921-9555-49dd81e23f11-kube-api-access-2r96b\") pod \"node-ca-2rvfs\" (UID: \"830bda40-f0ea-4921-9555-49dd81e23f11\") " pod="openshift-image-registry/node-ca-2rvfs"
Jun 02 19:40:09.774668 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.774641    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bs8z\" (UniqueName: \"kubernetes.io/projected/712723c9-edc2-41d6-b805-2968f5a7a31b-kube-api-access-6bs8z\") pod \"aws-ebs-csi-driver-node-xhbgd\" (UID: \"712723c9-edc2-41d6-b805-2968f5a7a31b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhbgd"
Jun 02 19:40:09.775151 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.775126    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlmgt\" (UniqueName: \"kubernetes.io/projected/9e2ad36f-0e51-473d-ab0f-96a54ad90b41-kube-api-access-vlmgt\") pod \"multus-zq5ll\" (UID: \"9e2ad36f-0e51-473d-ab0f-96a54ad90b41\") " pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.853158 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.853120    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wrvzk"
Jun 02 19:40:09.863999 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.863973    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bkv4t"
Jun 02 19:40:09.873514 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.873491    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cxcr4"
Jun 02 19:40:09.879036 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.879016    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fgkb7"
Jun 02 19:40:09.886674 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.886653    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:09.894251 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.894234    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2rvfs"
Jun 02 19:40:09.900765 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.900744    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4lnzn"
Jun 02 19:40:09.909293 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.909274    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zq5ll"
Jun 02 19:40:09.912851 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:09.912817    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhbgd"
Jun 02 19:40:10.167869 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:10.167775    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91837c0a-ed65-44e8-b6f4-461981ef22b2-metrics-certs\") pod \"network-metrics-daemon-xlffd\" (UID: \"91837c0a-ed65-44e8-b6f4-461981ef22b2\") " pod="openshift-multus/network-metrics-daemon-xlffd"
Jun 02 19:40:10.168019 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:10.167959    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 19:40:10.168069 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:10.168028    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91837c0a-ed65-44e8-b6f4-461981ef22b2-metrics-certs podName:91837c0a-ed65-44e8-b6f4-461981ef22b2 nodeName:}" failed. No retries permitted until 2026-06-02 19:40:11.168010818 +0000 UTC m=+4.022431091 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/91837c0a-ed65-44e8-b6f4-461981ef22b2-metrics-certs") pod "network-metrics-daemon-xlffd" (UID: "91837c0a-ed65-44e8-b6f4-461981ef22b2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 19:40:10.268915 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:10.268882    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gn6rs\" (UniqueName: \"kubernetes.io/projected/3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c-kube-api-access-gn6rs\") pod \"network-check-target-k5q95\" (UID: \"3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c\") " pod="openshift-network-diagnostics/network-check-target-k5q95"
Jun 02 19:40:10.269057 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:10.269009    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 02 19:40:10.269057 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:10.269022    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 02 19:40:10.269057 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:10.269032    2564 projected.go:194] Error preparing data for projected volume kube-api-access-gn6rs for pod openshift-network-diagnostics/network-check-target-k5q95: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 19:40:10.269150 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:10.269081    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c-kube-api-access-gn6rs podName:3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c nodeName:}" failed. No retries permitted until 2026-06-02 19:40:11.269067346 +0000 UTC m=+4.123487623 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gn6rs" (UniqueName: "kubernetes.io/projected/3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c-kube-api-access-gn6rs") pod "network-check-target-k5q95" (UID: "3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 19:40:10.462241 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:10.462209    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod830bda40_f0ea_4921_9555_49dd81e23f11.slice/crio-9a94a38d0e067a1377ef7c15d917822f0fa27ad7128de57cc93fb45ed2fc3456 WatchSource:0}: Error finding container 9a94a38d0e067a1377ef7c15d917822f0fa27ad7128de57cc93fb45ed2fc3456: Status 404 returned error can't find the container with id 9a94a38d0e067a1377ef7c15d917822f0fa27ad7128de57cc93fb45ed2fc3456
Jun 02 19:40:10.464149 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:10.464127    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod007be33d_35cf_421f_ac98_2a43194ee083.slice/crio-bd650af19bee2ef924fb71943939b22a9ae38ba5e727992984cf6e4ef26985bd WatchSource:0}: Error finding container bd650af19bee2ef924fb71943939b22a9ae38ba5e727992984cf6e4ef26985bd: Status 404 returned error can't find the container with id bd650af19bee2ef924fb71943939b22a9ae38ba5e727992984cf6e4ef26985bd
Jun 02 19:40:10.470003 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:10.469981    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce248b5e_f37f_4b11_b95d_5cef45bf2cba.slice/crio-38eca17b0d24623d3fb82ecdb955cea0d7e782d77a785d41eede158b54c87569 WatchSource:0}: Error finding container 38eca17b0d24623d3fb82ecdb955cea0d7e782d77a785d41eede158b54c87569: Status 404 returned error can't find the container with id 38eca17b0d24623d3fb82ecdb955cea0d7e782d77a785d41eede158b54c87569
Jun 02 19:40:10.470739 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:10.470713    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b6cbcad_e6ac_4814_92f0_ab915efd8844.slice/crio-4717a039ccadebc2b5ec8e580354db26e1393f4a0d81f08271aba2c7af96b93e WatchSource:0}: Error finding container 4717a039ccadebc2b5ec8e580354db26e1393f4a0d81f08271aba2c7af96b93e: Status 404 returned error can't find the container with id 4717a039ccadebc2b5ec8e580354db26e1393f4a0d81f08271aba2c7af96b93e
Jun 02 19:40:10.471339 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:10.471322    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23ffcdf5_086f_47b1_8e62_1963c8b8f21e.slice/crio-20731cab0db06e1c091b1ecb9f961ef879d55254ff3aed39a0a1585c8855e2bb WatchSource:0}: Error finding container 20731cab0db06e1c091b1ecb9f961ef879d55254ff3aed39a0a1585c8855e2bb: Status 404 returned error can't find the container with id 20731cab0db06e1c091b1ecb9f961ef879d55254ff3aed39a0a1585c8855e2bb
Jun 02 19:40:10.493489 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:10.493463    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e2ad36f_0e51_473d_ab0f_96a54ad90b41.slice/crio-5a5438f9240cdd6764b2f842405d58844b878bae38b1603e8d7b5ba7ce208939 WatchSource:0}: Error finding container 5a5438f9240cdd6764b2f842405d58844b878bae38b1603e8d7b5ba7ce208939: Status 404 returned error can't find the container with id 5a5438f9240cdd6764b2f842405d58844b878bae38b1603e8d7b5ba7ce208939
Jun 02 19:40:10.494166 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:10.494129    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod712723c9_edc2_41d6_b805_2968f5a7a31b.slice/crio-249c32f9e12bed243165e5d02b5f0b0749b4400c943ccc08a85e770f7fd03e62 WatchSource:0}: Error finding container 249c32f9e12bed243165e5d02b5f0b0749b4400c943ccc08a85e770f7fd03e62: Status 404 returned error can't find the container with id 249c32f9e12bed243165e5d02b5f0b0749b4400c943ccc08a85e770f7fd03e62
Jun 02 19:40:10.495794 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:10.495740    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod278707d7_17c9_4a6c_917e_1d2d056db08e.slice/crio-188fba6b02d566f0dae68e30d4426bbef54e902fd8d61c135ee64ae8f4ac3db1 WatchSource:0}: Error finding container 188fba6b02d566f0dae68e30d4426bbef54e902fd8d61c135ee64ae8f4ac3db1: Status 404 returned error can't find the container with id 188fba6b02d566f0dae68e30d4426bbef54e902fd8d61c135ee64ae8f4ac3db1
Jun 02 19:40:10.497129 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:10.497103    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcbb7e95_e1e4_4ebe_a7b8_460d29d57a26.slice/crio-272af70b8dd8c174f0db203d4134c562b19763d60c84aeb3849be655d8db6640 WatchSource:0}: Error finding container 272af70b8dd8c174f0db203d4134c562b19763d60c84aeb3849be655d8db6640: Status 404 returned error can't find the container with id 272af70b8dd8c174f0db203d4134c562b19763d60c84aeb3849be655d8db6640
Jun 02 19:40:10.589291 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:10.589260    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 19:35:08 +0000 UTC" deadline="2027-12-05 16:14:29.361230637 +0000 UTC"
Jun 02 19:40:10.589291 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:10.589288    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13220h34m18.771944567s"
Jun 02 19:40:10.652953 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:10.652918    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4lnzn" event={"ID":"bcbb7e95-e1e4-4ebe-a7b8-460d29d57a26","Type":"ContainerStarted","Data":"272af70b8dd8c174f0db203d4134c562b19763d60c84aeb3849be655d8db6640"}
Jun 02 19:40:10.654831 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:10.654808    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wrvzk" event={"ID":"7b6cbcad-e6ac-4814-92f0-ab915efd8844","Type":"ContainerStarted","Data":"4717a039ccadebc2b5ec8e580354db26e1393f4a0d81f08271aba2c7af96b93e"}
Jun 02 19:40:10.658754 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:10.658730    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-79xzx" event={"ID":"278707d7-17c9-4a6c-917e-1d2d056db08e","Type":"ContainerStarted","Data":"188fba6b02d566f0dae68e30d4426bbef54e902fd8d61c135ee64ae8f4ac3db1"}
Jun 02 19:40:10.659648 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:10.659603    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhbgd" event={"ID":"712723c9-edc2-41d6-b805-2968f5a7a31b","Type":"ContainerStarted","Data":"249c32f9e12bed243165e5d02b5f0b0749b4400c943ccc08a85e770f7fd03e62"}
Jun 02 19:40:10.661268 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:10.661250    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fgkb7" event={"ID":"23ffcdf5-086f-47b1-8e62-1963c8b8f21e","Type":"ContainerStarted","Data":"20731cab0db06e1c091b1ecb9f961ef879d55254ff3aed39a0a1585c8855e2bb"}
Jun 02 19:40:10.662797 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:10.662774    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cxcr4" event={"ID":"ce248b5e-f37f-4b11-b95d-5cef45bf2cba","Type":"ContainerStarted","Data":"38eca17b0d24623d3fb82ecdb955cea0d7e782d77a785d41eede158b54c87569"}
Jun 02 19:40:10.664235 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:10.664215    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bkv4t" event={"ID":"007be33d-35cf-421f-ac98-2a43194ee083","Type":"ContainerStarted","Data":"bd650af19bee2ef924fb71943939b22a9ae38ba5e727992984cf6e4ef26985bd"}
Jun 02 19:40:10.665588 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:10.665570    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-103.ec2.internal" event={"ID":"3d5ef594b0a6f2e96051da648ad4a60d","Type":"ContainerStarted","Data":"3443913cbb5f01416897eabe0ed2c866e57267b66e288536dd87400d835870a9"}
Jun 02 19:40:10.666516 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:10.666497    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zq5ll" event={"ID":"9e2ad36f-0e51-473d-ab0f-96a54ad90b41","Type":"ContainerStarted","Data":"5a5438f9240cdd6764b2f842405d58844b878bae38b1603e8d7b5ba7ce208939"}
Jun 02 19:40:10.667550 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:10.667532    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2rvfs" event={"ID":"830bda40-f0ea-4921-9555-49dd81e23f11","Type":"ContainerStarted","Data":"9a94a38d0e067a1377ef7c15d917822f0fa27ad7128de57cc93fb45ed2fc3456"}
Jun 02 19:40:10.679412 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:10.679367    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-103.ec2.internal" podStartSLOduration=2.679352813 podStartE2EDuration="2.679352813s" podCreationTimestamp="2026-06-02 19:40:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:40:10.679045289 +0000 UTC m=+3.533465582" watchObservedRunningTime="2026-06-02 19:40:10.679352813 +0000 UTC m=+3.533773096"
Jun 02 19:40:11.173987 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:11.173899    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91837c0a-ed65-44e8-b6f4-461981ef22b2-metrics-certs\") pod \"network-metrics-daemon-xlffd\" (UID: \"91837c0a-ed65-44e8-b6f4-461981ef22b2\") " pod="openshift-multus/network-metrics-daemon-xlffd"
Jun 02 19:40:11.174156 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:11.174045    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 19:40:11.174156 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:11.174110    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91837c0a-ed65-44e8-b6f4-461981ef22b2-metrics-certs podName:91837c0a-ed65-44e8-b6f4-461981ef22b2 nodeName:}" failed. No retries permitted until 2026-06-02 19:40:13.174091971 +0000 UTC m=+6.028512259 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/91837c0a-ed65-44e8-b6f4-461981ef22b2-metrics-certs") pod "network-metrics-daemon-xlffd" (UID: "91837c0a-ed65-44e8-b6f4-461981ef22b2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 19:40:11.274829 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:11.274614    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gn6rs\" (UniqueName: \"kubernetes.io/projected/3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c-kube-api-access-gn6rs\") pod \"network-check-target-k5q95\" (UID: \"3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c\") " pod="openshift-network-diagnostics/network-check-target-k5q95"
Jun 02 19:40:11.274829 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:11.274782    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 02 19:40:11.274829 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:11.274804    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 02 19:40:11.274829 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:11.274817    2564 projected.go:194] Error preparing data for projected volume kube-api-access-gn6rs for pod openshift-network-diagnostics/network-check-target-k5q95: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 19:40:11.275343 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:11.274893    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c-kube-api-access-gn6rs podName:3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c nodeName:}" failed. No retries permitted until 2026-06-02 19:40:13.274874746 +0000 UTC m=+6.129295032 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gn6rs" (UniqueName: "kubernetes.io/projected/3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c-kube-api-access-gn6rs") pod "network-check-target-k5q95" (UID: "3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 19:40:11.643557 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:11.642997    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlffd"
Jun 02 19:40:11.643557 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:11.643135    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xlffd" podUID="91837c0a-ed65-44e8-b6f4-461981ef22b2"
Jun 02 19:40:11.644362 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:11.644183    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5q95"
Jun 02 19:40:11.644362 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:11.644282    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k5q95" podUID="3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c"
Jun 02 19:40:11.686779 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:11.686742    2564 generic.go:358] "Generic (PLEG): container finished" podID="c76f033802b2eea65908f7d0ca4e5989" containerID="86e9e9f310c78a473f3d5a8d05736239a4dbc2cd30304b470458b274d50ec717" exitCode=0
Jun 02 19:40:11.687548 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:11.687521    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-103.ec2.internal" event={"ID":"c76f033802b2eea65908f7d0ca4e5989","Type":"ContainerDied","Data":"86e9e9f310c78a473f3d5a8d05736239a4dbc2cd30304b470458b274d50ec717"}
Jun 02 19:40:12.703693 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:12.703653    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-103.ec2.internal" event={"ID":"c76f033802b2eea65908f7d0ca4e5989","Type":"ContainerStarted","Data":"abaecce24babf0670025ee4aa7488e8be24f0154e4e2cb6b66ca302230246328"}
Jun 02 19:40:13.197245 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:13.196603    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91837c0a-ed65-44e8-b6f4-461981ef22b2-metrics-certs\") pod \"network-metrics-daemon-xlffd\" (UID: \"91837c0a-ed65-44e8-b6f4-461981ef22b2\") " pod="openshift-multus/network-metrics-daemon-xlffd"
Jun 02 19:40:13.197245 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:13.196749    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 19:40:13.197245 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:13.196814    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91837c0a-ed65-44e8-b6f4-461981ef22b2-metrics-certs podName:91837c0a-ed65-44e8-b6f4-461981ef22b2 nodeName:}" failed. No retries permitted until 2026-06-02 19:40:17.196794195 +0000 UTC m=+10.051214468 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/91837c0a-ed65-44e8-b6f4-461981ef22b2-metrics-certs") pod "network-metrics-daemon-xlffd" (UID: "91837c0a-ed65-44e8-b6f4-461981ef22b2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 19:40:13.297404 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:13.297363    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gn6rs\" (UniqueName: \"kubernetes.io/projected/3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c-kube-api-access-gn6rs\") pod \"network-check-target-k5q95\" (UID: \"3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c\") " pod="openshift-network-diagnostics/network-check-target-k5q95"
Jun 02 19:40:13.297573 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:13.297522    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 02 19:40:13.297573 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:13.297545    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 02 19:40:13.297573 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:13.297558    2564 projected.go:194] Error preparing data for projected volume kube-api-access-gn6rs for pod openshift-network-diagnostics/network-check-target-k5q95: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 19:40:13.297729 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:13.297620    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c-kube-api-access-gn6rs podName:3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c nodeName:}" failed. No retries permitted until 2026-06-02 19:40:17.297600848 +0000 UTC m=+10.152021141 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gn6rs" (UniqueName: "kubernetes.io/projected/3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c-kube-api-access-gn6rs") pod "network-check-target-k5q95" (UID: "3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 19:40:13.642401 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:13.642333    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5q95"
Jun 02 19:40:13.642546 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:13.642345    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlffd"
Jun 02 19:40:13.642546 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:13.642460    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k5q95" podUID="3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c"
Jun 02 19:40:13.642662 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:13.642542    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xlffd" podUID="91837c0a-ed65-44e8-b6f4-461981ef22b2"
Jun 02 19:40:15.642687 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:15.642652    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5q95"
Jun 02 19:40:15.643142 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:15.642652    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlffd"
Jun 02 19:40:15.643142 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:15.642781    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k5q95" podUID="3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c"
Jun 02 19:40:15.643142 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:15.642923    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xlffd" podUID="91837c0a-ed65-44e8-b6f4-461981ef22b2"
Jun 02 19:40:16.576199 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:16.576139    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-103.ec2.internal" podStartSLOduration=8.576116322 podStartE2EDuration="8.576116322s" podCreationTimestamp="2026-06-02 19:40:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:40:12.720576648 +0000 UTC m=+5.574996942" watchObservedRunningTime="2026-06-02 19:40:16.576116322 +0000 UTC m=+9.430536616"
Jun 02 19:40:16.576755 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:16.576728    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-pn7k7"]
Jun 02 19:40:16.583591 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:16.583572    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn7k7"
Jun 02 19:40:16.583712 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:16.583656    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn7k7" podUID="382834b8-2464-4874-b852-66124dc7ddab"
Jun 02 19:40:16.621907 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:16.621877    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/382834b8-2464-4874-b852-66124dc7ddab-original-pull-secret\") pod \"global-pull-secret-syncer-pn7k7\" (UID: \"382834b8-2464-4874-b852-66124dc7ddab\") " pod="kube-system/global-pull-secret-syncer-pn7k7"
Jun 02 19:40:16.622076 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:16.621920    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/382834b8-2464-4874-b852-66124dc7ddab-dbus\") pod \"global-pull-secret-syncer-pn7k7\" (UID: \"382834b8-2464-4874-b852-66124dc7ddab\") " pod="kube-system/global-pull-secret-syncer-pn7k7"
Jun 02 19:40:16.622076 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:16.621998    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/382834b8-2464-4874-b852-66124dc7ddab-kubelet-config\") pod \"global-pull-secret-syncer-pn7k7\" (UID: \"382834b8-2464-4874-b852-66124dc7ddab\") " pod="kube-system/global-pull-secret-syncer-pn7k7"
Jun 02 19:40:16.722830 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:16.722788    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/382834b8-2464-4874-b852-66124dc7ddab-kubelet-config\") pod \"global-pull-secret-syncer-pn7k7\" (UID: \"382834b8-2464-4874-b852-66124dc7ddab\") " pod="kube-system/global-pull-secret-syncer-pn7k7"
Jun 02 19:40:16.723269 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:16.722892    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/382834b8-2464-4874-b852-66124dc7ddab-original-pull-secret\") pod \"global-pull-secret-syncer-pn7k7\" (UID: \"382834b8-2464-4874-b852-66124dc7ddab\") " pod="kube-system/global-pull-secret-syncer-pn7k7"
Jun 02 19:40:16.723269 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:16.722923    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/382834b8-2464-4874-b852-66124dc7ddab-dbus\") pod \"global-pull-secret-syncer-pn7k7\" (UID: \"382834b8-2464-4874-b852-66124dc7ddab\") " pod="kube-system/global-pull-secret-syncer-pn7k7"
Jun 02 19:40:16.723269 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:16.723156    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/382834b8-2464-4874-b852-66124dc7ddab-dbus\") pod \"global-pull-secret-syncer-pn7k7\" (UID: \"382834b8-2464-4874-b852-66124dc7ddab\") " pod="kube-system/global-pull-secret-syncer-pn7k7"
Jun 02 19:40:16.723269 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:16.723219    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/382834b8-2464-4874-b852-66124dc7ddab-kubelet-config\") pod \"global-pull-secret-syncer-pn7k7\" (UID: \"382834b8-2464-4874-b852-66124dc7ddab\") " pod="kube-system/global-pull-secret-syncer-pn7k7"
Jun 02 19:40:16.723509 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:16.723310    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 02 19:40:16.723509 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:16.723390    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/382834b8-2464-4874-b852-66124dc7ddab-original-pull-secret podName:382834b8-2464-4874-b852-66124dc7ddab nodeName:}" failed. No retries permitted until 2026-06-02 19:40:17.223370701 +0000 UTC m=+10.077790974 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/382834b8-2464-4874-b852-66124dc7ddab-original-pull-secret") pod "global-pull-secret-syncer-pn7k7" (UID: "382834b8-2464-4874-b852-66124dc7ddab") : object "kube-system"/"original-pull-secret" not registered
Jun 02 19:40:17.226400 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:17.226288    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/382834b8-2464-4874-b852-66124dc7ddab-original-pull-secret\") pod \"global-pull-secret-syncer-pn7k7\" (UID: \"382834b8-2464-4874-b852-66124dc7ddab\") " pod="kube-system/global-pull-secret-syncer-pn7k7"
Jun 02 19:40:17.226400 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:17.226349    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91837c0a-ed65-44e8-b6f4-461981ef22b2-metrics-certs\") pod \"network-metrics-daemon-xlffd\" (UID: \"91837c0a-ed65-44e8-b6f4-461981ef22b2\") " pod="openshift-multus/network-metrics-daemon-xlffd"
Jun 02 19:40:17.226657 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:17.226465    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 02 19:40:17.226657 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:17.226543    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/382834b8-2464-4874-b852-66124dc7ddab-original-pull-secret podName:382834b8-2464-4874-b852-66124dc7ddab nodeName:}" failed. No retries permitted until 2026-06-02 19:40:18.226521855 +0000 UTC m=+11.080942151 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/382834b8-2464-4874-b852-66124dc7ddab-original-pull-secret") pod "global-pull-secret-syncer-pn7k7" (UID: "382834b8-2464-4874-b852-66124dc7ddab") : object "kube-system"/"original-pull-secret" not registered
Jun 02 19:40:17.226657 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:17.226475    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 19:40:17.226808 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:17.226669    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91837c0a-ed65-44e8-b6f4-461981ef22b2-metrics-certs podName:91837c0a-ed65-44e8-b6f4-461981ef22b2 nodeName:}" failed. No retries permitted until 2026-06-02 19:40:25.226646838 +0000 UTC m=+18.081067111 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/91837c0a-ed65-44e8-b6f4-461981ef22b2-metrics-certs") pod "network-metrics-daemon-xlffd" (UID: "91837c0a-ed65-44e8-b6f4-461981ef22b2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 19:40:17.327058 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:17.327020    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gn6rs\" (UniqueName: \"kubernetes.io/projected/3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c-kube-api-access-gn6rs\") pod \"network-check-target-k5q95\" (UID: \"3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c\") " pod="openshift-network-diagnostics/network-check-target-k5q95"
Jun 02 19:40:17.327254 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:17.327223    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 02 19:40:17.327254 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:17.327242    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 02 19:40:17.327379 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:17.327267    2564 projected.go:194] Error preparing data for projected volume kube-api-access-gn6rs for pod openshift-network-diagnostics/network-check-target-k5q95: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 19:40:17.327379 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:17.327326    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c-kube-api-access-gn6rs podName:3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c nodeName:}" failed. No retries permitted until 2026-06-02 19:40:25.327308213 +0000 UTC m=+18.181728487 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gn6rs" (UniqueName: "kubernetes.io/projected/3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c-kube-api-access-gn6rs") pod "network-check-target-k5q95" (UID: "3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 19:40:17.644381 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:17.644302    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlffd"
Jun 02 19:40:17.644517 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:17.644430    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xlffd" podUID="91837c0a-ed65-44e8-b6f4-461981ef22b2"
Jun 02 19:40:17.644517 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:17.644467    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5q95"
Jun 02 19:40:17.644601 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:17.644534    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k5q95" podUID="3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c"
Jun 02 19:40:18.233719 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:18.233683    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/382834b8-2464-4874-b852-66124dc7ddab-original-pull-secret\") pod \"global-pull-secret-syncer-pn7k7\" (UID: \"382834b8-2464-4874-b852-66124dc7ddab\") " pod="kube-system/global-pull-secret-syncer-pn7k7"
Jun 02 19:40:18.234207 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:18.233869    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 02 19:40:18.234207 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:18.233938    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/382834b8-2464-4874-b852-66124dc7ddab-original-pull-secret podName:382834b8-2464-4874-b852-66124dc7ddab nodeName:}" failed. No retries permitted until 2026-06-02 19:40:20.233919506 +0000 UTC m=+13.088339790 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/382834b8-2464-4874-b852-66124dc7ddab-original-pull-secret") pod "global-pull-secret-syncer-pn7k7" (UID: "382834b8-2464-4874-b852-66124dc7ddab") : object "kube-system"/"original-pull-secret" not registered
Jun 02 19:40:18.642011 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:18.641921    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn7k7"
Jun 02 19:40:18.642175 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:18.642057    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn7k7" podUID="382834b8-2464-4874-b852-66124dc7ddab"
Jun 02 19:40:19.642804 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:19.642766    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlffd"
Jun 02 19:40:19.643177 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:19.642953    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xlffd" podUID="91837c0a-ed65-44e8-b6f4-461981ef22b2"
Jun 02 19:40:19.643753 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:19.643731    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5q95"
Jun 02 19:40:19.643873 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:19.643834    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k5q95" podUID="3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c"
Jun 02 19:40:20.249208 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:20.249173    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/382834b8-2464-4874-b852-66124dc7ddab-original-pull-secret\") pod \"global-pull-secret-syncer-pn7k7\" (UID: \"382834b8-2464-4874-b852-66124dc7ddab\") " pod="kube-system/global-pull-secret-syncer-pn7k7"
Jun 02 19:40:20.249353 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:20.249337    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 02 19:40:20.249418 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:20.249399    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/382834b8-2464-4874-b852-66124dc7ddab-original-pull-secret podName:382834b8-2464-4874-b852-66124dc7ddab nodeName:}" failed. No retries permitted until 2026-06-02 19:40:24.249382524 +0000 UTC m=+17.103802812 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/382834b8-2464-4874-b852-66124dc7ddab-original-pull-secret") pod "global-pull-secret-syncer-pn7k7" (UID: "382834b8-2464-4874-b852-66124dc7ddab") : object "kube-system"/"original-pull-secret" not registered
Jun 02 19:40:20.643054 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:20.642816    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn7k7"
Jun 02 19:40:20.643772 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:20.643157    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn7k7" podUID="382834b8-2464-4874-b852-66124dc7ddab"
Jun 02 19:40:20.719889 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:20.719782    2564 generic.go:358] "Generic (PLEG): container finished" podID="7b6cbcad-e6ac-4814-92f0-ab915efd8844" containerID="0578094b5472147df8ea99968b3e2c1c91e683f8fb8f6ac0c737fb396fad4296" exitCode=0
Jun 02 19:40:20.720029 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:20.719884    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wrvzk" event={"ID":"7b6cbcad-e6ac-4814-92f0-ab915efd8844","Type":"ContainerDied","Data":"0578094b5472147df8ea99968b3e2c1c91e683f8fb8f6ac0c737fb396fad4296"}
Jun 02 19:40:20.721492 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:20.721410    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhbgd" event={"ID":"712723c9-edc2-41d6-b805-2968f5a7a31b","Type":"ContainerStarted","Data":"d168978252900abc0ec3612bea2d74d3681b37f5d663c3f8d7e05e54e5b6929f"}
Jun 02 19:40:20.723398 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:20.723371    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cxcr4" event={"ID":"ce248b5e-f37f-4b11-b95d-5cef45bf2cba","Type":"ContainerStarted","Data":"4f58ae97978e1fb426e86e99f85ee73569241544e3f91fcb732b37b4273bdd70"}
Jun 02 19:40:20.725031 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:20.724977    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bkv4t" event={"ID":"007be33d-35cf-421f-ac98-2a43194ee083","Type":"ContainerStarted","Data":"3ff1680853c98c107f28a74592496b0ec05cf2368bf463eb08771e1a6ee79d4f"}
Jun 02 19:40:20.726762 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:20.726739    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2rvfs" event={"ID":"830bda40-f0ea-4921-9555-49dd81e23f11","Type":"ContainerStarted","Data":"e2f5f29a22bcec3986c20a97c2a03c2cb88250d35640100a99e828e3f3b60c44"}
Jun 02 19:40:20.728219 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:20.728189    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4lnzn" event={"ID":"bcbb7e95-e1e4-4ebe-a7b8-460d29d57a26","Type":"ContainerStarted","Data":"87aea3077b7b732254264fc0f83a3cf28c4db9239da8de54ff3544afeae9ae64"}
Jun 02 19:40:20.753798 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:20.753730    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cxcr4" podStartSLOduration=4.041776657 podStartE2EDuration="13.753713193s" podCreationTimestamp="2026-06-02 19:40:07 +0000 UTC" firstStartedPulling="2026-06-02 19:40:10.492311755 +0000 UTC m=+3.346732026" lastFinishedPulling="2026-06-02 19:40:20.204248273 +0000 UTC m=+13.058668562" observedRunningTime="2026-06-02 19:40:20.75370419 +0000 UTC m=+13.608124485" watchObservedRunningTime="2026-06-02 19:40:20.753713193 +0000 UTC m=+13.608133489"
Jun 02 19:40:20.765290 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:20.765240    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2rvfs" podStartSLOduration=3.025236906 podStartE2EDuration="12.765224249s" podCreationTimestamp="2026-06-02 19:40:08 +0000 UTC" firstStartedPulling="2026-06-02 19:40:10.466452413 +0000 UTC m=+3.320872696" lastFinishedPulling="2026-06-02 19:40:20.206439754 +0000 UTC m=+13.060860039" observedRunningTime="2026-06-02 19:40:20.764859003 +0000 UTC m=+13.619279302" watchObservedRunningTime="2026-06-02 19:40:20.765224249 +0000 UTC m=+13.619644543"
Jun 02 19:40:20.777229 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:20.777183    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-4lnzn" podStartSLOduration=3.060222005 podStartE2EDuration="12.777165972s" podCreationTimestamp="2026-06-02 19:40:08 +0000 UTC" firstStartedPulling="2026-06-02 19:40:10.500077154 +0000 UTC m=+3.354497439" lastFinishedPulling="2026-06-02 19:40:20.217021128 +0000 UTC m=+13.071441406" observedRunningTime="2026-06-02 19:40:20.776357222 +0000 UTC m=+13.630777517" watchObservedRunningTime="2026-06-02 19:40:20.777165972 +0000 UTC m=+13.631586268"
Jun 02 19:40:20.789847 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:20.789802    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bkv4t" podStartSLOduration=4.009118602 podStartE2EDuration="13.789792911s" podCreationTimestamp="2026-06-02 19:40:07 +0000 UTC" firstStartedPulling="2026-06-02 19:40:10.468866803 +0000 UTC m=+3.323287077" lastFinishedPulling="2026-06-02 19:40:20.249541112 +0000 UTC m=+13.103961386" observedRunningTime="2026-06-02 19:40:20.789410727 +0000 UTC m=+13.643831020" watchObservedRunningTime="2026-06-02 19:40:20.789792911 +0000 UTC m=+13.644213203"
Jun 02 19:40:21.642545 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:21.642517    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5q95"
Jun 02 19:40:21.642674 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:21.642637    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k5q95" podUID="3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c"
Jun 02 19:40:21.642742 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:21.642664    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlffd"
Jun 02 19:40:21.642826 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:21.642803    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xlffd" podUID="91837c0a-ed65-44e8-b6f4-461981ef22b2"
Jun 02 19:40:21.731943 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:21.731893    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fgkb7" event={"ID":"23ffcdf5-086f-47b1-8e62-1963c8b8f21e","Type":"ContainerStarted","Data":"7fa93bad979950474960b1e7f5abad5f421801a7c54270593e356aa47911e994"}
Jun 02 19:40:21.745542 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:21.745497    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fgkb7" podStartSLOduration=5.024976297 podStartE2EDuration="14.745484911s" podCreationTimestamp="2026-06-02 19:40:07 +0000 UTC" firstStartedPulling="2026-06-02 19:40:10.492366954 +0000 UTC m=+3.346787237" lastFinishedPulling="2026-06-02 19:40:20.212875572 +0000 UTC m=+13.067295851" observedRunningTime="2026-06-02 19:40:21.745426175 +0000 UTC m=+14.599846469" watchObservedRunningTime="2026-06-02 19:40:21.745484911 +0000 UTC m=+14.599905203"
Jun 02 19:40:22.524918 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:22.524881    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cxcr4"
Jun 02 19:40:22.525696 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:22.525678    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cxcr4"
Jun 02 19:40:22.642478 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:22.642450    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn7k7"
Jun 02 19:40:22.642626 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:22.642573    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn7k7" podUID="382834b8-2464-4874-b852-66124dc7ddab"
Jun 02 19:40:22.733921 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:22.733874    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cxcr4"
Jun 02 19:40:22.734367 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:22.734144    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cxcr4"
Jun 02 19:40:23.642555 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:23.642518    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlffd"
Jun 02 19:40:23.642722 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:23.642528    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5q95"
Jun 02 19:40:23.642722 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:23.642664    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xlffd" podUID="91837c0a-ed65-44e8-b6f4-461981ef22b2"
Jun 02 19:40:23.642859 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:23.642726    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k5q95" podUID="3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c"
Jun 02 19:40:24.283256 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:24.283038    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/382834b8-2464-4874-b852-66124dc7ddab-original-pull-secret\") pod \"global-pull-secret-syncer-pn7k7\" (UID: \"382834b8-2464-4874-b852-66124dc7ddab\") " pod="kube-system/global-pull-secret-syncer-pn7k7"
Jun 02 19:40:24.283714 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:24.283167    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 02 19:40:24.283714 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:24.283367    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/382834b8-2464-4874-b852-66124dc7ddab-original-pull-secret podName:382834b8-2464-4874-b852-66124dc7ddab nodeName:}" failed. No retries permitted until 2026-06-02 19:40:32.283340809 +0000 UTC m=+25.137761096 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/382834b8-2464-4874-b852-66124dc7ddab-original-pull-secret") pod "global-pull-secret-syncer-pn7k7" (UID: "382834b8-2464-4874-b852-66124dc7ddab") : object "kube-system"/"original-pull-secret" not registered
Jun 02 19:40:24.642020 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:24.641919    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn7k7"
Jun 02 19:40:24.642166 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:24.642017    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn7k7" podUID="382834b8-2464-4874-b852-66124dc7ddab"
Jun 02 19:40:25.289492 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:25.289451    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91837c0a-ed65-44e8-b6f4-461981ef22b2-metrics-certs\") pod \"network-metrics-daemon-xlffd\" (UID: \"91837c0a-ed65-44e8-b6f4-461981ef22b2\") " pod="openshift-multus/network-metrics-daemon-xlffd"
Jun 02 19:40:25.289954 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:25.289561    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 19:40:25.289954 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:25.289635    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91837c0a-ed65-44e8-b6f4-461981ef22b2-metrics-certs podName:91837c0a-ed65-44e8-b6f4-461981ef22b2 nodeName:}" failed. No retries permitted until 2026-06-02 19:40:41.289612771 +0000 UTC m=+34.144033047 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/91837c0a-ed65-44e8-b6f4-461981ef22b2-metrics-certs") pod "network-metrics-daemon-xlffd" (UID: "91837c0a-ed65-44e8-b6f4-461981ef22b2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 19:40:25.390136 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:25.390102    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gn6rs\" (UniqueName: \"kubernetes.io/projected/3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c-kube-api-access-gn6rs\") pod \"network-check-target-k5q95\" (UID: \"3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c\") " pod="openshift-network-diagnostics/network-check-target-k5q95"
Jun 02 19:40:25.390322 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:25.390259    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 02 19:40:25.390322 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:25.390280    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 02 19:40:25.390322 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:25.390292    2564 projected.go:194] Error preparing data for projected volume kube-api-access-gn6rs for pod openshift-network-diagnostics/network-check-target-k5q95: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 19:40:25.390468 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:25.390352    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c-kube-api-access-gn6rs podName:3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c nodeName:}" failed. No retries permitted until 2026-06-02 19:40:41.39033478 +0000 UTC m=+34.244755054 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gn6rs" (UniqueName: "kubernetes.io/projected/3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c-kube-api-access-gn6rs") pod "network-check-target-k5q95" (UID: "3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 19:40:25.642107 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:25.642032    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlffd"
Jun 02 19:40:25.642236 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:25.642172    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xlffd" podUID="91837c0a-ed65-44e8-b6f4-461981ef22b2"
Jun 02 19:40:25.642668 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:25.642646    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5q95"
Jun 02 19:40:25.642800 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:25.642734    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k5q95" podUID="3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c"
Jun 02 19:40:26.642422 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:26.642390    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn7k7"
Jun 02 19:40:26.642972 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:26.642518    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn7k7" podUID="382834b8-2464-4874-b852-66124dc7ddab"
Jun 02 19:40:27.643005 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:27.642976    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlffd"
Jun 02 19:40:27.643463 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:27.643028    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5q95"
Jun 02 19:40:27.643463 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:27.643232    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xlffd" podUID="91837c0a-ed65-44e8-b6f4-461981ef22b2"
Jun 02 19:40:27.643611 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:27.643508    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k5q95" podUID="3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c"
Jun 02 19:40:28.642134 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:28.642101    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn7k7"
Jun 02 19:40:28.642273 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:28.642204    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn7k7" podUID="382834b8-2464-4874-b852-66124dc7ddab"
Jun 02 19:40:29.642104 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:29.642025    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlffd"
Jun 02 19:40:29.642104 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:29.642070    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5q95"
Jun 02 19:40:29.642631 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:29.642161    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xlffd" podUID="91837c0a-ed65-44e8-b6f4-461981ef22b2"
Jun 02 19:40:29.642631 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:29.642297    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k5q95" podUID="3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c"
Jun 02 19:40:30.642600 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:30.642565    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn7k7"
Jun 02 19:40:30.643083 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:30.642696    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn7k7" podUID="382834b8-2464-4874-b852-66124dc7ddab"
Jun 02 19:40:31.162062 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:31.162036    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jun 02 19:40:31.628020 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:31.627703    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T19:40:31.162058049Z","UUID":"fe1c3002-4c77-4ca4-a1e3-e6ec54797c27","Handler":null,"Name":"","Endpoint":""}
Jun 02 19:40:31.630494 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:31.630476    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jun 02 19:40:31.630598 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:31.630500    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jun 02 19:40:31.644690 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:31.644672    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5q95"
Jun 02 19:40:31.644690 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:31.644679    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlffd"
Jun 02 19:40:31.645199 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:31.644754    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k5q95" podUID="3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c"
Jun 02 19:40:31.645199 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:31.644899    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xlffd" podUID="91837c0a-ed65-44e8-b6f4-461981ef22b2"
Jun 02 19:40:31.749748 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:31.749716    2564 generic.go:358] "Generic (PLEG): container finished" podID="7b6cbcad-e6ac-4814-92f0-ab915efd8844" containerID="de1b6deecd78554e0bcec63d7f2595d007156ed95b132fb239a1ee106e172497" exitCode=0
Jun 02 19:40:31.749910 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:31.749793    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wrvzk" event={"ID":"7b6cbcad-e6ac-4814-92f0-ab915efd8844","Type":"ContainerDied","Data":"de1b6deecd78554e0bcec63d7f2595d007156ed95b132fb239a1ee106e172497"}
Jun 02 19:40:31.752500 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:31.752395    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-79xzx_278707d7-17c9-4a6c-917e-1d2d056db08e/ovn-acl-logging/0.log"
Jun 02 19:40:31.752975 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:31.752951    2564 generic.go:358] "Generic (PLEG): container finished" podID="278707d7-17c9-4a6c-917e-1d2d056db08e" containerID="bd9e8155d14565d2d8139c19197c3f2e673024efcfd4a069dae60b93a40621c0" exitCode=1
Jun 02 19:40:31.753160 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:31.753027    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-79xzx" event={"ID":"278707d7-17c9-4a6c-917e-1d2d056db08e","Type":"ContainerStarted","Data":"fb5336782a569192effe813a32f2bb64f300463b41c9726ac8e4b76c138e4b7e"}
Jun 02 19:40:31.753298 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:31.753283    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-79xzx" event={"ID":"278707d7-17c9-4a6c-917e-1d2d056db08e","Type":"ContainerStarted","Data":"0a9ef3b2127916b5fd3c0a74bf6553a856af1a06e759500e3559603edc06b435"}
Jun 02 19:40:31.753388 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:31.753376    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-79xzx" event={"ID":"278707d7-17c9-4a6c-917e-1d2d056db08e","Type":"ContainerStarted","Data":"46a98a7132d92f236bb6660e0c5ad4d15b5bfd47cfb950ebc8a0b5bd16945f78"}
Jun 02 19:40:31.753488 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:31.753456    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-79xzx" event={"ID":"278707d7-17c9-4a6c-917e-1d2d056db08e","Type":"ContainerStarted","Data":"9fe77a47368429d6a872ed9f1b83cb98cf08d92aba1fd20a3f6ab513a18eb1eb"}
Jun 02 19:40:31.753589 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:31.753499    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-79xzx" event={"ID":"278707d7-17c9-4a6c-917e-1d2d056db08e","Type":"ContainerDied","Data":"bd9e8155d14565d2d8139c19197c3f2e673024efcfd4a069dae60b93a40621c0"}
Jun 02 19:40:31.753589 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:31.753516    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-79xzx" event={"ID":"278707d7-17c9-4a6c-917e-1d2d056db08e","Type":"ContainerStarted","Data":"2a59651c4e632fd9866237a460877a4467cd150ce6e7c0fb67e103670650c556"}
Jun 02 19:40:31.756336 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:31.756311    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhbgd" event={"ID":"712723c9-edc2-41d6-b805-2968f5a7a31b","Type":"ContainerStarted","Data":"402f6218fbe799da81919a0a68d6b33efa6c9a754a05f7c6c0127f852eef1172"}
Jun 02 19:40:31.758048 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:31.757921    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zq5ll" event={"ID":"9e2ad36f-0e51-473d-ab0f-96a54ad90b41","Type":"ContainerStarted","Data":"3d24e085b3fb0931fb724b032502fad271a5d247c30ce573255fdd95b5645220"}
Jun 02 19:40:31.798720 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:31.798676    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-zq5ll" podStartSLOduration=4.824277403 podStartE2EDuration="23.798663697s" podCreationTimestamp="2026-06-02 19:40:08 +0000 UTC" firstStartedPulling="2026-06-02 19:40:10.495239353 +0000 UTC m=+3.349659638" lastFinishedPulling="2026-06-02 19:40:29.469625647 +0000 UTC m=+22.324045932" observedRunningTime="2026-06-02 19:40:31.798448272 +0000 UTC m=+24.652868564" watchObservedRunningTime="2026-06-02 19:40:31.798663697 +0000 UTC m=+24.653083990"
Jun 02 19:40:32.340531 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:32.340506    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/382834b8-2464-4874-b852-66124dc7ddab-original-pull-secret\") pod \"global-pull-secret-syncer-pn7k7\" (UID: \"382834b8-2464-4874-b852-66124dc7ddab\") " pod="kube-system/global-pull-secret-syncer-pn7k7"
Jun 02 19:40:32.340629 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:32.340622    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 02 19:40:32.340675 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:32.340666    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/382834b8-2464-4874-b852-66124dc7ddab-original-pull-secret podName:382834b8-2464-4874-b852-66124dc7ddab nodeName:}" failed. No retries permitted until 2026-06-02 19:40:48.340653157 +0000 UTC m=+41.195073428 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/382834b8-2464-4874-b852-66124dc7ddab-original-pull-secret") pod "global-pull-secret-syncer-pn7k7" (UID: "382834b8-2464-4874-b852-66124dc7ddab") : object "kube-system"/"original-pull-secret" not registered
Jun 02 19:40:32.642370 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:32.642296    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn7k7"
Jun 02 19:40:32.642516 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:32.642422    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn7k7" podUID="382834b8-2464-4874-b852-66124dc7ddab"
Jun 02 19:40:32.761585 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:32.761556    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wrvzk" event={"ID":"7b6cbcad-e6ac-4814-92f0-ab915efd8844","Type":"ContainerStarted","Data":"ddac31683eb4e191bdb20e78b1c20453d8159472ee8d07f3d57d8b660240d5ad"}
Jun 02 19:40:32.763349 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:32.763321    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhbgd" event={"ID":"712723c9-edc2-41d6-b805-2968f5a7a31b","Type":"ContainerStarted","Data":"73d2e9a8a1eac81f0b4fcee68ee6109c710c5bd6681434b3eda7a83609006408"}
Jun 02 19:40:32.802920 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:32.802882    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhbgd" podStartSLOduration=3.053599038 podStartE2EDuration="24.80287009s" podCreationTimestamp="2026-06-02 19:40:08 +0000 UTC" firstStartedPulling="2026-06-02 19:40:10.495854442 +0000 UTC m=+3.350274721" lastFinishedPulling="2026-06-02 19:40:32.245125502 +0000 UTC m=+25.099545773" observedRunningTime="2026-06-02 19:40:32.802582702 +0000 UTC m=+25.657002997" watchObservedRunningTime="2026-06-02 19:40:32.80287009 +0000 UTC m=+25.657290380"
Jun 02 19:40:33.642729 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:33.642699    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlffd"
Jun 02 19:40:33.642910 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:33.642699    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5q95"
Jun 02 19:40:33.642910 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:33.642804    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xlffd" podUID="91837c0a-ed65-44e8-b6f4-461981ef22b2"
Jun 02 19:40:33.642910 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:33.642885    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k5q95" podUID="3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c"
Jun 02 19:40:33.766080 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:33.766051    2564 generic.go:358] "Generic (PLEG): container finished" podID="7b6cbcad-e6ac-4814-92f0-ab915efd8844" containerID="ddac31683eb4e191bdb20e78b1c20453d8159472ee8d07f3d57d8b660240d5ad" exitCode=0
Jun 02 19:40:33.766524 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:33.766126    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wrvzk" event={"ID":"7b6cbcad-e6ac-4814-92f0-ab915efd8844","Type":"ContainerDied","Data":"ddac31683eb4e191bdb20e78b1c20453d8159472ee8d07f3d57d8b660240d5ad"}
Jun 02 19:40:33.769074 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:33.769056    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-79xzx_278707d7-17c9-4a6c-917e-1d2d056db08e/ovn-acl-logging/0.log"
Jun 02 19:40:34.642612 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:34.642564    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn7k7"
Jun 02 19:40:34.642702 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:34.642680    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn7k7" podUID="382834b8-2464-4874-b852-66124dc7ddab"
Jun 02 19:40:34.772965 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:34.772923    2564 generic.go:358] "Generic (PLEG): container finished" podID="7b6cbcad-e6ac-4814-92f0-ab915efd8844" containerID="25a4e5287226608f2521cc2b184756443b15cae3da3f990f9a395ed51012a1c2" exitCode=0
Jun 02 19:40:34.773370 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:34.772997    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wrvzk" event={"ID":"7b6cbcad-e6ac-4814-92f0-ab915efd8844","Type":"ContainerDied","Data":"25a4e5287226608f2521cc2b184756443b15cae3da3f990f9a395ed51012a1c2"}
Jun 02 19:40:34.775680 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:34.775645    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-79xzx_278707d7-17c9-4a6c-917e-1d2d056db08e/ovn-acl-logging/0.log"
Jun 02 19:40:34.776021 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:34.776000    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-79xzx" event={"ID":"278707d7-17c9-4a6c-917e-1d2d056db08e","Type":"ContainerStarted","Data":"02e2ec202af375d294d78b9e2289dca6e80356d25a659afe842ac5db8576ef54"}
Jun 02 19:40:35.642774 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:35.642746    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5q95"
Jun 02 19:40:35.642969 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:35.642746    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlffd"
Jun 02 19:40:35.642969 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:35.642861    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k5q95" podUID="3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c"
Jun 02 19:40:35.643069 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:35.642970    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xlffd" podUID="91837c0a-ed65-44e8-b6f4-461981ef22b2"
Jun 02 19:40:36.642740 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:36.642519    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn7k7"
Jun 02 19:40:36.643171 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:36.642861    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn7k7" podUID="382834b8-2464-4874-b852-66124dc7ddab"
Jun 02 19:40:36.782827 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:36.782800    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-79xzx_278707d7-17c9-4a6c-917e-1d2d056db08e/ovn-acl-logging/0.log"
Jun 02 19:40:36.783171 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:36.783139    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-79xzx" event={"ID":"278707d7-17c9-4a6c-917e-1d2d056db08e","Type":"ContainerStarted","Data":"f763dcd6afed7d492bfac8adc59ec50b9bb994aaeeb5c55b3aedf6d4c8c9a710"}
Jun 02 19:40:36.783497 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:36.783474    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:36.783497 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:36.783501    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:36.783821 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:36.783804    2564 scope.go:117] "RemoveContainer" containerID="bd9e8155d14565d2d8139c19197c3f2e673024efcfd4a069dae60b93a40621c0"
Jun 02 19:40:36.802398 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:36.802377    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:37.643607 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:37.643574    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlffd"
Jun 02 19:40:37.644139 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:37.643634    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5q95"
Jun 02 19:40:37.644139 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:37.643720    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xlffd" podUID="91837c0a-ed65-44e8-b6f4-461981ef22b2"
Jun 02 19:40:37.644139 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:37.643831    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k5q95" podUID="3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c"
Jun 02 19:40:37.787472 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:37.787445    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-79xzx_278707d7-17c9-4a6c-917e-1d2d056db08e/ovn-acl-logging/0.log"
Jun 02 19:40:37.787755 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:37.787735    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-79xzx" event={"ID":"278707d7-17c9-4a6c-917e-1d2d056db08e","Type":"ContainerStarted","Data":"cb10d3d84226c1c394e0400d657626b457e73de00811042129e1ceabb0ea06dd"}
Jun 02 19:40:37.788025 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:37.788001    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:37.805921 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:37.805893    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xlffd"]
Jun 02 19:40:37.806039 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:37.806026    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlffd"
Jun 02 19:40:37.806178 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:37.806149    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xlffd" podUID="91837c0a-ed65-44e8-b6f4-461981ef22b2"
Jun 02 19:40:37.806622 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:37.806600    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:40:37.809548 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:37.809529    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pn7k7"]
Jun 02 19:40:37.809637 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:37.809625    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn7k7"
Jun 02 19:40:37.809740 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:37.809723    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn7k7" podUID="382834b8-2464-4874-b852-66124dc7ddab"
Jun 02 19:40:37.819315 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:37.819271    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-79xzx" podStartSLOduration=9.265711289 podStartE2EDuration="29.819257251s" podCreationTimestamp="2026-06-02 19:40:08 +0000 UTC" firstStartedPulling="2026-06-02 19:40:10.499984609 +0000 UTC m=+3.354404889" lastFinishedPulling="2026-06-02 19:40:31.053530566 +0000 UTC m=+23.907950851" observedRunningTime="2026-06-02 19:40:37.81865721 +0000 UTC m=+30.673077502" watchObservedRunningTime="2026-06-02 19:40:37.819257251 +0000 UTC m=+30.673677545"
Jun 02 19:40:37.822824 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:37.822802    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k5q95"]
Jun 02 19:40:37.822935 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:37.822920    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5q95"
Jun 02 19:40:37.823028 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:37.823008    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k5q95" podUID="3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c"
Jun 02 19:40:39.642007 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:39.641975    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5q95"
Jun 02 19:40:39.642428 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:39.642007    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn7k7"
Jun 02 19:40:39.642428 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:39.642105    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k5q95" podUID="3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c"
Jun 02 19:40:39.642428 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:39.642191    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn7k7" podUID="382834b8-2464-4874-b852-66124dc7ddab"
Jun 02 19:40:39.642428 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:39.642204    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlffd"
Jun 02 19:40:39.642428 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:39.642310    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xlffd" podUID="91837c0a-ed65-44e8-b6f4-461981ef22b2"
Jun 02 19:40:41.312114 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:41.311869    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91837c0a-ed65-44e8-b6f4-461981ef22b2-metrics-certs\") pod \"network-metrics-daemon-xlffd\" (UID: \"91837c0a-ed65-44e8-b6f4-461981ef22b2\") " pod="openshift-multus/network-metrics-daemon-xlffd"
Jun 02 19:40:41.312564 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:41.312014    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 19:40:41.312564 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:41.312201    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91837c0a-ed65-44e8-b6f4-461981ef22b2-metrics-certs podName:91837c0a-ed65-44e8-b6f4-461981ef22b2 nodeName:}" failed. No retries permitted until 2026-06-02 19:41:13.312178586 +0000 UTC m=+66.166598867 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/91837c0a-ed65-44e8-b6f4-461981ef22b2-metrics-certs") pod "network-metrics-daemon-xlffd" (UID: "91837c0a-ed65-44e8-b6f4-461981ef22b2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 19:40:41.412750 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:41.412715    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gn6rs\" (UniqueName: \"kubernetes.io/projected/3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c-kube-api-access-gn6rs\") pod \"network-check-target-k5q95\" (UID: \"3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c\") " pod="openshift-network-diagnostics/network-check-target-k5q95"
Jun 02 19:40:41.412952 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:41.412933    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 02 19:40:41.413034 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:41.412957    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 02 19:40:41.413034 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:41.412971    2564 projected.go:194] Error preparing data for projected volume kube-api-access-gn6rs for pod openshift-network-diagnostics/network-check-target-k5q95: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 19:40:41.413139 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:41.413034    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c-kube-api-access-gn6rs podName:3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c nodeName:}" failed. No retries permitted until 2026-06-02 19:41:13.413016246 +0000 UTC m=+66.267436530 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gn6rs" (UniqueName: "kubernetes.io/projected/3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c-kube-api-access-gn6rs") pod "network-check-target-k5q95" (UID: "3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 19:40:41.642964 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:41.642888    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5q95"
Jun 02 19:40:41.643126 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:41.642895    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn7k7"
Jun 02 19:40:41.643126 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:41.643021    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k5q95" podUID="3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c"
Jun 02 19:40:41.643126 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:41.643114    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn7k7" podUID="382834b8-2464-4874-b852-66124dc7ddab"
Jun 02 19:40:41.643288 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:41.642900    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlffd"
Jun 02 19:40:41.643288 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:41.643249    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xlffd" podUID="91837c0a-ed65-44e8-b6f4-461981ef22b2"
Jun 02 19:40:43.509667 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.509645    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-103.ec2.internal" event="NodeReady"
Jun 02 19:40:43.510192 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.509794    2564 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
Jun 02 19:40:43.545034 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.545007    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-h4rgf"]
Jun 02 19:40:43.568281 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.568256    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5f899fcc64-s4hmb"]
Jun 02 19:40:43.568419 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.568402    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-h4rgf"
Jun 02 19:40:43.571346 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.571322    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jun 02 19:40:43.571470 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.571329    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jun 02 19:40:43.571470 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.571333    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-hm6kv\""
Jun 02 19:40:43.584249 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.584229    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-h4rgf"]
Jun 02 19:40:43.584349 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.584254    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kwwz5"]
Jun 02 19:40:43.584391 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.584376    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb"
Jun 02 19:40:43.586832 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.586811    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jun 02 19:40:43.586967 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.586916    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-t4b9l\""
Jun 02 19:40:43.586967 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.586926    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jun 02 19:40:43.587076 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.587012    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jun 02 19:40:43.592428 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.592411    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jun 02 19:40:43.609895 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.606391    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9fjnc"]
Jun 02 19:40:43.630623 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.630573    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-9jgn2"]
Jun 02 19:40:43.630740 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.630683    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kwwz5"
Jun 02 19:40:43.630913 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.630883    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9fjnc"
Jun 02 19:40:43.633081 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.633060    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jun 02 19:40:43.633222 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.633205    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6wmhd\""
Jun 02 19:40:43.633565 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.633494    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jun 02 19:40:43.633792 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.633766    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jun 02 19:40:43.633891 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.633864    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jun 02 19:40:43.634395 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.634381    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jun 02 19:40:43.634495 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.634406    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4xdcx\""
Jun 02 19:40:43.654622 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.654605    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-wcpcq"]
Jun 02 19:40:43.654752 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.654736    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-9jgn2"
Jun 02 19:40:43.657436 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.657416    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jun 02 19:40:43.657436 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.657420    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jun 02 19:40:43.657616 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.657440    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jun 02 19:40:43.657616 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.657504    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jun 02 19:40:43.657820 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.657641    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-rdngd\""
Jun 02 19:40:43.661930 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.661913    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jun 02 19:40:43.678896 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.678876    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-wcpcq"
Jun 02 19:40:43.681555 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.681540    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jun 02 19:40:43.681648 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.681559    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jun 02 19:40:43.681757 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.681741    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9rbdk"]
Jun 02 19:40:43.681818 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.681785    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jun 02 19:40:43.681818 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.681794    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-qqk95\""
Jun 02 19:40:43.681996 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.681981    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jun 02 19:40:43.694752 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.694733    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mt424"]
Jun 02 19:40:43.694889 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.694875    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9rbdk"
Jun 02 19:40:43.697283 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.697269    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jun 02 19:40:43.697356 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.697323    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-cpx74\""
Jun 02 19:40:43.697493 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.697476    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jun 02 19:40:43.697670 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.697655    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jun 02 19:40:43.698834 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.698818    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jun 02 19:40:43.716777 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.716753    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-c796fd74c-l2p9g"]
Jun 02 19:40:43.716916 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.716900    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mt424"
Jun 02 19:40:43.719405 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.719389    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jun 02 19:40:43.719528 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.719515    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jun 02 19:40:43.719599 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.719528    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jun 02 19:40:43.719599 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.719532    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jun 02 19:40:43.719680 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.719530    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-fwt8m\""
Jun 02 19:40:43.730975 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.730953    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfnd5\" (UniqueName: \"kubernetes.io/projected/03f84c87-e6c2-4b90-be42-138de83f59ef-kube-api-access-lfnd5\") pod \"volume-data-source-validator-7598fd5bd-h4rgf\" (UID: \"03f84c87-e6c2-4b90-be42-138de83f59ef\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-h4rgf"
Jun 02 19:40:43.731067 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.730982    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/902a5df6-ede1-4fee-8f32-cebc9b697d00-ca-trust-extracted\") pod \"image-registry-5f899fcc64-s4hmb\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") " pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb"
Jun 02 19:40:43.731067 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.731001    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/902a5df6-ede1-4fee-8f32-cebc9b697d00-trusted-ca\") pod \"image-registry-5f899fcc64-s4hmb\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") " pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb"
Jun 02 19:40:43.731067 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.731018    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6f6dc05-25cb-4329-8e28-11d41fd538c4-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-9fjnc\" (UID: \"d6f6dc05-25cb-4329-8e28-11d41fd538c4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9fjnc"
Jun 02 19:40:43.731067 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.731037    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/902a5df6-ede1-4fee-8f32-cebc9b697d00-bound-sa-token\") pod \"image-registry-5f899fcc64-s4hmb\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") " pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb"
Jun 02 19:40:43.731202 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.731144    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/902a5df6-ede1-4fee-8f32-cebc9b697d00-registry-certificates\") pod \"image-registry-5f899fcc64-s4hmb\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") " pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb"
Jun 02 19:40:43.731202 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.731165    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/099a66f9-dfe1-4ef7-b849-3e6951bd23f2-metrics-tls\") pod \"dns-default-kwwz5\" (UID: \"099a66f9-dfe1-4ef7-b849-3e6951bd23f2\") " pod="openshift-dns/dns-default-kwwz5"
Jun 02 19:40:43.731202 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.731183    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/099a66f9-dfe1-4ef7-b849-3e6951bd23f2-tmp-dir\") pod \"dns-default-kwwz5\" (UID: \"099a66f9-dfe1-4ef7-b849-3e6951bd23f2\") " pod="openshift-dns/dns-default-kwwz5"
Jun 02 19:40:43.731284 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.731200    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87msh\" (UniqueName: \"kubernetes.io/projected/d6f6dc05-25cb-4329-8e28-11d41fd538c4-kube-api-access-87msh\") pod \"cluster-samples-operator-755bbf9bfb-9fjnc\" (UID: \"d6f6dc05-25cb-4329-8e28-11d41fd538c4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9fjnc"
Jun 02 19:40:43.731284 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.731256    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx2zv\" (UniqueName: \"kubernetes.io/projected/902a5df6-ede1-4fee-8f32-cebc9b697d00-kube-api-access-nx2zv\") pod \"image-registry-5f899fcc64-s4hmb\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") " pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb"
Jun 02 19:40:43.731284 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.731280    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s69rl\" (UniqueName: \"kubernetes.io/projected/099a66f9-dfe1-4ef7-b849-3e6951bd23f2-kube-api-access-s69rl\") pod \"dns-default-kwwz5\" (UID: \"099a66f9-dfe1-4ef7-b849-3e6951bd23f2\") " pod="openshift-dns/dns-default-kwwz5"
Jun 02 19:40:43.731384 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.731331    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/902a5df6-ede1-4fee-8f32-cebc9b697d00-installation-pull-secrets\") pod \"image-registry-5f899fcc64-s4hmb\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") " pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb"
Jun 02 19:40:43.731384 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.731352    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/902a5df6-ede1-4fee-8f32-cebc9b697d00-registry-tls\") pod \"image-registry-5f899fcc64-s4hmb\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") " pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb"
Jun 02 19:40:43.731384 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.731374    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/099a66f9-dfe1-4ef7-b849-3e6951bd23f2-config-volume\") pod \"dns-default-kwwz5\" (UID: \"099a66f9-dfe1-4ef7-b849-3e6951bd23f2\") " pod="openshift-dns/dns-default-kwwz5"
Jun 02 19:40:43.731474 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.731398    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/902a5df6-ede1-4fee-8f32-cebc9b697d00-image-registry-private-configuration\") pod \"image-registry-5f899fcc64-s4hmb\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") " pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb"
Jun 02 19:40:43.738536 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.738519    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-788bf58df5-4t95b"]
Jun 02 19:40:43.738675 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.738661    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-c796fd74c-l2p9g"
Jun 02 19:40:43.740989 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.740897    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jun 02 19:40:43.741212 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.741193    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jun 02 19:40:43.741413 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.741398    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jun 02 19:40:43.741506 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.741486    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jun 02 19:40:43.741672 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.741651    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jun 02 19:40:43.741750 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.741489    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-f9knd\""
Jun 02 19:40:43.743146 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.743125    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jun 02 19:40:43.762600 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.762582    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lnzsg"]
Jun 02 19:40:43.762699 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.762683    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-4t95b"
Jun 02 19:40:43.765268 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.765238    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jun 02 19:40:43.765373 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.765270    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jun 02 19:40:43.765373 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.765276    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-mfknh\""
Jun 02 19:40:43.765515 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.765503    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jun 02 19:40:43.765566 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.765554    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jun 02 19:40:43.770392 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.770375    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jun 02 19:40:43.785023 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.785002    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-9prxw"]
Jun 02 19:40:43.785141 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.785128    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lnzsg"
Jun 02 19:40:43.788617 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.788601    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wcgmb\""
Jun 02 19:40:43.788617 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.788616    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jun 02 19:40:43.789075 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.789063    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jun 02 19:40:43.801625 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.801605    2564 generic.go:358] "Generic (PLEG): container finished" podID="7b6cbcad-e6ac-4814-92f0-ab915efd8844" containerID="4a275e857db35d2ea7f3443f96689fea6c1fcdf88604e9f29078c701e8287ddd" exitCode=0
Jun 02 19:40:43.804466 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.804453    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jun 02 19:40:43.805430 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.805411    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wrvzk" event={"ID":"7b6cbcad-e6ac-4814-92f0-ab915efd8844","Type":"ContainerDied","Data":"4a275e857db35d2ea7f3443f96689fea6c1fcdf88604e9f29078c701e8287ddd"}
Jun 02 19:40:43.805481 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.805452    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-695df548f6-k8xf6"]
Jun 02 19:40:43.805533 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.805523    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5q95"
Jun 02 19:40:43.805645 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.805523    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-9prxw"
Jun 02 19:40:43.805739 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.805715    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlffd"
Jun 02 19:40:43.805934 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.805917    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn7k7"
Jun 02 19:40:43.808382 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.808362    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 02 19:40:43.808633 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.808605    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 02 19:40:43.808633 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.808610    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qdhml\""
Jun 02 19:40:43.808782 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.808628    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 02 19:40:43.809030 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.809016    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 02 19:40:43.809109 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.809030    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jpm5f\""
Jun 02 19:40:43.809109 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.809055    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-7x2kr\""
Jun 02 19:40:43.825557 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.825539    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f87f5b48-pm598"]
Jun 02 19:40:43.825679 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.825664    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-695df548f6-k8xf6"
Jun 02 19:40:43.828533 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.828493    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jun 02 19:40:43.828634 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.828616    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jun 02 19:40:43.828827 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.828726    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-qmmc5\""
Jun 02 19:40:43.829172 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.829153    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jun 02 19:40:43.829248 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.829170    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jun 02 19:40:43.831799 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.831781    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/902a5df6-ede1-4fee-8f32-cebc9b697d00-bound-sa-token\") pod \"image-registry-5f899fcc64-s4hmb\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") " pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb"
Jun 02 19:40:43.831896 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.831812    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqv4f\" (UniqueName: \"kubernetes.io/projected/f987766a-4b0f-471b-a6fa-99a268314b79-kube-api-access-gqv4f\") pod \"service-ca-operator-69877444c-wcpcq\" (UID: \"f987766a-4b0f-471b-a6fa-99a268314b79\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-wcpcq"
Jun 02 19:40:43.831896 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.831832    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7c1244c6-6d55-4cff-8099-4fc240c590f4-serving-cert\") pod \"console-operator-86d7c6cc77-9jgn2\" (UID: \"7c1244c6-6d55-4cff-8099-4fc240c590f4\") " pod="openshift-console-operator/console-operator-86d7c6cc77-9jgn2"
Jun 02 19:40:43.831896 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.831879    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-87msh\" (UniqueName: \"kubernetes.io/projected/d6f6dc05-25cb-4329-8e28-11d41fd538c4-kube-api-access-87msh\") pod \"cluster-samples-operator-755bbf9bfb-9fjnc\" (UID: \"d6f6dc05-25cb-4329-8e28-11d41fd538c4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9fjnc"
Jun 02 19:40:43.832040 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.831935    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/099a66f9-dfe1-4ef7-b849-3e6951bd23f2-metrics-tls\") pod \"dns-default-kwwz5\" (UID: \"099a66f9-dfe1-4ef7-b849-3e6951bd23f2\") " pod="openshift-dns/dns-default-kwwz5"
Jun 02 19:40:43.832040 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.831967    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f987766a-4b0f-471b-a6fa-99a268314b79-serving-cert\") pod \"service-ca-operator-69877444c-wcpcq\" (UID: \"f987766a-4b0f-471b-a6fa-99a268314b79\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-wcpcq"
Jun 02 19:40:43.832040 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.832004    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nx2zv\" (UniqueName: \"kubernetes.io/projected/902a5df6-ede1-4fee-8f32-cebc9b697d00-kube-api-access-nx2zv\") pod \"image-registry-5f899fcc64-s4hmb\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") " pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb"
Jun 02 19:40:43.832040 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.832029    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s69rl\" (UniqueName: \"kubernetes.io/projected/099a66f9-dfe1-4ef7-b849-3e6951bd23f2-kube-api-access-s69rl\") pod \"dns-default-kwwz5\" (UID: \"099a66f9-dfe1-4ef7-b849-3e6951bd23f2\") " pod="openshift-dns/dns-default-kwwz5"
Jun 02 19:40:43.832040 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:43.832034    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 02 19:40:43.832264 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:43.832088    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/099a66f9-dfe1-4ef7-b849-3e6951bd23f2-metrics-tls podName:099a66f9-dfe1-4ef7-b849-3e6951bd23f2 nodeName:}" failed. No retries permitted until 2026-06-02 19:40:44.332067425 +0000 UTC m=+37.186487713 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/099a66f9-dfe1-4ef7-b849-3e6951bd23f2-metrics-tls") pod "dns-default-kwwz5" (UID: "099a66f9-dfe1-4ef7-b849-3e6951bd23f2") : secret "dns-default-metrics-tls" not found
Jun 02 19:40:43.832264 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.832110    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7c1244c6-6d55-4cff-8099-4fc240c590f4-config\") pod \"console-operator-86d7c6cc77-9jgn2\" (UID: \"7c1244c6-6d55-4cff-8099-4fc240c590f4\") " pod="openshift-console-operator/console-operator-86d7c6cc77-9jgn2"
Jun 02 19:40:43.832264 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.832144    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmhjm\" (UniqueName: \"kubernetes.io/projected/fa48db29-a46c-418f-80db-cc2c39f225d7-kube-api-access-pmhjm\") pod \"cluster-monitoring-operator-69b6cbdb88-9rbdk\" (UID: \"fa48db29-a46c-418f-80db-cc2c39f225d7\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9rbdk"
Jun 02 19:40:43.832264 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.832171    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f987766a-4b0f-471b-a6fa-99a268314b79-config\") pod \"service-ca-operator-69877444c-wcpcq\" (UID: \"f987766a-4b0f-471b-a6fa-99a268314b79\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-wcpcq"
Jun 02 19:40:43.832264 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.832201    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8c3ecc02-7b08-42ef-9078-60a7a2a271f2-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-mt424\" (UID: \"8c3ecc02-7b08-42ef-9078-60a7a2a271f2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mt424"
Jun 02 19:40:43.832264 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.832225    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7c1244c6-6d55-4cff-8099-4fc240c590f4-trusted-ca\") pod \"console-operator-86d7c6cc77-9jgn2\" (UID: \"7c1244c6-6d55-4cff-8099-4fc240c590f4\") " pod="openshift-console-operator/console-operator-86d7c6cc77-9jgn2"
Jun 02 19:40:43.832264 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.832250    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8620c80b-baae-412c-9d06-3e2fdb65665c-stats-auth\") pod \"router-default-c796fd74c-l2p9g\" (UID: \"8620c80b-baae-412c-9d06-3e2fdb65665c\") " pod="openshift-ingress/router-default-c796fd74c-l2p9g"
Jun 02 19:40:43.832528 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.832271    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2nqz\" (UniqueName: \"kubernetes.io/projected/8620c80b-baae-412c-9d06-3e2fdb65665c-kube-api-access-x2nqz\") pod \"router-default-c796fd74c-l2p9g\" (UID: \"8620c80b-baae-412c-9d06-3e2fdb65665c\") " pod="openshift-ingress/router-default-c796fd74c-l2p9g"
Jun 02 19:40:43.832528 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.832298    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/902a5df6-ede1-4fee-8f32-cebc9b697d00-ca-trust-extracted\") pod \"image-registry-5f899fcc64-s4hmb\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") " pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb"
Jun 02 19:40:43.832528 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.832354    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8620c80b-baae-412c-9d06-3e2fdb65665c-metrics-certs\") pod \"router-default-c796fd74c-l2p9g\" (UID: \"8620c80b-baae-412c-9d06-3e2fdb65665c\") " pod="openshift-ingress/router-default-c796fd74c-l2p9g"
Jun 02 19:40:43.832528 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.832436    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/902a5df6-ede1-4fee-8f32-cebc9b697d00-registry-certificates\") pod \"image-registry-5f899fcc64-s4hmb\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") " pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb"
Jun 02 19:40:43.832528 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.832479    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvvvs\" (UniqueName: \"kubernetes.io/projected/8c3ecc02-7b08-42ef-9078-60a7a2a271f2-kube-api-access-fvvvs\") pod \"kube-storage-version-migrator-operator-96ddc787c-mt424\" (UID: \"8c3ecc02-7b08-42ef-9078-60a7a2a271f2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mt424"
Jun 02 19:40:43.832528 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.832515    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8620c80b-baae-412c-9d06-3e2fdb65665c-default-certificate\") pod \"router-default-c796fd74c-l2p9g\" (UID: \"8620c80b-baae-412c-9d06-3e2fdb65665c\") " pod="openshift-ingress/router-default-c796fd74c-l2p9g"
Jun 02 19:40:43.832753 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.832544    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/099a66f9-dfe1-4ef7-b849-3e6951bd23f2-tmp-dir\") pod \"dns-default-kwwz5\" (UID: \"099a66f9-dfe1-4ef7-b849-3e6951bd23f2\") " pod="openshift-dns/dns-default-kwwz5"
Jun 02 19:40:43.832753 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.832573    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8c3ecc02-7b08-42ef-9078-60a7a2a271f2-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-mt424\" (UID: \"8c3ecc02-7b08-42ef-9078-60a7a2a271f2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mt424"
Jun 02 19:40:43.832753 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.832600    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa48db29-a46c-418f-80db-cc2c39f225d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-9rbdk\" (UID: \"fa48db29-a46c-418f-80db-cc2c39f225d7\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9rbdk"
Jun 02 19:40:43.832753 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.832629    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2pgb\" (UniqueName: \"kubernetes.io/projected/7c1244c6-6d55-4cff-8099-4fc240c590f4-kube-api-access-n2pgb\") pod \"console-operator-86d7c6cc77-9jgn2\" (UID: \"7c1244c6-6d55-4cff-8099-4fc240c590f4\") " pod="openshift-console-operator/console-operator-86d7c6cc77-9jgn2"
Jun 02 19:40:43.832753 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.832631    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/902a5df6-ede1-4fee-8f32-cebc9b697d00-ca-trust-extracted\") pod \"image-registry-5f899fcc64-s4hmb\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") " pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb"
Jun 02 19:40:43.832753 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.832701    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/902a5df6-ede1-4fee-8f32-cebc9b697d00-installation-pull-secrets\") pod \"image-registry-5f899fcc64-s4hmb\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") " pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb"
Jun 02 19:40:43.832753 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.832721    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/fa48db29-a46c-418f-80db-cc2c39f225d7-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-9rbdk\" (UID: \"fa48db29-a46c-418f-80db-cc2c39f225d7\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9rbdk"
Jun 02 19:40:43.832753 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.832742    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/902a5df6-ede1-4fee-8f32-cebc9b697d00-registry-tls\") pod \"image-registry-5f899fcc64-s4hmb\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") " pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb"
Jun 02 19:40:43.833122 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.832766    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/099a66f9-dfe1-4ef7-b849-3e6951bd23f2-config-volume\") pod \"dns-default-kwwz5\" (UID: \"099a66f9-dfe1-4ef7-b849-3e6951bd23f2\") " pod="openshift-dns/dns-default-kwwz5"
Jun 02 19:40:43.833122 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.832796    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/902a5df6-ede1-4fee-8f32-cebc9b697d00-image-registry-private-configuration\") pod \"image-registry-5f899fcc64-s4hmb\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") " pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb"
Jun 02 19:40:43.833122 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.832830    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/099a66f9-dfe1-4ef7-b849-3e6951bd23f2-tmp-dir\") pod \"dns-default-kwwz5\" (UID: \"099a66f9-dfe1-4ef7-b849-3e6951bd23f2\") " pod="openshift-dns/dns-default-kwwz5"
Jun 02 19:40:43.833122 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:43.832892    2564 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 02 19:40:43.833122 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:43.832905    2564 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f899fcc64-s4hmb: secret "image-registry-tls" not found
Jun 02 19:40:43.833122 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.832901    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lfnd5\" (UniqueName: \"kubernetes.io/projected/03f84c87-e6c2-4b90-be42-138de83f59ef-kube-api-access-lfnd5\") pod \"volume-data-source-validator-7598fd5bd-h4rgf\" (UID: \"03f84c87-e6c2-4b90-be42-138de83f59ef\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-h4rgf"
Jun 02 19:40:43.833122 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:43.832993    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/902a5df6-ede1-4fee-8f32-cebc9b697d00-registry-tls podName:902a5df6-ede1-4fee-8f32-cebc9b697d00 nodeName:}" failed. No retries permitted until 2026-06-02 19:40:44.332973289 +0000 UTC m=+37.187393572 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/902a5df6-ede1-4fee-8f32-cebc9b697d00-registry-tls") pod "image-registry-5f899fcc64-s4hmb" (UID: "902a5df6-ede1-4fee-8f32-cebc9b697d00") : secret "image-registry-tls" not found
Jun 02 19:40:43.833122 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.833051    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6f6dc05-25cb-4329-8e28-11d41fd538c4-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-9fjnc\" (UID: \"d6f6dc05-25cb-4329-8e28-11d41fd538c4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9fjnc"
Jun 02 19:40:43.833122 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.833055    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/902a5df6-ede1-4fee-8f32-cebc9b697d00-registry-certificates\") pod \"image-registry-5f899fcc64-s4hmb\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") " pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb"
Jun 02 19:40:43.833559 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.833194    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8620c80b-baae-412c-9d06-3e2fdb65665c-service-ca-bundle\") pod \"router-default-c796fd74c-l2p9g\" (UID: \"8620c80b-baae-412c-9d06-3e2fdb65665c\") " pod="openshift-ingress/router-default-c796fd74c-l2p9g"
Jun 02 19:40:43.833559 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.833227    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/902a5df6-ede1-4fee-8f32-cebc9b697d00-trusted-ca\") pod \"image-registry-5f899fcc64-s4hmb\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") " pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb"
Jun 02 19:40:43.833559 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.833338    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/099a66f9-dfe1-4ef7-b849-3e6951bd23f2-config-volume\") pod \"dns-default-kwwz5\" (UID: \"099a66f9-dfe1-4ef7-b849-3e6951bd23f2\") " pod="openshift-dns/dns-default-kwwz5"
Jun 02 19:40:43.833559 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:43.833354    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 02 19:40:43.833559 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:43.833400    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6f6dc05-25cb-4329-8e28-11d41fd538c4-samples-operator-tls podName:d6f6dc05-25cb-4329-8e28-11d41fd538c4 nodeName:}" failed. No retries permitted until 2026-06-02 19:40:44.333385031 +0000 UTC m=+37.187805305 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d6f6dc05-25cb-4329-8e28-11d41fd538c4-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-9fjnc" (UID: "d6f6dc05-25cb-4329-8e28-11d41fd538c4") : secret "samples-operator-tls" not found
Jun 02 19:40:43.834385 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.834366    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/902a5df6-ede1-4fee-8f32-cebc9b697d00-trusted-ca\") pod \"image-registry-5f899fcc64-s4hmb\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") " pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb"
Jun 02 19:40:43.837291 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.837265    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/902a5df6-ede1-4fee-8f32-cebc9b697d00-image-registry-private-configuration\") pod \"image-registry-5f899fcc64-s4hmb\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") " pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb"
Jun 02 19:40:43.837371 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.837331    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/902a5df6-ede1-4fee-8f32-cebc9b697d00-installation-pull-secrets\") pod \"image-registry-5f899fcc64-s4hmb\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") " pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb"
Jun 02 19:40:43.841047 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.841003    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s69rl\" (UniqueName: \"kubernetes.io/projected/099a66f9-dfe1-4ef7-b849-3e6951bd23f2-kube-api-access-s69rl\") pod \"dns-default-kwwz5\" (UID: \"099a66f9-dfe1-4ef7-b849-3e6951bd23f2\") " pod="openshift-dns/dns-default-kwwz5"
Jun 02 19:40:43.842034 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.842012    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87msh\" (UniqueName: \"kubernetes.io/projected/d6f6dc05-25cb-4329-8e28-11d41fd538c4-kube-api-access-87msh\") pod \"cluster-samples-operator-755bbf9bfb-9fjnc\" (UID: \"d6f6dc05-25cb-4329-8e28-11d41fd538c4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9fjnc"
Jun 02 19:40:43.842533 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.842510    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfnd5\" (UniqueName: \"kubernetes.io/projected/03f84c87-e6c2-4b90-be42-138de83f59ef-kube-api-access-lfnd5\") pod \"volume-data-source-validator-7598fd5bd-h4rgf\" (UID: \"03f84c87-e6c2-4b90-be42-138de83f59ef\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-h4rgf"
Jun 02 19:40:43.842896 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.842877    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/902a5df6-ede1-4fee-8f32-cebc9b697d00-bound-sa-token\") pod \"image-registry-5f899fcc64-s4hmb\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") " pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb"
Jun 02 19:40:43.855423 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.855397    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx2zv\" (UniqueName: \"kubernetes.io/projected/902a5df6-ede1-4fee-8f32-cebc9b697d00-kube-api-access-nx2zv\") pod \"image-registry-5f899fcc64-s4hmb\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") " pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb"
Jun 02 19:40:43.856796 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.856102    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-744478f76f-vskm7"]
Jun 02 19:40:43.856796 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.856523    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f87f5b48-pm598"
Jun 02 19:40:43.861077 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.861028    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jun 02 19:40:43.861165 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.861126    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jun 02 19:40:43.861260 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.861243    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jun 02 19:40:43.862400 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.861495    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jun 02 19:40:43.880145 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.880126    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-h4rgf"
Jun 02 19:40:43.888095 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.888072    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f899fcc64-s4hmb"]
Jun 02 19:40:43.888172 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.888109    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9fjnc"]
Jun 02 19:40:43.888172 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.888112    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-744478f76f-vskm7"
Jun 02 19:40:43.888172 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.888124    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kwwz5"]
Jun 02 19:40:43.888172 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.888137    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-9jgn2"]
Jun 02 19:40:43.888172 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.888149    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9rbdk"]
Jun 02 19:40:43.888172 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.888162    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lnzsg"]
Jun 02 19:40:43.888172 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.888174    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-4t95b"]
Jun 02 19:40:43.888561 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.888184    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-wcpcq"]
Jun 02 19:40:43.888561 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.888194    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-744478f76f-vskm7"]
Jun 02 19:40:43.888561 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.888205    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f87f5b48-pm598"]
Jun 02 19:40:43.888561 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.888215    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-9prxw"]
Jun 02 19:40:43.888561 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.888227    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mt424"]
Jun 02 19:40:43.888561 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.888237    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-695df548f6-k8xf6"]
Jun 02 19:40:43.888561 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.888272    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-c796fd74c-l2p9g"]
Jun 02 19:40:43.890747 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.890725    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jun 02 19:40:43.934272 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.934242    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cth2\" (UniqueName: \"kubernetes.io/projected/6c364585-c0af-48d3-9d12-ab83b0c040e2-kube-api-access-2cth2\") pod \"managed-serviceaccount-addon-agent-695df548f6-k8xf6\" (UID: \"6c364585-c0af-48d3-9d12-ab83b0c040e2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-695df548f6-k8xf6"
Jun 02 19:40:43.934520 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.934300    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8620c80b-baae-412c-9d06-3e2fdb65665c-service-ca-bundle\") pod \"router-default-c796fd74c-l2p9g\" (UID: \"8620c80b-baae-412c-9d06-3e2fdb65665c\") " pod="openshift-ingress/router-default-c796fd74c-l2p9g"
Jun 02 19:40:43.934520 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.934334    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gqv4f\" (UniqueName: \"kubernetes.io/projected/f987766a-4b0f-471b-a6fa-99a268314b79-kube-api-access-gqv4f\") pod \"service-ca-operator-69877444c-wcpcq\" (UID: \"f987766a-4b0f-471b-a6fa-99a268314b79\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-wcpcq"
Jun 02 19:40:43.934520 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.934363    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks8wm\" (UniqueName: \"kubernetes.io/projected/2beb603f-6723-4b6c-8c48-4cdb35e4bcab-kube-api-access-ks8wm\") pod \"network-check-source-56d84b9f44-9prxw\" (UID: \"2beb603f-6723-4b6c-8c48-4cdb35e4bcab\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-9prxw"
Jun 02 19:40:43.934520 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.934386    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c521bf4-fe5d-4188-a7ea-001c7e8c2255-tmp\") pod \"insights-operator-788bf58df5-4t95b\" (UID: \"8c521bf4-fe5d-4188-a7ea-001c7e8c2255\") " pod="openshift-insights/insights-operator-788bf58df5-4t95b"
Jun 02 19:40:43.934520 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.934409    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjf7q\" (UniqueName: \"kubernetes.io/projected/8c521bf4-fe5d-4188-a7ea-001c7e8c2255-kube-api-access-kjf7q\") pod \"insights-operator-788bf58df5-4t95b\" (UID: \"8c521bf4-fe5d-4188-a7ea-001c7e8c2255\") " pod="openshift-insights/insights-operator-788bf58df5-4t95b"
Jun 02 19:40:43.934520 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.934443    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7c1244c6-6d55-4cff-8099-4fc240c590f4-serving-cert\") pod \"console-operator-86d7c6cc77-9jgn2\" (UID: \"7c1244c6-6d55-4cff-8099-4fc240c590f4\") " pod="openshift-console-operator/console-operator-86d7c6cc77-9jgn2"
Jun 02 19:40:43.934520 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.934503    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8c521bf4-fe5d-4188-a7ea-001c7e8c2255-snapshots\") pod \"insights-operator-788bf58df5-4t95b\" (UID: \"8c521bf4-fe5d-4188-a7ea-001c7e8c2255\") " pod="openshift-insights/insights-operator-788bf58df5-4t95b"
Jun 02 19:40:43.934930 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.934531    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f987766a-4b0f-471b-a6fa-99a268314b79-serving-cert\") pod \"service-ca-operator-69877444c-wcpcq\" (UID: \"f987766a-4b0f-471b-a6fa-99a268314b79\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-wcpcq"
Jun 02 19:40:43.934930 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.934576    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7c1244c6-6d55-4cff-8099-4fc240c590f4-config\") pod \"console-operator-86d7c6cc77-9jgn2\" (UID: \"7c1244c6-6d55-4cff-8099-4fc240c590f4\") " pod="openshift-console-operator/console-operator-86d7c6cc77-9jgn2"
Jun 02 19:40:43.934930 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.934602    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c521bf4-fe5d-4188-a7ea-001c7e8c2255-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-4t95b\" (UID: \"8c521bf4-fe5d-4188-a7ea-001c7e8c2255\") " pod="openshift-insights/insights-operator-788bf58df5-4t95b"
Jun 02 19:40:43.934930 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.934630    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pmhjm\" (UniqueName: \"kubernetes.io/projected/fa48db29-a46c-418f-80db-cc2c39f225d7-kube-api-access-pmhjm\") pod \"cluster-monitoring-operator-69b6cbdb88-9rbdk\" (UID: \"fa48db29-a46c-418f-80db-cc2c39f225d7\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9rbdk"
Jun 02 19:40:43.934930 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.934656    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f987766a-4b0f-471b-a6fa-99a268314b79-config\") pod \"service-ca-operator-69877444c-wcpcq\" (UID: \"f987766a-4b0f-471b-a6fa-99a268314b79\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-wcpcq"
Jun 02 19:40:43.934930 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.934683    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8c3ecc02-7b08-42ef-9078-60a7a2a271f2-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-mt424\" (UID: \"8c3ecc02-7b08-42ef-9078-60a7a2a271f2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mt424"
Jun 02 19:40:43.934930 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.934709    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7c1244c6-6d55-4cff-8099-4fc240c590f4-trusted-ca\") pod \"console-operator-86d7c6cc77-9jgn2\" (UID: \"7c1244c6-6d55-4cff-8099-4fc240c590f4\") " pod="openshift-console-operator/console-operator-86d7c6cc77-9jgn2"
Jun 02 19:40:43.934930 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.934737    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8620c80b-baae-412c-9d06-3e2fdb65665c-stats-auth\") pod \"router-default-c796fd74c-l2p9g\" (UID: \"8620c80b-baae-412c-9d06-3e2fdb65665c\") " pod="openshift-ingress/router-default-c796fd74c-l2p9g"
Jun 02 19:40:43.934930 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.934764    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x2nqz\" (UniqueName: \"kubernetes.io/projected/8620c80b-baae-412c-9d06-3e2fdb65665c-kube-api-access-x2nqz\") pod \"router-default-c796fd74c-l2p9g\" (UID: \"8620c80b-baae-412c-9d06-3e2fdb65665c\") " pod="openshift-ingress/router-default-c796fd74c-l2p9g"
Jun 02 19:40:43.934930 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.934803    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8c521bf4-fe5d-4188-a7ea-001c7e8c2255-serving-cert\") pod \"insights-operator-788bf58df5-4t95b\" (UID: \"8c521bf4-fe5d-4188-a7ea-001c7e8c2255\") " pod="openshift-insights/insights-operator-788bf58df5-4t95b"
Jun 02 19:40:43.934930 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.934832    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8620c80b-baae-412c-9d06-3e2fdb65665c-metrics-certs\") pod \"router-default-c796fd74c-l2p9g\" (UID: \"8620c80b-baae-412c-9d06-3e2fdb65665c\") " pod="openshift-ingress/router-default-c796fd74c-l2p9g"
Jun 02 19:40:43.935408 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:43.934985    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8620c80b-baae-412c-9d06-3e2fdb65665c-service-ca-bundle podName:8620c80b-baae-412c-9d06-3e2fdb65665c nodeName:}" failed. No retries permitted until 2026-06-02 19:40:44.434967185 +0000 UTC m=+37.289387456 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8620c80b-baae-412c-9d06-3e2fdb65665c-service-ca-bundle") pod "router-default-c796fd74c-l2p9g" (UID: "8620c80b-baae-412c-9d06-3e2fdb65665c") : configmap references non-existent config key: service-ca.crt
Jun 02 19:40:43.935408 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.935011    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fvvvs\" (UniqueName: \"kubernetes.io/projected/8c3ecc02-7b08-42ef-9078-60a7a2a271f2-kube-api-access-fvvvs\") pod \"kube-storage-version-migrator-operator-96ddc787c-mt424\" (UID: \"8c3ecc02-7b08-42ef-9078-60a7a2a271f2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mt424"
Jun 02 19:40:43.935408 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.935041    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6c364585-c0af-48d3-9d12-ab83b0c040e2-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-695df548f6-k8xf6\" (UID: \"6c364585-c0af-48d3-9d12-ab83b0c040e2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-695df548f6-k8xf6"
Jun 02 19:40:43.935408 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.935057    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53c539fd-aeda-4f98-9450-4f7f05782e32-cert\") pod \"ingress-canary-lnzsg\" (UID: \"53c539fd-aeda-4f98-9450-4f7f05782e32\") " pod="openshift-ingress-canary/ingress-canary-lnzsg"
Jun 02 19:40:43.935408 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.935076    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c521bf4-fe5d-4188-a7ea-001c7e8c2255-service-ca-bundle\") pod \"insights-operator-788bf58df5-4t95b\" (UID: \"8c521bf4-fe5d-4188-a7ea-001c7e8c2255\") " pod="openshift-insights/insights-operator-788bf58df5-4t95b"
Jun 02 19:40:43.935408 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.935096    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8620c80b-baae-412c-9d06-3e2fdb65665c-default-certificate\") pod \"router-default-c796fd74c-l2p9g\" (UID: \"8620c80b-baae-412c-9d06-3e2fdb65665c\") " pod="openshift-ingress/router-default-c796fd74c-l2p9g"
Jun 02 19:40:43.935408 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.935116    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8c3ecc02-7b08-42ef-9078-60a7a2a271f2-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-mt424\" (UID: \"8c3ecc02-7b08-42ef-9078-60a7a2a271f2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mt424"
Jun 02 19:40:43.935408 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.935136    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa48db29-a46c-418f-80db-cc2c39f225d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-9rbdk\" (UID: \"fa48db29-a46c-418f-80db-cc2c39f225d7\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9rbdk"
Jun 02 19:40:43.935408 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.935155    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx66w\" (UniqueName: \"kubernetes.io/projected/53c539fd-aeda-4f98-9450-4f7f05782e32-kube-api-access-dx66w\") pod \"ingress-canary-lnzsg\" (UID: \"53c539fd-aeda-4f98-9450-4f7f05782e32\") " pod="openshift-ingress-canary/ingress-canary-lnzsg"
Jun 02 19:40:43.935408 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.935175    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n2pgb\" (UniqueName: \"kubernetes.io/projected/7c1244c6-6d55-4cff-8099-4fc240c590f4-kube-api-access-n2pgb\") pod \"console-operator-86d7c6cc77-9jgn2\" (UID: \"7c1244c6-6d55-4cff-8099-4fc240c590f4\") " pod="openshift-console-operator/console-operator-86d7c6cc77-9jgn2"
Jun 02 19:40:43.935408 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.935197    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/fa48db29-a46c-418f-80db-cc2c39f225d7-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-9rbdk\" (UID: \"fa48db29-a46c-418f-80db-cc2c39f225d7\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9rbdk"
Jun 02 19:40:43.936936 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.936074    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7c1244c6-6d55-4cff-8099-4fc240c590f4-config\") pod \"console-operator-86d7c6cc77-9jgn2\" (UID: \"7c1244c6-6d55-4cff-8099-4fc240c590f4\") " pod="openshift-console-operator/console-operator-86d7c6cc77-9jgn2"
Jun 02 19:40:43.936936 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:43.936370    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 02 19:40:43.936936 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:43.936410    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 02 19:40:43.936936 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:43.936422    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa48db29-a46c-418f-80db-cc2c39f225d7-cluster-monitoring-operator-tls podName:fa48db29-a46c-418f-80db-cc2c39f225d7 nodeName:}" failed. No retries permitted until 2026-06-02 19:40:44.436405605 +0000 UTC m=+37.290825887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fa48db29-a46c-418f-80db-cc2c39f225d7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-9rbdk" (UID: "fa48db29-a46c-418f-80db-cc2c39f225d7") : secret "cluster-monitoring-operator-tls" not found
Jun 02 19:40:43.936936 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:43.936460    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8620c80b-baae-412c-9d06-3e2fdb65665c-metrics-certs podName:8620c80b-baae-412c-9d06-3e2fdb65665c nodeName:}" failed. No retries permitted until 2026-06-02 19:40:44.436444121 +0000 UTC m=+37.290864407 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8620c80b-baae-412c-9d06-3e2fdb65665c-metrics-certs") pod "router-default-c796fd74c-l2p9g" (UID: "8620c80b-baae-412c-9d06-3e2fdb65665c") : secret "router-metrics-certs-default" not found
Jun 02 19:40:43.936936 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.936508    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f987766a-4b0f-471b-a6fa-99a268314b79-config\") pod \"service-ca-operator-69877444c-wcpcq\" (UID: \"f987766a-4b0f-471b-a6fa-99a268314b79\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-wcpcq"
Jun 02 19:40:43.936936 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.936753    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7c1244c6-6d55-4cff-8099-4fc240c590f4-trusted-ca\") pod \"console-operator-86d7c6cc77-9jgn2\" (UID: \"7c1244c6-6d55-4cff-8099-4fc240c590f4\") " pod="openshift-console-operator/console-operator-86d7c6cc77-9jgn2"
Jun 02 19:40:43.937494 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.937319    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8c3ecc02-7b08-42ef-9078-60a7a2a271f2-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-mt424\" (UID: \"8c3ecc02-7b08-42ef-9078-60a7a2a271f2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mt424"
Jun 02 19:40:43.937786 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.937743    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/fa48db29-a46c-418f-80db-cc2c39f225d7-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-9rbdk\" (UID: \"fa48db29-a46c-418f-80db-cc2c39f225d7\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9rbdk"
Jun 02 19:40:43.938376 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.938356    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7c1244c6-6d55-4cff-8099-4fc240c590f4-serving-cert\") pod \"console-operator-86d7c6cc77-9jgn2\" (UID: \"7c1244c6-6d55-4cff-8099-4fc240c590f4\") " pod="openshift-console-operator/console-operator-86d7c6cc77-9jgn2"
Jun 02 19:40:43.939270 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.939229    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8620c80b-baae-412c-9d06-3e2fdb65665c-default-certificate\") pod \"router-default-c796fd74c-l2p9g\" (UID: \"8620c80b-baae-412c-9d06-3e2fdb65665c\") " pod="openshift-ingress/router-default-c796fd74c-l2p9g"
Jun 02 19:40:43.939382 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.939333    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8620c80b-baae-412c-9d06-3e2fdb65665c-stats-auth\") pod \"router-default-c796fd74c-l2p9g\" (UID: \"8620c80b-baae-412c-9d06-3e2fdb65665c\") " pod="openshift-ingress/router-default-c796fd74c-l2p9g"
Jun 02 19:40:43.939705 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.939681    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8c3ecc02-7b08-42ef-9078-60a7a2a271f2-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-mt424\" (UID: \"8c3ecc02-7b08-42ef-9078-60a7a2a271f2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mt424"
Jun 02 19:40:43.939768 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.939752    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f987766a-4b0f-471b-a6fa-99a268314b79-serving-cert\") pod \"service-ca-operator-69877444c-wcpcq\" (UID: \"f987766a-4b0f-471b-a6fa-99a268314b79\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-wcpcq"
Jun 02 19:40:43.944368 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.944346    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2nqz\" (UniqueName: \"kubernetes.io/projected/8620c80b-baae-412c-9d06-3e2fdb65665c-kube-api-access-x2nqz\") pod \"router-default-c796fd74c-l2p9g\" (UID: \"8620c80b-baae-412c-9d06-3e2fdb65665c\") " pod="openshift-ingress/router-default-c796fd74c-l2p9g"
Jun 02 19:40:43.944458 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.944386    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqv4f\" (UniqueName: \"kubernetes.io/projected/f987766a-4b0f-471b-a6fa-99a268314b79-kube-api-access-gqv4f\") pod \"service-ca-operator-69877444c-wcpcq\" (UID: \"f987766a-4b0f-471b-a6fa-99a268314b79\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-wcpcq"
Jun 02 19:40:43.944712 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.944696    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmhjm\" (UniqueName: \"kubernetes.io/projected/fa48db29-a46c-418f-80db-cc2c39f225d7-kube-api-access-pmhjm\") pod \"cluster-monitoring-operator-69b6cbdb88-9rbdk\" (UID: \"fa48db29-a46c-418f-80db-cc2c39f225d7\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9rbdk"
Jun 02 19:40:43.945770 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.945739    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvvvs\" (UniqueName: \"kubernetes.io/projected/8c3ecc02-7b08-42ef-9078-60a7a2a271f2-kube-api-access-fvvvs\") pod \"kube-storage-version-migrator-operator-96ddc787c-mt424\" (UID: \"8c3ecc02-7b08-42ef-9078-60a7a2a271f2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mt424"
Jun 02 19:40:43.946061 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.946046    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2pgb\" (UniqueName: \"kubernetes.io/projected/7c1244c6-6d55-4cff-8099-4fc240c590f4-kube-api-access-n2pgb\") pod \"console-operator-86d7c6cc77-9jgn2\" (UID: \"7c1244c6-6d55-4cff-8099-4fc240c590f4\") " pod="openshift-console-operator/console-operator-86d7c6cc77-9jgn2"
Jun 02 19:40:43.963078 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.962956    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-9jgn2"
Jun 02 19:40:43.987129 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:43.987000    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-wcpcq"
Jun 02 19:40:44.024910 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.024553    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mt424"
Jun 02 19:40:44.036302 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.036273    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2cth2\" (UniqueName: \"kubernetes.io/projected/6c364585-c0af-48d3-9d12-ab83b0c040e2-kube-api-access-2cth2\") pod \"managed-serviceaccount-addon-agent-695df548f6-k8xf6\" (UID: \"6c364585-c0af-48d3-9d12-ab83b0c040e2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-695df548f6-k8xf6"
Jun 02 19:40:44.036426 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.036317    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/333a1655-7d2a-433a-9691-3a9042662fcf-tmp\") pod \"klusterlet-addon-workmgr-744478f76f-vskm7\" (UID: \"333a1655-7d2a-433a-9691-3a9042662fcf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-744478f76f-vskm7"
Jun 02 19:40:44.036426 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.036367    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ks8wm\" (UniqueName: \"kubernetes.io/projected/2beb603f-6723-4b6c-8c48-4cdb35e4bcab-kube-api-access-ks8wm\") pod \"network-check-source-56d84b9f44-9prxw\" (UID: \"2beb603f-6723-4b6c-8c48-4cdb35e4bcab\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-9prxw"
Jun 02 19:40:44.036426 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.036392    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c521bf4-fe5d-4188-a7ea-001c7e8c2255-tmp\") pod \"insights-operator-788bf58df5-4t95b\" (UID: \"8c521bf4-fe5d-4188-a7ea-001c7e8c2255\") " pod="openshift-insights/insights-operator-788bf58df5-4t95b"
Jun 02 19:40:44.036426 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.036416    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kjf7q\" (UniqueName: \"kubernetes.io/projected/8c521bf4-fe5d-4188-a7ea-001c7e8c2255-kube-api-access-kjf7q\") pod \"insights-operator-788bf58df5-4t95b\" (UID: \"8c521bf4-fe5d-4188-a7ea-001c7e8c2255\") " pod="openshift-insights/insights-operator-788bf58df5-4t95b"
Jun 02 19:40:44.036678 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.036442    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/333a1655-7d2a-433a-9691-3a9042662fcf-klusterlet-config\") pod \"klusterlet-addon-workmgr-744478f76f-vskm7\" (UID: \"333a1655-7d2a-433a-9691-3a9042662fcf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-744478f76f-vskm7"
Jun 02 19:40:44.036678 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.036486    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5e0dd968-14ea-4b7f-bf65-c20f0c90f605-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-69f87f5b48-pm598\" (UID: \"5e0dd968-14ea-4b7f-bf65-c20f0c90f605\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f87f5b48-pm598"
Jun 02 19:40:44.036678 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.036663    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/5e0dd968-14ea-4b7f-bf65-c20f0c90f605-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-69f87f5b48-pm598\" (UID: \"5e0dd968-14ea-4b7f-bf65-c20f0c90f605\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f87f5b48-pm598"
Jun 02 19:40:44.036827 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.036716    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8c521bf4-fe5d-4188-a7ea-001c7e8c2255-snapshots\") pod \"insights-operator-788bf58df5-4t95b\" (UID: \"8c521bf4-fe5d-4188-a7ea-001c7e8c2255\") " pod="openshift-insights/insights-operator-788bf58df5-4t95b"
Jun 02 19:40:44.036827 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.036750    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5e0dd968-14ea-4b7f-bf65-c20f0c90f605-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-69f87f5b48-pm598\" (UID: \"5e0dd968-14ea-4b7f-bf65-c20f0c90f605\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f87f5b48-pm598"
Jun 02 19:40:44.036948 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.036827    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c521bf4-fe5d-4188-a7ea-001c7e8c2255-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-4t95b\" (UID: \"8c521bf4-fe5d-4188-a7ea-001c7e8c2255\") " pod="openshift-insights/insights-operator-788bf58df5-4t95b"
Jun 02 19:40:44.036948 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.036907    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8c521bf4-fe5d-4188-a7ea-001c7e8c2255-serving-cert\") pod \"insights-operator-788bf58df5-4t95b\" (UID: \"8c521bf4-fe5d-4188-a7ea-001c7e8c2255\") " pod="openshift-insights/insights-operator-788bf58df5-4t95b"
Jun 02 19:40:44.036948 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.036915    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c521bf4-fe5d-4188-a7ea-001c7e8c2255-tmp\") pod \"insights-operator-788bf58df5-4t95b\" (UID: \"8c521bf4-fe5d-4188-a7ea-001c7e8c2255\") " pod="openshift-insights/insights-operator-788bf58df5-4t95b"
Jun 02 19:40:44.036948 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.036940    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lngpm\" (UniqueName: \"kubernetes.io/projected/5e0dd968-14ea-4b7f-bf65-c20f0c90f605-kube-api-access-lngpm\") pod \"cluster-proxy-proxy-agent-69f87f5b48-pm598\" (UID: \"5e0dd968-14ea-4b7f-bf65-c20f0c90f605\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f87f5b48-pm598"
Jun 02 19:40:44.037151 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.036997    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5e0dd968-14ea-4b7f-bf65-c20f0c90f605-hub\") pod \"cluster-proxy-proxy-agent-69f87f5b48-pm598\" (UID: \"5e0dd968-14ea-4b7f-bf65-c20f0c90f605\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f87f5b48-pm598"
Jun 02 19:40:44.037151 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.037063    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6c364585-c0af-48d3-9d12-ab83b0c040e2-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-695df548f6-k8xf6\" (UID: \"6c364585-c0af-48d3-9d12-ab83b0c040e2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-695df548f6-k8xf6"
Jun 02 19:40:44.037151 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.037091    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53c539fd-aeda-4f98-9450-4f7f05782e32-cert\") pod \"ingress-canary-lnzsg\" (UID: \"53c539fd-aeda-4f98-9450-4f7f05782e32\") " pod="openshift-ingress-canary/ingress-canary-lnzsg"
Jun 02 19:40:44.037151 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.037120    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c521bf4-fe5d-4188-a7ea-001c7e8c2255-service-ca-bundle\") pod \"insights-operator-788bf58df5-4t95b\" (UID: \"8c521bf4-fe5d-4188-a7ea-001c7e8c2255\") " pod="openshift-insights/insights-operator-788bf58df5-4t95b"
Jun 02 19:40:44.037151 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.037147    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm99p\" (UniqueName: \"kubernetes.io/projected/333a1655-7d2a-433a-9691-3a9042662fcf-kube-api-access-pm99p\") pod \"klusterlet-addon-workmgr-744478f76f-vskm7\" (UID: \"333a1655-7d2a-433a-9691-3a9042662fcf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-744478f76f-vskm7"
Jun 02 19:40:44.037376 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.037189    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dx66w\" (UniqueName: \"kubernetes.io/projected/53c539fd-aeda-4f98-9450-4f7f05782e32-kube-api-access-dx66w\") pod \"ingress-canary-lnzsg\" (UID: \"53c539fd-aeda-4f98-9450-4f7f05782e32\") " pod="openshift-ingress-canary/ingress-canary-lnzsg"
Jun 02 19:40:44.037376 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.037217    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5e0dd968-14ea-4b7f-bf65-c20f0c90f605-ca\") pod \"cluster-proxy-proxy-agent-69f87f5b48-pm598\" (UID: \"5e0dd968-14ea-4b7f-bf65-c20f0c90f605\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f87f5b48-pm598"
Jun 02 19:40:44.037376 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.037236    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8c521bf4-fe5d-4188-a7ea-001c7e8c2255-snapshots\") pod \"insights-operator-788bf58df5-4t95b\" (UID: \"8c521bf4-fe5d-4188-a7ea-001c7e8c2255\") " pod="openshift-insights/insights-operator-788bf58df5-4t95b"
Jun 02 19:40:44.037534 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:44.037420    2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 02 19:40:44.037534 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:44.037472    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53c539fd-aeda-4f98-9450-4f7f05782e32-cert podName:53c539fd-aeda-4f98-9450-4f7f05782e32 nodeName:}" failed. No retries permitted until 2026-06-02 19:40:44.537455349 +0000 UTC m=+37.391875634 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/53c539fd-aeda-4f98-9450-4f7f05782e32-cert") pod "ingress-canary-lnzsg" (UID: "53c539fd-aeda-4f98-9450-4f7f05782e32") : secret "canary-serving-cert" not found
Jun 02 19:40:44.037534 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.037502    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-h4rgf"]
Jun 02 19:40:44.037680 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.037598    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c521bf4-fe5d-4188-a7ea-001c7e8c2255-service-ca-bundle\") pod \"insights-operator-788bf58df5-4t95b\" (UID: \"8c521bf4-fe5d-4188-a7ea-001c7e8c2255\") " pod="openshift-insights/insights-operator-788bf58df5-4t95b"
Jun 02 19:40:44.037734 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.037695    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c521bf4-fe5d-4188-a7ea-001c7e8c2255-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-4t95b\" (UID: \"8c521bf4-fe5d-4188-a7ea-001c7e8c2255\") " pod="openshift-insights/insights-operator-788bf58df5-4t95b"
Jun 02 19:40:44.040509 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.040488    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8c521bf4-fe5d-4188-a7ea-001c7e8c2255-serving-cert\") pod \"insights-operator-788bf58df5-4t95b\" (UID: \"8c521bf4-fe5d-4188-a7ea-001c7e8c2255\") " pod="openshift-insights/insights-operator-788bf58df5-4t95b"
Jun 02 19:40:44.041882 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.041864    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6c364585-c0af-48d3-9d12-ab83b0c040e2-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-695df548f6-k8xf6\" (UID: \"6c364585-c0af-48d3-9d12-ab83b0c040e2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-695df548f6-k8xf6"
Jun 02 19:40:44.044234 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.044209    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjf7q\" (UniqueName: \"kubernetes.io/projected/8c521bf4-fe5d-4188-a7ea-001c7e8c2255-kube-api-access-kjf7q\") pod \"insights-operator-788bf58df5-4t95b\" (UID: \"8c521bf4-fe5d-4188-a7ea-001c7e8c2255\") " pod="openshift-insights/insights-operator-788bf58df5-4t95b"
Jun 02 19:40:44.044565 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.044549    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cth2\" (UniqueName: \"kubernetes.io/projected/6c364585-c0af-48d3-9d12-ab83b0c040e2-kube-api-access-2cth2\") pod \"managed-serviceaccount-addon-agent-695df548f6-k8xf6\" (UID: \"6c364585-c0af-48d3-9d12-ab83b0c040e2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-695df548f6-k8xf6"
Jun 02 19:40:44.045722 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.045702    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx66w\" (UniqueName: \"kubernetes.io/projected/53c539fd-aeda-4f98-9450-4f7f05782e32-kube-api-access-dx66w\") pod \"ingress-canary-lnzsg\" (UID: \"53c539fd-aeda-4f98-9450-4f7f05782e32\") " pod="openshift-ingress-canary/ingress-canary-lnzsg"
Jun 02 19:40:44.045798 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.045705    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks8wm\" (UniqueName: \"kubernetes.io/projected/2beb603f-6723-4b6c-8c48-4cdb35e4bcab-kube-api-access-ks8wm\") pod \"network-check-source-56d84b9f44-9prxw\" (UID: \"2beb603f-6723-4b6c-8c48-4cdb35e4bcab\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-9prxw"
Jun 02 19:40:44.071250 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.071229    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-4t95b"
Jun 02 19:40:44.094233 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.093948    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-9jgn2"]
Jun 02 19:40:44.097075 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:44.096802    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03f84c87_e6c2_4b90_be42_138de83f59ef.slice/crio-30c07e72961bf718f88d27bb0fce28fd55e5bfe1f5a468e5b5c979a7d0b0b008 WatchSource:0}: Error finding container 30c07e72961bf718f88d27bb0fce28fd55e5bfe1f5a468e5b5c979a7d0b0b008: Status 404 returned error can't find the container with id 30c07e72961bf718f88d27bb0fce28fd55e5bfe1f5a468e5b5c979a7d0b0b008
Jun 02 19:40:44.098021 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:44.097996    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c1244c6_6d55_4cff_8099_4fc240c590f4.slice/crio-7d714a39ee9b966d0ece0f207d596dd05b5fd45dd395c0f0ce6d8263b559390e WatchSource:0}: Error finding container 7d714a39ee9b966d0ece0f207d596dd05b5fd45dd395c0f0ce6d8263b559390e: Status 404 returned error can't find the container with id 7d714a39ee9b966d0ece0f207d596dd05b5fd45dd395c0f0ce6d8263b559390e
Jun 02 19:40:44.126032 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.125903    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-9prxw"
Jun 02 19:40:44.139295 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.138565    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pm99p\" (UniqueName: \"kubernetes.io/projected/333a1655-7d2a-433a-9691-3a9042662fcf-kube-api-access-pm99p\") pod \"klusterlet-addon-workmgr-744478f76f-vskm7\" (UID: \"333a1655-7d2a-433a-9691-3a9042662fcf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-744478f76f-vskm7"
Jun 02 19:40:44.139295 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.138624    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5e0dd968-14ea-4b7f-bf65-c20f0c90f605-ca\") pod \"cluster-proxy-proxy-agent-69f87f5b48-pm598\" (UID: \"5e0dd968-14ea-4b7f-bf65-c20f0c90f605\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f87f5b48-pm598"
Jun 02 19:40:44.139295 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.138673    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/333a1655-7d2a-433a-9691-3a9042662fcf-tmp\") pod \"klusterlet-addon-workmgr-744478f76f-vskm7\" (UID: \"333a1655-7d2a-433a-9691-3a9042662fcf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-744478f76f-vskm7"
Jun 02 19:40:44.139295 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.138726    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/333a1655-7d2a-433a-9691-3a9042662fcf-klusterlet-config\") pod \"klusterlet-addon-workmgr-744478f76f-vskm7\" (UID: \"333a1655-7d2a-433a-9691-3a9042662fcf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-744478f76f-vskm7"
Jun 02 19:40:44.139295 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.138764    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5e0dd968-14ea-4b7f-bf65-c20f0c90f605-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-69f87f5b48-pm598\" (UID: \"5e0dd968-14ea-4b7f-bf65-c20f0c90f605\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f87f5b48-pm598"
Jun 02 19:40:44.139295 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.138793    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/5e0dd968-14ea-4b7f-bf65-c20f0c90f605-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-69f87f5b48-pm598\" (UID: \"5e0dd968-14ea-4b7f-bf65-c20f0c90f605\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f87f5b48-pm598"
Jun 02 19:40:44.139295 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.138856    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5e0dd968-14ea-4b7f-bf65-c20f0c90f605-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-69f87f5b48-pm598\" (UID: \"5e0dd968-14ea-4b7f-bf65-c20f0c90f605\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f87f5b48-pm598"
Jun 02 19:40:44.139295 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.138923    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lngpm\" (UniqueName: \"kubernetes.io/projected/5e0dd968-14ea-4b7f-bf65-c20f0c90f605-kube-api-access-lngpm\") pod \"cluster-proxy-proxy-agent-69f87f5b48-pm598\" (UID: \"5e0dd968-14ea-4b7f-bf65-c20f0c90f605\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f87f5b48-pm598"
Jun 02 19:40:44.139295 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.138958    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5e0dd968-14ea-4b7f-bf65-c20f0c90f605-hub\") pod \"cluster-proxy-proxy-agent-69f87f5b48-pm598\" (UID: \"5e0dd968-14ea-4b7f-bf65-c20f0c90f605\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f87f5b48-pm598"
Jun 02 19:40:44.139802 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.139764    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/333a1655-7d2a-433a-9691-3a9042662fcf-tmp\") pod \"klusterlet-addon-workmgr-744478f76f-vskm7\" (UID: \"333a1655-7d2a-433a-9691-3a9042662fcf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-744478f76f-vskm7"
Jun 02 19:40:44.140437 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.140284    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/5e0dd968-14ea-4b7f-bf65-c20f0c90f605-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-69f87f5b48-pm598\" (UID: \"5e0dd968-14ea-4b7f-bf65-c20f0c90f605\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f87f5b48-pm598"
Jun 02 19:40:44.143289 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.143253    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5e0dd968-14ea-4b7f-bf65-c20f0c90f605-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-69f87f5b48-pm598\" (UID: \"5e0dd968-14ea-4b7f-bf65-c20f0c90f605\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f87f5b48-pm598"
Jun 02 19:40:44.143384 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.143337    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5e0dd968-14ea-4b7f-bf65-c20f0c90f605-hub\") pod \"cluster-proxy-proxy-agent-69f87f5b48-pm598\" (UID: \"5e0dd968-14ea-4b7f-bf65-c20f0c90f605\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f87f5b48-pm598"
Jun 02 19:40:44.144476 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.144454    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/333a1655-7d2a-433a-9691-3a9042662fcf-klusterlet-config\") pod \"klusterlet-addon-workmgr-744478f76f-vskm7\" (UID: \"333a1655-7d2a-433a-9691-3a9042662fcf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-744478f76f-vskm7"
Jun 02 19:40:44.149060 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.149037    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm99p\" (UniqueName: \"kubernetes.io/projected/333a1655-7d2a-433a-9691-3a9042662fcf-kube-api-access-pm99p\") pod \"klusterlet-addon-workmgr-744478f76f-vskm7\" (UID: \"333a1655-7d2a-433a-9691-3a9042662fcf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-744478f76f-vskm7"
Jun 02 19:40:44.150128 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.150034    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5e0dd968-14ea-4b7f-bf65-c20f0c90f605-ca\") pod \"cluster-proxy-proxy-agent-69f87f5b48-pm598\" (UID: \"5e0dd968-14ea-4b7f-bf65-c20f0c90f605\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f87f5b48-pm598"
Jun 02 19:40:44.152551 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.152508    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5e0dd968-14ea-4b7f-bf65-c20f0c90f605-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-69f87f5b48-pm598\" (UID: \"5e0dd968-14ea-4b7f-bf65-c20f0c90f605\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f87f5b48-pm598"
Jun 02 19:40:44.160938 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.160695    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lngpm\" (UniqueName: \"kubernetes.io/projected/5e0dd968-14ea-4b7f-bf65-c20f0c90f605-kube-api-access-lngpm\") pod \"cluster-proxy-proxy-agent-69f87f5b48-pm598\" (UID: \"5e0dd968-14ea-4b7f-bf65-c20f0c90f605\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f87f5b48-pm598"
Jun 02 19:40:44.168971 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.162493    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-695df548f6-k8xf6"
Jun 02 19:40:44.174303 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.173714    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f87f5b48-pm598"
Jun 02 19:40:44.237447 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.236727    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-744478f76f-vskm7"
Jun 02 19:40:44.283897 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.281311    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-wcpcq"]
Jun 02 19:40:44.283897 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.283452    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mt424"]
Jun 02 19:40:44.285353 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:44.284905    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf987766a_4b0f_471b_a6fa_99a268314b79.slice/crio-a244652e5593ff86004b3f1616fd3cd62c5ee1457a6b75d926bf09cb7d5ac9b8 WatchSource:0}: Error finding container a244652e5593ff86004b3f1616fd3cd62c5ee1457a6b75d926bf09cb7d5ac9b8: Status 404 returned error can't find the container with id a244652e5593ff86004b3f1616fd3cd62c5ee1457a6b75d926bf09cb7d5ac9b8
Jun 02 19:40:44.293129 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:44.290611    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c3ecc02_7b08_42ef_9078_60a7a2a271f2.slice/crio-902f520390a53cf9e7cfc87567c388183d62392fa85082950e59187f2c5c5e4a WatchSource:0}: Error finding container 902f520390a53cf9e7cfc87567c388183d62392fa85082950e59187f2c5c5e4a: Status 404 returned error can't find the container with id 902f520390a53cf9e7cfc87567c388183d62392fa85082950e59187f2c5c5e4a
Jun 02 19:40:44.296781 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.296640    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-4t95b"]
Jun 02 19:40:44.300662 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:44.300640    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c521bf4_fe5d_4188_a7ea_001c7e8c2255.slice/crio-f4607f9c21d555cc5873c382b3819d92ca8d45848a8aa55f0a4f45128bb37193 WatchSource:0}: Error finding container f4607f9c21d555cc5873c382b3819d92ca8d45848a8aa55f0a4f45128bb37193: Status 404 returned error can't find the container with id f4607f9c21d555cc5873c382b3819d92ca8d45848a8aa55f0a4f45128bb37193
Jun 02 19:40:44.316979 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.316953    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-9prxw"]
Jun 02 19:40:44.320268 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:44.320228    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2beb603f_6723_4b6c_8c48_4cdb35e4bcab.slice/crio-08697476f0932fbfb061459c77eb8c4f9ee33c52ebf1d85d0aab19320af332c1 WatchSource:0}: Error finding container 08697476f0932fbfb061459c77eb8c4f9ee33c52ebf1d85d0aab19320af332c1: Status 404 returned error can't find the container with id 08697476f0932fbfb061459c77eb8c4f9ee33c52ebf1d85d0aab19320af332c1
Jun 02 19:40:44.343225 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.342996    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/902a5df6-ede1-4fee-8f32-cebc9b697d00-registry-tls\") pod \"image-registry-5f899fcc64-s4hmb\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") " pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb"
Jun 02 19:40:44.343225 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.343054    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6f6dc05-25cb-4329-8e28-11d41fd538c4-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-9fjnc\" (UID: \"d6f6dc05-25cb-4329-8e28-11d41fd538c4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9fjnc"
Jun 02 19:40:44.343225 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.343119    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/099a66f9-dfe1-4ef7-b849-3e6951bd23f2-metrics-tls\") pod \"dns-default-kwwz5\" (UID: \"099a66f9-dfe1-4ef7-b849-3e6951bd23f2\") " pod="openshift-dns/dns-default-kwwz5"
Jun 02 19:40:44.343225 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:44.343132    2564 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 02 19:40:44.343225 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:44.343148    2564 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f899fcc64-s4hmb: secret "image-registry-tls" not found
Jun 02 19:40:44.343225 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:44.343203    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 02 19:40:44.343225 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:44.343216    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/902a5df6-ede1-4fee-8f32-cebc9b697d00-registry-tls podName:902a5df6-ede1-4fee-8f32-cebc9b697d00 nodeName:}" failed. No retries permitted until 2026-06-02 19:40:45.343197327 +0000 UTC m=+38.197617604 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/902a5df6-ede1-4fee-8f32-cebc9b697d00-registry-tls") pod "image-registry-5f899fcc64-s4hmb" (UID: "902a5df6-ede1-4fee-8f32-cebc9b697d00") : secret "image-registry-tls" not found
Jun 02 19:40:44.343629 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:44.343258    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6f6dc05-25cb-4329-8e28-11d41fd538c4-samples-operator-tls podName:d6f6dc05-25cb-4329-8e28-11d41fd538c4 nodeName:}" failed. No retries permitted until 2026-06-02 19:40:45.343245165 +0000 UTC m=+38.197665436 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d6f6dc05-25cb-4329-8e28-11d41fd538c4-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-9fjnc" (UID: "d6f6dc05-25cb-4329-8e28-11d41fd538c4") : secret "samples-operator-tls" not found
Jun 02 19:40:44.343629 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:44.343205    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 02 19:40:44.343629 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:44.343294    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/099a66f9-dfe1-4ef7-b849-3e6951bd23f2-metrics-tls podName:099a66f9-dfe1-4ef7-b849-3e6951bd23f2 nodeName:}" failed. No retries permitted until 2026-06-02 19:40:45.343287826 +0000 UTC m=+38.197708097 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/099a66f9-dfe1-4ef7-b849-3e6951bd23f2-metrics-tls") pod "dns-default-kwwz5" (UID: "099a66f9-dfe1-4ef7-b849-3e6951bd23f2") : secret "dns-default-metrics-tls" not found
Jun 02 19:40:44.359989 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.359941    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-695df548f6-k8xf6"]
Jun 02 19:40:44.363767 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:44.363742    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c364585_c0af_48d3_9d12_ab83b0c040e2.slice/crio-580a827af74a2218d72210d055edb8dce0b4a1de7b9b79c49951a2a9909d76f2 WatchSource:0}: Error finding container 580a827af74a2218d72210d055edb8dce0b4a1de7b9b79c49951a2a9909d76f2: Status 404 returned error can't find the container with id 580a827af74a2218d72210d055edb8dce0b4a1de7b9b79c49951a2a9909d76f2
Jun 02 19:40:44.375600 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.375537    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f87f5b48-pm598"]
Jun 02 19:40:44.377750 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:44.377703    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5e0dd968_14ea_4b7f_bf65_c20f0c90f605.slice/crio-54d3c089b6e7a49370e87cf5e602f98cbe468cafb3740bf1397437b5c09a2eb9 WatchSource:0}: Error finding container 54d3c089b6e7a49370e87cf5e602f98cbe468cafb3740bf1397437b5c09a2eb9: Status 404 returned error can't find the container with id 54d3c089b6e7a49370e87cf5e602f98cbe468cafb3740bf1397437b5c09a2eb9
Jun 02 19:40:44.389791 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.389770    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-744478f76f-vskm7"]
Jun 02 19:40:44.392071 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:44.392048    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod333a1655_7d2a_433a_9691_3a9042662fcf.slice/crio-8971260d97852061bb8db597354510719e0bffbe2be78f954243539a0f27527c WatchSource:0}: Error finding container 8971260d97852061bb8db597354510719e0bffbe2be78f954243539a0f27527c: Status 404 returned error can't find the container with id 8971260d97852061bb8db597354510719e0bffbe2be78f954243539a0f27527c
Jun 02 19:40:44.444038 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.444016    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8620c80b-baae-412c-9d06-3e2fdb65665c-service-ca-bundle\") pod \"router-default-c796fd74c-l2p9g\" (UID: \"8620c80b-baae-412c-9d06-3e2fdb65665c\") " pod="openshift-ingress/router-default-c796fd74c-l2p9g"
Jun 02 19:40:44.444127 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.444088    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8620c80b-baae-412c-9d06-3e2fdb65665c-metrics-certs\") pod \"router-default-c796fd74c-l2p9g\" (UID: \"8620c80b-baae-412c-9d06-3e2fdb65665c\") " pod="openshift-ingress/router-default-c796fd74c-l2p9g"
Jun 02 19:40:44.444170 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.444130    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa48db29-a46c-418f-80db-cc2c39f225d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-9rbdk\" (UID: \"fa48db29-a46c-418f-80db-cc2c39f225d7\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9rbdk"
Jun 02 19:40:44.444202 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:44.444170    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8620c80b-baae-412c-9d06-3e2fdb65665c-service-ca-bundle podName:8620c80b-baae-412c-9d06-3e2fdb65665c nodeName:}" failed. No retries permitted until 2026-06-02 19:40:45.444151348 +0000 UTC m=+38.298571619 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8620c80b-baae-412c-9d06-3e2fdb65665c-service-ca-bundle") pod "router-default-c796fd74c-l2p9g" (UID: "8620c80b-baae-412c-9d06-3e2fdb65665c") : configmap references non-existent config key: service-ca.crt
Jun 02 19:40:44.444246 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:44.444234    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 02 19:40:44.444283 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:44.444239    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 02 19:40:44.444283 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:44.444278    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa48db29-a46c-418f-80db-cc2c39f225d7-cluster-monitoring-operator-tls podName:fa48db29-a46c-418f-80db-cc2c39f225d7 nodeName:}" failed. No retries permitted until 2026-06-02 19:40:45.444266204 +0000 UTC m=+38.298686474 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fa48db29-a46c-418f-80db-cc2c39f225d7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-9rbdk" (UID: "fa48db29-a46c-418f-80db-cc2c39f225d7") : secret "cluster-monitoring-operator-tls" not found
Jun 02 19:40:44.444351 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:44.444291    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8620c80b-baae-412c-9d06-3e2fdb65665c-metrics-certs podName:8620c80b-baae-412c-9d06-3e2fdb65665c nodeName:}" failed. No retries permitted until 2026-06-02 19:40:45.444284689 +0000 UTC m=+38.298704959 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8620c80b-baae-412c-9d06-3e2fdb65665c-metrics-certs") pod "router-default-c796fd74c-l2p9g" (UID: "8620c80b-baae-412c-9d06-3e2fdb65665c") : secret "router-metrics-certs-default" not found
Jun 02 19:40:44.545390 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.545362    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53c539fd-aeda-4f98-9450-4f7f05782e32-cert\") pod \"ingress-canary-lnzsg\" (UID: \"53c539fd-aeda-4f98-9450-4f7f05782e32\") " pod="openshift-ingress-canary/ingress-canary-lnzsg"
Jun 02 19:40:44.545946 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:44.545525    2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 02 19:40:44.545946 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:44.545587    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53c539fd-aeda-4f98-9450-4f7f05782e32-cert podName:53c539fd-aeda-4f98-9450-4f7f05782e32 nodeName:}" failed. No retries permitted until 2026-06-02 19:40:45.54556966 +0000 UTC m=+38.399989947 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/53c539fd-aeda-4f98-9450-4f7f05782e32-cert") pod "ingress-canary-lnzsg" (UID: "53c539fd-aeda-4f98-9450-4f7f05782e32") : secret "canary-serving-cert" not found
Jun 02 19:40:44.805346 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.805308    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-9jgn2" event={"ID":"7c1244c6-6d55-4cff-8099-4fc240c590f4","Type":"ContainerStarted","Data":"7d714a39ee9b966d0ece0f207d596dd05b5fd45dd395c0f0ce6d8263b559390e"}
Jun 02 19:40:44.806502 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.806466    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-h4rgf" event={"ID":"03f84c87-e6c2-4b90-be42-138de83f59ef","Type":"ContainerStarted","Data":"30c07e72961bf718f88d27bb0fce28fd55e5bfe1f5a468e5b5c979a7d0b0b008"}
Jun 02 19:40:44.810028 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.810002    2564 generic.go:358] "Generic (PLEG): container finished" podID="7b6cbcad-e6ac-4814-92f0-ab915efd8844" containerID="38920f8380d428b4a180f8968bbae4db1ed5c0a8fc2d1c96987268be4d952415" exitCode=0
Jun 02 19:40:44.810122 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.810074    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wrvzk" event={"ID":"7b6cbcad-e6ac-4814-92f0-ab915efd8844","Type":"ContainerDied","Data":"38920f8380d428b4a180f8968bbae4db1ed5c0a8fc2d1c96987268be4d952415"}
Jun 02 19:40:44.811569 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.811534    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-9prxw" event={"ID":"2beb603f-6723-4b6c-8c48-4cdb35e4bcab","Type":"ContainerStarted","Data":"08697476f0932fbfb061459c77eb8c4f9ee33c52ebf1d85d0aab19320af332c1"}
Jun 02 19:40:44.812811 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.812786    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-744478f76f-vskm7" event={"ID":"333a1655-7d2a-433a-9691-3a9042662fcf","Type":"ContainerStarted","Data":"8971260d97852061bb8db597354510719e0bffbe2be78f954243539a0f27527c"}
Jun 02 19:40:44.813995 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.813973    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-695df548f6-k8xf6" event={"ID":"6c364585-c0af-48d3-9d12-ab83b0c040e2","Type":"ContainerStarted","Data":"580a827af74a2218d72210d055edb8dce0b4a1de7b9b79c49951a2a9909d76f2"}
Jun 02 19:40:44.815260 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.815221    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-4t95b" event={"ID":"8c521bf4-fe5d-4188-a7ea-001c7e8c2255","Type":"ContainerStarted","Data":"f4607f9c21d555cc5873c382b3819d92ca8d45848a8aa55f0a4f45128bb37193"}
Jun 02 19:40:44.816446 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.816425    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f87f5b48-pm598" event={"ID":"5e0dd968-14ea-4b7f-bf65-c20f0c90f605","Type":"ContainerStarted","Data":"54d3c089b6e7a49370e87cf5e602f98cbe468cafb3740bf1397437b5c09a2eb9"}
Jun 02 19:40:44.818851 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.818811    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mt424" event={"ID":"8c3ecc02-7b08-42ef-9078-60a7a2a271f2","Type":"ContainerStarted","Data":"902f520390a53cf9e7cfc87567c388183d62392fa85082950e59187f2c5c5e4a"}
Jun 02 19:40:44.822531 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:44.822489    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-wcpcq" event={"ID":"f987766a-4b0f-471b-a6fa-99a268314b79","Type":"ContainerStarted","Data":"a244652e5593ff86004b3f1616fd3cd62c5ee1457a6b75d926bf09cb7d5ac9b8"}
Jun 02 19:40:45.354107 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:45.352860    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/902a5df6-ede1-4fee-8f32-cebc9b697d00-registry-tls\") pod \"image-registry-5f899fcc64-s4hmb\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") " pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb"
Jun 02 19:40:45.354107 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:45.353144    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6f6dc05-25cb-4329-8e28-11d41fd538c4-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-9fjnc\" (UID: \"d6f6dc05-25cb-4329-8e28-11d41fd538c4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9fjnc"
Jun 02 19:40:45.354107 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:45.353222    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/099a66f9-dfe1-4ef7-b849-3e6951bd23f2-metrics-tls\") pod \"dns-default-kwwz5\" (UID: \"099a66f9-dfe1-4ef7-b849-3e6951bd23f2\") " pod="openshift-dns/dns-default-kwwz5"
Jun 02 19:40:45.354107 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:45.353425    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 02 19:40:45.354107 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:45.353488    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/099a66f9-dfe1-4ef7-b849-3e6951bd23f2-metrics-tls podName:099a66f9-dfe1-4ef7-b849-3e6951bd23f2 nodeName:}" failed. No retries permitted until 2026-06-02 19:40:47.353470506 +0000 UTC m=+40.207890793 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/099a66f9-dfe1-4ef7-b849-3e6951bd23f2-metrics-tls") pod "dns-default-kwwz5" (UID: "099a66f9-dfe1-4ef7-b849-3e6951bd23f2") : secret "dns-default-metrics-tls" not found
Jun 02 19:40:45.354107 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:45.353925    2564 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 02 19:40:45.354107 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:45.353943    2564 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f899fcc64-s4hmb: secret "image-registry-tls" not found
Jun 02 19:40:45.354107 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:45.353990    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/902a5df6-ede1-4fee-8f32-cebc9b697d00-registry-tls podName:902a5df6-ede1-4fee-8f32-cebc9b697d00 nodeName:}" failed. No retries permitted until 2026-06-02 19:40:47.353973585 +0000 UTC m=+40.208393875 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/902a5df6-ede1-4fee-8f32-cebc9b697d00-registry-tls") pod "image-registry-5f899fcc64-s4hmb" (UID: "902a5df6-ede1-4fee-8f32-cebc9b697d00") : secret "image-registry-tls" not found
Jun 02 19:40:45.354107 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:45.354048    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 02 19:40:45.354107 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:45.354079    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6f6dc05-25cb-4329-8e28-11d41fd538c4-samples-operator-tls podName:d6f6dc05-25cb-4329-8e28-11d41fd538c4 nodeName:}" failed. No retries permitted until 2026-06-02 19:40:47.354068456 +0000 UTC m=+40.208488726 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d6f6dc05-25cb-4329-8e28-11d41fd538c4-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-9fjnc" (UID: "d6f6dc05-25cb-4329-8e28-11d41fd538c4") : secret "samples-operator-tls" not found
Jun 02 19:40:45.454925 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:45.453980    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8620c80b-baae-412c-9d06-3e2fdb65665c-service-ca-bundle\") pod \"router-default-c796fd74c-l2p9g\" (UID: \"8620c80b-baae-412c-9d06-3e2fdb65665c\") " pod="openshift-ingress/router-default-c796fd74c-l2p9g"
Jun 02 19:40:45.454925 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:45.454109    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8620c80b-baae-412c-9d06-3e2fdb65665c-metrics-certs\") pod \"router-default-c796fd74c-l2p9g\" (UID: \"8620c80b-baae-412c-9d06-3e2fdb65665c\") " pod="openshift-ingress/router-default-c796fd74c-l2p9g"
Jun 02 19:40:45.454925 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:45.454181    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa48db29-a46c-418f-80db-cc2c39f225d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-9rbdk\" (UID: \"fa48db29-a46c-418f-80db-cc2c39f225d7\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9rbdk"
Jun 02 19:40:45.454925 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:45.454298    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 02 19:40:45.454925 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:45.454365    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa48db29-a46c-418f-80db-cc2c39f225d7-cluster-monitoring-operator-tls podName:fa48db29-a46c-418f-80db-cc2c39f225d7 nodeName:}" failed. No retries permitted until 2026-06-02 19:40:47.454345929 +0000 UTC m=+40.308766203 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fa48db29-a46c-418f-80db-cc2c39f225d7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-9rbdk" (UID: "fa48db29-a46c-418f-80db-cc2c39f225d7") : secret "cluster-monitoring-operator-tls" not found
Jun 02 19:40:45.454925 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:45.454774    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8620c80b-baae-412c-9d06-3e2fdb65665c-service-ca-bundle podName:8620c80b-baae-412c-9d06-3e2fdb65665c nodeName:}" failed. No retries permitted until 2026-06-02 19:40:47.454758369 +0000 UTC m=+40.309178644 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8620c80b-baae-412c-9d06-3e2fdb65665c-service-ca-bundle") pod "router-default-c796fd74c-l2p9g" (UID: "8620c80b-baae-412c-9d06-3e2fdb65665c") : configmap references non-existent config key: service-ca.crt
Jun 02 19:40:45.454925 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:45.454857    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 02 19:40:45.454925 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:45.454892    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8620c80b-baae-412c-9d06-3e2fdb65665c-metrics-certs podName:8620c80b-baae-412c-9d06-3e2fdb65665c nodeName:}" failed. No retries permitted until 2026-06-02 19:40:47.454880173 +0000 UTC m=+40.309300447 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8620c80b-baae-412c-9d06-3e2fdb65665c-metrics-certs") pod "router-default-c796fd74c-l2p9g" (UID: "8620c80b-baae-412c-9d06-3e2fdb65665c") : secret "router-metrics-certs-default" not found
Jun 02 19:40:45.555319 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:45.554720    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53c539fd-aeda-4f98-9450-4f7f05782e32-cert\") pod \"ingress-canary-lnzsg\" (UID: \"53c539fd-aeda-4f98-9450-4f7f05782e32\") " pod="openshift-ingress-canary/ingress-canary-lnzsg"
Jun 02 19:40:45.555319 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:45.554910    2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 02 19:40:45.555319 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:45.554974    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53c539fd-aeda-4f98-9450-4f7f05782e32-cert podName:53c539fd-aeda-4f98-9450-4f7f05782e32 nodeName:}" failed. No retries permitted until 2026-06-02 19:40:47.554953952 +0000 UTC m=+40.409374227 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/53c539fd-aeda-4f98-9450-4f7f05782e32-cert") pod "ingress-canary-lnzsg" (UID: "53c539fd-aeda-4f98-9450-4f7f05782e32") : secret "canary-serving-cert" not found
Jun 02 19:40:45.866485 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:45.866448    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wrvzk" event={"ID":"7b6cbcad-e6ac-4814-92f0-ab915efd8844","Type":"ContainerStarted","Data":"8b2b047d07000ad69900c33ca7d89b2a6049286985d4286478951b572349c65e"}
Jun 02 19:40:45.892630 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:45.892559    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wrvzk" podStartSLOduration=6.295375529 podStartE2EDuration="38.892539441s" podCreationTimestamp="2026-06-02 19:40:07 +0000 UTC" firstStartedPulling="2026-06-02 19:40:10.492357749 +0000 UTC m=+3.346778023" lastFinishedPulling="2026-06-02 19:40:43.089521665 +0000 UTC m=+35.943941935" observedRunningTime="2026-06-02 19:40:45.890329708 +0000 UTC m=+38.744750000" watchObservedRunningTime="2026-06-02 19:40:45.892539441 +0000 UTC m=+38.746959729"
Jun 02 19:40:47.376245 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:47.376206    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/902a5df6-ede1-4fee-8f32-cebc9b697d00-registry-tls\") pod \"image-registry-5f899fcc64-s4hmb\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") " pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb"
Jun 02 19:40:47.376816 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:47.376279    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6f6dc05-25cb-4329-8e28-11d41fd538c4-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-9fjnc\" (UID: \"d6f6dc05-25cb-4329-8e28-11d41fd538c4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9fjnc"
Jun 02 19:40:47.376816 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:47.376352    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/099a66f9-dfe1-4ef7-b849-3e6951bd23f2-metrics-tls\") pod \"dns-default-kwwz5\" (UID: \"099a66f9-dfe1-4ef7-b849-3e6951bd23f2\") " pod="openshift-dns/dns-default-kwwz5"
Jun 02 19:40:47.376816 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:47.376484    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 02 19:40:47.376816 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:47.376544    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/099a66f9-dfe1-4ef7-b849-3e6951bd23f2-metrics-tls podName:099a66f9-dfe1-4ef7-b849-3e6951bd23f2 nodeName:}" failed. No retries permitted until 2026-06-02 19:40:51.376524852 +0000 UTC m=+44.230945132 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/099a66f9-dfe1-4ef7-b849-3e6951bd23f2-metrics-tls") pod "dns-default-kwwz5" (UID: "099a66f9-dfe1-4ef7-b849-3e6951bd23f2") : secret "dns-default-metrics-tls" not found
Jun 02 19:40:47.376816 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:47.376616    2564 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 02 19:40:47.376816 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:47.376627    2564 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f899fcc64-s4hmb: secret "image-registry-tls" not found
Jun 02 19:40:47.376816 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:47.376659    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/902a5df6-ede1-4fee-8f32-cebc9b697d00-registry-tls podName:902a5df6-ede1-4fee-8f32-cebc9b697d00 nodeName:}" failed. No retries permitted until 2026-06-02 19:40:51.376648414 +0000 UTC m=+44.231068698 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/902a5df6-ede1-4fee-8f32-cebc9b697d00-registry-tls") pod "image-registry-5f899fcc64-s4hmb" (UID: "902a5df6-ede1-4fee-8f32-cebc9b697d00") : secret "image-registry-tls" not found
Jun 02 19:40:47.376816 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:47.376715    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 02 19:40:47.376816 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:47.376747    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6f6dc05-25cb-4329-8e28-11d41fd538c4-samples-operator-tls podName:d6f6dc05-25cb-4329-8e28-11d41fd538c4 nodeName:}" failed. No retries permitted until 2026-06-02 19:40:51.376737538 +0000 UTC m=+44.231157811 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d6f6dc05-25cb-4329-8e28-11d41fd538c4-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-9fjnc" (UID: "d6f6dc05-25cb-4329-8e28-11d41fd538c4") : secret "samples-operator-tls" not found
Jun 02 19:40:47.477085 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:47.477047    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8620c80b-baae-412c-9d06-3e2fdb65665c-metrics-certs\") pod \"router-default-c796fd74c-l2p9g\" (UID: \"8620c80b-baae-412c-9d06-3e2fdb65665c\") " pod="openshift-ingress/router-default-c796fd74c-l2p9g"
Jun 02 19:40:47.477261 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:47.477145    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa48db29-a46c-418f-80db-cc2c39f225d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-9rbdk\" (UID: \"fa48db29-a46c-418f-80db-cc2c39f225d7\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9rbdk"
Jun 02 19:40:47.477261 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:47.477215    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8620c80b-baae-412c-9d06-3e2fdb65665c-service-ca-bundle\") pod \"router-default-c796fd74c-l2p9g\" (UID: \"8620c80b-baae-412c-9d06-3e2fdb65665c\") " pod="openshift-ingress/router-default-c796fd74c-l2p9g"
Jun 02 19:40:47.477436 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:47.477390    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8620c80b-baae-412c-9d06-3e2fdb65665c-service-ca-bundle podName:8620c80b-baae-412c-9d06-3e2fdb65665c nodeName:}" failed. No retries permitted until 2026-06-02 19:40:51.477372336 +0000 UTC m=+44.331792625 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8620c80b-baae-412c-9d06-3e2fdb65665c-service-ca-bundle") pod "router-default-c796fd74c-l2p9g" (UID: "8620c80b-baae-412c-9d06-3e2fdb65665c") : configmap references non-existent config key: service-ca.crt
Jun 02 19:40:47.477855 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:47.477816    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 02 19:40:47.477916 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:47.477887    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8620c80b-baae-412c-9d06-3e2fdb65665c-metrics-certs podName:8620c80b-baae-412c-9d06-3e2fdb65665c nodeName:}" failed. No retries permitted until 2026-06-02 19:40:51.477871231 +0000 UTC m=+44.332291506 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8620c80b-baae-412c-9d06-3e2fdb65665c-metrics-certs") pod "router-default-c796fd74c-l2p9g" (UID: "8620c80b-baae-412c-9d06-3e2fdb65665c") : secret "router-metrics-certs-default" not found
Jun 02 19:40:47.477984 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:47.477950    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 02 19:40:47.478034 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:47.477983    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa48db29-a46c-418f-80db-cc2c39f225d7-cluster-monitoring-operator-tls podName:fa48db29-a46c-418f-80db-cc2c39f225d7 nodeName:}" failed. No retries permitted until 2026-06-02 19:40:51.477971982 +0000 UTC m=+44.332392254 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fa48db29-a46c-418f-80db-cc2c39f225d7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-9rbdk" (UID: "fa48db29-a46c-418f-80db-cc2c39f225d7") : secret "cluster-monitoring-operator-tls" not found
Jun 02 19:40:47.578219 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:47.578182    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53c539fd-aeda-4f98-9450-4f7f05782e32-cert\") pod \"ingress-canary-lnzsg\" (UID: \"53c539fd-aeda-4f98-9450-4f7f05782e32\") " pod="openshift-ingress-canary/ingress-canary-lnzsg"
Jun 02 19:40:47.578447 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:47.578429    2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 02 19:40:47.578532 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:47.578494    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53c539fd-aeda-4f98-9450-4f7f05782e32-cert podName:53c539fd-aeda-4f98-9450-4f7f05782e32 nodeName:}" failed. No retries permitted until 2026-06-02 19:40:51.578476172 +0000 UTC m=+44.432896466 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/53c539fd-aeda-4f98-9450-4f7f05782e32-cert") pod "ingress-canary-lnzsg" (UID: "53c539fd-aeda-4f98-9450-4f7f05782e32") : secret "canary-serving-cert" not found
Jun 02 19:40:48.390647 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:48.390601    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/382834b8-2464-4874-b852-66124dc7ddab-original-pull-secret\") pod \"global-pull-secret-syncer-pn7k7\" (UID: \"382834b8-2464-4874-b852-66124dc7ddab\") " pod="kube-system/global-pull-secret-syncer-pn7k7"
Jun 02 19:40:48.394745 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:48.394712    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/382834b8-2464-4874-b852-66124dc7ddab-original-pull-secret\") pod \"global-pull-secret-syncer-pn7k7\" (UID: \"382834b8-2464-4874-b852-66124dc7ddab\") " pod="kube-system/global-pull-secret-syncer-pn7k7"
Jun 02 19:40:48.633486 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:48.633353    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn7k7"
Jun 02 19:40:49.726769 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:49.726736    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-95ppp"]
Jun 02 19:40:49.747456 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:49.747408    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-95ppp"]
Jun 02 19:40:49.747601 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:49.747547    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-95ppp"
Jun 02 19:40:49.750148 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:49.750123    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jun 02 19:40:49.750269 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:49.750133    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jun 02 19:40:49.750269 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:49.750230    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-t8txk\""
Jun 02 19:40:49.799524 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:49.799489    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/912780cc-8979-4267-9189-ec7f34a66078-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-95ppp\" (UID: \"912780cc-8979-4267-9189-ec7f34a66078\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-95ppp"
Jun 02 19:40:49.799687 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:49.799611    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/912780cc-8979-4267-9189-ec7f34a66078-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-95ppp\" (UID: \"912780cc-8979-4267-9189-ec7f34a66078\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-95ppp"
Jun 02 19:40:49.900226 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:49.900186    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/912780cc-8979-4267-9189-ec7f34a66078-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-95ppp\" (UID: \"912780cc-8979-4267-9189-ec7f34a66078\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-95ppp"
Jun 02 19:40:49.900464 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:49.900435    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/912780cc-8979-4267-9189-ec7f34a66078-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-95ppp\" (UID: \"912780cc-8979-4267-9189-ec7f34a66078\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-95ppp"
Jun 02 19:40:49.900628 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:49.900593    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 02 19:40:49.900696 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:49.900666    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/912780cc-8979-4267-9189-ec7f34a66078-networking-console-plugin-cert podName:912780cc-8979-4267-9189-ec7f34a66078 nodeName:}" failed. No retries permitted until 2026-06-02 19:40:50.400646679 +0000 UTC m=+43.255066964 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/912780cc-8979-4267-9189-ec7f34a66078-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-95ppp" (UID: "912780cc-8979-4267-9189-ec7f34a66078") : secret "networking-console-plugin-cert" not found
Jun 02 19:40:49.900928 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:49.900887    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/912780cc-8979-4267-9189-ec7f34a66078-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-95ppp\" (UID: \"912780cc-8979-4267-9189-ec7f34a66078\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-95ppp"
Jun 02 19:40:50.403556 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:50.403493    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/912780cc-8979-4267-9189-ec7f34a66078-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-95ppp\" (UID: \"912780cc-8979-4267-9189-ec7f34a66078\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-95ppp"
Jun 02 19:40:50.403726 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:50.403667    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 02 19:40:50.403809 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:50.403739    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/912780cc-8979-4267-9189-ec7f34a66078-networking-console-plugin-cert podName:912780cc-8979-4267-9189-ec7f34a66078 nodeName:}" failed. No retries permitted until 2026-06-02 19:40:51.403718641 +0000 UTC m=+44.258138917 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/912780cc-8979-4267-9189-ec7f34a66078-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-95ppp" (UID: "912780cc-8979-4267-9189-ec7f34a66078") : secret "networking-console-plugin-cert" not found
Jun 02 19:40:51.415132 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:51.415098    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/902a5df6-ede1-4fee-8f32-cebc9b697d00-registry-tls\") pod \"image-registry-5f899fcc64-s4hmb\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") " pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb"
Jun 02 19:40:51.415132 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:51.415145    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6f6dc05-25cb-4329-8e28-11d41fd538c4-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-9fjnc\" (UID: \"d6f6dc05-25cb-4329-8e28-11d41fd538c4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9fjnc"
Jun 02 19:40:51.415801 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:51.415197    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/099a66f9-dfe1-4ef7-b849-3e6951bd23f2-metrics-tls\") pod \"dns-default-kwwz5\" (UID: \"099a66f9-dfe1-4ef7-b849-3e6951bd23f2\") " pod="openshift-dns/dns-default-kwwz5"
Jun 02 19:40:51.415801 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:51.415229    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/912780cc-8979-4267-9189-ec7f34a66078-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-95ppp\" (UID: \"912780cc-8979-4267-9189-ec7f34a66078\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-95ppp"
Jun 02 19:40:51.415801 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:51.415265    2564 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 02 19:40:51.415801 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:51.415285    2564 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f899fcc64-s4hmb: secret "image-registry-tls" not found
Jun 02 19:40:51.415801 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:51.415332    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 02 19:40:51.415801 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:51.415341    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/902a5df6-ede1-4fee-8f32-cebc9b697d00-registry-tls podName:902a5df6-ede1-4fee-8f32-cebc9b697d00 nodeName:}" failed. No retries permitted until 2026-06-02 19:40:59.415325792 +0000 UTC m=+52.269746064 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/902a5df6-ede1-4fee-8f32-cebc9b697d00-registry-tls") pod "image-registry-5f899fcc64-s4hmb" (UID: "902a5df6-ede1-4fee-8f32-cebc9b697d00") : secret "image-registry-tls" not found
Jun 02 19:40:51.415801 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:51.415350    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 02 19:40:51.415801 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:51.415396    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6f6dc05-25cb-4329-8e28-11d41fd538c4-samples-operator-tls podName:d6f6dc05-25cb-4329-8e28-11d41fd538c4 nodeName:}" failed. No retries permitted until 2026-06-02 19:40:59.41537993 +0000 UTC m=+52.269800219 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d6f6dc05-25cb-4329-8e28-11d41fd538c4-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-9fjnc" (UID: "d6f6dc05-25cb-4329-8e28-11d41fd538c4") : secret "samples-operator-tls" not found
Jun 02 19:40:51.415801 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:51.415397    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 02 19:40:51.415801 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:51.415415    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/099a66f9-dfe1-4ef7-b849-3e6951bd23f2-metrics-tls podName:099a66f9-dfe1-4ef7-b849-3e6951bd23f2 nodeName:}" failed. No retries permitted until 2026-06-02 19:40:59.415405338 +0000 UTC m=+52.269825609 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/099a66f9-dfe1-4ef7-b849-3e6951bd23f2-metrics-tls") pod "dns-default-kwwz5" (UID: "099a66f9-dfe1-4ef7-b849-3e6951bd23f2") : secret "dns-default-metrics-tls" not found
Jun 02 19:40:51.415801 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:51.415443    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/912780cc-8979-4267-9189-ec7f34a66078-networking-console-plugin-cert podName:912780cc-8979-4267-9189-ec7f34a66078 nodeName:}" failed. No retries permitted until 2026-06-02 19:40:53.415436139 +0000 UTC m=+46.269856409 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/912780cc-8979-4267-9189-ec7f34a66078-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-95ppp" (UID: "912780cc-8979-4267-9189-ec7f34a66078") : secret "networking-console-plugin-cert" not found
Jun 02 19:40:51.517013 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:51.516530    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8620c80b-baae-412c-9d06-3e2fdb65665c-service-ca-bundle\") pod \"router-default-c796fd74c-l2p9g\" (UID: \"8620c80b-baae-412c-9d06-3e2fdb65665c\") " pod="openshift-ingress/router-default-c796fd74c-l2p9g"
Jun 02 19:40:51.517013 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:51.516679    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8620c80b-baae-412c-9d06-3e2fdb65665c-metrics-certs\") pod \"router-default-c796fd74c-l2p9g\" (UID: \"8620c80b-baae-412c-9d06-3e2fdb65665c\") " pod="openshift-ingress/router-default-c796fd74c-l2p9g"
Jun 02 19:40:51.517013 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:51.516747    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa48db29-a46c-418f-80db-cc2c39f225d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-9rbdk\" (UID: \"fa48db29-a46c-418f-80db-cc2c39f225d7\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9rbdk"
Jun 02 19:40:51.517013 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:51.516928    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 02 19:40:51.517013 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:51.516951    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8620c80b-baae-412c-9d06-3e2fdb65665c-service-ca-bundle podName:8620c80b-baae-412c-9d06-3e2fdb65665c nodeName:}" failed. No retries permitted until 2026-06-02 19:40:59.516926084 +0000 UTC m=+52.371346362 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8620c80b-baae-412c-9d06-3e2fdb65665c-service-ca-bundle") pod "router-default-c796fd74c-l2p9g" (UID: "8620c80b-baae-412c-9d06-3e2fdb65665c") : configmap references non-existent config key: service-ca.crt
Jun 02 19:40:51.517013 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:51.516986    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8620c80b-baae-412c-9d06-3e2fdb65665c-metrics-certs podName:8620c80b-baae-412c-9d06-3e2fdb65665c nodeName:}" failed. No retries permitted until 2026-06-02 19:40:59.516970128 +0000 UTC m=+52.371390402 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8620c80b-baae-412c-9d06-3e2fdb65665c-metrics-certs") pod "router-default-c796fd74c-l2p9g" (UID: "8620c80b-baae-412c-9d06-3e2fdb65665c") : secret "router-metrics-certs-default" not found
Jun 02 19:40:51.517446 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:51.517047    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 02 19:40:51.517446 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:51.517104    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa48db29-a46c-418f-80db-cc2c39f225d7-cluster-monitoring-operator-tls podName:fa48db29-a46c-418f-80db-cc2c39f225d7 nodeName:}" failed. No retries permitted until 2026-06-02 19:40:59.517091734 +0000 UTC m=+52.371512025 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fa48db29-a46c-418f-80db-cc2c39f225d7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-9rbdk" (UID: "fa48db29-a46c-418f-80db-cc2c39f225d7") : secret "cluster-monitoring-operator-tls" not found
Jun 02 19:40:51.618216 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:51.618176    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53c539fd-aeda-4f98-9450-4f7f05782e32-cert\") pod \"ingress-canary-lnzsg\" (UID: \"53c539fd-aeda-4f98-9450-4f7f05782e32\") " pod="openshift-ingress-canary/ingress-canary-lnzsg"
Jun 02 19:40:51.618412 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:51.618282    2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 02 19:40:51.618412 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:51.618334    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53c539fd-aeda-4f98-9450-4f7f05782e32-cert podName:53c539fd-aeda-4f98-9450-4f7f05782e32 nodeName:}" failed. No retries permitted until 2026-06-02 19:40:59.618318537 +0000 UTC m=+52.472738808 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/53c539fd-aeda-4f98-9450-4f7f05782e32-cert") pod "ingress-canary-lnzsg" (UID: "53c539fd-aeda-4f98-9450-4f7f05782e32") : secret "canary-serving-cert" not found
Jun 02 19:40:53.434119 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:53.434081    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/912780cc-8979-4267-9189-ec7f34a66078-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-95ppp\" (UID: \"912780cc-8979-4267-9189-ec7f34a66078\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-95ppp"
Jun 02 19:40:53.434787 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:53.434265    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 02 19:40:53.434787 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:53.434346    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/912780cc-8979-4267-9189-ec7f34a66078-networking-console-plugin-cert podName:912780cc-8979-4267-9189-ec7f34a66078 nodeName:}" failed. No retries permitted until 2026-06-02 19:40:57.434324023 +0000 UTC m=+50.288744308 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/912780cc-8979-4267-9189-ec7f34a66078-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-95ppp" (UID: "912780cc-8979-4267-9189-ec7f34a66078") : secret "networking-console-plugin-cert" not found
Jun 02 19:40:57.271616 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:57.271589    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pn7k7"]
Jun 02 19:40:57.275066 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:40:57.275040    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod382834b8_2464_4874_b852_66124dc7ddab.slice/crio-457306eb7022ada244171a4050a8159390f43404a4243997f988b254effb901b WatchSource:0}: Error finding container 457306eb7022ada244171a4050a8159390f43404a4243997f988b254effb901b: Status 404 returned error can't find the container with id 457306eb7022ada244171a4050a8159390f43404a4243997f988b254effb901b
Jun 02 19:40:57.470491 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:57.470197    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/912780cc-8979-4267-9189-ec7f34a66078-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-95ppp\" (UID: \"912780cc-8979-4267-9189-ec7f34a66078\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-95ppp"
Jun 02 19:40:57.470491 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:57.470471    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 02 19:40:57.470661 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:57.470532    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/912780cc-8979-4267-9189-ec7f34a66078-networking-console-plugin-cert podName:912780cc-8979-4267-9189-ec7f34a66078 nodeName:}" failed. No retries permitted until 2026-06-02 19:41:05.470512349 +0000 UTC m=+58.324932638 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/912780cc-8979-4267-9189-ec7f34a66078-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-95ppp" (UID: "912780cc-8979-4267-9189-ec7f34a66078") : secret "networking-console-plugin-cert" not found
Jun 02 19:40:57.897511 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:57.897462    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f87f5b48-pm598" event={"ID":"5e0dd968-14ea-4b7f-bf65-c20f0c90f605","Type":"ContainerStarted","Data":"c4e7cde6029e367a053c6f864406140495ef08a22d2479d79b1a84c63674717f"}
Jun 02 19:40:57.898739 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:57.898714    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mt424" event={"ID":"8c3ecc02-7b08-42ef-9078-60a7a2a271f2","Type":"ContainerStarted","Data":"91b23b15a0a3fc9564bd710c69eaa7d9e0708cdc74d2baf2ea57763b51c51cec"}
Jun 02 19:40:57.901264 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:57.900865    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-wcpcq" event={"ID":"f987766a-4b0f-471b-a6fa-99a268314b79","Type":"ContainerStarted","Data":"4639751f6d886d887fc74f0b021786da18c0b6ac790d2818665ed6cad5258156"}
Jun 02 19:40:57.902826 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:57.902695    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9jgn2_7c1244c6-6d55-4cff-8099-4fc240c590f4/console-operator/0.log"
Jun 02 19:40:57.902826 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:57.902727    2564 generic.go:358] "Generic (PLEG): container finished" podID="7c1244c6-6d55-4cff-8099-4fc240c590f4" containerID="5909d9d125cdae227893c0551c05d02febce786cb1a452b7a599bcfad3676157" exitCode=255
Jun 02 19:40:57.902826 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:57.902794    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-9jgn2" event={"ID":"7c1244c6-6d55-4cff-8099-4fc240c590f4","Type":"ContainerDied","Data":"5909d9d125cdae227893c0551c05d02febce786cb1a452b7a599bcfad3676157"}
Jun 02 19:40:57.903323 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:57.903071    2564 scope.go:117] "RemoveContainer" containerID="5909d9d125cdae227893c0551c05d02febce786cb1a452b7a599bcfad3676157"
Jun 02 19:40:57.907371 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:57.907342    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-h4rgf" event={"ID":"03f84c87-e6c2-4b90-be42-138de83f59ef","Type":"ContainerStarted","Data":"c11be731987886a5b8595ae49ef62603365c8df94f3f9ca1977c06591f0bf725"}
Jun 02 19:40:57.908869 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:57.908811    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pn7k7" event={"ID":"382834b8-2464-4874-b852-66124dc7ddab","Type":"ContainerStarted","Data":"457306eb7022ada244171a4050a8159390f43404a4243997f988b254effb901b"}
Jun 02 19:40:57.910235 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:57.910199    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-9prxw" event={"ID":"2beb603f-6723-4b6c-8c48-4cdb35e4bcab","Type":"ContainerStarted","Data":"fe37068e600f6c98c5d40697bcebf1d53b724f1c2dc2dcd720f4fb20403924c5"}
Jun 02 19:40:57.912187 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:57.912060    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-744478f76f-vskm7" event={"ID":"333a1655-7d2a-433a-9691-3a9042662fcf","Type":"ContainerStarted","Data":"9885447d2fcce742f8ca0b08141ef5ef873c953a26d3a02c6ba19824326a7192"}
Jun 02 19:40:57.912499 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:57.912468    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-744478f76f-vskm7"
Jun 02 19:40:57.914220 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:57.914202    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-744478f76f-vskm7"
Jun 02 19:40:57.915120 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:57.915101    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-695df548f6-k8xf6" event={"ID":"6c364585-c0af-48d3-9d12-ab83b0c040e2","Type":"ContainerStarted","Data":"44a12b07aae05bd68eccd8f6e1f36496f469a7f125a44fc37fa8bb217dfb8569"}
Jun 02 19:40:57.916624 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:57.916537    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mt424" podStartSLOduration=12.049721774 podStartE2EDuration="24.916525131s" podCreationTimestamp="2026-06-02 19:40:33 +0000 UTC" firstStartedPulling="2026-06-02 19:40:44.294185809 +0000 UTC m=+37.148606080" lastFinishedPulling="2026-06-02 19:40:57.160989151 +0000 UTC m=+50.015409437" observedRunningTime="2026-06-02 19:40:57.915707197 +0000 UTC m=+50.770127485" watchObservedRunningTime="2026-06-02 19:40:57.916525131 +0000 UTC m=+50.770945425"
Jun 02 19:40:57.918174 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:57.917755    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-4t95b" event={"ID":"8c521bf4-fe5d-4188-a7ea-001c7e8c2255","Type":"ContainerStarted","Data":"6b5bfb90d87cd9ef32848cd799aff24d837f5990bc2a43cd876a603e7be3daa0"}
Jun 02 19:40:57.971555 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:57.971508    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-9prxw" podStartSLOduration=12.083181542 podStartE2EDuration="24.971491476s" podCreationTimestamp="2026-06-02 19:40:33 +0000 UTC" firstStartedPulling="2026-06-02 19:40:44.323088039 +0000 UTC m=+37.177508310" lastFinishedPulling="2026-06-02 19:40:57.211397962 +0000 UTC m=+50.065818244" observedRunningTime="2026-06-02 19:40:57.951746336 +0000 UTC m=+50.806166631" watchObservedRunningTime="2026-06-02 19:40:57.971491476 +0000 UTC m=+50.825911771"
Jun 02 19:40:57.972183 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:57.972136    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-wcpcq" podStartSLOduration=12.050452165 podStartE2EDuration="24.972126319s" podCreationTimestamp="2026-06-02 19:40:33 +0000 UTC" firstStartedPulling="2026-06-02 19:40:44.290114635 +0000 UTC m=+37.144534920" lastFinishedPulling="2026-06-02 19:40:57.211788802 +0000 UTC m=+50.066209074" observedRunningTime="2026-06-02 19:40:57.971068767 +0000 UTC m=+50.825489060" watchObservedRunningTime="2026-06-02 19:40:57.972126319 +0000 UTC m=+50.826546613"
Jun 02 19:40:57.998232 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:57.996619    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-h4rgf" podStartSLOduration=13.133985453 podStartE2EDuration="24.996602059s" podCreationTimestamp="2026-06-02 19:40:33 +0000 UTC" firstStartedPulling="2026-06-02 19:40:44.099140353 +0000 UTC m=+36.953560638" lastFinishedPulling="2026-06-02 19:40:55.961756969 +0000 UTC m=+48.816177244" observedRunningTime="2026-06-02 19:40:57.996118966 +0000 UTC m=+50.850539262" watchObservedRunningTime="2026-06-02 19:40:57.996602059 +0000 UTC m=+50.851022354"
Jun 02 19:40:58.018876 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:58.018801    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-744478f76f-vskm7" podStartSLOduration=9.202283658 podStartE2EDuration="22.01878625s" podCreationTimestamp="2026-06-02 19:40:36 +0000 UTC" firstStartedPulling="2026-06-02 19:40:44.393524366 +0000 UTC m=+37.247944637" lastFinishedPulling="2026-06-02 19:40:57.21002695 +0000 UTC m=+50.064447229" observedRunningTime="2026-06-02 19:40:58.017135908 +0000 UTC m=+50.871556202" watchObservedRunningTime="2026-06-02 19:40:58.01878625 +0000 UTC m=+50.873206546"
Jun 02 19:40:58.040739 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:58.040597    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-695df548f6-k8xf6" podStartSLOduration=9.187730159000001 podStartE2EDuration="22.04058155s" podCreationTimestamp="2026-06-02 19:40:36 +0000 UTC" firstStartedPulling="2026-06-02 19:40:44.365606193 +0000 UTC m=+37.220026468" lastFinishedPulling="2026-06-02 19:40:57.218457587 +0000 UTC m=+50.072877859" observedRunningTime="2026-06-02 19:40:58.038528377 +0000 UTC m=+50.892948671" watchObservedRunningTime="2026-06-02 19:40:58.04058155 +0000 UTC m=+50.895001844"
Jun 02 19:40:58.923717 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:58.923631    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9jgn2_7c1244c6-6d55-4cff-8099-4fc240c590f4/console-operator/1.log"
Jun 02 19:40:58.924815 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:58.924421    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9jgn2_7c1244c6-6d55-4cff-8099-4fc240c590f4/console-operator/0.log"
Jun 02 19:40:58.924815 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:58.924464    2564 generic.go:358] "Generic (PLEG): container finished" podID="7c1244c6-6d55-4cff-8099-4fc240c590f4" containerID="bf9cb1ac0717f226841adf6bd82038d5799236e1a8caef94406ff5c2a9bee2a1" exitCode=255
Jun 02 19:40:58.924815 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:58.924619    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-9jgn2" event={"ID":"7c1244c6-6d55-4cff-8099-4fc240c590f4","Type":"ContainerDied","Data":"bf9cb1ac0717f226841adf6bd82038d5799236e1a8caef94406ff5c2a9bee2a1"}
Jun 02 19:40:58.924815 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:58.924656    2564 scope.go:117] "RemoveContainer" containerID="5909d9d125cdae227893c0551c05d02febce786cb1a452b7a599bcfad3676157"
Jun 02 19:40:58.925109 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:58.924888    2564 scope.go:117] "RemoveContainer" containerID="bf9cb1ac0717f226841adf6bd82038d5799236e1a8caef94406ff5c2a9bee2a1"
Jun 02 19:40:58.925165 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:58.925111    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-9jgn2_openshift-console-operator(7c1244c6-6d55-4cff-8099-4fc240c590f4)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-9jgn2" podUID="7c1244c6-6d55-4cff-8099-4fc240c590f4"
Jun 02 19:40:58.944831 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:58.944791    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-788bf58df5-4t95b" podStartSLOduration=13.086277753 podStartE2EDuration="25.944778515s" podCreationTimestamp="2026-06-02 19:40:33 +0000 UTC" firstStartedPulling="2026-06-02 19:40:44.302988407 +0000 UTC m=+37.157408678" lastFinishedPulling="2026-06-02 19:40:57.161489166 +0000 UTC m=+50.015909440" observedRunningTime="2026-06-02 19:40:58.057918306 +0000 UTC m=+50.912338599" watchObservedRunningTime="2026-06-02 19:40:58.944778515 +0000 UTC m=+51.799198807"
Jun 02 19:40:59.416250 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:59.416205    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/099a66f9-dfe1-4ef7-b849-3e6951bd23f2-metrics-tls\") pod \"dns-default-kwwz5\" (UID: \"099a66f9-dfe1-4ef7-b849-3e6951bd23f2\") " pod="openshift-dns/dns-default-kwwz5"
Jun 02 19:40:59.416444 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:59.416348    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/902a5df6-ede1-4fee-8f32-cebc9b697d00-registry-tls\") pod \"image-registry-5f899fcc64-s4hmb\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") " pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb"
Jun 02 19:40:59.416444 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:59.416367    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 02 19:40:59.416444 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:59.416387    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6f6dc05-25cb-4329-8e28-11d41fd538c4-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-9fjnc\" (UID: \"d6f6dc05-25cb-4329-8e28-11d41fd538c4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9fjnc"
Jun 02 19:40:59.416444 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:59.416442    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/099a66f9-dfe1-4ef7-b849-3e6951bd23f2-metrics-tls podName:099a66f9-dfe1-4ef7-b849-3e6951bd23f2 nodeName:}" failed. No retries permitted until 2026-06-02 19:41:15.416420503 +0000 UTC m=+68.270840777 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/099a66f9-dfe1-4ef7-b849-3e6951bd23f2-metrics-tls") pod "dns-default-kwwz5" (UID: "099a66f9-dfe1-4ef7-b849-3e6951bd23f2") : secret "dns-default-metrics-tls" not found
Jun 02 19:40:59.416724 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:59.416530    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 02 19:40:59.416724 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:59.416588    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6f6dc05-25cb-4329-8e28-11d41fd538c4-samples-operator-tls podName:d6f6dc05-25cb-4329-8e28-11d41fd538c4 nodeName:}" failed. No retries permitted until 2026-06-02 19:41:15.416570505 +0000 UTC m=+68.270990792 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d6f6dc05-25cb-4329-8e28-11d41fd538c4-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-9fjnc" (UID: "d6f6dc05-25cb-4329-8e28-11d41fd538c4") : secret "samples-operator-tls" not found
Jun 02 19:40:59.416724 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:59.416659    2564 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 02 19:40:59.416724 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:59.416671    2564 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f899fcc64-s4hmb: secret "image-registry-tls" not found
Jun 02 19:40:59.416724 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:59.416713    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/902a5df6-ede1-4fee-8f32-cebc9b697d00-registry-tls podName:902a5df6-ede1-4fee-8f32-cebc9b697d00 nodeName:}" failed. No retries permitted until 2026-06-02 19:41:15.416701067 +0000 UTC m=+68.271121341 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/902a5df6-ede1-4fee-8f32-cebc9b697d00-registry-tls") pod "image-registry-5f899fcc64-s4hmb" (UID: "902a5df6-ede1-4fee-8f32-cebc9b697d00") : secret "image-registry-tls" not found
Jun 02 19:40:59.517016 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:59.516974    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8620c80b-baae-412c-9d06-3e2fdb65665c-service-ca-bundle\") pod \"router-default-c796fd74c-l2p9g\" (UID: \"8620c80b-baae-412c-9d06-3e2fdb65665c\") " pod="openshift-ingress/router-default-c796fd74c-l2p9g"
Jun 02 19:40:59.517192 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:59.517158    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8620c80b-baae-412c-9d06-3e2fdb65665c-service-ca-bundle podName:8620c80b-baae-412c-9d06-3e2fdb65665c nodeName:}" failed. No retries permitted until 2026-06-02 19:41:15.517136335 +0000 UTC m=+68.371556612 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8620c80b-baae-412c-9d06-3e2fdb65665c-service-ca-bundle") pod "router-default-c796fd74c-l2p9g" (UID: "8620c80b-baae-412c-9d06-3e2fdb65665c") : configmap references non-existent config key: service-ca.crt
Jun 02 19:40:59.618473 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:59.618432    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8620c80b-baae-412c-9d06-3e2fdb65665c-metrics-certs\") pod \"router-default-c796fd74c-l2p9g\" (UID: \"8620c80b-baae-412c-9d06-3e2fdb65665c\") " pod="openshift-ingress/router-default-c796fd74c-l2p9g"
Jun 02 19:40:59.618665 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:59.618496    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53c539fd-aeda-4f98-9450-4f7f05782e32-cert\") pod \"ingress-canary-lnzsg\" (UID: \"53c539fd-aeda-4f98-9450-4f7f05782e32\") " pod="openshift-ingress-canary/ingress-canary-lnzsg"
Jun 02 19:40:59.618665 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:59.618526    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa48db29-a46c-418f-80db-cc2c39f225d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-9rbdk\" (UID: \"fa48db29-a46c-418f-80db-cc2c39f225d7\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9rbdk"
Jun 02 19:40:59.618772 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:59.618728    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 02 19:40:59.618822 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:59.618791    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa48db29-a46c-418f-80db-cc2c39f225d7-cluster-monitoring-operator-tls podName:fa48db29-a46c-418f-80db-cc2c39f225d7 nodeName:}" failed. No retries permitted until 2026-06-02 19:41:15.618773242 +0000 UTC m=+68.473193531 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fa48db29-a46c-418f-80db-cc2c39f225d7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-9rbdk" (UID: "fa48db29-a46c-418f-80db-cc2c39f225d7") : secret "cluster-monitoring-operator-tls" not found
Jun 02 19:40:59.619209 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:59.618939    2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 02 19:40:59.619209 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:59.618983    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53c539fd-aeda-4f98-9450-4f7f05782e32-cert podName:53c539fd-aeda-4f98-9450-4f7f05782e32 nodeName:}" failed. No retries permitted until 2026-06-02 19:41:15.618969496 +0000 UTC m=+68.473389789 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/53c539fd-aeda-4f98-9450-4f7f05782e32-cert") pod "ingress-canary-lnzsg" (UID: "53c539fd-aeda-4f98-9450-4f7f05782e32") : secret "canary-serving-cert" not found
Jun 02 19:40:59.619209 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:59.619038    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 02 19:40:59.619209 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:59.619070    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8620c80b-baae-412c-9d06-3e2fdb65665c-metrics-certs podName:8620c80b-baae-412c-9d06-3e2fdb65665c nodeName:}" failed. No retries permitted until 2026-06-02 19:41:15.61905975 +0000 UTC m=+68.473480027 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8620c80b-baae-412c-9d06-3e2fdb65665c-metrics-certs") pod "router-default-c796fd74c-l2p9g" (UID: "8620c80b-baae-412c-9d06-3e2fdb65665c") : secret "router-metrics-certs-default" not found
Jun 02 19:40:59.930580 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:59.930533    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9jgn2_7c1244c6-6d55-4cff-8099-4fc240c590f4/console-operator/1.log"
Jun 02 19:40:59.931107 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:40:59.930977    2564 scope.go:117] "RemoveContainer" containerID="bf9cb1ac0717f226841adf6bd82038d5799236e1a8caef94406ff5c2a9bee2a1"
Jun 02 19:40:59.931305 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:40:59.931190    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-9jgn2_openshift-console-operator(7c1244c6-6d55-4cff-8099-4fc240c590f4)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-9jgn2" podUID="7c1244c6-6d55-4cff-8099-4fc240c590f4"
Jun 02 19:41:00.285716 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:00.285686    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4lnzn_bcbb7e95-e1e4-4ebe-a7b8-460d29d57a26/dns-node-resolver/0.log"
Jun 02 19:41:01.285802 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:01.285772    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2rvfs_830bda40-f0ea-4921-9555-49dd81e23f11/node-ca/0.log"
Jun 02 19:41:02.948797 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:02.948711    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f87f5b48-pm598" event={"ID":"5e0dd968-14ea-4b7f-bf65-c20f0c90f605","Type":"ContainerStarted","Data":"d83498267a429594aeed641e6a7588fb00faecf4768470b6b71c8221ebf67344"}
Jun 02 19:41:02.948797 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:02.948749    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f87f5b48-pm598" event={"ID":"5e0dd968-14ea-4b7f-bf65-c20f0c90f605","Type":"ContainerStarted","Data":"5a972e730f2d85d32ec18c4a9840cd47869f08b1ac2a6c234e85d7fcf23ecffe"}
Jun 02 19:41:02.950042 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:02.950019    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pn7k7" event={"ID":"382834b8-2464-4874-b852-66124dc7ddab","Type":"ContainerStarted","Data":"97ea0c10e65d60f8664bf722ad2caaf44681df1e790c93db1426847bf44c0cac"}
Jun 02 19:41:02.972957 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:02.972916    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f87f5b48-pm598" podStartSLOduration=9.235190811 podStartE2EDuration="26.972904906s" podCreationTimestamp="2026-06-02 19:40:36 +0000 UTC" firstStartedPulling="2026-06-02 19:40:44.379433311 +0000 UTC m=+37.233853599" lastFinishedPulling="2026-06-02 19:41:02.117147424 +0000 UTC m=+54.971567694" observedRunningTime="2026-06-02 19:41:02.971965808 +0000 UTC m=+55.826386101" watchObservedRunningTime="2026-06-02 19:41:02.972904906 +0000 UTC m=+55.827325199"
Jun 02 19:41:02.986701 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:02.986660    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pn7k7" podStartSLOduration=41.773426398 podStartE2EDuration="46.986648911s" podCreationTimestamp="2026-06-02 19:40:16 +0000 UTC" firstStartedPulling="2026-06-02 19:40:57.277147434 +0000 UTC m=+50.131567706" lastFinishedPulling="2026-06-02 19:41:02.490369943 +0000 UTC m=+55.344790219" observedRunningTime="2026-06-02 19:41:02.986118037 +0000 UTC m=+55.840538332" watchObservedRunningTime="2026-06-02 19:41:02.986648911 +0000 UTC m=+55.841069204"
Jun 02 19:41:03.964109 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:03.964082    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-9jgn2"
Jun 02 19:41:03.964109 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:03.964111    2564 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-9jgn2"
Jun 02 19:41:03.964756 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:03.964494    2564 scope.go:117] "RemoveContainer" containerID="bf9cb1ac0717f226841adf6bd82038d5799236e1a8caef94406ff5c2a9bee2a1"
Jun 02 19:41:03.968146 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:41:03.965030    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-9jgn2_openshift-console-operator(7c1244c6-6d55-4cff-8099-4fc240c590f4)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-9jgn2" podUID="7c1244c6-6d55-4cff-8099-4fc240c590f4"
Jun 02 19:41:05.472577 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:05.472535    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/912780cc-8979-4267-9189-ec7f34a66078-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-95ppp\" (UID: \"912780cc-8979-4267-9189-ec7f34a66078\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-95ppp"
Jun 02 19:41:05.472982 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:41:05.472644    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 02 19:41:05.472982 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:41:05.472717    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/912780cc-8979-4267-9189-ec7f34a66078-networking-console-plugin-cert podName:912780cc-8979-4267-9189-ec7f34a66078 nodeName:}" failed. No retries permitted until 2026-06-02 19:41:21.472699072 +0000 UTC m=+74.327119345 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/912780cc-8979-4267-9189-ec7f34a66078-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-95ppp" (UID: "912780cc-8979-4267-9189-ec7f34a66078") : secret "networking-console-plugin-cert" not found
Jun 02 19:41:09.803040 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:09.803011    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-79xzx"
Jun 02 19:41:13.336603 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:13.336567    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91837c0a-ed65-44e8-b6f4-461981ef22b2-metrics-certs\") pod \"network-metrics-daemon-xlffd\" (UID: \"91837c0a-ed65-44e8-b6f4-461981ef22b2\") " pod="openshift-multus/network-metrics-daemon-xlffd"
Jun 02 19:41:13.339234 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:13.339215    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 02 19:41:13.347235 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:41:13.347215    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 02 19:41:13.347290 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:41:13.347283    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91837c0a-ed65-44e8-b6f4-461981ef22b2-metrics-certs podName:91837c0a-ed65-44e8-b6f4-461981ef22b2 nodeName:}" failed. No retries permitted until 2026-06-02 19:42:17.347260725 +0000 UTC m=+130.201680999 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/91837c0a-ed65-44e8-b6f4-461981ef22b2-metrics-certs") pod "network-metrics-daemon-xlffd" (UID: "91837c0a-ed65-44e8-b6f4-461981ef22b2") : secret "metrics-daemon-secret" not found
Jun 02 19:41:13.437197 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:13.437160    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gn6rs\" (UniqueName: \"kubernetes.io/projected/3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c-kube-api-access-gn6rs\") pod \"network-check-target-k5q95\" (UID: \"3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c\") " pod="openshift-network-diagnostics/network-check-target-k5q95"
Jun 02 19:41:13.439798 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:13.439772    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn6rs\" (UniqueName: \"kubernetes.io/projected/3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c-kube-api-access-gn6rs\") pod \"network-check-target-k5q95\" (UID: \"3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c\") " pod="openshift-network-diagnostics/network-check-target-k5q95"
Jun 02 19:41:13.518532 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:13.518502    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qdhml\""
Jun 02 19:41:13.526724 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:13.526701    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5q95"
Jun 02 19:41:13.647008 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:13.646981    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k5q95"]
Jun 02 19:41:13.648372 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:41:13.648345    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f73a3f6_cdc3_4c87_98cc_d4eccf9f694c.slice/crio-af26bbceb8147391229d8d26583d379123f361c0c6f1d422a213bd534475ace6 WatchSource:0}: Error finding container af26bbceb8147391229d8d26583d379123f361c0c6f1d422a213bd534475ace6: Status 404 returned error can't find the container with id af26bbceb8147391229d8d26583d379123f361c0c6f1d422a213bd534475ace6
Jun 02 19:41:13.982658 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:13.982627    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k5q95" event={"ID":"3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c","Type":"ContainerStarted","Data":"2f0c564d8949211974192874eb09ef5f522ed40b3cf72c4d84cf36e1e7dbe520"}
Jun 02 19:41:13.982658 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:13.982663    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k5q95" event={"ID":"3f73a3f6-cdc3-4c87-98cc-d4eccf9f694c","Type":"ContainerStarted","Data":"af26bbceb8147391229d8d26583d379123f361c0c6f1d422a213bd534475ace6"}
Jun 02 19:41:13.982876 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:13.982812    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-k5q95"
Jun 02 19:41:14.000384 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:14.000339    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-k5q95" podStartSLOduration=67.000324315 podStartE2EDuration="1m7.000324315s" podCreationTimestamp="2026-06-02 19:40:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:41:13.999397867 +0000 UTC m=+66.853818160" watchObservedRunningTime="2026-06-02 19:41:14.000324315 +0000 UTC m=+66.854744608"
Jun 02 19:41:15.453667 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:15.453625    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/902a5df6-ede1-4fee-8f32-cebc9b697d00-registry-tls\") pod \"image-registry-5f899fcc64-s4hmb\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") " pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb"
Jun 02 19:41:15.454075 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:15.453681    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6f6dc05-25cb-4329-8e28-11d41fd538c4-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-9fjnc\" (UID: \"d6f6dc05-25cb-4329-8e28-11d41fd538c4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9fjnc"
Jun 02 19:41:15.454075 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:15.453733    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/099a66f9-dfe1-4ef7-b849-3e6951bd23f2-metrics-tls\") pod \"dns-default-kwwz5\" (UID: \"099a66f9-dfe1-4ef7-b849-3e6951bd23f2\") " pod="openshift-dns/dns-default-kwwz5"
Jun 02 19:41:15.456118 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:15.456091    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/099a66f9-dfe1-4ef7-b849-3e6951bd23f2-metrics-tls\") pod \"dns-default-kwwz5\" (UID: \"099a66f9-dfe1-4ef7-b849-3e6951bd23f2\") " pod="openshift-dns/dns-default-kwwz5"
Jun 02 19:41:15.456209 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:15.456174    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6f6dc05-25cb-4329-8e28-11d41fd538c4-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-9fjnc\" (UID: \"d6f6dc05-25cb-4329-8e28-11d41fd538c4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9fjnc"
Jun 02 19:41:15.456276 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:15.456255    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/902a5df6-ede1-4fee-8f32-cebc9b697d00-registry-tls\") pod \"image-registry-5f899fcc64-s4hmb\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") " pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb"
Jun 02 19:41:15.554657 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:15.554615    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8620c80b-baae-412c-9d06-3e2fdb65665c-service-ca-bundle\") pod \"router-default-c796fd74c-l2p9g\" (UID: \"8620c80b-baae-412c-9d06-3e2fdb65665c\") " pod="openshift-ingress/router-default-c796fd74c-l2p9g"
Jun 02 19:41:15.555237 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:15.555218    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8620c80b-baae-412c-9d06-3e2fdb65665c-service-ca-bundle\") pod \"router-default-c796fd74c-l2p9g\" (UID: \"8620c80b-baae-412c-9d06-3e2fdb65665c\") " pod="openshift-ingress/router-default-c796fd74c-l2p9g"
Jun 02 19:41:15.655204 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:15.655172    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8620c80b-baae-412c-9d06-3e2fdb65665c-metrics-certs\") pod \"router-default-c796fd74c-l2p9g\" (UID: \"8620c80b-baae-412c-9d06-3e2fdb65665c\") " pod="openshift-ingress/router-default-c796fd74c-l2p9g"
Jun 02 19:41:15.655395 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:15.655215    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53c539fd-aeda-4f98-9450-4f7f05782e32-cert\") pod \"ingress-canary-lnzsg\" (UID: \"53c539fd-aeda-4f98-9450-4f7f05782e32\") " pod="openshift-ingress-canary/ingress-canary-lnzsg"
Jun 02 19:41:15.655395 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:15.655240    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa48db29-a46c-418f-80db-cc2c39f225d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-9rbdk\" (UID: \"fa48db29-a46c-418f-80db-cc2c39f225d7\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9rbdk"
Jun 02 19:41:15.657694 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:15.657671    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8620c80b-baae-412c-9d06-3e2fdb65665c-metrics-certs\") pod \"router-default-c796fd74c-l2p9g\" (UID: \"8620c80b-baae-412c-9d06-3e2fdb65665c\") " pod="openshift-ingress/router-default-c796fd74c-l2p9g"
Jun 02 19:41:15.657788 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:15.657671    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa48db29-a46c-418f-80db-cc2c39f225d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-9rbdk\" (UID: \"fa48db29-a46c-418f-80db-cc2c39f225d7\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9rbdk"
Jun 02 19:41:15.657788 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:15.657753    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53c539fd-aeda-4f98-9450-4f7f05782e32-cert\") pod \"ingress-canary-lnzsg\" (UID: \"53c539fd-aeda-4f98-9450-4f7f05782e32\") " pod="openshift-ingress-canary/ingress-canary-lnzsg"
Jun 02 19:41:15.698393 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:15.698362    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-t4b9l\""
Jun 02 19:41:15.706395 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:15.706328    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb"
Jun 02 19:41:15.742802 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:15.742775    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6wmhd\""
Jun 02 19:41:15.746882 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:15.746855    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4xdcx\""
Jun 02 19:41:15.750818 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:15.750788    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kwwz5"
Jun 02 19:41:15.756515 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:15.755964    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9fjnc"
Jun 02 19:41:15.805207 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:15.805178    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-cpx74\""
Jun 02 19:41:15.818041 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:15.813716    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9rbdk"
Jun 02 19:41:15.850416 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:15.850368    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f899fcc64-s4hmb"]
Jun 02 19:41:15.851917 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:15.851894    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-f9knd\""
Jun 02 19:41:15.855407 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:41:15.855383    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod902a5df6_ede1_4fee_8f32_cebc9b697d00.slice/crio-a16a4cd62b94b87b886434d162ed0e40751642137e055fd00c45e3362d2023ff WatchSource:0}: Error finding container a16a4cd62b94b87b886434d162ed0e40751642137e055fd00c45e3362d2023ff: Status 404 returned error can't find the container with id a16a4cd62b94b87b886434d162ed0e40751642137e055fd00c45e3362d2023ff
Jun 02 19:41:15.858456 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:15.858190    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-c796fd74c-l2p9g"
Jun 02 19:41:15.895562 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:15.895520    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wcgmb\""
Jun 02 19:41:15.902738 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:15.902666    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lnzsg"
Jun 02 19:41:15.908222 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:15.908157    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9fjnc"]
Jun 02 19:41:15.925562 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:15.925105    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kwwz5"]
Jun 02 19:41:15.931460 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:41:15.931150    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod099a66f9_dfe1_4ef7_b849_3e6951bd23f2.slice/crio-5277347e33691702a4d7ff62b23c1d3db7bc2b0d5763bb81b19525a765ce7c84 WatchSource:0}: Error finding container 5277347e33691702a4d7ff62b23c1d3db7bc2b0d5763bb81b19525a765ce7c84: Status 404 returned error can't find the container with id 5277347e33691702a4d7ff62b23c1d3db7bc2b0d5763bb81b19525a765ce7c84
Jun 02 19:41:15.989112 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:15.989078    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kwwz5" event={"ID":"099a66f9-dfe1-4ef7-b849-3e6951bd23f2","Type":"ContainerStarted","Data":"5277347e33691702a4d7ff62b23c1d3db7bc2b0d5763bb81b19525a765ce7c84"}
Jun 02 19:41:15.990283 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:15.990226    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb" event={"ID":"902a5df6-ede1-4fee-8f32-cebc9b697d00","Type":"ContainerStarted","Data":"a16a4cd62b94b87b886434d162ed0e40751642137e055fd00c45e3362d2023ff"}
Jun 02 19:41:15.998729 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:15.998691    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9rbdk"]
Jun 02 19:41:16.004621 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:41:16.004053    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa48db29_a46c_418f_80db_cc2c39f225d7.slice/crio-0f861caf6dfe44742b4cd0f2d51213f78868335f52b65e34c3dc84c795ca4441 WatchSource:0}: Error finding container 0f861caf6dfe44742b4cd0f2d51213f78868335f52b65e34c3dc84c795ca4441: Status 404 returned error can't find the container with id 0f861caf6dfe44742b4cd0f2d51213f78868335f52b65e34c3dc84c795ca4441
Jun 02 19:41:16.028096 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:16.028046    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-c796fd74c-l2p9g"]
Jun 02 19:41:16.031825 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:41:16.031798    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8620c80b_baae_412c_9d06_3e2fdb65665c.slice/crio-07aeb49543a21ad0334b50c34c186820af5a9a4a73184ef21e5bbf6acf380aa0 WatchSource:0}: Error finding container 07aeb49543a21ad0334b50c34c186820af5a9a4a73184ef21e5bbf6acf380aa0: Status 404 returned error can't find the container with id 07aeb49543a21ad0334b50c34c186820af5a9a4a73184ef21e5bbf6acf380aa0
Jun 02 19:41:16.056621 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:16.056594    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lnzsg"]
Jun 02 19:41:16.059890 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:41:16.059858    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53c539fd_aeda_4f98_9450_4f7f05782e32.slice/crio-abf15d30097abb644a37792c8a80a2a7e3022a634e9975e8442fd7ff6dd64817 WatchSource:0}: Error finding container abf15d30097abb644a37792c8a80a2a7e3022a634e9975e8442fd7ff6dd64817: Status 404 returned error can't find the container with id abf15d30097abb644a37792c8a80a2a7e3022a634e9975e8442fd7ff6dd64817
Jun 02 19:41:16.996965 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:16.996772    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-c796fd74c-l2p9g" event={"ID":"8620c80b-baae-412c-9d06-3e2fdb65665c","Type":"ContainerStarted","Data":"fd5290b8c6a52c929fcd32328ea73b21eb22a3689d225d612d727a5415c9981a"}
Jun 02 19:41:16.996965 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:16.996818    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-c796fd74c-l2p9g" event={"ID":"8620c80b-baae-412c-9d06-3e2fdb65665c","Type":"ContainerStarted","Data":"07aeb49543a21ad0334b50c34c186820af5a9a4a73184ef21e5bbf6acf380aa0"}
Jun 02 19:41:16.998442 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:16.998383    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9rbdk" event={"ID":"fa48db29-a46c-418f-80db-cc2c39f225d7","Type":"ContainerStarted","Data":"0f861caf6dfe44742b4cd0f2d51213f78868335f52b65e34c3dc84c795ca4441"}
Jun 02 19:41:16.999606 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:16.999573    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lnzsg" event={"ID":"53c539fd-aeda-4f98-9450-4f7f05782e32","Type":"ContainerStarted","Data":"abf15d30097abb644a37792c8a80a2a7e3022a634e9975e8442fd7ff6dd64817"}
Jun 02 19:41:17.003162 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:17.003133    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb" event={"ID":"902a5df6-ede1-4fee-8f32-cebc9b697d00","Type":"ContainerStarted","Data":"7f975606aee31cd7fba14d70dd243f47d901c90583b1d14f646712c02675b6cc"}
Jun 02 19:41:17.003512 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:17.003485    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb"
Jun 02 19:41:17.005458 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:17.005437    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9fjnc" event={"ID":"d6f6dc05-25cb-4329-8e28-11d41fd538c4","Type":"ContainerStarted","Data":"c76dc271677b74b1644ca1dd77507378ed0fca0592014560530c3f590e04b9bf"}
Jun 02 19:41:17.028208 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:17.028151    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-c796fd74c-l2p9g" podStartSLOduration=44.028132442 podStartE2EDuration="44.028132442s" podCreationTimestamp="2026-06-02 19:40:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:41:17.027942753 +0000 UTC m=+69.882363048" watchObservedRunningTime="2026-06-02 19:41:17.028132442 +0000 UTC m=+69.882552733"
Jun 02 19:41:17.664448 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:17.664390    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb" podStartSLOduration=69.664376036 podStartE2EDuration="1m9.664376036s" podCreationTimestamp="2026-06-02 19:40:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:41:17.051986042 +0000 UTC m=+69.906406336" watchObservedRunningTime="2026-06-02 19:41:17.664376036 +0000 UTC m=+70.518796328"
Jun 02 19:41:17.859243 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:17.859198    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-c796fd74c-l2p9g"
Jun 02 19:41:17.862044 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:17.862021    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-c796fd74c-l2p9g"
Jun 02 19:41:18.010872 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:18.010801    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kwwz5" event={"ID":"099a66f9-dfe1-4ef7-b849-3e6951bd23f2","Type":"ContainerStarted","Data":"02ca565645c861c4ec6ac9a92707eb1b051e9e4873e2aa93ed4532c2b88f5d56"}
Jun 02 19:41:18.011364 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:18.011212    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-c796fd74c-l2p9g"
Jun 02 19:41:18.012612 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:18.012583    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-c796fd74c-l2p9g"
Jun 02 19:41:19.642461 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:19.642429    2564 scope.go:117] "RemoveContainer" containerID="bf9cb1ac0717f226841adf6bd82038d5799236e1a8caef94406ff5c2a9bee2a1"
Jun 02 19:41:20.019395 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:20.019372    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9jgn2_7c1244c6-6d55-4cff-8099-4fc240c590f4/console-operator/2.log"
Jun 02 19:41:20.019777 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:20.019760    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9jgn2_7c1244c6-6d55-4cff-8099-4fc240c590f4/console-operator/1.log"
Jun 02 19:41:20.019879 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:20.019794    2564 generic.go:358] "Generic (PLEG): container finished" podID="7c1244c6-6d55-4cff-8099-4fc240c590f4" containerID="e35530898f3621ca23ebf4993536ab296d0c5a6c59830e03ca5fc33b913585ee" exitCode=255
Jun 02 19:41:20.019941 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:20.019880    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-9jgn2" event={"ID":"7c1244c6-6d55-4cff-8099-4fc240c590f4","Type":"ContainerDied","Data":"e35530898f3621ca23ebf4993536ab296d0c5a6c59830e03ca5fc33b913585ee"}
Jun 02 19:41:20.019995 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:20.019938    2564 scope.go:117] "RemoveContainer" containerID="bf9cb1ac0717f226841adf6bd82038d5799236e1a8caef94406ff5c2a9bee2a1"
Jun 02 19:41:20.020266 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:20.020235    2564 scope.go:117] "RemoveContainer" containerID="e35530898f3621ca23ebf4993536ab296d0c5a6c59830e03ca5fc33b913585ee"
Jun 02 19:41:20.020513 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:41:20.020468    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-9jgn2_openshift-console-operator(7c1244c6-6d55-4cff-8099-4fc240c590f4)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-9jgn2" podUID="7c1244c6-6d55-4cff-8099-4fc240c590f4"
Jun 02 19:41:20.021386 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:20.021366    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9rbdk" event={"ID":"fa48db29-a46c-418f-80db-cc2c39f225d7","Type":"ContainerStarted","Data":"1268ebee293bb276731a772c90b8ee3a19b1694f275a032e7df24592994e6075"}
Jun 02 19:41:20.022695 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:20.022673    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lnzsg" event={"ID":"53c539fd-aeda-4f98-9450-4f7f05782e32","Type":"ContainerStarted","Data":"5629c941a9b8da26993825e347995f992cfa6c395ae11a1d5fa2368301b98e9a"}
Jun 02 19:41:20.024341 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:20.024322    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9fjnc" event={"ID":"d6f6dc05-25cb-4329-8e28-11d41fd538c4","Type":"ContainerStarted","Data":"e1a9511ee6928dd1bf187cbd871d5bbe61bf298fc22e850cd109b065f39a2003"}
Jun 02 19:41:20.024440 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:20.024349    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9fjnc" event={"ID":"d6f6dc05-25cb-4329-8e28-11d41fd538c4","Type":"ContainerStarted","Data":"e3cc443f7bae5f34b4cfa19b916fa846602bea1db1214f7e1531f746f80eb9ae"}
Jun 02 19:41:20.025932 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:20.025911    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kwwz5" event={"ID":"099a66f9-dfe1-4ef7-b849-3e6951bd23f2","Type":"ContainerStarted","Data":"853fb35cd318b725ef8dd3c042af378ccc255d2249fa14b8aeddcfc07bd1c797"}
Jun 02 19:41:20.058174 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:20.058127    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9fjnc" podStartSLOduration=44.036063993 podStartE2EDuration="47.058115707s" podCreationTimestamp="2026-06-02 19:40:33 +0000 UTC" firstStartedPulling="2026-06-02 19:41:16.004890451 +0000 UTC m=+68.859310735" lastFinishedPulling="2026-06-02 19:41:19.026942174 +0000 UTC m=+71.881362449" observedRunningTime="2026-06-02 19:41:20.057651284 +0000 UTC m=+72.912071578" watchObservedRunningTime="2026-06-02 19:41:20.058115707 +0000 UTC m=+72.912535999"
Jun 02 19:41:20.077317 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:20.077272    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-kwwz5" podStartSLOduration=35.564895559 podStartE2EDuration="37.077258933s" podCreationTimestamp="2026-06-02 19:40:43 +0000 UTC" firstStartedPulling="2026-06-02 19:41:15.934613882 +0000 UTC m=+68.789034167" lastFinishedPulling="2026-06-02 19:41:17.446977254 +0000 UTC m=+70.301397541" observedRunningTime="2026-06-02 19:41:20.075934793 +0000 UTC m=+72.930355115" watchObservedRunningTime="2026-06-02 19:41:20.077258933 +0000 UTC m=+72.931679258"
Jun 02 19:41:20.092851 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:20.092802    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lnzsg" podStartSLOduration=34.12940389 podStartE2EDuration="37.092789963s" podCreationTimestamp="2026-06-02 19:40:43 +0000 UTC" firstStartedPulling="2026-06-02 19:41:16.06165176 +0000 UTC m=+68.916072030" lastFinishedPulling="2026-06-02 19:41:19.025037822 +0000 UTC m=+71.879458103" observedRunningTime="2026-06-02 19:41:20.092158951 +0000 UTC m=+72.946579244" watchObservedRunningTime="2026-06-02 19:41:20.092789963 +0000 UTC m=+72.947210255"
Jun 02 19:41:20.111732 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:20.111688    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9rbdk" podStartSLOduration=44.091008154 podStartE2EDuration="47.111677321s" podCreationTimestamp="2026-06-02 19:40:33 +0000 UTC" firstStartedPulling="2026-06-02 19:41:16.005784738 +0000 UTC m=+68.860205012" lastFinishedPulling="2026-06-02 19:41:19.026453892 +0000 UTC m=+71.880874179" observedRunningTime="2026-06-02 19:41:20.110380987 +0000 UTC m=+72.964801359" watchObservedRunningTime="2026-06-02 19:41:20.111677321 +0000 UTC m=+72.966097614"
Jun 02 19:41:21.030075 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:21.030048    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9jgn2_7c1244c6-6d55-4cff-8099-4fc240c590f4/console-operator/2.log"
Jun 02 19:41:21.030687 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:21.030667    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kwwz5"
Jun 02 19:41:21.503297 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:21.503258    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/912780cc-8979-4267-9189-ec7f34a66078-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-95ppp\" (UID: \"912780cc-8979-4267-9189-ec7f34a66078\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-95ppp"
Jun 02 19:41:21.505622 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:21.505589    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/912780cc-8979-4267-9189-ec7f34a66078-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-95ppp\" (UID: \"912780cc-8979-4267-9189-ec7f34a66078\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-95ppp"
Jun 02 19:41:21.561444 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:21.561420    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-t8txk\""
Jun 02 19:41:21.569490 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:21.569464    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-95ppp"
Jun 02 19:41:21.689919 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:21.689886    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-95ppp"]
Jun 02 19:41:21.692716 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:41:21.692689    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod912780cc_8979_4267_9189_ec7f34a66078.slice/crio-4b84289a2d4b9e8c9bd13dd99b4cb49aebc902d2f929c4445d931aeb04db953e WatchSource:0}: Error finding container 4b84289a2d4b9e8c9bd13dd99b4cb49aebc902d2f929c4445d931aeb04db953e: Status 404 returned error can't find the container with id 4b84289a2d4b9e8c9bd13dd99b4cb49aebc902d2f929c4445d931aeb04db953e
Jun 02 19:41:22.033940 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:22.033908    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-95ppp" event={"ID":"912780cc-8979-4267-9189-ec7f34a66078","Type":"ContainerStarted","Data":"4b84289a2d4b9e8c9bd13dd99b4cb49aebc902d2f929c4445d931aeb04db953e"}
Jun 02 19:41:23.963343 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:23.963308    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-9jgn2"
Jun 02 19:41:23.963343 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:23.963343    2564 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-9jgn2"
Jun 02 19:41:23.963887 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:23.963756    2564 scope.go:117] "RemoveContainer" containerID="e35530898f3621ca23ebf4993536ab296d0c5a6c59830e03ca5fc33b913585ee"
Jun 02 19:41:23.964013 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:41:23.963992    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-9jgn2_openshift-console-operator(7c1244c6-6d55-4cff-8099-4fc240c590f4)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-9jgn2" podUID="7c1244c6-6d55-4cff-8099-4fc240c590f4"
Jun 02 19:41:24.041112 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:24.041073    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-95ppp" event={"ID":"912780cc-8979-4267-9189-ec7f34a66078","Type":"ContainerStarted","Data":"1a71fa1249752f3aaebc832bdbe13bbfbc6bf2fc0447adb454ed68560cf1dd63"}
Jun 02 19:41:24.058122 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:24.058078    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-95ppp" podStartSLOduration=33.345329767 podStartE2EDuration="35.058063753s" podCreationTimestamp="2026-06-02 19:40:49 +0000 UTC" firstStartedPulling="2026-06-02 19:41:21.694971617 +0000 UTC m=+74.549391891" lastFinishedPulling="2026-06-02 19:41:23.407705596 +0000 UTC m=+76.262125877" observedRunningTime="2026-06-02 19:41:24.057289381 +0000 UTC m=+76.911709673" watchObservedRunningTime="2026-06-02 19:41:24.058063753 +0000 UTC m=+76.912484045"
Jun 02 19:41:25.162928 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:25.162896    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-b5c54"]
Jun 02 19:41:25.209674 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:25.209635    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-b5c54"]
Jun 02 19:41:25.209856 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:25.209767    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-b5c54"
Jun 02 19:41:25.213266 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:25.213241    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jun 02 19:41:25.213266 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:25.213277    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jun 02 19:41:25.214098 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:25.214080    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-p6s4l\""
Jun 02 19:41:25.336818 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:25.336732    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/29020b86-4d7e-426a-b87f-5db87a284cdb-crio-socket\") pod \"insights-runtime-extractor-b5c54\" (UID: \"29020b86-4d7e-426a-b87f-5db87a284cdb\") " pod="openshift-insights/insights-runtime-extractor-b5c54"
Jun 02 19:41:25.336818 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:25.336766    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/29020b86-4d7e-426a-b87f-5db87a284cdb-data-volume\") pod \"insights-runtime-extractor-b5c54\" (UID: \"29020b86-4d7e-426a-b87f-5db87a284cdb\") " pod="openshift-insights/insights-runtime-extractor-b5c54"
Jun 02 19:41:25.336818 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:25.336788    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/29020b86-4d7e-426a-b87f-5db87a284cdb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b5c54\" (UID: \"29020b86-4d7e-426a-b87f-5db87a284cdb\") " pod="openshift-insights/insights-runtime-extractor-b5c54"
Jun 02 19:41:25.336818 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:25.336808    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nrnh\" (UniqueName: \"kubernetes.io/projected/29020b86-4d7e-426a-b87f-5db87a284cdb-kube-api-access-2nrnh\") pod \"insights-runtime-extractor-b5c54\" (UID: \"29020b86-4d7e-426a-b87f-5db87a284cdb\") " pod="openshift-insights/insights-runtime-extractor-b5c54"
Jun 02 19:41:25.337133 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:25.336959    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/29020b86-4d7e-426a-b87f-5db87a284cdb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b5c54\" (UID: \"29020b86-4d7e-426a-b87f-5db87a284cdb\") " pod="openshift-insights/insights-runtime-extractor-b5c54"
Jun 02 19:41:25.438092 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:25.437969    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/29020b86-4d7e-426a-b87f-5db87a284cdb-crio-socket\") pod \"insights-runtime-extractor-b5c54\" (UID: \"29020b86-4d7e-426a-b87f-5db87a284cdb\") " pod="openshift-insights/insights-runtime-extractor-b5c54"
Jun 02 19:41:25.438092 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:25.438002    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/29020b86-4d7e-426a-b87f-5db87a284cdb-data-volume\") pod \"insights-runtime-extractor-b5c54\" (UID: \"29020b86-4d7e-426a-b87f-5db87a284cdb\") " pod="openshift-insights/insights-runtime-extractor-b5c54"
Jun 02 19:41:25.438092 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:25.438029    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/29020b86-4d7e-426a-b87f-5db87a284cdb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b5c54\" (UID: \"29020b86-4d7e-426a-b87f-5db87a284cdb\") " pod="openshift-insights/insights-runtime-extractor-b5c54"
Jun 02 19:41:25.438092 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:25.438061    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2nrnh\" (UniqueName: \"kubernetes.io/projected/29020b86-4d7e-426a-b87f-5db87a284cdb-kube-api-access-2nrnh\") pod \"insights-runtime-extractor-b5c54\" (UID: \"29020b86-4d7e-426a-b87f-5db87a284cdb\") " pod="openshift-insights/insights-runtime-extractor-b5c54"
Jun 02 19:41:25.438383 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:25.438092    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/29020b86-4d7e-426a-b87f-5db87a284cdb-crio-socket\") pod \"insights-runtime-extractor-b5c54\" (UID: \"29020b86-4d7e-426a-b87f-5db87a284cdb\") " pod="openshift-insights/insights-runtime-extractor-b5c54"
Jun 02 19:41:25.438383 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:25.438168    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/29020b86-4d7e-426a-b87f-5db87a284cdb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b5c54\" (UID: \"29020b86-4d7e-426a-b87f-5db87a284cdb\") " pod="openshift-insights/insights-runtime-extractor-b5c54"
Jun 02 19:41:25.438383 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:25.438364    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/29020b86-4d7e-426a-b87f-5db87a284cdb-data-volume\") pod \"insights-runtime-extractor-b5c54\" (UID: \"29020b86-4d7e-426a-b87f-5db87a284cdb\") " pod="openshift-insights/insights-runtime-extractor-b5c54"
Jun 02 19:41:25.438685 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:25.438668    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/29020b86-4d7e-426a-b87f-5db87a284cdb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b5c54\" (UID: \"29020b86-4d7e-426a-b87f-5db87a284cdb\") " pod="openshift-insights/insights-runtime-extractor-b5c54"
Jun 02 19:41:25.440420 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:25.440398    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/29020b86-4d7e-426a-b87f-5db87a284cdb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b5c54\" (UID: \"29020b86-4d7e-426a-b87f-5db87a284cdb\") " pod="openshift-insights/insights-runtime-extractor-b5c54"
Jun 02 19:41:25.446237 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:25.446214    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nrnh\" (UniqueName: \"kubernetes.io/projected/29020b86-4d7e-426a-b87f-5db87a284cdb-kube-api-access-2nrnh\") pod \"insights-runtime-extractor-b5c54\" (UID: \"29020b86-4d7e-426a-b87f-5db87a284cdb\") " pod="openshift-insights/insights-runtime-extractor-b5c54"
Jun 02 19:41:25.518889 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:25.518828    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-b5c54"
Jun 02 19:41:25.647010 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:25.646988    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-b5c54"]
Jun 02 19:41:25.649475 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:41:25.649448    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29020b86_4d7e_426a_b87f_5db87a284cdb.slice/crio-8678566bb151cdc42d583ceadb28c3e23a0f5461d34a1ae918ce0f35a07b95d9 WatchSource:0}: Error finding container 8678566bb151cdc42d583ceadb28c3e23a0f5461d34a1ae918ce0f35a07b95d9: Status 404 returned error can't find the container with id 8678566bb151cdc42d583ceadb28c3e23a0f5461d34a1ae918ce0f35a07b95d9
Jun 02 19:41:26.048227 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:26.048193    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b5c54" event={"ID":"29020b86-4d7e-426a-b87f-5db87a284cdb","Type":"ContainerStarted","Data":"5d840dc426988e9c05e69ccc83334ecf0d084b39d399107c0c0feb0bbe6b4092"}
Jun 02 19:41:26.048227 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:26.048232    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b5c54" event={"ID":"29020b86-4d7e-426a-b87f-5db87a284cdb","Type":"ContainerStarted","Data":"8678566bb151cdc42d583ceadb28c3e23a0f5461d34a1ae918ce0f35a07b95d9"}
Jun 02 19:41:28.035995 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:28.035962    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kwwz5"
Jun 02 19:41:28.055345 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:28.055313    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b5c54" event={"ID":"29020b86-4d7e-426a-b87f-5db87a284cdb","Type":"ContainerStarted","Data":"55cfab4118c00dbd7c5c75f25dd412588e18766f387ff92ff28a0b317471b9cf"}
Jun 02 19:41:30.065957 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:30.065921    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b5c54" event={"ID":"29020b86-4d7e-426a-b87f-5db87a284cdb","Type":"ContainerStarted","Data":"3267a61d1f24759d21db466f47875865109875003849ad7a94404cab7e745c66"}
Jun 02 19:41:30.089964 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:30.089914    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-b5c54" podStartSLOduration=1.6638006669999998 podStartE2EDuration="5.089901256s" podCreationTimestamp="2026-06-02 19:41:25 +0000 UTC" firstStartedPulling="2026-06-02 19:41:25.781160563 +0000 UTC m=+78.635580834" lastFinishedPulling="2026-06-02 19:41:29.207261152 +0000 UTC m=+82.061681423" observedRunningTime="2026-06-02 19:41:30.0891461 +0000 UTC m=+82.943566393" watchObservedRunningTime="2026-06-02 19:41:30.089901256 +0000 UTC m=+82.944321549"
Jun 02 19:41:34.035462 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:34.035429    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zzfzp"]
Jun 02 19:41:34.065655 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:34.065626    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zzfzp"
Jun 02 19:41:34.068421 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:34.068400    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jun 02 19:41:34.068573 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:34.068525    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jun 02 19:41:34.068616 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:34.068535    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jun 02 19:41:34.068759 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:34.068741    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jun 02 19:41:34.069501 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:34.069485    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-skltt\""
Jun 02 19:41:34.106870 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:34.106829    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4bfbddfa-0b6e-4efa-a153-25ce321c6bea-node-exporter-accelerators-collector-config\") pod \"node-exporter-zzfzp\" (UID: \"4bfbddfa-0b6e-4efa-a153-25ce321c6bea\") " pod="openshift-monitoring/node-exporter-zzfzp"
Jun 02 19:41:34.107009 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:34.106885    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4bfbddfa-0b6e-4efa-a153-25ce321c6bea-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zzfzp\" (UID: \"4bfbddfa-0b6e-4efa-a153-25ce321c6bea\") " pod="openshift-monitoring/node-exporter-zzfzp"
Jun 02 19:41:34.107009 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:34.106937    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4bfbddfa-0b6e-4efa-a153-25ce321c6bea-node-exporter-textfile\") pod \"node-exporter-zzfzp\" (UID: \"4bfbddfa-0b6e-4efa-a153-25ce321c6bea\") " pod="openshift-monitoring/node-exporter-zzfzp"
Jun 02 19:41:34.107009 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:34.106975    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssdq5\" (UniqueName: \"kubernetes.io/projected/4bfbddfa-0b6e-4efa-a153-25ce321c6bea-kube-api-access-ssdq5\") pod \"node-exporter-zzfzp\" (UID: \"4bfbddfa-0b6e-4efa-a153-25ce321c6bea\") " pod="openshift-monitoring/node-exporter-zzfzp"
Jun 02 19:41:34.107009 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:34.106996    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4bfbddfa-0b6e-4efa-a153-25ce321c6bea-node-exporter-tls\") pod \"node-exporter-zzfzp\" (UID: \"4bfbddfa-0b6e-4efa-a153-25ce321c6bea\") " pod="openshift-monitoring/node-exporter-zzfzp"
Jun 02 19:41:34.107175 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:34.107021    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4bfbddfa-0b6e-4efa-a153-25ce321c6bea-root\") pod \"node-exporter-zzfzp\" (UID: \"4bfbddfa-0b6e-4efa-a153-25ce321c6bea\") " pod="openshift-monitoring/node-exporter-zzfzp"
Jun 02 19:41:34.107175 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:34.107064    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bfbddfa-0b6e-4efa-a153-25ce321c6bea-sys\") pod \"node-exporter-zzfzp\" (UID: \"4bfbddfa-0b6e-4efa-a153-25ce321c6bea\") " pod="openshift-monitoring/node-exporter-zzfzp"
Jun 02 19:41:34.107175 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:34.107091    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4bfbddfa-0b6e-4efa-a153-25ce321c6bea-node-exporter-wtmp\") pod \"node-exporter-zzfzp\" (UID: \"4bfbddfa-0b6e-4efa-a153-25ce321c6bea\") " pod="openshift-monitoring/node-exporter-zzfzp"
Jun 02 19:41:34.107175 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:34.107153    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bfbddfa-0b6e-4efa-a153-25ce321c6bea-metrics-client-ca\") pod \"node-exporter-zzfzp\" (UID: \"4bfbddfa-0b6e-4efa-a153-25ce321c6bea\") " pod="openshift-monitoring/node-exporter-zzfzp"
Jun 02 19:41:34.208184 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:34.208156    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4bfbddfa-0b6e-4efa-a153-25ce321c6bea-node-exporter-wtmp\") pod \"node-exporter-zzfzp\" (UID: \"4bfbddfa-0b6e-4efa-a153-25ce321c6bea\") " pod="openshift-monitoring/node-exporter-zzfzp"
Jun 02 19:41:34.208341 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:34.208207    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bfbddfa-0b6e-4efa-a153-25ce321c6bea-metrics-client-ca\") pod \"node-exporter-zzfzp\" (UID: \"4bfbddfa-0b6e-4efa-a153-25ce321c6bea\") " pod="openshift-monitoring/node-exporter-zzfzp"
Jun 02 19:41:34.208341 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:34.208251    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4bfbddfa-0b6e-4efa-a153-25ce321c6bea-node-exporter-accelerators-collector-config\") pod \"node-exporter-zzfzp\" (UID: \"4bfbddfa-0b6e-4efa-a153-25ce321c6bea\") " pod="openshift-monitoring/node-exporter-zzfzp"
Jun 02 19:41:34.208341 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:34.208275    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4bfbddfa-0b6e-4efa-a153-25ce321c6bea-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zzfzp\" (UID: \"4bfbddfa-0b6e-4efa-a153-25ce321c6bea\") " pod="openshift-monitoring/node-exporter-zzfzp"
Jun 02 19:41:34.208341 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:34.208315    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4bfbddfa-0b6e-4efa-a153-25ce321c6bea-node-exporter-textfile\") pod \"node-exporter-zzfzp\" (UID: \"4bfbddfa-0b6e-4efa-a153-25ce321c6bea\") " pod="openshift-monitoring/node-exporter-zzfzp"
Jun 02 19:41:34.208341 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:34.208324    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4bfbddfa-0b6e-4efa-a153-25ce321c6bea-node-exporter-wtmp\") pod \"node-exporter-zzfzp\" (UID: \"4bfbddfa-0b6e-4efa-a153-25ce321c6bea\") " pod="openshift-monitoring/node-exporter-zzfzp"
Jun 02 19:41:34.208573 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:34.208342    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ssdq5\" (UniqueName: \"kubernetes.io/projected/4bfbddfa-0b6e-4efa-a153-25ce321c6bea-kube-api-access-ssdq5\") pod \"node-exporter-zzfzp\" (UID: \"4bfbddfa-0b6e-4efa-a153-25ce321c6bea\") " pod="openshift-monitoring/node-exporter-zzfzp"
Jun 02 19:41:34.208573 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:34.208370    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4bfbddfa-0b6e-4efa-a153-25ce321c6bea-node-exporter-tls\") pod \"node-exporter-zzfzp\" (UID: \"4bfbddfa-0b6e-4efa-a153-25ce321c6bea\") " pod="openshift-monitoring/node-exporter-zzfzp"
Jun 02 19:41:34.208573 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:34.208399    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4bfbddfa-0b6e-4efa-a153-25ce321c6bea-root\") pod \"node-exporter-zzfzp\" (UID: \"4bfbddfa-0b6e-4efa-a153-25ce321c6bea\") " pod="openshift-monitoring/node-exporter-zzfzp"
Jun 02 19:41:34.208573 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:34.208428    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bfbddfa-0b6e-4efa-a153-25ce321c6bea-sys\") pod \"node-exporter-zzfzp\" (UID: \"4bfbddfa-0b6e-4efa-a153-25ce321c6bea\") " pod="openshift-monitoring/node-exporter-zzfzp"
Jun 02 19:41:34.208573 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:34.208475    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4bfbddfa-0b6e-4efa-a153-25ce321c6bea-root\") pod \"node-exporter-zzfzp\" (UID: \"4bfbddfa-0b6e-4efa-a153-25ce321c6bea\") " pod="openshift-monitoring/node-exporter-zzfzp"
Jun 02 19:41:34.208573 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:41:34.208503    2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jun 02 19:41:34.208573 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:34.208500    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bfbddfa-0b6e-4efa-a153-25ce321c6bea-sys\") pod \"node-exporter-zzfzp\" (UID: \"4bfbddfa-0b6e-4efa-a153-25ce321c6bea\") " pod="openshift-monitoring/node-exporter-zzfzp"
Jun 02 19:41:34.208901 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:41:34.208591    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bfbddfa-0b6e-4efa-a153-25ce321c6bea-node-exporter-tls podName:4bfbddfa-0b6e-4efa-a153-25ce321c6bea nodeName:}" failed. No retries permitted until 2026-06-02 19:41:34.708554483 +0000 UTC m=+87.562974763 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4bfbddfa-0b6e-4efa-a153-25ce321c6bea-node-exporter-tls") pod "node-exporter-zzfzp" (UID: "4bfbddfa-0b6e-4efa-a153-25ce321c6bea") : secret "node-exporter-tls" not found
Jun 02 19:41:34.208901 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:34.208684    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4bfbddfa-0b6e-4efa-a153-25ce321c6bea-node-exporter-textfile\") pod \"node-exporter-zzfzp\" (UID: \"4bfbddfa-0b6e-4efa-a153-25ce321c6bea\") " pod="openshift-monitoring/node-exporter-zzfzp"
Jun 02 19:41:34.208988 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:34.208927    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4bfbddfa-0b6e-4efa-a153-25ce321c6bea-node-exporter-accelerators-collector-config\") pod \"node-exporter-zzfzp\" (UID: \"4bfbddfa-0b6e-4efa-a153-25ce321c6bea\") " pod="openshift-monitoring/node-exporter-zzfzp"
Jun 02 19:41:34.209084 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:34.209068    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bfbddfa-0b6e-4efa-a153-25ce321c6bea-metrics-client-ca\") pod \"node-exporter-zzfzp\" (UID: \"4bfbddfa-0b6e-4efa-a153-25ce321c6bea\") " pod="openshift-monitoring/node-exporter-zzfzp"
Jun 02 19:41:34.210723 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:34.210708    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4bfbddfa-0b6e-4efa-a153-25ce321c6bea-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zzfzp\" (UID: \"4bfbddfa-0b6e-4efa-a153-25ce321c6bea\") " pod="openshift-monitoring/node-exporter-zzfzp"
Jun 02 19:41:34.219092 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:34.219071    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssdq5\" (UniqueName: \"kubernetes.io/projected/4bfbddfa-0b6e-4efa-a153-25ce321c6bea-kube-api-access-ssdq5\") pod \"node-exporter-zzfzp\" (UID: \"4bfbddfa-0b6e-4efa-a153-25ce321c6bea\") " pod="openshift-monitoring/node-exporter-zzfzp"
Jun 02 19:41:34.714413 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:34.714374    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4bfbddfa-0b6e-4efa-a153-25ce321c6bea-node-exporter-tls\") pod \"node-exporter-zzfzp\" (UID: \"4bfbddfa-0b6e-4efa-a153-25ce321c6bea\") " pod="openshift-monitoring/node-exporter-zzfzp"
Jun 02 19:41:34.716601 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:34.716574    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4bfbddfa-0b6e-4efa-a153-25ce321c6bea-node-exporter-tls\") pod \"node-exporter-zzfzp\" (UID: \"4bfbddfa-0b6e-4efa-a153-25ce321c6bea\") " pod="openshift-monitoring/node-exporter-zzfzp"
Jun 02 19:41:34.974648 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:34.974568    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zzfzp"
Jun 02 19:41:34.983548 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:41:34.983512    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bfbddfa_0b6e_4efa_a153_25ce321c6bea.slice/crio-1f05923482e64923ca3bbc42e99bf2398df39ac37b748594467d89edaec96751 WatchSource:0}: Error finding container 1f05923482e64923ca3bbc42e99bf2398df39ac37b748594467d89edaec96751: Status 404 returned error can't find the container with id 1f05923482e64923ca3bbc42e99bf2398df39ac37b748594467d89edaec96751
Jun 02 19:41:35.079780 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:35.079738    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zzfzp" event={"ID":"4bfbddfa-0b6e-4efa-a153-25ce321c6bea","Type":"ContainerStarted","Data":"1f05923482e64923ca3bbc42e99bf2398df39ac37b748594467d89edaec96751"}
Jun 02 19:41:35.711106 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:35.711064    2564 patch_prober.go:28] interesting pod/image-registry-5f899fcc64-s4hmb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 02 19:41:35.711398 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:35.711128    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb" podUID="902a5df6-ede1-4fee-8f32-cebc9b697d00" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 02 19:41:37.087299 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:37.087267    2564 generic.go:358] "Generic (PLEG): container finished" podID="4bfbddfa-0b6e-4efa-a153-25ce321c6bea" containerID="603a428cf060e000b14e7e83543f705f70c1153cd3c66700851d8af198c276fa" exitCode=0
Jun 02 19:41:37.087675 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:37.087339    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zzfzp" event={"ID":"4bfbddfa-0b6e-4efa-a153-25ce321c6bea","Type":"ContainerDied","Data":"603a428cf060e000b14e7e83543f705f70c1153cd3c66700851d8af198c276fa"}
Jun 02 19:41:38.015241 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:38.015214    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb"
Jun 02 19:41:38.092052 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:38.092018    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zzfzp" event={"ID":"4bfbddfa-0b6e-4efa-a153-25ce321c6bea","Type":"ContainerStarted","Data":"33776d578aabca942cc9365aa013822d4c0e9ac40ed5e1b16a67339485e7ba74"}
Jun 02 19:41:38.092052 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:38.092056    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zzfzp" event={"ID":"4bfbddfa-0b6e-4efa-a153-25ce321c6bea","Type":"ContainerStarted","Data":"17cd3b62cd0aaaeb60c34e0fcb08c732d83a69c916b08b22d5de26225a6a665a"}
Jun 02 19:41:38.112104 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:38.112055    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zzfzp" podStartSLOduration=2.675871469 podStartE2EDuration="4.11204183s" podCreationTimestamp="2026-06-02 19:41:34 +0000 UTC" firstStartedPulling="2026-06-02 19:41:34.985209884 +0000 UTC m=+87.839630155" lastFinishedPulling="2026-06-02 19:41:36.421380233 +0000 UTC m=+89.275800516" observedRunningTime="2026-06-02 19:41:38.110546477 +0000 UTC m=+90.964966771" watchObservedRunningTime="2026-06-02 19:41:38.11204183 +0000 UTC m=+90.966462123"
Jun 02 19:41:38.642587 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:38.642556    2564 scope.go:117] "RemoveContainer" containerID="e35530898f3621ca23ebf4993536ab296d0c5a6c59830e03ca5fc33b913585ee"
Jun 02 19:41:38.642751 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:41:38.642715    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-9jgn2_openshift-console-operator(7c1244c6-6d55-4cff-8099-4fc240c590f4)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-9jgn2" podUID="7c1244c6-6d55-4cff-8099-4fc240c590f4"
Jun 02 19:41:44.988571 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:44.988540    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-k5q95"
Jun 02 19:41:48.794011 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:48.793971    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5f899fcc64-s4hmb"]
Jun 02 19:41:53.642990 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:53.642956    2564 scope.go:117] "RemoveContainer" containerID="e35530898f3621ca23ebf4993536ab296d0c5a6c59830e03ca5fc33b913585ee"
Jun 02 19:41:54.137043 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:54.137014    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9jgn2_7c1244c6-6d55-4cff-8099-4fc240c590f4/console-operator/2.log"
Jun 02 19:41:54.137208 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:54.137094    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-9jgn2" event={"ID":"7c1244c6-6d55-4cff-8099-4fc240c590f4","Type":"ContainerStarted","Data":"4a57093bf25942c2d1c998c6cfc020a3c41ad348e4e9873c89866d9e062ed8c9"}
Jun 02 19:41:54.137473 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:54.137364    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-9jgn2"
Jun 02 19:41:54.156218 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:54.156176    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-9jgn2" podStartSLOduration=68.095507212 podStartE2EDuration="1m21.1561631s" podCreationTimestamp="2026-06-02 19:40:33 +0000 UTC" firstStartedPulling="2026-06-02 19:40:44.10037304 +0000 UTC m=+36.954793325" lastFinishedPulling="2026-06-02 19:40:57.161028924 +0000 UTC m=+50.015449213" observedRunningTime="2026-06-02 19:41:54.155111578 +0000 UTC m=+107.009531872" watchObservedRunningTime="2026-06-02 19:41:54.1561631 +0000 UTC m=+107.010583393"
Jun 02 19:41:54.374506 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:41:54.374467    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-9jgn2"
Jun 02 19:42:13.817774 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:13.817721    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb" podUID="902a5df6-ede1-4fee-8f32-cebc9b697d00" containerName="registry" containerID="cri-o://7f975606aee31cd7fba14d70dd243f47d901c90583b1d14f646712c02675b6cc" gracePeriod=30
Jun 02 19:42:14.066746 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:14.066723    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb"
Jun 02 19:42:14.176033 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:14.175952    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f87f5b48-pm598" podUID="5e0dd968-14ea-4b7f-bf65-c20f0c90f605" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jun 02 19:42:14.188919 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:14.188889    2564 generic.go:358] "Generic (PLEG): container finished" podID="902a5df6-ede1-4fee-8f32-cebc9b697d00" containerID="7f975606aee31cd7fba14d70dd243f47d901c90583b1d14f646712c02675b6cc" exitCode=0
Jun 02 19:42:14.189078 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:14.188942    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb"
Jun 02 19:42:14.189078 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:14.188974    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb" event={"ID":"902a5df6-ede1-4fee-8f32-cebc9b697d00","Type":"ContainerDied","Data":"7f975606aee31cd7fba14d70dd243f47d901c90583b1d14f646712c02675b6cc"}
Jun 02 19:42:14.189078 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:14.189014    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f899fcc64-s4hmb" event={"ID":"902a5df6-ede1-4fee-8f32-cebc9b697d00","Type":"ContainerDied","Data":"a16a4cd62b94b87b886434d162ed0e40751642137e055fd00c45e3362d2023ff"}
Jun 02 19:42:14.189078 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:14.189029    2564 scope.go:117] "RemoveContainer" containerID="7f975606aee31cd7fba14d70dd243f47d901c90583b1d14f646712c02675b6cc"
Jun 02 19:42:14.198500 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:14.198476    2564 scope.go:117] "RemoveContainer" containerID="7f975606aee31cd7fba14d70dd243f47d901c90583b1d14f646712c02675b6cc"
Jun 02 19:42:14.198770 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:42:14.198750    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f975606aee31cd7fba14d70dd243f47d901c90583b1d14f646712c02675b6cc\": container with ID starting with 7f975606aee31cd7fba14d70dd243f47d901c90583b1d14f646712c02675b6cc not found: ID does not exist" containerID="7f975606aee31cd7fba14d70dd243f47d901c90583b1d14f646712c02675b6cc"
Jun 02 19:42:14.198853 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:14.198782    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f975606aee31cd7fba14d70dd243f47d901c90583b1d14f646712c02675b6cc"} err="failed to get container status \"7f975606aee31cd7fba14d70dd243f47d901c90583b1d14f646712c02675b6cc\": rpc error: code = NotFound desc = could not find container \"7f975606aee31cd7fba14d70dd243f47d901c90583b1d14f646712c02675b6cc\": container with ID starting with 7f975606aee31cd7fba14d70dd243f47d901c90583b1d14f646712c02675b6cc not found: ID does not exist"
Jun 02 19:42:14.255471 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:14.255430    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/902a5df6-ede1-4fee-8f32-cebc9b697d00-registry-tls\") pod \"902a5df6-ede1-4fee-8f32-cebc9b697d00\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") "
Jun 02 19:42:14.255654 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:14.255500    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/902a5df6-ede1-4fee-8f32-cebc9b697d00-image-registry-private-configuration\") pod \"902a5df6-ede1-4fee-8f32-cebc9b697d00\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") "
Jun 02 19:42:14.255654 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:14.255527    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/902a5df6-ede1-4fee-8f32-cebc9b697d00-registry-certificates\") pod \"902a5df6-ede1-4fee-8f32-cebc9b697d00\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") "
Jun 02 19:42:14.255654 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:14.255571    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/902a5df6-ede1-4fee-8f32-cebc9b697d00-trusted-ca\") pod \"902a5df6-ede1-4fee-8f32-cebc9b697d00\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") "
Jun 02 19:42:14.255654 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:14.255592    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/902a5df6-ede1-4fee-8f32-cebc9b697d00-ca-trust-extracted\") pod \"902a5df6-ede1-4fee-8f32-cebc9b697d00\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") "
Jun 02 19:42:14.255971 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:14.255651    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/902a5df6-ede1-4fee-8f32-cebc9b697d00-bound-sa-token\") pod \"902a5df6-ede1-4fee-8f32-cebc9b697d00\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") "
Jun 02 19:42:14.255971 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:14.255706    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/902a5df6-ede1-4fee-8f32-cebc9b697d00-installation-pull-secrets\") pod \"902a5df6-ede1-4fee-8f32-cebc9b697d00\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") "
Jun 02 19:42:14.255971 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:14.255736    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nx2zv\" (UniqueName: \"kubernetes.io/projected/902a5df6-ede1-4fee-8f32-cebc9b697d00-kube-api-access-nx2zv\") pod \"902a5df6-ede1-4fee-8f32-cebc9b697d00\" (UID: \"902a5df6-ede1-4fee-8f32-cebc9b697d00\") "
Jun 02 19:42:14.256125 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:14.256040    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/902a5df6-ede1-4fee-8f32-cebc9b697d00-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "902a5df6-ede1-4fee-8f32-cebc9b697d00" (UID: "902a5df6-ede1-4fee-8f32-cebc9b697d00"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 02 19:42:14.256125 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:14.256103    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/902a5df6-ede1-4fee-8f32-cebc9b697d00-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "902a5df6-ede1-4fee-8f32-cebc9b697d00" (UID: "902a5df6-ede1-4fee-8f32-cebc9b697d00"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 02 19:42:14.258160 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:14.258129    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/902a5df6-ede1-4fee-8f32-cebc9b697d00-kube-api-access-nx2zv" (OuterVolumeSpecName: "kube-api-access-nx2zv") pod "902a5df6-ede1-4fee-8f32-cebc9b697d00" (UID: "902a5df6-ede1-4fee-8f32-cebc9b697d00"). InnerVolumeSpecName "kube-api-access-nx2zv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 02 19:42:14.258294 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:14.258212    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/902a5df6-ede1-4fee-8f32-cebc9b697d00-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "902a5df6-ede1-4fee-8f32-cebc9b697d00" (UID: "902a5df6-ede1-4fee-8f32-cebc9b697d00"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 02 19:42:14.258294 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:14.258243    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/902a5df6-ede1-4fee-8f32-cebc9b697d00-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "902a5df6-ede1-4fee-8f32-cebc9b697d00" (UID: "902a5df6-ede1-4fee-8f32-cebc9b697d00"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 02 19:42:14.258520 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:14.258492    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/902a5df6-ede1-4fee-8f32-cebc9b697d00-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "902a5df6-ede1-4fee-8f32-cebc9b697d00" (UID: "902a5df6-ede1-4fee-8f32-cebc9b697d00"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 02 19:42:14.258673 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:14.258644    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/902a5df6-ede1-4fee-8f32-cebc9b697d00-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "902a5df6-ede1-4fee-8f32-cebc9b697d00" (UID: "902a5df6-ede1-4fee-8f32-cebc9b697d00"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 02 19:42:14.264821 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:14.264794    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/902a5df6-ede1-4fee-8f32-cebc9b697d00-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "902a5df6-ede1-4fee-8f32-cebc9b697d00" (UID: "902a5df6-ede1-4fee-8f32-cebc9b697d00"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 02 19:42:14.356727 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:14.356696    2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/902a5df6-ede1-4fee-8f32-cebc9b697d00-image-registry-private-configuration\") on node \"ip-10-0-130-103.ec2.internal\" DevicePath \"\""
Jun 02 19:42:14.356898 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:14.356723    2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/902a5df6-ede1-4fee-8f32-cebc9b697d00-registry-certificates\") on node \"ip-10-0-130-103.ec2.internal\" DevicePath \"\""
Jun 02 19:42:14.356898 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:14.356762    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/902a5df6-ede1-4fee-8f32-cebc9b697d00-trusted-ca\") on node \"ip-10-0-130-103.ec2.internal\" DevicePath \"\""
Jun 02 19:42:14.356898 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:14.356772    2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/902a5df6-ede1-4fee-8f32-cebc9b697d00-ca-trust-extracted\") on node \"ip-10-0-130-103.ec2.internal\" DevicePath \"\""
Jun 02 19:42:14.356898 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:14.356781    2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/902a5df6-ede1-4fee-8f32-cebc9b697d00-bound-sa-token\") on node \"ip-10-0-130-103.ec2.internal\" DevicePath \"\""
Jun 02 19:42:14.356898 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:14.356790    2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/902a5df6-ede1-4fee-8f32-cebc9b697d00-installation-pull-secrets\") on node \"ip-10-0-130-103.ec2.internal\" DevicePath \"\""
Jun 02 19:42:14.356898 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:14.356798    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nx2zv\" (UniqueName: \"kubernetes.io/projected/902a5df6-ede1-4fee-8f32-cebc9b697d00-kube-api-access-nx2zv\") on node \"ip-10-0-130-103.ec2.internal\" DevicePath \"\""
Jun 02 19:42:14.356898 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:14.356809    2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/902a5df6-ede1-4fee-8f32-cebc9b697d00-registry-tls\") on node \"ip-10-0-130-103.ec2.internal\" DevicePath \"\""
Jun 02 19:42:14.510250 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:14.510221    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5f899fcc64-s4hmb"]
Jun 02 19:42:14.514582 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:14.514557    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5f899fcc64-s4hmb"]
Jun 02 19:42:15.646104 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:15.646072    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="902a5df6-ede1-4fee-8f32-cebc9b697d00" path="/var/lib/kubelet/pods/902a5df6-ede1-4fee-8f32-cebc9b697d00/volumes"
Jun 02 19:42:17.379199 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:17.379158    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91837c0a-ed65-44e8-b6f4-461981ef22b2-metrics-certs\") pod \"network-metrics-daemon-xlffd\" (UID: \"91837c0a-ed65-44e8-b6f4-461981ef22b2\") " pod="openshift-multus/network-metrics-daemon-xlffd"
Jun 02 19:42:17.381426 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:17.381402    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91837c0a-ed65-44e8-b6f4-461981ef22b2-metrics-certs\") pod \"network-metrics-daemon-xlffd\" (UID: \"91837c0a-ed65-44e8-b6f4-461981ef22b2\") " pod="openshift-multus/network-metrics-daemon-xlffd"
Jun 02 19:42:17.423591 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:17.423565    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jpm5f\""
Jun 02 19:42:17.431284 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:17.431267    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlffd"
Jun 02 19:42:17.559498 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:17.559473    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xlffd"]
Jun 02 19:42:17.562237 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:42:17.562209    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91837c0a_ed65_44e8_b6f4_461981ef22b2.slice/crio-ef10747ace009a6875411761fa48d9e7a2b547169ba0bb866134283c914b69b3 WatchSource:0}: Error finding container ef10747ace009a6875411761fa48d9e7a2b547169ba0bb866134283c914b69b3: Status 404 returned error can't find the container with id ef10747ace009a6875411761fa48d9e7a2b547169ba0bb866134283c914b69b3
Jun 02 19:42:18.202399 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:18.202363    2564 generic.go:358] "Generic (PLEG): container finished" podID="8c521bf4-fe5d-4188-a7ea-001c7e8c2255" containerID="6b5bfb90d87cd9ef32848cd799aff24d837f5990bc2a43cd876a603e7be3daa0" exitCode=0
Jun 02 19:42:18.202545 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:18.202442    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-4t95b" event={"ID":"8c521bf4-fe5d-4188-a7ea-001c7e8c2255","Type":"ContainerDied","Data":"6b5bfb90d87cd9ef32848cd799aff24d837f5990bc2a43cd876a603e7be3daa0"}
Jun 02 19:42:18.202952 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:18.202929    2564 scope.go:117] "RemoveContainer" containerID="6b5bfb90d87cd9ef32848cd799aff24d837f5990bc2a43cd876a603e7be3daa0"
Jun 02 19:42:18.203811 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:18.203790    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xlffd" event={"ID":"91837c0a-ed65-44e8-b6f4-461981ef22b2","Type":"ContainerStarted","Data":"ef10747ace009a6875411761fa48d9e7a2b547169ba0bb866134283c914b69b3"}
Jun 02 19:42:19.208689 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:19.208598    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xlffd" event={"ID":"91837c0a-ed65-44e8-b6f4-461981ef22b2","Type":"ContainerStarted","Data":"4869e9b07f443543b667ab195f5f92e6460fbf9d1ff7fbebd9c9bc78766deadd"}
Jun 02 19:42:19.208689 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:19.208640    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xlffd" event={"ID":"91837c0a-ed65-44e8-b6f4-461981ef22b2","Type":"ContainerStarted","Data":"bb9c874a9f00dc77fcfd745b8ed5bfc94e5ad75764da5c86c4a90deaa44023af"}
Jun 02 19:42:19.210218 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:19.210196    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-4t95b" event={"ID":"8c521bf4-fe5d-4188-a7ea-001c7e8c2255","Type":"ContainerStarted","Data":"6c0679a6cd29c1c59b9a75d1906a0f5822f9cf4ffa9b754c65798cf105d48766"}
Jun 02 19:42:19.229752 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:19.229702    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xlffd" podStartSLOduration=130.860015778 podStartE2EDuration="2m12.229688387s" podCreationTimestamp="2026-06-02 19:40:07 +0000 UTC" firstStartedPulling="2026-06-02 19:42:17.564483121 +0000 UTC m=+130.418903392" lastFinishedPulling="2026-06-02 19:42:18.934155727 +0000 UTC m=+131.788576001" observedRunningTime="2026-06-02 19:42:19.228239487 +0000 UTC m=+132.082659805" watchObservedRunningTime="2026-06-02 19:42:19.229688387 +0000 UTC m=+132.084108713"
Jun 02 19:42:21.199081 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:21.199046    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-9rbdk_fa48db29-a46c-418f-80db-cc2c39f225d7/cluster-monitoring-operator/0.log"
Jun 02 19:42:23.221586 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:23.221552    2564 generic.go:358] "Generic (PLEG): container finished" podID="8c3ecc02-7b08-42ef-9078-60a7a2a271f2" containerID="91b23b15a0a3fc9564bd710c69eaa7d9e0708cdc74d2baf2ea57763b51c51cec" exitCode=0
Jun 02 19:42:23.221970 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:23.221626    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mt424" event={"ID":"8c3ecc02-7b08-42ef-9078-60a7a2a271f2","Type":"ContainerDied","Data":"91b23b15a0a3fc9564bd710c69eaa7d9e0708cdc74d2baf2ea57763b51c51cec"}
Jun 02 19:42:23.221970 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:23.221956    2564 scope.go:117] "RemoveContainer" containerID="91b23b15a0a3fc9564bd710c69eaa7d9e0708cdc74d2baf2ea57763b51c51cec"
Jun 02 19:42:23.591727 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:23.591697    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zzfzp_4bfbddfa-0b6e-4efa-a153-25ce321c6bea/init-textfile/0.log"
Jun 02 19:42:23.793658 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:23.793630    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zzfzp_4bfbddfa-0b6e-4efa-a153-25ce321c6bea/node-exporter/0.log"
Jun 02 19:42:23.992882 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:23.992823    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zzfzp_4bfbddfa-0b6e-4efa-a153-25ce321c6bea/kube-rbac-proxy/0.log"
Jun 02 19:42:24.175736 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:24.175694    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f87f5b48-pm598" podUID="5e0dd968-14ea-4b7f-bf65-c20f0c90f605" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jun 02 19:42:24.230025 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:24.229993    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mt424" event={"ID":"8c3ecc02-7b08-42ef-9078-60a7a2a271f2","Type":"ContainerStarted","Data":"6ef9bdd5c3c22908df349966693c7a2390f1babc2c9128c8d24b59ab791e3caa"}
Jun 02 19:42:28.593461 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:28.593430    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-76c9bb5fdf-95ppp_912780cc-8979-4267-9189-ec7f34a66078/networking-console-plugin/0.log"
Jun 02 19:42:28.791546 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:28.791517    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9jgn2_7c1244c6-6d55-4cff-8099-4fc240c590f4/console-operator/2.log"
Jun 02 19:42:28.994128 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:28.994084    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9jgn2_7c1244c6-6d55-4cff-8099-4fc240c590f4/console-operator/3.log"
Jun 02 19:42:29.803516 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:29.803476    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c796fd74c-l2p9g_8620c80b-baae-412c-9d06-3e2fdb65665c/router/0.log"
Jun 02 19:42:29.994500 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:29.994474    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lnzsg_53c539fd-aeda-4f98-9450-4f7f05782e32/serve-healthcheck-canary/0.log"
Jun 02 19:42:30.246847 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:30.246754    2564 generic.go:358] "Generic (PLEG): container finished" podID="f987766a-4b0f-471b-a6fa-99a268314b79" containerID="4639751f6d886d887fc74f0b021786da18c0b6ac790d2818665ed6cad5258156" exitCode=0
Jun 02 19:42:30.246975 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:30.246829    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-wcpcq" event={"ID":"f987766a-4b0f-471b-a6fa-99a268314b79","Type":"ContainerDied","Data":"4639751f6d886d887fc74f0b021786da18c0b6ac790d2818665ed6cad5258156"}
Jun 02 19:42:30.247178 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:30.247166    2564 scope.go:117] "RemoveContainer" containerID="4639751f6d886d887fc74f0b021786da18c0b6ac790d2818665ed6cad5258156"
Jun 02 19:42:31.251662 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:31.251625    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-wcpcq" event={"ID":"f987766a-4b0f-471b-a6fa-99a268314b79","Type":"ContainerStarted","Data":"865e50765666c0af9c06217251c6cb792d30b0e008bbb7fb5864064e03226a2c"}
Jun 02 19:42:34.175597 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:34.175560    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f87f5b48-pm598" podUID="5e0dd968-14ea-4b7f-bf65-c20f0c90f605" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jun 02 19:42:34.176004 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:34.175627    2564 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f87f5b48-pm598"
Jun 02 19:42:34.176144 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:34.176126    2564 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"d83498267a429594aeed641e6a7588fb00faecf4768470b6b71c8221ebf67344"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f87f5b48-pm598" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jun 02 19:42:34.176184 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:34.176170    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f87f5b48-pm598" podUID="5e0dd968-14ea-4b7f-bf65-c20f0c90f605" containerName="service-proxy" containerID="cri-o://d83498267a429594aeed641e6a7588fb00faecf4768470b6b71c8221ebf67344" gracePeriod=30
Jun 02 19:42:35.267035 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:35.267003    2564 generic.go:358] "Generic (PLEG): container finished" podID="5e0dd968-14ea-4b7f-bf65-c20f0c90f605" containerID="d83498267a429594aeed641e6a7588fb00faecf4768470b6b71c8221ebf67344" exitCode=2
Jun 02 19:42:35.267387 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:35.267073    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f87f5b48-pm598" event={"ID":"5e0dd968-14ea-4b7f-bf65-c20f0c90f605","Type":"ContainerDied","Data":"d83498267a429594aeed641e6a7588fb00faecf4768470b6b71c8221ebf67344"}
Jun 02 19:42:35.267387 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:42:35.267111    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f87f5b48-pm598" event={"ID":"5e0dd968-14ea-4b7f-bf65-c20f0c90f605","Type":"ContainerStarted","Data":"a4eb63cee7ae18918078490ebee751e12758ffe297ac6056bffdc2d2499eb972"}
Jun 02 19:45:05.424240 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:05.424206    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw"]
Jun 02 19:45:05.424644 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:05.424475    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="902a5df6-ede1-4fee-8f32-cebc9b697d00" containerName="registry"
Jun 02 19:45:05.424644 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:05.424487    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="902a5df6-ede1-4fee-8f32-cebc9b697d00" containerName="registry"
Jun 02 19:45:05.424644 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:05.424548    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="902a5df6-ede1-4fee-8f32-cebc9b697d00" containerName="registry"
Jun 02 19:45:05.427285 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:05.427270    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw"
Jun 02 19:45:05.429910 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:05.429887    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jun 02 19:45:05.430050 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:05.430029    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jun 02 19:45:05.430113 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:05.430091    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jun 02 19:45:05.430170 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:05.430145    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jun 02 19:45:05.430364 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:05.430346    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-77tcn\""
Jun 02 19:45:05.439910 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:05.439891    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw"]
Jun 02 19:45:05.501437 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:05.501409    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72d000cc-cc28-4d24-ada9-44f8ec4316e9-tmp\") pod \"opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw\" (UID: \"72d000cc-cc28-4d24-ada9-44f8ec4316e9\") " pod="opendatahub/opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw"
Jun 02 19:45:05.501599 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:05.501444    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lvvf\" (UniqueName: \"kubernetes.io/projected/72d000cc-cc28-4d24-ada9-44f8ec4316e9-kube-api-access-9lvvf\") pod \"opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw\" (UID: \"72d000cc-cc28-4d24-ada9-44f8ec4316e9\") " pod="opendatahub/opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw"
Jun 02 19:45:05.501599 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:05.501472    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/72d000cc-cc28-4d24-ada9-44f8ec4316e9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw\" (UID: \"72d000cc-cc28-4d24-ada9-44f8ec4316e9\") " pod="opendatahub/opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw"
Jun 02 19:45:05.501599 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:05.501570    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/72d000cc-cc28-4d24-ada9-44f8ec4316e9-manifests\") pod \"opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw\" (UID: \"72d000cc-cc28-4d24-ada9-44f8ec4316e9\") " pod="opendatahub/opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw"
Jun 02 19:45:05.501754 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:05.501670    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72d000cc-cc28-4d24-ada9-44f8ec4316e9-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw\" (UID: \"72d000cc-cc28-4d24-ada9-44f8ec4316e9\") " pod="opendatahub/opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw"
Jun 02 19:45:05.602860 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:05.602824    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72d000cc-cc28-4d24-ada9-44f8ec4316e9-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw\" (UID: \"72d000cc-cc28-4d24-ada9-44f8ec4316e9\") " pod="opendatahub/opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw"
Jun 02 19:45:05.603004 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:05.602870    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72d000cc-cc28-4d24-ada9-44f8ec4316e9-tmp\") pod \"opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw\" (UID: \"72d000cc-cc28-4d24-ada9-44f8ec4316e9\") " pod="opendatahub/opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw"
Jun 02 19:45:05.603004 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:05.602890    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9lvvf\" (UniqueName: \"kubernetes.io/projected/72d000cc-cc28-4d24-ada9-44f8ec4316e9-kube-api-access-9lvvf\") pod \"opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw\" (UID: \"72d000cc-cc28-4d24-ada9-44f8ec4316e9\") " pod="opendatahub/opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw"
Jun 02 19:45:05.603004 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:05.602910    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/72d000cc-cc28-4d24-ada9-44f8ec4316e9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw\" (UID: \"72d000cc-cc28-4d24-ada9-44f8ec4316e9\") " pod="opendatahub/opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw"
Jun 02 19:45:05.603004 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:05.602935    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/72d000cc-cc28-4d24-ada9-44f8ec4316e9-manifests\") pod \"opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw\" (UID: \"72d000cc-cc28-4d24-ada9-44f8ec4316e9\") " pod="opendatahub/opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw"
Jun 02 19:45:05.603318 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:05.603292    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/72d000cc-cc28-4d24-ada9-44f8ec4316e9-manifests\") pod \"opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw\" (UID: \"72d000cc-cc28-4d24-ada9-44f8ec4316e9\") " pod="opendatahub/opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw"
Jun 02 19:45:05.605090 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:05.605066    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72d000cc-cc28-4d24-ada9-44f8ec4316e9-tmp\") pod \"opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw\" (UID: \"72d000cc-cc28-4d24-ada9-44f8ec4316e9\") " pod="opendatahub/opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw"
Jun 02 19:45:05.605188 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:05.605167    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/72d000cc-cc28-4d24-ada9-44f8ec4316e9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw\" (UID: \"72d000cc-cc28-4d24-ada9-44f8ec4316e9\") " pod="opendatahub/opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw"
Jun 02 19:45:05.605393 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:05.605372    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72d000cc-cc28-4d24-ada9-44f8ec4316e9-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw\" (UID: \"72d000cc-cc28-4d24-ada9-44f8ec4316e9\") " pod="opendatahub/opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw"
Jun 02 19:45:05.614092 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:05.614069    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lvvf\" (UniqueName: \"kubernetes.io/projected/72d000cc-cc28-4d24-ada9-44f8ec4316e9-kube-api-access-9lvvf\") pod \"opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw\" (UID: \"72d000cc-cc28-4d24-ada9-44f8ec4316e9\") " pod="opendatahub/opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw"
Jun 02 19:45:05.737605 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:05.737576    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw"
Jun 02 19:45:05.866461 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:05.866420    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw"]
Jun 02 19:45:05.869920 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:45:05.869894    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72d000cc_cc28_4d24_ada9_44f8ec4316e9.slice/crio-35701e8239c97ef8babed4f7e3dbaf4db34eebfaf2f3ab929e56f3504d20ad76 WatchSource:0}: Error finding container 35701e8239c97ef8babed4f7e3dbaf4db34eebfaf2f3ab929e56f3504d20ad76: Status 404 returned error can't find the container with id 35701e8239c97ef8babed4f7e3dbaf4db34eebfaf2f3ab929e56f3504d20ad76
Jun 02 19:45:06.682104 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:06.682059    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw" event={"ID":"72d000cc-cc28-4d24-ada9-44f8ec4316e9","Type":"ContainerStarted","Data":"35701e8239c97ef8babed4f7e3dbaf4db34eebfaf2f3ab929e56f3504d20ad76"}
Jun 02 19:45:08.694946 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:08.694912    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9jgn2_7c1244c6-6d55-4cff-8099-4fc240c590f4/console-operator/2.log"
Jun 02 19:45:08.697359 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:08.694919    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9jgn2_7c1244c6-6d55-4cff-8099-4fc240c590f4/console-operator/2.log"
Jun 02 19:45:08.699472 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:08.699451    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-79xzx_278707d7-17c9-4a6c-917e-1d2d056db08e/ovn-acl-logging/0.log"
Jun 02 19:45:08.699610 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:08.699595    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-79xzx_278707d7-17c9-4a6c-917e-1d2d056db08e/ovn-acl-logging/0.log"
Jun 02 19:45:08.703370 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:08.703343    2564 kubelet.go:1628] "Image garbage collection succeeded"
Jun 02 19:45:09.692877 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:09.692832    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw" event={"ID":"72d000cc-cc28-4d24-ada9-44f8ec4316e9","Type":"ContainerStarted","Data":"882f99a97ddc8a6bd447cd33a8fddd837a3138fe907e1573c144025d15bf1531"}
Jun 02 19:45:10.696943 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:10.696907    2564 generic.go:358] "Generic (PLEG): container finished" podID="72d000cc-cc28-4d24-ada9-44f8ec4316e9" containerID="882f99a97ddc8a6bd447cd33a8fddd837a3138fe907e1573c144025d15bf1531" exitCode=0
Jun 02 19:45:10.697421 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:10.696973    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw" event={"ID":"72d000cc-cc28-4d24-ada9-44f8ec4316e9","Type":"ContainerDied","Data":"882f99a97ddc8a6bd447cd33a8fddd837a3138fe907e1573c144025d15bf1531"}
Jun 02 19:45:10.697591 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:10.697571    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 02 19:45:11.702057 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:11.702022    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw" event={"ID":"72d000cc-cc28-4d24-ada9-44f8ec4316e9","Type":"ContainerStarted","Data":"c6ae74558f371f43bb8bd2b426a61cc4d202d8a56b7df1b781440d20a9caedcc"}
Jun 02 19:45:11.702425 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:11.702142    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw"
Jun 02 19:45:11.726783 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:11.726740    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw" podStartSLOduration=1.597902527 podStartE2EDuration="6.726727916s" podCreationTimestamp="2026-06-02 19:45:05 +0000 UTC" firstStartedPulling="2026-06-02 19:45:05.871501796 +0000 UTC m=+298.725922070" lastFinishedPulling="2026-06-02 19:45:11.000327169 +0000 UTC m=+303.854747459" observedRunningTime="2026-06-02 19:45:11.725222671 +0000 UTC m=+304.579642964" watchObservedRunningTime="2026-06-02 19:45:11.726727916 +0000 UTC m=+304.581148209"
Jun 02 19:45:22.707085 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:22.707054    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw"
Jun 02 19:45:25.333575 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:25.333539    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-757778c8b9-l4tzj"]
Jun 02 19:45:25.336577 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:25.336561    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-757778c8b9-l4tzj"
Jun 02 19:45:25.339517 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:25.339492    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jun 02 19:45:25.339616 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:25.339557    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jun 02 19:45:25.347617 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:25.347581    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-757778c8b9-l4tzj"]
Jun 02 19:45:25.466633 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:25.466597    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chft9\" (UniqueName: \"kubernetes.io/projected/f770bd82-d20d-4641-a17d-1f00c9cb3746-kube-api-access-chft9\") pod \"kube-auth-proxy-757778c8b9-l4tzj\" (UID: \"f770bd82-d20d-4641-a17d-1f00c9cb3746\") " pod="openshift-ingress/kube-auth-proxy-757778c8b9-l4tzj"
Jun 02 19:45:25.466796 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:25.466640    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f770bd82-d20d-4641-a17d-1f00c9cb3746-tmp\") pod \"kube-auth-proxy-757778c8b9-l4tzj\" (UID: \"f770bd82-d20d-4641-a17d-1f00c9cb3746\") " pod="openshift-ingress/kube-auth-proxy-757778c8b9-l4tzj"
Jun 02 19:45:25.466796 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:25.466714    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f770bd82-d20d-4641-a17d-1f00c9cb3746-tls-certs\") pod \"kube-auth-proxy-757778c8b9-l4tzj\" (UID: \"f770bd82-d20d-4641-a17d-1f00c9cb3746\") " pod="openshift-ingress/kube-auth-proxy-757778c8b9-l4tzj"
Jun 02 19:45:25.567915 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:25.567885    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f770bd82-d20d-4641-a17d-1f00c9cb3746-tls-certs\") pod \"kube-auth-proxy-757778c8b9-l4tzj\" (UID: \"f770bd82-d20d-4641-a17d-1f00c9cb3746\") " pod="openshift-ingress/kube-auth-proxy-757778c8b9-l4tzj"
Jun 02 19:45:25.568076 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:25.567975    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-chft9\" (UniqueName: \"kubernetes.io/projected/f770bd82-d20d-4641-a17d-1f00c9cb3746-kube-api-access-chft9\") pod \"kube-auth-proxy-757778c8b9-l4tzj\" (UID: \"f770bd82-d20d-4641-a17d-1f00c9cb3746\") " pod="openshift-ingress/kube-auth-proxy-757778c8b9-l4tzj"
Jun 02 19:45:25.568076 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:25.568005    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f770bd82-d20d-4641-a17d-1f00c9cb3746-tmp\") pod \"kube-auth-proxy-757778c8b9-l4tzj\" (UID: \"f770bd82-d20d-4641-a17d-1f00c9cb3746\") " pod="openshift-ingress/kube-auth-proxy-757778c8b9-l4tzj"
Jun 02 19:45:25.570208 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:25.570179    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f770bd82-d20d-4641-a17d-1f00c9cb3746-tmp\") pod \"kube-auth-proxy-757778c8b9-l4tzj\" (UID: \"f770bd82-d20d-4641-a17d-1f00c9cb3746\") " pod="openshift-ingress/kube-auth-proxy-757778c8b9-l4tzj"
Jun 02 19:45:25.570490 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:25.570390    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f770bd82-d20d-4641-a17d-1f00c9cb3746-tls-certs\") pod \"kube-auth-proxy-757778c8b9-l4tzj\" (UID: \"f770bd82-d20d-4641-a17d-1f00c9cb3746\") " pod="openshift-ingress/kube-auth-proxy-757778c8b9-l4tzj"
Jun 02 19:45:25.588278 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:25.588215    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chft9\" (UniqueName: \"kubernetes.io/projected/f770bd82-d20d-4641-a17d-1f00c9cb3746-kube-api-access-chft9\") pod \"kube-auth-proxy-757778c8b9-l4tzj\" (UID: \"f770bd82-d20d-4641-a17d-1f00c9cb3746\") " pod="openshift-ingress/kube-auth-proxy-757778c8b9-l4tzj"
Jun 02 19:45:25.597805 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:25.597782    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-76588b95-ptxcz"]
Jun 02 19:45:25.600963 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:25.600948    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-ptxcz"
Jun 02 19:45:25.603485 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:25.603464    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jun 02 19:45:25.603589 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:25.603483    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-qvpgm\""
Jun 02 19:45:25.612107 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:25.612087    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-ptxcz"]
Jun 02 19:45:25.647616 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:25.647593    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-757778c8b9-l4tzj"
Jun 02 19:45:25.669583 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:25.669476    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8397dcd-5188-4618-adc9-e7df76a812aa-cert\") pod \"odh-model-controller-76588b95-ptxcz\" (UID: \"b8397dcd-5188-4618-adc9-e7df76a812aa\") " pod="opendatahub/odh-model-controller-76588b95-ptxcz"
Jun 02 19:45:25.669583 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:25.669573    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7nv2\" (UniqueName: \"kubernetes.io/projected/b8397dcd-5188-4618-adc9-e7df76a812aa-kube-api-access-q7nv2\") pod \"odh-model-controller-76588b95-ptxcz\" (UID: \"b8397dcd-5188-4618-adc9-e7df76a812aa\") " pod="opendatahub/odh-model-controller-76588b95-ptxcz"
Jun 02 19:45:25.770898 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:25.770857    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q7nv2\" (UniqueName: \"kubernetes.io/projected/b8397dcd-5188-4618-adc9-e7df76a812aa-kube-api-access-q7nv2\") pod \"odh-model-controller-76588b95-ptxcz\" (UID: \"b8397dcd-5188-4618-adc9-e7df76a812aa\") " pod="opendatahub/odh-model-controller-76588b95-ptxcz"
Jun 02 19:45:25.771055 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:25.770930    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8397dcd-5188-4618-adc9-e7df76a812aa-cert\") pod \"odh-model-controller-76588b95-ptxcz\" (UID: \"b8397dcd-5188-4618-adc9-e7df76a812aa\") " pod="opendatahub/odh-model-controller-76588b95-ptxcz"
Jun 02 19:45:25.771055 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:45:25.771025    2564 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jun 02 19:45:25.771137 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:45:25.771086    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8397dcd-5188-4618-adc9-e7df76a812aa-cert podName:b8397dcd-5188-4618-adc9-e7df76a812aa nodeName:}" failed. No retries permitted until 2026-06-02 19:45:26.271068594 +0000 UTC m=+319.125488865 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b8397dcd-5188-4618-adc9-e7df76a812aa-cert") pod "odh-model-controller-76588b95-ptxcz" (UID: "b8397dcd-5188-4618-adc9-e7df76a812aa") : secret "odh-model-controller-webhook-cert" not found
Jun 02 19:45:25.781367 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:25.781345    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-757778c8b9-l4tzj"]
Jun 02 19:45:25.783393 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:45:25.783371    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf770bd82_d20d_4641_a17d_1f00c9cb3746.slice/crio-3f1cd7d92e6a3ec9487e4d1b0410cbf2679d845fad563febd7eebbc5dcde0f4c WatchSource:0}: Error finding container 3f1cd7d92e6a3ec9487e4d1b0410cbf2679d845fad563febd7eebbc5dcde0f4c: Status 404 returned error can't find the container with id 3f1cd7d92e6a3ec9487e4d1b0410cbf2679d845fad563febd7eebbc5dcde0f4c
Jun 02 19:45:25.787804 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:25.787783    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7nv2\" (UniqueName: \"kubernetes.io/projected/b8397dcd-5188-4618-adc9-e7df76a812aa-kube-api-access-q7nv2\") pod \"odh-model-controller-76588b95-ptxcz\" (UID: \"b8397dcd-5188-4618-adc9-e7df76a812aa\") " pod="opendatahub/odh-model-controller-76588b95-ptxcz"
Jun 02 19:45:26.257140 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:26.257103    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-6577596cd5-56vdd"]
Jun 02 19:45:26.261491 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:26.261474    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-56vdd"
Jun 02 19:45:26.264109 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:26.264084    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jun 02 19:45:26.271892 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:26.271870    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-56vdd"]
Jun 02 19:45:26.275566 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:26.275546    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8397dcd-5188-4618-adc9-e7df76a812aa-cert\") pod \"odh-model-controller-76588b95-ptxcz\" (UID: \"b8397dcd-5188-4618-adc9-e7df76a812aa\") " pod="opendatahub/odh-model-controller-76588b95-ptxcz"
Jun 02 19:45:26.277798 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:26.277774    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8397dcd-5188-4618-adc9-e7df76a812aa-cert\") pod \"odh-model-controller-76588b95-ptxcz\" (UID: \"b8397dcd-5188-4618-adc9-e7df76a812aa\") " pod="opendatahub/odh-model-controller-76588b95-ptxcz"
Jun 02 19:45:26.376696 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:26.376647    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbb95\" (UniqueName: \"kubernetes.io/projected/cf36fd81-89e0-4217-8459-1881b5c313dc-kube-api-access-jbb95\") pod \"model-serving-api-6577596cd5-56vdd\" (UID: \"cf36fd81-89e0-4217-8459-1881b5c313dc\") " pod="opendatahub/model-serving-api-6577596cd5-56vdd"
Jun 02 19:45:26.377156 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:26.376709    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf36fd81-89e0-4217-8459-1881b5c313dc-tls-certs\") pod \"model-serving-api-6577596cd5-56vdd\" (UID: \"cf36fd81-89e0-4217-8459-1881b5c313dc\") " pod="opendatahub/model-serving-api-6577596cd5-56vdd"
Jun 02 19:45:26.477417 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:26.477367    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jbb95\" (UniqueName: \"kubernetes.io/projected/cf36fd81-89e0-4217-8459-1881b5c313dc-kube-api-access-jbb95\") pod \"model-serving-api-6577596cd5-56vdd\" (UID: \"cf36fd81-89e0-4217-8459-1881b5c313dc\") " pod="opendatahub/model-serving-api-6577596cd5-56vdd"
Jun 02 19:45:26.477417 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:26.477423    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf36fd81-89e0-4217-8459-1881b5c313dc-tls-certs\") pod \"model-serving-api-6577596cd5-56vdd\" (UID: \"cf36fd81-89e0-4217-8459-1881b5c313dc\") " pod="opendatahub/model-serving-api-6577596cd5-56vdd"
Jun 02 19:45:26.477670 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:45:26.477592    2564 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jun 02 19:45:26.477670 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:45:26.477658    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf36fd81-89e0-4217-8459-1881b5c313dc-tls-certs podName:cf36fd81-89e0-4217-8459-1881b5c313dc nodeName:}" failed. No retries permitted until 2026-06-02 19:45:26.977636812 +0000 UTC m=+319.832057098 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/cf36fd81-89e0-4217-8459-1881b5c313dc-tls-certs") pod "model-serving-api-6577596cd5-56vdd" (UID: "cf36fd81-89e0-4217-8459-1881b5c313dc") : secret "model-serving-api-tls" not found
Jun 02 19:45:26.489076 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:26.489049    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbb95\" (UniqueName: \"kubernetes.io/projected/cf36fd81-89e0-4217-8459-1881b5c313dc-kube-api-access-jbb95\") pod \"model-serving-api-6577596cd5-56vdd\" (UID: \"cf36fd81-89e0-4217-8459-1881b5c313dc\") " pod="opendatahub/model-serving-api-6577596cd5-56vdd"
Jun 02 19:45:26.510758 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:26.510684    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-ptxcz"
Jun 02 19:45:26.666269 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:26.666239    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-ptxcz"]
Jun 02 19:45:26.669607 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:45:26.669580    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8397dcd_5188_4618_adc9_e7df76a812aa.slice/crio-b6fce271e57a3f79ee7620028de97b48998d2a531975e7b0a68b94cf05b4efe3 WatchSource:0}: Error finding container b6fce271e57a3f79ee7620028de97b48998d2a531975e7b0a68b94cf05b4efe3: Status 404 returned error can't find the container with id b6fce271e57a3f79ee7620028de97b48998d2a531975e7b0a68b94cf05b4efe3
Jun 02 19:45:26.751296 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:26.751247    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-757778c8b9-l4tzj" event={"ID":"f770bd82-d20d-4641-a17d-1f00c9cb3746","Type":"ContainerStarted","Data":"3f1cd7d92e6a3ec9487e4d1b0410cbf2679d845fad563febd7eebbc5dcde0f4c"}
Jun 02 19:45:26.752446 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:26.752411    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-ptxcz" event={"ID":"b8397dcd-5188-4618-adc9-e7df76a812aa","Type":"ContainerStarted","Data":"b6fce271e57a3f79ee7620028de97b48998d2a531975e7b0a68b94cf05b4efe3"}
Jun 02 19:45:26.982277 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:26.982234    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf36fd81-89e0-4217-8459-1881b5c313dc-tls-certs\") pod \"model-serving-api-6577596cd5-56vdd\" (UID: \"cf36fd81-89e0-4217-8459-1881b5c313dc\") " pod="opendatahub/model-serving-api-6577596cd5-56vdd"
Jun 02 19:45:26.985057 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:26.985032    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf36fd81-89e0-4217-8459-1881b5c313dc-tls-certs\") pod \"model-serving-api-6577596cd5-56vdd\" (UID: \"cf36fd81-89e0-4217-8459-1881b5c313dc\") " pod="opendatahub/model-serving-api-6577596cd5-56vdd"
Jun 02 19:45:27.172148 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:27.172112    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-56vdd"
Jun 02 19:45:30.059678 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:30.059653    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-56vdd"]
Jun 02 19:45:30.061507 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:45:30.061478    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf36fd81_89e0_4217_8459_1881b5c313dc.slice/crio-3e48f41a62a57b47d39dbe222cf6a23d8c2a0f86c959ef3ac8e86cb4d1f6c4bd WatchSource:0}: Error finding container 3e48f41a62a57b47d39dbe222cf6a23d8c2a0f86c959ef3ac8e86cb4d1f6c4bd: Status 404 returned error can't find the container with id 3e48f41a62a57b47d39dbe222cf6a23d8c2a0f86c959ef3ac8e86cb4d1f6c4bd
Jun 02 19:45:30.771264 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:30.771224    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-ptxcz" event={"ID":"b8397dcd-5188-4618-adc9-e7df76a812aa","Type":"ContainerStarted","Data":"fecb02c60d879d5440e0982f02e79babc6c5db08ca23c74e9d01ffcb47dac0b0"}
Jun 02 19:45:30.771453 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:30.771375    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-76588b95-ptxcz"
Jun 02 19:45:30.772416 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:30.772390    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-56vdd" event={"ID":"cf36fd81-89e0-4217-8459-1881b5c313dc","Type":"ContainerStarted","Data":"3e48f41a62a57b47d39dbe222cf6a23d8c2a0f86c959ef3ac8e86cb4d1f6c4bd"}
Jun 02 19:45:30.773742 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:30.773710    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-757778c8b9-l4tzj" event={"ID":"f770bd82-d20d-4641-a17d-1f00c9cb3746","Type":"ContainerStarted","Data":"4e5054ed88a0fd371164fb7e42c986878e012831abd5592ff6665fb1a892f790"}
Jun 02 19:45:30.788734 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:30.788696    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-76588b95-ptxcz" podStartSLOduration=2.495456561 podStartE2EDuration="5.788684811s" podCreationTimestamp="2026-06-02 19:45:25 +0000 UTC" firstStartedPulling="2026-06-02 19:45:26.671382196 +0000 UTC m=+319.525802466" lastFinishedPulling="2026-06-02 19:45:29.964610445 +0000 UTC m=+322.819030716" observedRunningTime="2026-06-02 19:45:30.787161178 +0000 UTC m=+323.641581473" watchObservedRunningTime="2026-06-02 19:45:30.788684811 +0000 UTC m=+323.643105104"
Jun 02 19:45:30.806148 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:30.806110    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-757778c8b9-l4tzj" podStartSLOduration=1.65886881 podStartE2EDuration="5.806095655s" podCreationTimestamp="2026-06-02 19:45:25 +0000 UTC" firstStartedPulling="2026-06-02 19:45:25.784883096 +0000 UTC m=+318.639303366" lastFinishedPulling="2026-06-02 19:45:29.932109926 +0000 UTC m=+322.786530211" observedRunningTime="2026-06-02 19:45:30.804737975 +0000 UTC m=+323.659158267" watchObservedRunningTime="2026-06-02 19:45:30.806095655 +0000 UTC m=+323.660516158"
Jun 02 19:45:32.781130 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:32.781094    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-56vdd" event={"ID":"cf36fd81-89e0-4217-8459-1881b5c313dc","Type":"ContainerStarted","Data":"1ed014e87994c004cea39ea5d4b712e8e940c30fa32ffb3c262d8302096ea8d5"}
Jun 02 19:45:32.781556 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:32.781214    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-6577596cd5-56vdd"
Jun 02 19:45:32.800392 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:32.800345    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/model-serving-api-6577596cd5-56vdd" podStartSLOduration=4.910332924 podStartE2EDuration="6.800333248s" podCreationTimestamp="2026-06-02 19:45:26 +0000 UTC" firstStartedPulling="2026-06-02 19:45:30.063288286 +0000 UTC m=+322.917708557" lastFinishedPulling="2026-06-02 19:45:31.953288593 +0000 UTC m=+324.807708881" observedRunningTime="2026-06-02 19:45:32.798832692 +0000 UTC m=+325.653252985" watchObservedRunningTime="2026-06-02 19:45:32.800333248 +0000 UTC m=+325.654753541"
Jun 02 19:45:35.468428 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:35.468393    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-52tkm"]
Jun 02 19:45:35.471645 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:35.471619    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-52tkm"
Jun 02 19:45:35.474625 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:35.474602    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jun 02 19:45:35.474736 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:35.474650    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-t5mmw\""
Jun 02 19:45:35.480550 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:35.480519    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-5jhhm"]
Jun 02 19:45:35.483762 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:35.483739    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-52tkm"]
Jun 02 19:45:35.483888 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:35.483859    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-5jhhm"
Jun 02 19:45:35.487617 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:35.487595    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-sllrb\""
Jun 02 19:45:35.487741 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:35.487725    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jun 02 19:45:35.504945 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:35.504921    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-5jhhm"]
Jun 02 19:45:35.556621 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:35.556591    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/685f3707-55c9-4abd-b61a-239c7895fa07-cert\") pod \"kserve-controller-manager-7c99ffcdcd-52tkm\" (UID: \"685f3707-55c9-4abd-b61a-239c7895fa07\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-52tkm"
Jun 02 19:45:35.556753 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:35.556707    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkg7q\" (UniqueName: \"kubernetes.io/projected/685f3707-55c9-4abd-b61a-239c7895fa07-kube-api-access-hkg7q\") pod \"kserve-controller-manager-7c99ffcdcd-52tkm\" (UID: \"685f3707-55c9-4abd-b61a-239c7895fa07\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-52tkm"
Jun 02 19:45:35.657704 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:35.657680    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hkg7q\" (UniqueName: \"kubernetes.io/projected/685f3707-55c9-4abd-b61a-239c7895fa07-kube-api-access-hkg7q\") pod \"kserve-controller-manager-7c99ffcdcd-52tkm\" (UID: \"685f3707-55c9-4abd-b61a-239c7895fa07\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-52tkm"
Jun 02 19:45:35.657895 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:35.657711    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/685f3707-55c9-4abd-b61a-239c7895fa07-cert\") pod \"kserve-controller-manager-7c99ffcdcd-52tkm\" (UID: \"685f3707-55c9-4abd-b61a-239c7895fa07\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-52tkm"
Jun 02 19:45:35.657895 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:35.657740    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b7c2f3c-f17d-46b9-a325-0ee7b73562ec-cert\") pod \"llmisvc-controller-manager-c6b9847d7-5jhhm\" (UID: \"1b7c2f3c-f17d-46b9-a325-0ee7b73562ec\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-5jhhm"
Jun 02 19:45:35.657895 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:35.657778    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nspgs\" (UniqueName: \"kubernetes.io/projected/1b7c2f3c-f17d-46b9-a325-0ee7b73562ec-kube-api-access-nspgs\") pod \"llmisvc-controller-manager-c6b9847d7-5jhhm\" (UID: \"1b7c2f3c-f17d-46b9-a325-0ee7b73562ec\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-5jhhm"
Jun 02 19:45:35.660010 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:35.659992    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/685f3707-55c9-4abd-b61a-239c7895fa07-cert\") pod \"kserve-controller-manager-7c99ffcdcd-52tkm\" (UID: \"685f3707-55c9-4abd-b61a-239c7895fa07\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-52tkm"
Jun 02 19:45:35.674435 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:35.674415    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkg7q\" (UniqueName: \"kubernetes.io/projected/685f3707-55c9-4abd-b61a-239c7895fa07-kube-api-access-hkg7q\") pod \"kserve-controller-manager-7c99ffcdcd-52tkm\" (UID: \"685f3707-55c9-4abd-b61a-239c7895fa07\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-52tkm"
Jun 02 19:45:35.758127 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:35.758101    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nspgs\" (UniqueName: \"kubernetes.io/projected/1b7c2f3c-f17d-46b9-a325-0ee7b73562ec-kube-api-access-nspgs\") pod \"llmisvc-controller-manager-c6b9847d7-5jhhm\" (UID: \"1b7c2f3c-f17d-46b9-a325-0ee7b73562ec\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-5jhhm"
Jun 02 19:45:35.758248 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:35.758163    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b7c2f3c-f17d-46b9-a325-0ee7b73562ec-cert\") pod \"llmisvc-controller-manager-c6b9847d7-5jhhm\" (UID: \"1b7c2f3c-f17d-46b9-a325-0ee7b73562ec\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-5jhhm"
Jun 02 19:45:35.760315 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:35.760279    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b7c2f3c-f17d-46b9-a325-0ee7b73562ec-cert\") pod \"llmisvc-controller-manager-c6b9847d7-5jhhm\" (UID: \"1b7c2f3c-f17d-46b9-a325-0ee7b73562ec\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-5jhhm"
Jun 02 19:45:35.769744 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:35.769718    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nspgs\" (UniqueName: \"kubernetes.io/projected/1b7c2f3c-f17d-46b9-a325-0ee7b73562ec-kube-api-access-nspgs\") pod \"llmisvc-controller-manager-c6b9847d7-5jhhm\" (UID: \"1b7c2f3c-f17d-46b9-a325-0ee7b73562ec\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-5jhhm"
Jun 02 19:45:35.781611 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:35.781593    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-52tkm"
Jun 02 19:45:35.793106 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:35.793086    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-5jhhm"
Jun 02 19:45:35.937881 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:35.937809    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-52tkm"]
Jun 02 19:45:35.939497 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:45:35.939465    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod685f3707_55c9_4abd_b61a_239c7895fa07.slice/crio-67003dcbf7498b657958f4cb609216025f241d4da9940191e29cadaeda8a7477 WatchSource:0}: Error finding container 67003dcbf7498b657958f4cb609216025f241d4da9940191e29cadaeda8a7477: Status 404 returned error can't find the container with id 67003dcbf7498b657958f4cb609216025f241d4da9940191e29cadaeda8a7477
Jun 02 19:45:35.963702 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:35.963681    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-5jhhm"]
Jun 02 19:45:35.964902 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:45:35.964868    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1b7c2f3c_f17d_46b9_a325_0ee7b73562ec.slice/crio-eb19c09d75be1f2cd65b0d771d64e1c78dd4a3cb8544bf6cbd8203a18280196f WatchSource:0}: Error finding container eb19c09d75be1f2cd65b0d771d64e1c78dd4a3cb8544bf6cbd8203a18280196f: Status 404 returned error can't find the container with id eb19c09d75be1f2cd65b0d771d64e1c78dd4a3cb8544bf6cbd8203a18280196f
Jun 02 19:45:36.794598 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:36.794559    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-5jhhm" event={"ID":"1b7c2f3c-f17d-46b9-a325-0ee7b73562ec","Type":"ContainerStarted","Data":"eb19c09d75be1f2cd65b0d771d64e1c78dd4a3cb8544bf6cbd8203a18280196f"}
Jun 02 19:45:36.795827 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:36.795802    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-52tkm" event={"ID":"685f3707-55c9-4abd-b61a-239c7895fa07","Type":"ContainerStarted","Data":"67003dcbf7498b657958f4cb609216025f241d4da9940191e29cadaeda8a7477"}
Jun 02 19:45:39.807197 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:39.807167    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-5jhhm" event={"ID":"1b7c2f3c-f17d-46b9-a325-0ee7b73562ec","Type":"ContainerStarted","Data":"942c5790683cd4797e5acb5f219c1c3c237fc349acd649f9e65ba82a75a4da65"}
Jun 02 19:45:39.807632 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:39.807258    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-5jhhm"
Jun 02 19:45:39.808437 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:39.808417    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-52tkm" event={"ID":"685f3707-55c9-4abd-b61a-239c7895fa07","Type":"ContainerStarted","Data":"77abc0df02e857f74551b5f8dc715df2c1ac76e17ef5fb4c0763627364a169f9"}
Jun 02 19:45:39.808532 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:39.808522    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-52tkm"
Jun 02 19:45:39.830968 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:39.830925    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-5jhhm" podStartSLOduration=1.332463845 podStartE2EDuration="4.830913216s" podCreationTimestamp="2026-06-02 19:45:35 +0000 UTC" firstStartedPulling="2026-06-02 19:45:35.966184164 +0000 UTC m=+328.820604435" lastFinishedPulling="2026-06-02 19:45:39.464633531 +0000 UTC m=+332.319053806" observedRunningTime="2026-06-02 19:45:39.830167477 +0000 UTC m=+332.684587771" watchObservedRunningTime="2026-06-02 19:45:39.830913216 +0000 UTC m=+332.685333574"
Jun 02 19:45:39.865209 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:39.865161    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-52tkm" podStartSLOduration=2.05033854 podStartE2EDuration="4.865149333s" podCreationTimestamp="2026-06-02 19:45:35 +0000 UTC" firstStartedPulling="2026-06-02 19:45:35.940796572 +0000 UTC m=+328.795216845" lastFinishedPulling="2026-06-02 19:45:38.755607368 +0000 UTC m=+331.610027638" observedRunningTime="2026-06-02 19:45:39.864257618 +0000 UTC m=+332.718677911" watchObservedRunningTime="2026-06-02 19:45:39.865149333 +0000 UTC m=+332.719569625"
Jun 02 19:45:41.815346 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:41.815312    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-76588b95-ptxcz"
Jun 02 19:45:43.788522 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:43.788492    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-6577596cd5-56vdd"
Jun 02 19:45:55.711927 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:55.711820    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-fd65b6c4c-czhgt"]
Jun 02 19:45:55.715055 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:55.715035    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-fd65b6c4c-czhgt"
Jun 02 19:45:55.717883 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:55.717861    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\""
Jun 02 19:45:55.718113 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:55.718098    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-s2sj4\""
Jun 02 19:45:55.724007 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:55.723986    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-fd65b6c4c-czhgt"]
Jun 02 19:45:55.808387 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:55.808350    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/07b4643f-605a-4b4d-b52d-84bb7e9054cd-redirect-config\") pod \"dashboard-redirect-fd65b6c4c-czhgt\" (UID: \"07b4643f-605a-4b4d-b52d-84bb7e9054cd\") " pod="opendatahub/dashboard-redirect-fd65b6c4c-czhgt"
Jun 02 19:45:55.808576 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:55.808401    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cjdq\" (UniqueName: \"kubernetes.io/projected/07b4643f-605a-4b4d-b52d-84bb7e9054cd-kube-api-access-9cjdq\") pod \"dashboard-redirect-fd65b6c4c-czhgt\" (UID: \"07b4643f-605a-4b4d-b52d-84bb7e9054cd\") " pod="opendatahub/dashboard-redirect-fd65b6c4c-czhgt"
Jun 02 19:45:55.909707 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:55.909668    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/07b4643f-605a-4b4d-b52d-84bb7e9054cd-redirect-config\") pod \"dashboard-redirect-fd65b6c4c-czhgt\" (UID: \"07b4643f-605a-4b4d-b52d-84bb7e9054cd\") " pod="opendatahub/dashboard-redirect-fd65b6c4c-czhgt"
Jun 02 19:45:55.909972 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:55.909728    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9cjdq\" (UniqueName: \"kubernetes.io/projected/07b4643f-605a-4b4d-b52d-84bb7e9054cd-kube-api-access-9cjdq\") pod \"dashboard-redirect-fd65b6c4c-czhgt\" (UID: \"07b4643f-605a-4b4d-b52d-84bb7e9054cd\") " pod="opendatahub/dashboard-redirect-fd65b6c4c-czhgt"
Jun 02 19:45:55.910369 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:55.910346    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/07b4643f-605a-4b4d-b52d-84bb7e9054cd-redirect-config\") pod \"dashboard-redirect-fd65b6c4c-czhgt\" (UID: \"07b4643f-605a-4b4d-b52d-84bb7e9054cd\") " pod="opendatahub/dashboard-redirect-fd65b6c4c-czhgt"
Jun 02 19:45:55.918046 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:55.918027    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cjdq\" (UniqueName: \"kubernetes.io/projected/07b4643f-605a-4b4d-b52d-84bb7e9054cd-kube-api-access-9cjdq\") pod \"dashboard-redirect-fd65b6c4c-czhgt\" (UID: \"07b4643f-605a-4b4d-b52d-84bb7e9054cd\") " pod="opendatahub/dashboard-redirect-fd65b6c4c-czhgt"
Jun 02 19:45:56.026347 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:56.026301    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-fd65b6c4c-czhgt"
Jun 02 19:45:56.152281 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:56.152259    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-fd65b6c4c-czhgt"]
Jun 02 19:45:56.154288 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:45:56.154256    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07b4643f_605a_4b4d_b52d_84bb7e9054cd.slice/crio-4cf03ed3795e717c1fdda4ba39c7056049aa424c23556079e4d68650f38f2f8f WatchSource:0}: Error finding container 4cf03ed3795e717c1fdda4ba39c7056049aa424c23556079e4d68650f38f2f8f: Status 404 returned error can't find the container with id 4cf03ed3795e717c1fdda4ba39c7056049aa424c23556079e4d68650f38f2f8f
Jun 02 19:45:56.864305 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:56.864267    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-fd65b6c4c-czhgt" event={"ID":"07b4643f-605a-4b4d-b52d-84bb7e9054cd","Type":"ContainerStarted","Data":"4cf03ed3795e717c1fdda4ba39c7056049aa424c23556079e4d68650f38f2f8f"}
Jun 02 19:45:58.876751 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:58.876714    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-fd65b6c4c-czhgt" event={"ID":"07b4643f-605a-4b4d-b52d-84bb7e9054cd","Type":"ContainerStarted","Data":"b405907093b3d54594158d1daf7d11b44accd469ab87e03877e6b82b5522258c"}
Jun 02 19:45:58.893572 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:45:58.893520    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-fd65b6c4c-czhgt" podStartSLOduration=1.78994726 podStartE2EDuration="3.893507869s" podCreationTimestamp="2026-06-02 19:45:55 +0000 UTC" firstStartedPulling="2026-06-02 19:45:56.155549733 +0000 UTC m=+349.009970003" lastFinishedPulling="2026-06-02 19:45:58.259110337 +0000 UTC m=+351.113530612" observedRunningTime="2026-06-02 19:45:58.891539458 +0000 UTC m=+351.745959754" watchObservedRunningTime="2026-06-02 19:45:58.893507869 +0000 UTC m=+351.747928217"
Jun 02 19:46:10.814487 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:10.814454    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-5jhhm"
Jun 02 19:46:10.817921 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:10.817895    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-52tkm"
Jun 02 19:46:13.977045 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:13.977012    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-jztww"]
Jun 02 19:46:13.983430 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:13.983407    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-jztww"
Jun 02 19:46:13.985974 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:13.985951    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jun 02 19:46:13.985974 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:13.985970    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jun 02 19:46:13.986143 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:13.986071    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-tvhb2\""
Jun 02 19:46:13.986143 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:13.986079    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jun 02 19:46:13.986327 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:13.986314    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jun 02 19:46:13.992690 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:13.992668    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-jztww"]
Jun 02 19:46:14.052678 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:14.052652    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dd287ae-a743-4660-a0aa-79043fbc4e03-istio-token\") pod \"istiod-openshift-gateway-798958bb55-jztww\" (UID: \"6dd287ae-a743-4660-a0aa-79043fbc4e03\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-jztww"
Jun 02 19:46:14.052678 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:14.052678    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6dd287ae-a743-4660-a0aa-79043fbc4e03-cacerts\") pod \"istiod-openshift-gateway-798958bb55-jztww\" (UID: \"6dd287ae-a743-4660-a0aa-79043fbc4e03\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-jztww"
Jun 02 19:46:14.052908 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:14.052705    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dd287ae-a743-4660-a0aa-79043fbc4e03-local-certs\") pod \"istiod-openshift-gateway-798958bb55-jztww\" (UID: \"6dd287ae-a743-4660-a0aa-79043fbc4e03\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-jztww"
Jun 02 19:46:14.052908 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:14.052811    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6dd287ae-a743-4660-a0aa-79043fbc4e03-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-jztww\" (UID: \"6dd287ae-a743-4660-a0aa-79043fbc4e03\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-jztww"
Jun 02 19:46:14.052908 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:14.052863    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6dd287ae-a743-4660-a0aa-79043fbc4e03-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-jztww\" (UID: \"6dd287ae-a743-4660-a0aa-79043fbc4e03\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-jztww"
Jun 02 19:46:14.052908 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:14.052890    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6dd287ae-a743-4660-a0aa-79043fbc4e03-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-jztww\" (UID: \"6dd287ae-a743-4660-a0aa-79043fbc4e03\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-jztww"
Jun 02 19:46:14.053040 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:14.052914    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd48r\" (UniqueName: \"kubernetes.io/projected/6dd287ae-a743-4660-a0aa-79043fbc4e03-kube-api-access-kd48r\") pod \"istiod-openshift-gateway-798958bb55-jztww\" (UID: \"6dd287ae-a743-4660-a0aa-79043fbc4e03\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-jztww"
Jun 02 19:46:14.153847 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:14.153814    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dd287ae-a743-4660-a0aa-79043fbc4e03-istio-token\") pod \"istiod-openshift-gateway-798958bb55-jztww\" (UID: \"6dd287ae-a743-4660-a0aa-79043fbc4e03\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-jztww"
Jun 02 19:46:14.153982 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:14.153869    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6dd287ae-a743-4660-a0aa-79043fbc4e03-cacerts\") pod \"istiod-openshift-gateway-798958bb55-jztww\" (UID: \"6dd287ae-a743-4660-a0aa-79043fbc4e03\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-jztww"
Jun 02 19:46:14.153982 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:14.153903    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dd287ae-a743-4660-a0aa-79043fbc4e03-local-certs\") pod \"istiod-openshift-gateway-798958bb55-jztww\" (UID: \"6dd287ae-a743-4660-a0aa-79043fbc4e03\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-jztww"
Jun 02 19:46:14.153982 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:14.153952    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6dd287ae-a743-4660-a0aa-79043fbc4e03-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-jztww\" (UID: \"6dd287ae-a743-4660-a0aa-79043fbc4e03\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-jztww"
Jun 02 19:46:14.154152 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:14.153985    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6dd287ae-a743-4660-a0aa-79043fbc4e03-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-jztww\" (UID: \"6dd287ae-a743-4660-a0aa-79043fbc4e03\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-jztww"
Jun 02 19:46:14.154152 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:14.154017    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6dd287ae-a743-4660-a0aa-79043fbc4e03-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-jztww\" (UID: \"6dd287ae-a743-4660-a0aa-79043fbc4e03\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-jztww"
Jun 02 19:46:14.154152 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:14.154041    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kd48r\" (UniqueName: \"kubernetes.io/projected/6dd287ae-a743-4660-a0aa-79043fbc4e03-kube-api-access-kd48r\") pod \"istiod-openshift-gateway-798958bb55-jztww\" (UID: \"6dd287ae-a743-4660-a0aa-79043fbc4e03\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-jztww"
Jun 02 19:46:14.155058 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:14.155023    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6dd287ae-a743-4660-a0aa-79043fbc4e03-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-jztww\" (UID: \"6dd287ae-a743-4660-a0aa-79043fbc4e03\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-jztww"
Jun 02 19:46:14.157282 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:14.157254    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6dd287ae-a743-4660-a0aa-79043fbc4e03-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-jztww\" (UID: \"6dd287ae-a743-4660-a0aa-79043fbc4e03\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-jztww"
Jun 02 19:46:14.157390 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:14.157287    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6dd287ae-a743-4660-a0aa-79043fbc4e03-cacerts\") pod \"istiod-openshift-gateway-798958bb55-jztww\" (UID: \"6dd287ae-a743-4660-a0aa-79043fbc4e03\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-jztww"
Jun 02 19:46:14.157390 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:14.157338    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6dd287ae-a743-4660-a0aa-79043fbc4e03-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-jztww\" (UID: \"6dd287ae-a743-4660-a0aa-79043fbc4e03\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-jztww"
Jun 02 19:46:14.162090 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:14.162060    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dd287ae-a743-4660-a0aa-79043fbc4e03-local-certs\") pod \"istiod-openshift-gateway-798958bb55-jztww\" (UID: \"6dd287ae-a743-4660-a0aa-79043fbc4e03\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-jztww"
Jun 02 19:46:14.162506 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:14.162482    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd48r\" (UniqueName: \"kubernetes.io/projected/6dd287ae-a743-4660-a0aa-79043fbc4e03-kube-api-access-kd48r\") pod \"istiod-openshift-gateway-798958bb55-jztww\" (UID: \"6dd287ae-a743-4660-a0aa-79043fbc4e03\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-jztww"
Jun 02 19:46:14.163693 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:14.163673    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dd287ae-a743-4660-a0aa-79043fbc4e03-istio-token\") pod \"istiod-openshift-gateway-798958bb55-jztww\" (UID: \"6dd287ae-a743-4660-a0aa-79043fbc4e03\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-jztww"
Jun 02 19:46:14.293398 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:14.293369    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-jztww"
Jun 02 19:46:14.424477 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:14.424439    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-jztww"]
Jun 02 19:46:14.426116 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:46:14.426088    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dd287ae_a743_4660_a0aa_79043fbc4e03.slice/crio-55baf172f55fdf3d6f9689db5d4b7dd7b70ca3944453b0a510414ba0f725a018 WatchSource:0}: Error finding container 55baf172f55fdf3d6f9689db5d4b7dd7b70ca3944453b0a510414ba0f725a018: Status 404 returned error can't find the container with id 55baf172f55fdf3d6f9689db5d4b7dd7b70ca3944453b0a510414ba0f725a018
Jun 02 19:46:14.924690 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:14.924655    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-jztww" event={"ID":"6dd287ae-a743-4660-a0aa-79043fbc4e03","Type":"ContainerStarted","Data":"55baf172f55fdf3d6f9689db5d4b7dd7b70ca3944453b0a510414ba0f725a018"}
Jun 02 19:46:17.169749 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:17.169714    2564 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jun 02 19:46:17.170023 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:17.169781    2564 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jun 02 19:46:17.936468 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:17.936433    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-jztww" event={"ID":"6dd287ae-a743-4660-a0aa-79043fbc4e03","Type":"ContainerStarted","Data":"d8f0e9de247114673df8c6a2ebbdbadcdda789e31e7b48f6a83b7f2d952b97be"}
Jun 02 19:46:17.936639 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:17.936487    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-jztww"
Jun 02 19:46:17.959287 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:17.959237    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-jztww" podStartSLOduration=2.218112783 podStartE2EDuration="4.959223683s" podCreationTimestamp="2026-06-02 19:46:13 +0000 UTC" firstStartedPulling="2026-06-02 19:46:14.428371085 +0000 UTC m=+367.282791358" lastFinishedPulling="2026-06-02 19:46:17.169481984 +0000 UTC m=+370.023902258" observedRunningTime="2026-06-02 19:46:17.958387479 +0000 UTC m=+370.812807763" watchObservedRunningTime="2026-06-02 19:46:17.959223683 +0000 UTC m=+370.813643977"
Jun 02 19:46:18.941959 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:46:18.941934    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-jztww"
Jun 02 19:47:29.066773 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:29.066682    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-xs6q9"]
Jun 02 19:47:29.070106 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:29.070087    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-xs6q9"
Jun 02 19:47:29.072793 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:29.072776    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jun 02 19:47:29.072966 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:29.072948    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jun 02 19:47:29.073040 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:29.072988    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-h858j\""
Jun 02 19:47:29.079764 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:29.079743    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-xs6q9"]
Jun 02 19:47:29.195051 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:29.195022    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3a76cfb-9f89-4013-9fa6-71f50956dc18-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-xs6q9\" (UID: \"c3a76cfb-9f89-4013-9fa6-71f50956dc18\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-xs6q9"
Jun 02 19:47:29.195264 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:29.195144    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trhbl\" (UniqueName: \"kubernetes.io/projected/c3a76cfb-9f89-4013-9fa6-71f50956dc18-kube-api-access-trhbl\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-xs6q9\" (UID: \"c3a76cfb-9f89-4013-9fa6-71f50956dc18\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-xs6q9"
Jun 02 19:47:29.296475 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:29.296439    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-trhbl\" (UniqueName: \"kubernetes.io/projected/c3a76cfb-9f89-4013-9fa6-71f50956dc18-kube-api-access-trhbl\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-xs6q9\" (UID: \"c3a76cfb-9f89-4013-9fa6-71f50956dc18\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-xs6q9"
Jun 02 19:47:29.296642 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:29.296483    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3a76cfb-9f89-4013-9fa6-71f50956dc18-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-xs6q9\" (UID: \"c3a76cfb-9f89-4013-9fa6-71f50956dc18\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-xs6q9"
Jun 02 19:47:29.296831 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:29.296816    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3a76cfb-9f89-4013-9fa6-71f50956dc18-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-xs6q9\" (UID: \"c3a76cfb-9f89-4013-9fa6-71f50956dc18\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-xs6q9"
Jun 02 19:47:29.305173 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:29.305150    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trhbl\" (UniqueName: \"kubernetes.io/projected/c3a76cfb-9f89-4013-9fa6-71f50956dc18-kube-api-access-trhbl\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-xs6q9\" (UID: \"c3a76cfb-9f89-4013-9fa6-71f50956dc18\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-xs6q9"
Jun 02 19:47:29.381024 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:29.380938    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-xs6q9"
Jun 02 19:47:29.522750 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:29.522726    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-xs6q9"]
Jun 02 19:47:29.525071 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:47:29.525045    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3a76cfb_9f89_4013_9fa6_71f50956dc18.slice/crio-928f00a6a56d9311943e2536e67e226aa2c3c281addfae5a032672fe6d21792f WatchSource:0}: Error finding container 928f00a6a56d9311943e2536e67e226aa2c3c281addfae5a032672fe6d21792f: Status 404 returned error can't find the container with id 928f00a6a56d9311943e2536e67e226aa2c3c281addfae5a032672fe6d21792f
Jun 02 19:47:29.842475 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:29.842443    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-xs6q9"]
Jun 02 19:47:29.854508 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:29.854475    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-xs6q9"]
Jun 02 19:47:29.873265 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:29.873238    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-96gw6"]
Jun 02 19:47:29.878012 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:29.877989    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-96gw6"
Jun 02 19:47:29.898115 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:29.898085    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-96gw6"]
Jun 02 19:47:30.001663 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:30.001629    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1324fb85-a211-4990-a151-c3b05015d2ac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-96gw6\" (UID: \"1324fb85-a211-4990-a151-c3b05015d2ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-96gw6"
Jun 02 19:47:30.001831 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:30.001674    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jznsb\" (UniqueName: \"kubernetes.io/projected/1324fb85-a211-4990-a151-c3b05015d2ac-kube-api-access-jznsb\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-96gw6\" (UID: \"1324fb85-a211-4990-a151-c3b05015d2ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-96gw6"
Jun 02 19:47:30.102399 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:30.102329    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1324fb85-a211-4990-a151-c3b05015d2ac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-96gw6\" (UID: \"1324fb85-a211-4990-a151-c3b05015d2ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-96gw6"
Jun 02 19:47:30.102399 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:30.102371    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jznsb\" (UniqueName: \"kubernetes.io/projected/1324fb85-a211-4990-a151-c3b05015d2ac-kube-api-access-jznsb\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-96gw6\" (UID: \"1324fb85-a211-4990-a151-c3b05015d2ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-96gw6"
Jun 02 19:47:30.102771 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:30.102640    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1324fb85-a211-4990-a151-c3b05015d2ac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-96gw6\" (UID: \"1324fb85-a211-4990-a151-c3b05015d2ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-96gw6"
Jun 02 19:47:30.111638 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:30.111593    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jznsb\" (UniqueName: \"kubernetes.io/projected/1324fb85-a211-4990-a151-c3b05015d2ac-kube-api-access-jznsb\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-96gw6\" (UID: \"1324fb85-a211-4990-a151-c3b05015d2ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-96gw6"
Jun 02 19:47:30.189648 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:30.189615    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-96gw6"
Jun 02 19:47:30.356832 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:30.356806    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-96gw6"]
Jun 02 19:47:30.468752 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:47:30.468715    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1324fb85_a211_4990_a151_c3b05015d2ac.slice/crio-094e95cb6fe68f678dab558405b63230d2788a5797e6f00e1aad88b71153f269 WatchSource:0}: Error finding container 094e95cb6fe68f678dab558405b63230d2788a5797e6f00e1aad88b71153f269: Status 404 returned error can't find the container with id 094e95cb6fe68f678dab558405b63230d2788a5797e6f00e1aad88b71153f269
Jun 02 19:47:31.178437 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:31.178396    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-96gw6" event={"ID":"1324fb85-a211-4990-a151-c3b05015d2ac","Type":"ContainerStarted","Data":"094e95cb6fe68f678dab558405b63230d2788a5797e6f00e1aad88b71153f269"}
Jun 02 19:47:34.190126 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:34.190080    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-xs6q9" podUID="c3a76cfb-9f89-4013-9fa6-71f50956dc18" containerName="manager" containerID="cri-o://ef8ba2641e9f03dc1f52ac42bdcd41b893824a2a7444560a970f620253c32bf0" gracePeriod=2
Jun 02 19:47:34.191382 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:34.191354    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-96gw6" event={"ID":"1324fb85-a211-4990-a151-c3b05015d2ac","Type":"ContainerStarted","Data":"147c923f8e31cd9882e5809ec922a49dcbb8897f6d122ceb5edd04e9cfdc3f60"}
Jun 02 19:47:34.191486 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:34.191408    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-96gw6"
Jun 02 19:47:34.212220 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:34.212160    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-96gw6" podStartSLOduration=1.563094554 podStartE2EDuration="5.212144674s" podCreationTimestamp="2026-06-02 19:47:29 +0000 UTC" firstStartedPulling="2026-06-02 19:47:30.470998672 +0000 UTC m=+443.325418946" lastFinishedPulling="2026-06-02 19:47:34.120048792 +0000 UTC m=+446.974469066" observedRunningTime="2026-06-02 19:47:34.211234092 +0000 UTC m=+447.065654386" watchObservedRunningTime="2026-06-02 19:47:34.212144674 +0000 UTC m=+447.066564968"
Jun 02 19:47:36.364591 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:36.364569    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-xs6q9"
Jun 02 19:47:36.461665 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:36.461605    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trhbl\" (UniqueName: \"kubernetes.io/projected/c3a76cfb-9f89-4013-9fa6-71f50956dc18-kube-api-access-trhbl\") pod \"c3a76cfb-9f89-4013-9fa6-71f50956dc18\" (UID: \"c3a76cfb-9f89-4013-9fa6-71f50956dc18\") "
Jun 02 19:47:36.461763 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:36.461707    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3a76cfb-9f89-4013-9fa6-71f50956dc18-extensions-socket-volume\") pod \"c3a76cfb-9f89-4013-9fa6-71f50956dc18\" (UID: \"c3a76cfb-9f89-4013-9fa6-71f50956dc18\") "
Jun 02 19:47:36.461973 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:36.461948    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3a76cfb-9f89-4013-9fa6-71f50956dc18-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c3a76cfb-9f89-4013-9fa6-71f50956dc18" (UID: "c3a76cfb-9f89-4013-9fa6-71f50956dc18"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 02 19:47:36.463681 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:36.463660    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3a76cfb-9f89-4013-9fa6-71f50956dc18-kube-api-access-trhbl" (OuterVolumeSpecName: "kube-api-access-trhbl") pod "c3a76cfb-9f89-4013-9fa6-71f50956dc18" (UID: "c3a76cfb-9f89-4013-9fa6-71f50956dc18"). InnerVolumeSpecName "kube-api-access-trhbl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 02 19:47:36.562691 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:36.562657    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3a76cfb-9f89-4013-9fa6-71f50956dc18-extensions-socket-volume\") on node \"ip-10-0-130-103.ec2.internal\" DevicePath \"\""
Jun 02 19:47:36.562691 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:36.562686    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trhbl\" (UniqueName: \"kubernetes.io/projected/c3a76cfb-9f89-4013-9fa6-71f50956dc18-kube-api-access-trhbl\") on node \"ip-10-0-130-103.ec2.internal\" DevicePath \"\""
Jun 02 19:47:37.202373 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:37.202341    2564 generic.go:358] "Generic (PLEG): container finished" podID="c3a76cfb-9f89-4013-9fa6-71f50956dc18" containerID="ef8ba2641e9f03dc1f52ac42bdcd41b893824a2a7444560a970f620253c32bf0" exitCode=137
Jun 02 19:47:37.202534 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:37.202395    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-xs6q9"
Jun 02 19:47:37.202534 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:37.202443    2564 scope.go:117] "RemoveContainer" containerID="ef8ba2641e9f03dc1f52ac42bdcd41b893824a2a7444560a970f620253c32bf0"
Jun 02 19:47:37.205064 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:37.205033    2564 status_manager.go:895] "Failed to get status for pod" podUID="c3a76cfb-9f89-4013-9fa6-71f50956dc18" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-xs6q9" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-xs6q9\" is forbidden: User \"system:node:ip-10-0-130-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-103.ec2.internal' and this object"
Jun 02 19:47:37.210783 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:37.210761    2564 scope.go:117] "RemoveContainer" containerID="ef8ba2641e9f03dc1f52ac42bdcd41b893824a2a7444560a970f620253c32bf0"
Jun 02 19:47:37.211050 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:47:37.211032    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef8ba2641e9f03dc1f52ac42bdcd41b893824a2a7444560a970f620253c32bf0\": container with ID starting with ef8ba2641e9f03dc1f52ac42bdcd41b893824a2a7444560a970f620253c32bf0 not found: ID does not exist" containerID="ef8ba2641e9f03dc1f52ac42bdcd41b893824a2a7444560a970f620253c32bf0"
Jun 02 19:47:37.211137 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:37.211058    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef8ba2641e9f03dc1f52ac42bdcd41b893824a2a7444560a970f620253c32bf0"} err="failed to get container status \"ef8ba2641e9f03dc1f52ac42bdcd41b893824a2a7444560a970f620253c32bf0\": rpc error: code = NotFound desc = could not find container \"ef8ba2641e9f03dc1f52ac42bdcd41b893824a2a7444560a970f620253c32bf0\": container with ID starting with ef8ba2641e9f03dc1f52ac42bdcd41b893824a2a7444560a970f620253c32bf0 not found: ID does not exist"
Jun 02 19:47:37.212995 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:37.212968    2564 status_manager.go:895] "Failed to get status for pod" podUID="c3a76cfb-9f89-4013-9fa6-71f50956dc18" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-xs6q9" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-xs6q9\" is forbidden: User \"system:node:ip-10-0-130-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-103.ec2.internal' and this object"
Jun 02 19:47:37.646859 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:37.646802    2564 status_manager.go:895] "Failed to get status for pod" podUID="c3a76cfb-9f89-4013-9fa6-71f50956dc18" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-xs6q9" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-xs6q9\" is forbidden: User \"system:node:ip-10-0-130-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-103.ec2.internal' and this object"
Jun 02 19:47:37.647205 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:37.646887    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3a76cfb-9f89-4013-9fa6-71f50956dc18" path="/var/lib/kubelet/pods/c3a76cfb-9f89-4013-9fa6-71f50956dc18/volumes"
Jun 02 19:47:45.196442 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:45.196409    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-96gw6"
Jun 02 19:47:58.027702 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:58.027665    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-96gw6"]
Jun 02 19:47:58.028179 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:58.027975    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-96gw6" podUID="1324fb85-a211-4990-a151-c3b05015d2ac" containerName="manager" containerID="cri-o://147c923f8e31cd9882e5809ec922a49dcbb8897f6d122ceb5edd04e9cfdc3f60" gracePeriod=10
Jun 02 19:47:58.276059 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:58.276028    2564 generic.go:358] "Generic (PLEG): container finished" podID="1324fb85-a211-4990-a151-c3b05015d2ac" containerID="147c923f8e31cd9882e5809ec922a49dcbb8897f6d122ceb5edd04e9cfdc3f60" exitCode=0
Jun 02 19:47:58.276203 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:58.276076    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-96gw6" event={"ID":"1324fb85-a211-4990-a151-c3b05015d2ac","Type":"ContainerDied","Data":"147c923f8e31cd9882e5809ec922a49dcbb8897f6d122ceb5edd04e9cfdc3f60"}
Jun 02 19:47:58.276203 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:58.276104    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-96gw6" event={"ID":"1324fb85-a211-4990-a151-c3b05015d2ac","Type":"ContainerDied","Data":"094e95cb6fe68f678dab558405b63230d2788a5797e6f00e1aad88b71153f269"}
Jun 02 19:47:58.276203 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:58.276116    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="094e95cb6fe68f678dab558405b63230d2788a5797e6f00e1aad88b71153f269"
Jun 02 19:47:58.276718 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:58.276696    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-96gw6"
Jun 02 19:47:58.350966 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:58.350905    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1324fb85-a211-4990-a151-c3b05015d2ac-extensions-socket-volume\") pod \"1324fb85-a211-4990-a151-c3b05015d2ac\" (UID: \"1324fb85-a211-4990-a151-c3b05015d2ac\") "
Jun 02 19:47:58.351091 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:58.350967    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jznsb\" (UniqueName: \"kubernetes.io/projected/1324fb85-a211-4990-a151-c3b05015d2ac-kube-api-access-jznsb\") pod \"1324fb85-a211-4990-a151-c3b05015d2ac\" (UID: \"1324fb85-a211-4990-a151-c3b05015d2ac\") "
Jun 02 19:47:58.351385 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:58.351358    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1324fb85-a211-4990-a151-c3b05015d2ac-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1324fb85-a211-4990-a151-c3b05015d2ac" (UID: "1324fb85-a211-4990-a151-c3b05015d2ac"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 02 19:47:58.352998 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:58.352975    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1324fb85-a211-4990-a151-c3b05015d2ac-kube-api-access-jznsb" (OuterVolumeSpecName: "kube-api-access-jznsb") pod "1324fb85-a211-4990-a151-c3b05015d2ac" (UID: "1324fb85-a211-4990-a151-c3b05015d2ac"). InnerVolumeSpecName "kube-api-access-jznsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 02 19:47:58.451492 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:58.451464    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jznsb\" (UniqueName: \"kubernetes.io/projected/1324fb85-a211-4990-a151-c3b05015d2ac-kube-api-access-jznsb\") on node \"ip-10-0-130-103.ec2.internal\" DevicePath \"\""
Jun 02 19:47:58.451492 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:58.451490    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1324fb85-a211-4990-a151-c3b05015d2ac-extensions-socket-volume\") on node \"ip-10-0-130-103.ec2.internal\" DevicePath \"\""
Jun 02 19:47:59.278973 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:59.278939    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-96gw6"
Jun 02 19:47:59.302250 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:59.302226    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-96gw6"]
Jun 02 19:47:59.306443 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:59.306419    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-96gw6"]
Jun 02 19:47:59.647027 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:47:59.646953    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1324fb85-a211-4990-a151-c3b05015d2ac" path="/var/lib/kubelet/pods/1324fb85-a211-4990-a151-c3b05015d2ac/volumes"
Jun 02 19:48:01.536803 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.536771    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp"]
Jun 02 19:48:01.537343 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.537161    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3a76cfb-9f89-4013-9fa6-71f50956dc18" containerName="manager"
Jun 02 19:48:01.537343 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.537176    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3a76cfb-9f89-4013-9fa6-71f50956dc18" containerName="manager"
Jun 02 19:48:01.537343 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.537184    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1324fb85-a211-4990-a151-c3b05015d2ac" containerName="manager"
Jun 02 19:48:01.537343 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.537189    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1324fb85-a211-4990-a151-c3b05015d2ac" containerName="manager"
Jun 02 19:48:01.537343 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.537246    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="1324fb85-a211-4990-a151-c3b05015d2ac" containerName="manager"
Jun 02 19:48:01.537343 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.537263    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="c3a76cfb-9f89-4013-9fa6-71f50956dc18" containerName="manager"
Jun 02 19:48:01.541779 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.541746    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp"
Jun 02 19:48:01.544556 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.544532    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-ntw7t\""
Jun 02 19:48:01.558513 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.558484    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp"]
Jun 02 19:48:01.577498 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.577472    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e20c07ea-b3ed-4016-ac3f-56ed150f52fb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gw2mp\" (UID: \"e20c07ea-b3ed-4016-ac3f-56ed150f52fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp"
Jun 02 19:48:01.577619 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.577518    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e20c07ea-b3ed-4016-ac3f-56ed150f52fb-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gw2mp\" (UID: \"e20c07ea-b3ed-4016-ac3f-56ed150f52fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp"
Jun 02 19:48:01.577619 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.577556    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e20c07ea-b3ed-4016-ac3f-56ed150f52fb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gw2mp\" (UID: \"e20c07ea-b3ed-4016-ac3f-56ed150f52fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp"
Jun 02 19:48:01.577619 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.577582    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drwqv\" (UniqueName: \"kubernetes.io/projected/e20c07ea-b3ed-4016-ac3f-56ed150f52fb-kube-api-access-drwqv\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gw2mp\" (UID: \"e20c07ea-b3ed-4016-ac3f-56ed150f52fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp"
Jun 02 19:48:01.577770 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.577622    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e20c07ea-b3ed-4016-ac3f-56ed150f52fb-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gw2mp\" (UID: \"e20c07ea-b3ed-4016-ac3f-56ed150f52fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp"
Jun 02 19:48:01.577770 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.577726    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e20c07ea-b3ed-4016-ac3f-56ed150f52fb-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gw2mp\" (UID: \"e20c07ea-b3ed-4016-ac3f-56ed150f52fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp"
Jun 02 19:48:01.577891 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.577771    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e20c07ea-b3ed-4016-ac3f-56ed150f52fb-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gw2mp\" (UID: \"e20c07ea-b3ed-4016-ac3f-56ed150f52fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp"
Jun 02 19:48:01.577891 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.577812    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e20c07ea-b3ed-4016-ac3f-56ed150f52fb-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gw2mp\" (UID: \"e20c07ea-b3ed-4016-ac3f-56ed150f52fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp"
Jun 02 19:48:01.577891 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.577860    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e20c07ea-b3ed-4016-ac3f-56ed150f52fb-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gw2mp\" (UID: \"e20c07ea-b3ed-4016-ac3f-56ed150f52fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp"
Jun 02 19:48:01.678616 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.678584    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e20c07ea-b3ed-4016-ac3f-56ed150f52fb-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gw2mp\" (UID: \"e20c07ea-b3ed-4016-ac3f-56ed150f52fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp"
Jun 02 19:48:01.678616 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.678616    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e20c07ea-b3ed-4016-ac3f-56ed150f52fb-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gw2mp\" (UID: \"e20c07ea-b3ed-4016-ac3f-56ed150f52fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp"
Jun 02 19:48:01.678798 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.678636    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e20c07ea-b3ed-4016-ac3f-56ed150f52fb-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gw2mp\" (UID: \"e20c07ea-b3ed-4016-ac3f-56ed150f52fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp"
Jun 02 19:48:01.678920 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.678896    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e20c07ea-b3ed-4016-ac3f-56ed150f52fb-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gw2mp\" (UID: \"e20c07ea-b3ed-4016-ac3f-56ed150f52fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp"
Jun 02 19:48:01.678985 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.678951    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e20c07ea-b3ed-4016-ac3f-56ed150f52fb-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gw2mp\" (UID: \"e20c07ea-b3ed-4016-ac3f-56ed150f52fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp"
Jun 02 19:48:01.678985 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.678962    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e20c07ea-b3ed-4016-ac3f-56ed150f52fb-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gw2mp\" (UID: \"e20c07ea-b3ed-4016-ac3f-56ed150f52fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp"
Jun 02 19:48:01.679090 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.679010    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e20c07ea-b3ed-4016-ac3f-56ed150f52fb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gw2mp\" (UID: \"e20c07ea-b3ed-4016-ac3f-56ed150f52fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp"
Jun 02 19:48:01.679090 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.679030    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e20c07ea-b3ed-4016-ac3f-56ed150f52fb-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gw2mp\" (UID: \"e20c07ea-b3ed-4016-ac3f-56ed150f52fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp"
Jun 02 19:48:01.679090 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.679055    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e20c07ea-b3ed-4016-ac3f-56ed150f52fb-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gw2mp\" (UID: \"e20c07ea-b3ed-4016-ac3f-56ed150f52fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp"
Jun 02 19:48:01.679090 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.679057    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e20c07ea-b3ed-4016-ac3f-56ed150f52fb-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gw2mp\" (UID: \"e20c07ea-b3ed-4016-ac3f-56ed150f52fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp"
Jun 02 19:48:01.679294 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.679118    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e20c07ea-b3ed-4016-ac3f-56ed150f52fb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gw2mp\" (UID: \"e20c07ea-b3ed-4016-ac3f-56ed150f52fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp"
Jun 02 19:48:01.679294 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.679137    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-drwqv\" (UniqueName: \"kubernetes.io/projected/e20c07ea-b3ed-4016-ac3f-56ed150f52fb-kube-api-access-drwqv\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gw2mp\" (UID: \"e20c07ea-b3ed-4016-ac3f-56ed150f52fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp"
Jun 02 19:48:01.679294 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.679243    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e20c07ea-b3ed-4016-ac3f-56ed150f52fb-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gw2mp\" (UID: \"e20c07ea-b3ed-4016-ac3f-56ed150f52fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp"
Jun 02 19:48:01.679561 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.679539    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e20c07ea-b3ed-4016-ac3f-56ed150f52fb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gw2mp\" (UID: \"e20c07ea-b3ed-4016-ac3f-56ed150f52fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp"
Jun 02 19:48:01.681195 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.681168    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e20c07ea-b3ed-4016-ac3f-56ed150f52fb-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gw2mp\" (UID: \"e20c07ea-b3ed-4016-ac3f-56ed150f52fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp"
Jun 02 19:48:01.681696 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.681673    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e20c07ea-b3ed-4016-ac3f-56ed150f52fb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gw2mp\" (UID: \"e20c07ea-b3ed-4016-ac3f-56ed150f52fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp"
Jun 02 19:48:01.686736 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.686714    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e20c07ea-b3ed-4016-ac3f-56ed150f52fb-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gw2mp\" (UID: \"e20c07ea-b3ed-4016-ac3f-56ed150f52fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp"
Jun 02 19:48:01.686964 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.686946    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drwqv\" (UniqueName: \"kubernetes.io/projected/e20c07ea-b3ed-4016-ac3f-56ed150f52fb-kube-api-access-drwqv\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gw2mp\" (UID: \"e20c07ea-b3ed-4016-ac3f-56ed150f52fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp"
Jun 02 19:48:01.858120 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.858036    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp"
Jun 02 19:48:01.991900 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:01.991855    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp"]
Jun 02 19:48:01.994210 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:48:01.994179    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode20c07ea_b3ed_4016_ac3f_56ed150f52fb.slice/crio-8c1dd076c7e35641102b962c06483bcc9a31f8fc3e474034a484c56a9a09b6f9 WatchSource:0}: Error finding container 8c1dd076c7e35641102b962c06483bcc9a31f8fc3e474034a484c56a9a09b6f9: Status 404 returned error can't find the container with id 8c1dd076c7e35641102b962c06483bcc9a31f8fc3e474034a484c56a9a09b6f9
Jun 02 19:48:02.288884 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:02.288830    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp" event={"ID":"e20c07ea-b3ed-4016-ac3f-56ed150f52fb","Type":"ContainerStarted","Data":"8c1dd076c7e35641102b962c06483bcc9a31f8fc3e474034a484c56a9a09b6f9"}
Jun 02 19:48:04.387030 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:04.386999    2564 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jun 02 19:48:04.387291 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:04.387080    2564 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jun 02 19:48:04.387291 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:04.387145    2564 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jun 02 19:48:05.301056 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:05.301015    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp" event={"ID":"e20c07ea-b3ed-4016-ac3f-56ed150f52fb","Type":"ContainerStarted","Data":"b51dcee12febd75816fe1fded915adc962febafcf2fd4755fe2ae09143054000"}
Jun 02 19:48:05.324639 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:05.324590    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp" podStartSLOduration=1.9339638369999999 podStartE2EDuration="4.324576936s" podCreationTimestamp="2026-06-02 19:48:01 +0000 UTC" firstStartedPulling="2026-06-02 19:48:01.99607507 +0000 UTC m=+474.850495341" lastFinishedPulling="2026-06-02 19:48:04.386688158 +0000 UTC m=+477.241108440" observedRunningTime="2026-06-02 19:48:05.322569772 +0000 UTC m=+478.176990066" watchObservedRunningTime="2026-06-02 19:48:05.324576936 +0000 UTC m=+478.178997228"
Jun 02 19:48:05.858171 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:05.858136    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp"
Jun 02 19:48:05.862996 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:05.862971    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp"
Jun 02 19:48:06.304555 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:06.304526    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp"
Jun 02 19:48:06.305422 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:06.305405    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gw2mp"
Jun 02 19:48:13.913061 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:13.913024    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-w7qv9"]
Jun 02 19:48:13.917505 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:13.917487    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-w7qv9"
Jun 02 19:48:13.919854 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:13.919821    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jun 02 19:48:13.919957 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:13.919914    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jun 02 19:48:13.919957 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:13.919934    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-j28xm\""
Jun 02 19:48:13.920777 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:13.920761    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jun 02 19:48:13.923877 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:13.923857    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-w7qv9"]
Jun 02 19:48:13.984815 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:13.984783    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h82d\" (UniqueName: \"kubernetes.io/projected/dc0a10af-3e93-43c5-8417-245e16ff2909-kube-api-access-6h82d\") pod \"limitador-limitador-7d549b5b-w7qv9\" (UID: \"dc0a10af-3e93-43c5-8417-245e16ff2909\") " pod="kuadrant-system/limitador-limitador-7d549b5b-w7qv9"
Jun 02 19:48:13.984996 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:13.984890    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dc0a10af-3e93-43c5-8417-245e16ff2909-config-file\") pod \"limitador-limitador-7d549b5b-w7qv9\" (UID: \"dc0a10af-3e93-43c5-8417-245e16ff2909\") " pod="kuadrant-system/limitador-limitador-7d549b5b-w7qv9"
Jun 02 19:48:14.009041 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:14.009010    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-w7qv9"]
Jun 02 19:48:14.085327 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:14.085292    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dc0a10af-3e93-43c5-8417-245e16ff2909-config-file\") pod \"limitador-limitador-7d549b5b-w7qv9\" (UID: \"dc0a10af-3e93-43c5-8417-245e16ff2909\") " pod="kuadrant-system/limitador-limitador-7d549b5b-w7qv9"
Jun 02 19:48:14.085488 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:14.085349    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6h82d\" (UniqueName: \"kubernetes.io/projected/dc0a10af-3e93-43c5-8417-245e16ff2909-kube-api-access-6h82d\") pod \"limitador-limitador-7d549b5b-w7qv9\" (UID: \"dc0a10af-3e93-43c5-8417-245e16ff2909\") " pod="kuadrant-system/limitador-limitador-7d549b5b-w7qv9"
Jun 02 19:48:14.085927 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:14.085909    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dc0a10af-3e93-43c5-8417-245e16ff2909-config-file\") pod \"limitador-limitador-7d549b5b-w7qv9\" (UID: \"dc0a10af-3e93-43c5-8417-245e16ff2909\") " pod="kuadrant-system/limitador-limitador-7d549b5b-w7qv9"
Jun 02 19:48:14.093856 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:14.093816    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h82d\" (UniqueName: \"kubernetes.io/projected/dc0a10af-3e93-43c5-8417-245e16ff2909-kube-api-access-6h82d\") pod \"limitador-limitador-7d549b5b-w7qv9\" (UID: \"dc0a10af-3e93-43c5-8417-245e16ff2909\") " pod="kuadrant-system/limitador-limitador-7d549b5b-w7qv9"
Jun 02 19:48:14.229004 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:14.228901    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-w7qv9"
Jun 02 19:48:14.359535 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:14.359509    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-w7qv9"]
Jun 02 19:48:14.361765 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:48:14.361737    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc0a10af_3e93_43c5_8417_245e16ff2909.slice/crio-2bf65437fe808484bf29ac19918e22e1dd4e09b868ce5c801c82635b34132fbe WatchSource:0}: Error finding container 2bf65437fe808484bf29ac19918e22e1dd4e09b868ce5c801c82635b34132fbe: Status 404 returned error can't find the container with id 2bf65437fe808484bf29ac19918e22e1dd4e09b868ce5c801c82635b34132fbe
Jun 02 19:48:15.338816 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:15.338775    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-w7qv9" event={"ID":"dc0a10af-3e93-43c5-8417-245e16ff2909","Type":"ContainerStarted","Data":"2bf65437fe808484bf29ac19918e22e1dd4e09b868ce5c801c82635b34132fbe"}
Jun 02 19:48:17.347230 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:17.347196    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-w7qv9" event={"ID":"dc0a10af-3e93-43c5-8417-245e16ff2909","Type":"ContainerStarted","Data":"f3fd4e2228c39415fd23fc5ca4cf11c8d0707872204ff2f4c75ae2f4526f2d53"}
Jun 02 19:48:17.347670 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:17.347339    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-w7qv9"
Jun 02 19:48:17.365714 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:17.365618    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-w7qv9" podStartSLOduration=1.626842362 podStartE2EDuration="4.365600417s" podCreationTimestamp="2026-06-02 19:48:13 +0000 UTC" firstStartedPulling="2026-06-02 19:48:14.363499924 +0000 UTC m=+487.217920197" lastFinishedPulling="2026-06-02 19:48:17.102257981 +0000 UTC m=+489.956678252" observedRunningTime="2026-06-02 19:48:17.364425114 +0000 UTC m=+490.218845412" watchObservedRunningTime="2026-06-02 19:48:17.365600417 +0000 UTC m=+490.220020710"
Jun 02 19:48:28.351940 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:28.351911    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-w7qv9"
Jun 02 19:48:29.292965 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:29.292930    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-w7qv9"]
Jun 02 19:48:29.293189 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:29.293152    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-w7qv9" podUID="dc0a10af-3e93-43c5-8417-245e16ff2909" containerName="limitador" containerID="cri-o://f3fd4e2228c39415fd23fc5ca4cf11c8d0707872204ff2f4c75ae2f4526f2d53" gracePeriod=30
Jun 02 19:48:29.846072 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:29.846048    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-w7qv9"
Jun 02 19:48:30.027553 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:30.027520    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6h82d\" (UniqueName: \"kubernetes.io/projected/dc0a10af-3e93-43c5-8417-245e16ff2909-kube-api-access-6h82d\") pod \"dc0a10af-3e93-43c5-8417-245e16ff2909\" (UID: \"dc0a10af-3e93-43c5-8417-245e16ff2909\") "
Jun 02 19:48:30.027726 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:30.027602    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dc0a10af-3e93-43c5-8417-245e16ff2909-config-file\") pod \"dc0a10af-3e93-43c5-8417-245e16ff2909\" (UID: \"dc0a10af-3e93-43c5-8417-245e16ff2909\") "
Jun 02 19:48:30.027999 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:30.027968    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc0a10af-3e93-43c5-8417-245e16ff2909-config-file" (OuterVolumeSpecName: "config-file") pod "dc0a10af-3e93-43c5-8417-245e16ff2909" (UID: "dc0a10af-3e93-43c5-8417-245e16ff2909"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 02 19:48:30.029543 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:30.029517    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc0a10af-3e93-43c5-8417-245e16ff2909-kube-api-access-6h82d" (OuterVolumeSpecName: "kube-api-access-6h82d") pod "dc0a10af-3e93-43c5-8417-245e16ff2909" (UID: "dc0a10af-3e93-43c5-8417-245e16ff2909"). InnerVolumeSpecName "kube-api-access-6h82d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 02 19:48:30.128967 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:30.128925    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6h82d\" (UniqueName: \"kubernetes.io/projected/dc0a10af-3e93-43c5-8417-245e16ff2909-kube-api-access-6h82d\") on node \"ip-10-0-130-103.ec2.internal\" DevicePath \"\""
Jun 02 19:48:30.128967 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:30.128966    2564 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dc0a10af-3e93-43c5-8417-245e16ff2909-config-file\") on node \"ip-10-0-130-103.ec2.internal\" DevicePath \"\""
Jun 02 19:48:30.396243 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:30.396157    2564 generic.go:358] "Generic (PLEG): container finished" podID="dc0a10af-3e93-43c5-8417-245e16ff2909" containerID="f3fd4e2228c39415fd23fc5ca4cf11c8d0707872204ff2f4c75ae2f4526f2d53" exitCode=0
Jun 02 19:48:30.396243 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:30.396197    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-w7qv9" event={"ID":"dc0a10af-3e93-43c5-8417-245e16ff2909","Type":"ContainerDied","Data":"f3fd4e2228c39415fd23fc5ca4cf11c8d0707872204ff2f4c75ae2f4526f2d53"}
Jun 02 19:48:30.396243 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:30.396221    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-w7qv9" event={"ID":"dc0a10af-3e93-43c5-8417-245e16ff2909","Type":"ContainerDied","Data":"2bf65437fe808484bf29ac19918e22e1dd4e09b868ce5c801c82635b34132fbe"}
Jun 02 19:48:30.396243 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:30.396222    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-w7qv9"
Jun 02 19:48:30.396243 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:30.396235    2564 scope.go:117] "RemoveContainer" containerID="f3fd4e2228c39415fd23fc5ca4cf11c8d0707872204ff2f4c75ae2f4526f2d53"
Jun 02 19:48:30.404900 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:30.404880    2564 scope.go:117] "RemoveContainer" containerID="f3fd4e2228c39415fd23fc5ca4cf11c8d0707872204ff2f4c75ae2f4526f2d53"
Jun 02 19:48:30.405178 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:48:30.405156    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3fd4e2228c39415fd23fc5ca4cf11c8d0707872204ff2f4c75ae2f4526f2d53\": container with ID starting with f3fd4e2228c39415fd23fc5ca4cf11c8d0707872204ff2f4c75ae2f4526f2d53 not found: ID does not exist" containerID="f3fd4e2228c39415fd23fc5ca4cf11c8d0707872204ff2f4c75ae2f4526f2d53"
Jun 02 19:48:30.405225 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:30.405186    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3fd4e2228c39415fd23fc5ca4cf11c8d0707872204ff2f4c75ae2f4526f2d53"} err="failed to get container status \"f3fd4e2228c39415fd23fc5ca4cf11c8d0707872204ff2f4c75ae2f4526f2d53\": rpc error: code = NotFound desc = could not find container \"f3fd4e2228c39415fd23fc5ca4cf11c8d0707872204ff2f4c75ae2f4526f2d53\": container with ID starting with f3fd4e2228c39415fd23fc5ca4cf11c8d0707872204ff2f4c75ae2f4526f2d53 not found: ID does not exist"
Jun 02 19:48:30.420713 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:30.420691    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-w7qv9"]
Jun 02 19:48:30.430335 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:30.430310    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-w7qv9"]
Jun 02 19:48:31.647549 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:31.647514    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc0a10af-3e93-43c5-8417-245e16ff2909" path="/var/lib/kubelet/pods/dc0a10af-3e93-43c5-8417-245e16ff2909/volumes"
Jun 02 19:48:32.137740 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:32.137702    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-qjcwg"]
Jun 02 19:48:32.138253 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:32.138235    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc0a10af-3e93-43c5-8417-245e16ff2909" containerName="limitador"
Jun 02 19:48:32.138360 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:32.138255    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc0a10af-3e93-43c5-8417-245e16ff2909" containerName="limitador"
Jun 02 19:48:32.138360 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:32.138343    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="dc0a10af-3e93-43c5-8417-245e16ff2909" containerName="limitador"
Jun 02 19:48:32.142940 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:32.142916    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-qjcwg"
Jun 02 19:48:32.145569 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:32.145547    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jun 02 19:48:32.148314 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:32.148291    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-qjcwg"]
Jun 02 19:48:32.246511 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:32.246469    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzwmt\" (UniqueName: \"kubernetes.io/projected/4c0e04db-98b0-43ec-97e1-47b2fe32fb11-kube-api-access-bzwmt\") pod \"postgres-68c4fbbd6f-qjcwg\" (UID: \"4c0e04db-98b0-43ec-97e1-47b2fe32fb11\") " pod="opendatahub/postgres-68c4fbbd6f-qjcwg"
Jun 02 19:48:32.246672 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:32.246602    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4c0e04db-98b0-43ec-97e1-47b2fe32fb11-data\") pod \"postgres-68c4fbbd6f-qjcwg\" (UID: \"4c0e04db-98b0-43ec-97e1-47b2fe32fb11\") " pod="opendatahub/postgres-68c4fbbd6f-qjcwg"
Jun 02 19:48:32.347412 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:32.347371    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4c0e04db-98b0-43ec-97e1-47b2fe32fb11-data\") pod \"postgres-68c4fbbd6f-qjcwg\" (UID: \"4c0e04db-98b0-43ec-97e1-47b2fe32fb11\") " pod="opendatahub/postgres-68c4fbbd6f-qjcwg"
Jun 02 19:48:32.347592 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:32.347454    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bzwmt\" (UniqueName: \"kubernetes.io/projected/4c0e04db-98b0-43ec-97e1-47b2fe32fb11-kube-api-access-bzwmt\") pod \"postgres-68c4fbbd6f-qjcwg\" (UID: \"4c0e04db-98b0-43ec-97e1-47b2fe32fb11\") " pod="opendatahub/postgres-68c4fbbd6f-qjcwg"
Jun 02 19:48:32.347759 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:32.347729    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4c0e04db-98b0-43ec-97e1-47b2fe32fb11-data\") pod \"postgres-68c4fbbd6f-qjcwg\" (UID: \"4c0e04db-98b0-43ec-97e1-47b2fe32fb11\") " pod="opendatahub/postgres-68c4fbbd6f-qjcwg"
Jun 02 19:48:32.357228 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:32.357204    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzwmt\" (UniqueName: \"kubernetes.io/projected/4c0e04db-98b0-43ec-97e1-47b2fe32fb11-kube-api-access-bzwmt\") pod \"postgres-68c4fbbd6f-qjcwg\" (UID: \"4c0e04db-98b0-43ec-97e1-47b2fe32fb11\") " pod="opendatahub/postgres-68c4fbbd6f-qjcwg"
Jun 02 19:48:32.455826 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:32.455756    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-qjcwg"
Jun 02 19:48:32.580661 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:32.580639    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-qjcwg"]
Jun 02 19:48:32.582739 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:48:32.582713    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c0e04db_98b0_43ec_97e1_47b2fe32fb11.slice/crio-c47bfc6cda0bb1e750c1396e8ff4ea8a5b2b1c959c8b3e11dbe538afa06fd200 WatchSource:0}: Error finding container c47bfc6cda0bb1e750c1396e8ff4ea8a5b2b1c959c8b3e11dbe538afa06fd200: Status 404 returned error can't find the container with id c47bfc6cda0bb1e750c1396e8ff4ea8a5b2b1c959c8b3e11dbe538afa06fd200
Jun 02 19:48:33.409909 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:33.409870    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-qjcwg" event={"ID":"4c0e04db-98b0-43ec-97e1-47b2fe32fb11","Type":"ContainerStarted","Data":"c47bfc6cda0bb1e750c1396e8ff4ea8a5b2b1c959c8b3e11dbe538afa06fd200"}
Jun 02 19:48:35.417691 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:35.417651    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-qjcwg" event={"ID":"4c0e04db-98b0-43ec-97e1-47b2fe32fb11","Type":"ContainerStarted","Data":"64b80340a31508566186505f98cfb3f95a7c0ff91e0dc2cb5cd92eb663fdb203"}
Jun 02 19:48:35.418048 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:35.417779    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-qjcwg"
Jun 02 19:48:35.434746 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:35.434698    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-qjcwg" podStartSLOduration=1.490966039 podStartE2EDuration="3.434683236s" podCreationTimestamp="2026-06-02 19:48:32 +0000 UTC" firstStartedPulling="2026-06-02 19:48:32.583951258 +0000 UTC m=+505.438371532" lastFinishedPulling="2026-06-02 19:48:34.527668454 +0000 UTC m=+507.382088729" observedRunningTime="2026-06-02 19:48:35.433666665 +0000 UTC m=+508.288086968" watchObservedRunningTime="2026-06-02 19:48:35.434683236 +0000 UTC m=+508.289103532"
Jun 02 19:48:41.453304 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:48:41.453277    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-qjcwg"
Jun 02 19:49:39.945244 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:39.945214    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-b85cfb8dd-ljnsd"]
Jun 02 19:49:39.948431 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:39.948414    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b85cfb8dd-ljnsd"
Jun 02 19:49:39.951290 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:39.951265    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6tp78\""
Jun 02 19:49:39.951403 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:39.951269    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jun 02 19:49:39.956381 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:39.955893    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b85cfb8dd-ljnsd"]
Jun 02 19:49:40.018002 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:40.017965    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c75b8\" (UniqueName: \"kubernetes.io/projected/1bf81182-057d-4fb7-9f1c-54a3affc28f8-kube-api-access-c75b8\") pod \"maas-controller-b85cfb8dd-ljnsd\" (UID: \"1bf81182-057d-4fb7-9f1c-54a3affc28f8\") " pod="opendatahub/maas-controller-b85cfb8dd-ljnsd"
Jun 02 19:49:40.118513 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:40.118473    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c75b8\" (UniqueName: \"kubernetes.io/projected/1bf81182-057d-4fb7-9f1c-54a3affc28f8-kube-api-access-c75b8\") pod \"maas-controller-b85cfb8dd-ljnsd\" (UID: \"1bf81182-057d-4fb7-9f1c-54a3affc28f8\") " pod="opendatahub/maas-controller-b85cfb8dd-ljnsd"
Jun 02 19:49:40.137236 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:40.137207    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c75b8\" (UniqueName: \"kubernetes.io/projected/1bf81182-057d-4fb7-9f1c-54a3affc28f8-kube-api-access-c75b8\") pod \"maas-controller-b85cfb8dd-ljnsd\" (UID: \"1bf81182-057d-4fb7-9f1c-54a3affc28f8\") " pod="opendatahub/maas-controller-b85cfb8dd-ljnsd"
Jun 02 19:49:40.178359 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:40.178332    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8d84675b-tmfbj"]
Jun 02 19:49:40.181509 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:40.181494    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8d84675b-tmfbj"
Jun 02 19:49:40.193301 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:40.193276    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8d84675b-tmfbj"]
Jun 02 19:49:40.219954 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:40.219902    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t24zd\" (UniqueName: \"kubernetes.io/projected/fb81404c-b9e2-4574-bc1b-1be79acecbce-kube-api-access-t24zd\") pod \"maas-controller-8d84675b-tmfbj\" (UID: \"fb81404c-b9e2-4574-bc1b-1be79acecbce\") " pod="opendatahub/maas-controller-8d84675b-tmfbj"
Jun 02 19:49:40.260206 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:40.260174    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b85cfb8dd-ljnsd"
Jun 02 19:49:40.321387 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:40.321189    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t24zd\" (UniqueName: \"kubernetes.io/projected/fb81404c-b9e2-4574-bc1b-1be79acecbce-kube-api-access-t24zd\") pod \"maas-controller-8d84675b-tmfbj\" (UID: \"fb81404c-b9e2-4574-bc1b-1be79acecbce\") " pod="opendatahub/maas-controller-8d84675b-tmfbj"
Jun 02 19:49:40.332894 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:40.332868    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t24zd\" (UniqueName: \"kubernetes.io/projected/fb81404c-b9e2-4574-bc1b-1be79acecbce-kube-api-access-t24zd\") pod \"maas-controller-8d84675b-tmfbj\" (UID: \"fb81404c-b9e2-4574-bc1b-1be79acecbce\") " pod="opendatahub/maas-controller-8d84675b-tmfbj"
Jun 02 19:49:40.390292 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:40.390186    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b85cfb8dd-ljnsd"]
Jun 02 19:49:40.392570 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:49:40.392539    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bf81182_057d_4fb7_9f1c_54a3affc28f8.slice/crio-0b8ff9a11fbbe4513cfa11732008c8839fa2f7fa014c7baa0f9d143bc3ff9d5d WatchSource:0}: Error finding container 0b8ff9a11fbbe4513cfa11732008c8839fa2f7fa014c7baa0f9d143bc3ff9d5d: Status 404 returned error can't find the container with id 0b8ff9a11fbbe4513cfa11732008c8839fa2f7fa014c7baa0f9d143bc3ff9d5d
Jun 02 19:49:40.491689 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:40.491662    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8d84675b-tmfbj"
Jun 02 19:49:40.619168 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:40.619144    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8d84675b-tmfbj"]
Jun 02 19:49:40.621454 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:49:40.621425    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb81404c_b9e2_4574_bc1b_1be79acecbce.slice/crio-fe5697cc6bc22b35317a462097369034134e14951d173711ba08175d10b9f296 WatchSource:0}: Error finding container fe5697cc6bc22b35317a462097369034134e14951d173711ba08175d10b9f296: Status 404 returned error can't find the container with id fe5697cc6bc22b35317a462097369034134e14951d173711ba08175d10b9f296
Jun 02 19:49:40.632065 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:40.632041    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8d84675b-tmfbj" event={"ID":"fb81404c-b9e2-4574-bc1b-1be79acecbce","Type":"ContainerStarted","Data":"fe5697cc6bc22b35317a462097369034134e14951d173711ba08175d10b9f296"}
Jun 02 19:49:40.633027 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:40.632985    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b85cfb8dd-ljnsd" event={"ID":"1bf81182-057d-4fb7-9f1c-54a3affc28f8","Type":"ContainerStarted","Data":"0b8ff9a11fbbe4513cfa11732008c8839fa2f7fa014c7baa0f9d143bc3ff9d5d"}
Jun 02 19:49:43.649952 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:43.649917    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8d84675b-tmfbj" event={"ID":"fb81404c-b9e2-4574-bc1b-1be79acecbce","Type":"ContainerStarted","Data":"6c042256ff092814eb4d16ccbb9b079c3322290adb5ea6f4b294166f06741640"}
Jun 02 19:49:43.650371 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:43.649989    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8d84675b-tmfbj"
Jun 02 19:49:43.651186 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:43.651159    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b85cfb8dd-ljnsd" event={"ID":"1bf81182-057d-4fb7-9f1c-54a3affc28f8","Type":"ContainerStarted","Data":"7c80412cbaa13e9fb4e77b93556244263ef9d81ca8c2cf966f83ca508cb35103"}
Jun 02 19:49:43.651320 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:43.651261    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-b85cfb8dd-ljnsd"
Jun 02 19:49:43.672670 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:43.672620    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-8d84675b-tmfbj" podStartSLOduration=1.2031325609999999 podStartE2EDuration="3.672606115s" podCreationTimestamp="2026-06-02 19:49:40 +0000 UTC" firstStartedPulling="2026-06-02 19:49:40.622777866 +0000 UTC m=+573.477198139" lastFinishedPulling="2026-06-02 19:49:43.092251417 +0000 UTC m=+575.946671693" observedRunningTime="2026-06-02 19:49:43.670947161 +0000 UTC m=+576.525367455" watchObservedRunningTime="2026-06-02 19:49:43.672606115 +0000 UTC m=+576.527026405"
Jun 02 19:49:43.691385 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:43.691334    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-b85cfb8dd-ljnsd" podStartSLOduration=2.003485829 podStartE2EDuration="4.691319969s" podCreationTimestamp="2026-06-02 19:49:39 +0000 UTC" firstStartedPulling="2026-06-02 19:49:40.393801586 +0000 UTC m=+573.248221858" lastFinishedPulling="2026-06-02 19:49:43.081635724 +0000 UTC m=+575.936055998" observedRunningTime="2026-06-02 19:49:43.690250037 +0000 UTC m=+576.544670336" watchObservedRunningTime="2026-06-02 19:49:43.691319969 +0000 UTC m=+576.545740265"
Jun 02 19:49:54.661067 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:54.661032    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-b85cfb8dd-ljnsd"
Jun 02 19:49:54.661450 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:54.661327    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8d84675b-tmfbj"
Jun 02 19:49:54.797566 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:54.797531    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b85cfb8dd-ljnsd"]
Jun 02 19:49:54.797803 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:54.797756    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-b85cfb8dd-ljnsd" podUID="1bf81182-057d-4fb7-9f1c-54a3affc28f8" containerName="manager" containerID="cri-o://7c80412cbaa13e9fb4e77b93556244263ef9d81ca8c2cf966f83ca508cb35103" gracePeriod=30
Jun 02 19:49:55.038538 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:55.038515    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b85cfb8dd-ljnsd"
Jun 02 19:49:55.148518 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:55.148484    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c75b8\" (UniqueName: \"kubernetes.io/projected/1bf81182-057d-4fb7-9f1c-54a3affc28f8-kube-api-access-c75b8\") pod \"1bf81182-057d-4fb7-9f1c-54a3affc28f8\" (UID: \"1bf81182-057d-4fb7-9f1c-54a3affc28f8\") "
Jun 02 19:49:55.150753 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:55.150724    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bf81182-057d-4fb7-9f1c-54a3affc28f8-kube-api-access-c75b8" (OuterVolumeSpecName: "kube-api-access-c75b8") pod "1bf81182-057d-4fb7-9f1c-54a3affc28f8" (UID: "1bf81182-057d-4fb7-9f1c-54a3affc28f8"). InnerVolumeSpecName "kube-api-access-c75b8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 02 19:49:55.249526 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:55.249495    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c75b8\" (UniqueName: \"kubernetes.io/projected/1bf81182-057d-4fb7-9f1c-54a3affc28f8-kube-api-access-c75b8\") on node \"ip-10-0-130-103.ec2.internal\" DevicePath \"\""
Jun 02 19:49:55.689592 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:55.689559    2564 generic.go:358] "Generic (PLEG): container finished" podID="1bf81182-057d-4fb7-9f1c-54a3affc28f8" containerID="7c80412cbaa13e9fb4e77b93556244263ef9d81ca8c2cf966f83ca508cb35103" exitCode=0
Jun 02 19:49:55.689958 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:55.689622    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b85cfb8dd-ljnsd"
Jun 02 19:49:55.689958 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:55.689629    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b85cfb8dd-ljnsd" event={"ID":"1bf81182-057d-4fb7-9f1c-54a3affc28f8","Type":"ContainerDied","Data":"7c80412cbaa13e9fb4e77b93556244263ef9d81ca8c2cf966f83ca508cb35103"}
Jun 02 19:49:55.689958 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:55.689665    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b85cfb8dd-ljnsd" event={"ID":"1bf81182-057d-4fb7-9f1c-54a3affc28f8","Type":"ContainerDied","Data":"0b8ff9a11fbbe4513cfa11732008c8839fa2f7fa014c7baa0f9d143bc3ff9d5d"}
Jun 02 19:49:55.689958 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:55.689681    2564 scope.go:117] "RemoveContainer" containerID="7c80412cbaa13e9fb4e77b93556244263ef9d81ca8c2cf966f83ca508cb35103"
Jun 02 19:49:55.698030 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:55.698020    2564 scope.go:117] "RemoveContainer" containerID="7c80412cbaa13e9fb4e77b93556244263ef9d81ca8c2cf966f83ca508cb35103"
Jun 02 19:49:55.698247 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:49:55.698231    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c80412cbaa13e9fb4e77b93556244263ef9d81ca8c2cf966f83ca508cb35103\": container with ID starting with 7c80412cbaa13e9fb4e77b93556244263ef9d81ca8c2cf966f83ca508cb35103 not found: ID does not exist" containerID="7c80412cbaa13e9fb4e77b93556244263ef9d81ca8c2cf966f83ca508cb35103"
Jun 02 19:49:55.698307 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:55.698255    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c80412cbaa13e9fb4e77b93556244263ef9d81ca8c2cf966f83ca508cb35103"} err="failed to get container status \"7c80412cbaa13e9fb4e77b93556244263ef9d81ca8c2cf966f83ca508cb35103\": rpc error: code = NotFound desc = could not find container \"7c80412cbaa13e9fb4e77b93556244263ef9d81ca8c2cf966f83ca508cb35103\": container with ID starting with 7c80412cbaa13e9fb4e77b93556244263ef9d81ca8c2cf966f83ca508cb35103 not found: ID does not exist"
Jun 02 19:49:55.705768 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:55.705748    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b85cfb8dd-ljnsd"]
Jun 02 19:49:55.710050 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:55.710030    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-b85cfb8dd-ljnsd"]
Jun 02 19:49:57.647765 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:49:57.647737    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bf81182-057d-4fb7-9f1c-54a3affc28f8" path="/var/lib/kubelet/pods/1bf81182-057d-4fb7-9f1c-54a3affc28f8/volumes"
Jun 02 19:50:08.720331 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:08.720220    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9jgn2_7c1244c6-6d55-4cff-8099-4fc240c590f4/console-operator/2.log"
Jun 02 19:50:08.740770 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:08.720464    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9jgn2_7c1244c6-6d55-4cff-8099-4fc240c590f4/console-operator/2.log"
Jun 02 19:50:08.740770 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:08.724376    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-79xzx_278707d7-17c9-4a6c-917e-1d2d056db08e/ovn-acl-logging/0.log"
Jun 02 19:50:08.740770 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:08.724727    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-79xzx_278707d7-17c9-4a6c-917e-1d2d056db08e/ovn-acl-logging/0.log"
Jun 02 19:50:14.413116 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:14.413085    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-fbbd484dc-vv28p"]
Jun 02 19:50:14.413583 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:14.413456    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bf81182-057d-4fb7-9f1c-54a3affc28f8" containerName="manager"
Jun 02 19:50:14.413583 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:14.413467    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bf81182-057d-4fb7-9f1c-54a3affc28f8" containerName="manager"
Jun 02 19:50:14.413583 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:14.413530    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="1bf81182-057d-4fb7-9f1c-54a3affc28f8" containerName="manager"
Jun 02 19:50:14.416471 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:14.416454    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-fbbd484dc-vv28p"
Jun 02 19:50:14.419307 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:14.419287    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jun 02 19:50:14.427694 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:14.427675    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-fbbd484dc-vv28p"]
Jun 02 19:50:14.518280 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:14.518245    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6154ff1a-bd8a-4239-beca-ab7fb998ec9f-maas-api-tls\") pod \"maas-api-fbbd484dc-vv28p\" (UID: \"6154ff1a-bd8a-4239-beca-ab7fb998ec9f\") " pod="opendatahub/maas-api-fbbd484dc-vv28p"
Jun 02 19:50:14.518456 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:14.518324    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czcvj\" (UniqueName: \"kubernetes.io/projected/6154ff1a-bd8a-4239-beca-ab7fb998ec9f-kube-api-access-czcvj\") pod \"maas-api-fbbd484dc-vv28p\" (UID: \"6154ff1a-bd8a-4239-beca-ab7fb998ec9f\") " pod="opendatahub/maas-api-fbbd484dc-vv28p"
Jun 02 19:50:14.619342 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:14.619307    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-czcvj\" (UniqueName: \"kubernetes.io/projected/6154ff1a-bd8a-4239-beca-ab7fb998ec9f-kube-api-access-czcvj\") pod \"maas-api-fbbd484dc-vv28p\" (UID: \"6154ff1a-bd8a-4239-beca-ab7fb998ec9f\") " pod="opendatahub/maas-api-fbbd484dc-vv28p"
Jun 02 19:50:14.619516 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:14.619368    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6154ff1a-bd8a-4239-beca-ab7fb998ec9f-maas-api-tls\") pod \"maas-api-fbbd484dc-vv28p\" (UID: \"6154ff1a-bd8a-4239-beca-ab7fb998ec9f\") " pod="opendatahub/maas-api-fbbd484dc-vv28p"
Jun 02 19:50:14.619516 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:50:14.619498    2564 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jun 02 19:50:14.619591 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:50:14.619571    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6154ff1a-bd8a-4239-beca-ab7fb998ec9f-maas-api-tls podName:6154ff1a-bd8a-4239-beca-ab7fb998ec9f nodeName:}" failed. No retries permitted until 2026-06-02 19:50:15.119550923 +0000 UTC m=+607.973971210 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6154ff1a-bd8a-4239-beca-ab7fb998ec9f-maas-api-tls") pod "maas-api-fbbd484dc-vv28p" (UID: "6154ff1a-bd8a-4239-beca-ab7fb998ec9f") : secret "maas-api-serving-cert" not found
Jun 02 19:50:14.628497 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:14.628472    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czcvj\" (UniqueName: \"kubernetes.io/projected/6154ff1a-bd8a-4239-beca-ab7fb998ec9f-kube-api-access-czcvj\") pod \"maas-api-fbbd484dc-vv28p\" (UID: \"6154ff1a-bd8a-4239-beca-ab7fb998ec9f\") " pod="opendatahub/maas-api-fbbd484dc-vv28p"
Jun 02 19:50:14.910445 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:14.910402    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-hz998"]
Jun 02 19:50:14.913871 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:14.913827    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-hz998"
Jun 02 19:50:14.916257 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:14.916230    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-xsgqm\""
Jun 02 19:50:14.916375 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:14.916230    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jun 02 19:50:14.922926 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:14.922901    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-hz998"]
Jun 02 19:50:14.923087 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:14.923067    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8p48\" (UniqueName: \"kubernetes.io/projected/b3070c55-4e27-4b34-ba28-8185b2eca577-kube-api-access-h8p48\") pod \"payload-processing-58b6c8fdc7-hz998\" (UID: \"b3070c55-4e27-4b34-ba28-8185b2eca577\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-hz998"
Jun 02 19:50:15.024286 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:15.024247    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h8p48\" (UniqueName: \"kubernetes.io/projected/b3070c55-4e27-4b34-ba28-8185b2eca577-kube-api-access-h8p48\") pod \"payload-processing-58b6c8fdc7-hz998\" (UID: \"b3070c55-4e27-4b34-ba28-8185b2eca577\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-hz998"
Jun 02 19:50:15.035459 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:15.035416    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8p48\" (UniqueName: \"kubernetes.io/projected/b3070c55-4e27-4b34-ba28-8185b2eca577-kube-api-access-h8p48\") pod \"payload-processing-58b6c8fdc7-hz998\" (UID: \"b3070c55-4e27-4b34-ba28-8185b2eca577\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-hz998"
Jun 02 19:50:15.125787 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:15.125749    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6154ff1a-bd8a-4239-beca-ab7fb998ec9f-maas-api-tls\") pod \"maas-api-fbbd484dc-vv28p\" (UID: \"6154ff1a-bd8a-4239-beca-ab7fb998ec9f\") " pod="opendatahub/maas-api-fbbd484dc-vv28p"
Jun 02 19:50:15.128193 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:15.128168    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6154ff1a-bd8a-4239-beca-ab7fb998ec9f-maas-api-tls\") pod \"maas-api-fbbd484dc-vv28p\" (UID: \"6154ff1a-bd8a-4239-beca-ab7fb998ec9f\") " pod="opendatahub/maas-api-fbbd484dc-vv28p"
Jun 02 19:50:15.225347 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:15.225254    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-hz998"
Jun 02 19:50:15.328350 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:15.326833    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-fbbd484dc-vv28p"
Jun 02 19:50:15.360267 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:15.360231    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-hz998"]
Jun 02 19:50:15.362975 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:50:15.362949    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3070c55_4e27_4b34_ba28_8185b2eca577.slice/crio-0e511a743a15c3699a83c6d146e0f9e07b0d1874a5edc71d2f8d3bd81a257dce WatchSource:0}: Error finding container 0e511a743a15c3699a83c6d146e0f9e07b0d1874a5edc71d2f8d3bd81a257dce: Status 404 returned error can't find the container with id 0e511a743a15c3699a83c6d146e0f9e07b0d1874a5edc71d2f8d3bd81a257dce
Jun 02 19:50:15.364968 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:15.364944    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 02 19:50:15.462391 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:15.462358    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-fbbd484dc-vv28p"]
Jun 02 19:50:15.462730 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:50:15.462561    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6154ff1a_bd8a_4239_beca_ab7fb998ec9f.slice/crio-98a97d1ded35fe35cdb0f5677156b64a78c4de8f973fc4bedd0673a0e3ec1122 WatchSource:0}: Error finding container 98a97d1ded35fe35cdb0f5677156b64a78c4de8f973fc4bedd0673a0e3ec1122: Status 404 returned error can't find the container with id 98a97d1ded35fe35cdb0f5677156b64a78c4de8f973fc4bedd0673a0e3ec1122
Jun 02 19:50:15.757999 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:15.757961    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-fbbd484dc-vv28p" event={"ID":"6154ff1a-bd8a-4239-beca-ab7fb998ec9f","Type":"ContainerStarted","Data":"98a97d1ded35fe35cdb0f5677156b64a78c4de8f973fc4bedd0673a0e3ec1122"}
Jun 02 19:50:15.758976 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:15.758952    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-hz998" event={"ID":"b3070c55-4e27-4b34-ba28-8185b2eca577","Type":"ContainerStarted","Data":"0e511a743a15c3699a83c6d146e0f9e07b0d1874a5edc71d2f8d3bd81a257dce"}
Jun 02 19:50:18.778125 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:18.778083    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-fbbd484dc-vv28p" event={"ID":"6154ff1a-bd8a-4239-beca-ab7fb998ec9f","Type":"ContainerStarted","Data":"f7dd4de5521896ebf806e4dbcd68b6535ac40c4de9a29cc73442cd01ddc296fa"}
Jun 02 19:50:18.778567 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:18.778221    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-fbbd484dc-vv28p"
Jun 02 19:50:18.779412 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:18.779388    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-hz998" event={"ID":"b3070c55-4e27-4b34-ba28-8185b2eca577","Type":"ContainerStarted","Data":"7d3a47c856ac5da9f6f11da492846aa51c06106fec255f1426a43a4d7330846c"}
Jun 02 19:50:18.779528 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:18.779434    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-hz998"
Jun 02 19:50:18.799614 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:18.799569    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-fbbd484dc-vv28p" podStartSLOduration=1.987902177 podStartE2EDuration="4.799554059s" podCreationTimestamp="2026-06-02 19:50:14 +0000 UTC" firstStartedPulling="2026-06-02 19:50:15.463825356 +0000 UTC m=+608.318245627" lastFinishedPulling="2026-06-02 19:50:18.275477232 +0000 UTC m=+611.129897509" observedRunningTime="2026-06-02 19:50:18.797214994 +0000 UTC m=+611.651635286" watchObservedRunningTime="2026-06-02 19:50:18.799554059 +0000 UTC m=+611.653974354"
Jun 02 19:50:18.819782 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:18.819743    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-hz998" podStartSLOduration=1.8613126979999999 podStartE2EDuration="4.819729819s" podCreationTimestamp="2026-06-02 19:50:14 +0000 UTC" firstStartedPulling="2026-06-02 19:50:15.365118419 +0000 UTC m=+608.219538704" lastFinishedPulling="2026-06-02 19:50:18.323535552 +0000 UTC m=+611.177955825" observedRunningTime="2026-06-02 19:50:18.818030626 +0000 UTC m=+611.672450919" watchObservedRunningTime="2026-06-02 19:50:18.819729819 +0000 UTC m=+611.674150112"
Jun 02 19:50:24.788282 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:24.788251    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-fbbd484dc-vv28p"
Jun 02 19:50:29.785238 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:50:29.785146    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-hz998"
Jun 02 19:51:12.108796 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:12.108762    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx"]
Jun 02 19:51:12.112319 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:12.112303    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx"
Jun 02 19:51:12.116105 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:12.116083    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jun 02 19:51:12.116466 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:12.116449    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6c4kb\""
Jun 02 19:51:12.117152 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:12.117133    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jun 02 19:51:12.117241 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:12.117191    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jun 02 19:51:12.128634 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:12.128599    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx"]
Jun 02 19:51:12.218200 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:12.218166    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb1bedaa-1af9-476e-a082-da9686857763-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx\" (UID: \"cb1bedaa-1af9-476e-a082-da9686857763\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx"
Jun 02 19:51:12.218200 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:12.218210    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb1bedaa-1af9-476e-a082-da9686857763-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx\" (UID: \"cb1bedaa-1af9-476e-a082-da9686857763\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx"
Jun 02 19:51:12.218425 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:12.218231    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkgkl\" (UniqueName: \"kubernetes.io/projected/cb1bedaa-1af9-476e-a082-da9686857763-kube-api-access-vkgkl\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx\" (UID: \"cb1bedaa-1af9-476e-a082-da9686857763\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx"
Jun 02 19:51:12.218425 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:12.218291    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb1bedaa-1af9-476e-a082-da9686857763-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx\" (UID: \"cb1bedaa-1af9-476e-a082-da9686857763\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx"
Jun 02 19:51:12.218425 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:12.218338    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cb1bedaa-1af9-476e-a082-da9686857763-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx\" (UID: \"cb1bedaa-1af9-476e-a082-da9686857763\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx"
Jun 02 19:51:12.218425 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:12.218372    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb1bedaa-1af9-476e-a082-da9686857763-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx\" (UID: \"cb1bedaa-1af9-476e-a082-da9686857763\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx"
Jun 02 19:51:12.319607 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:12.319559    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb1bedaa-1af9-476e-a082-da9686857763-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx\" (UID: \"cb1bedaa-1af9-476e-a082-da9686857763\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx"
Jun 02 19:51:12.319787 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:12.319612    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb1bedaa-1af9-476e-a082-da9686857763-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx\" (UID: \"cb1bedaa-1af9-476e-a082-da9686857763\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx"
Jun 02 19:51:12.319787 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:12.319735    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vkgkl\" (UniqueName: \"kubernetes.io/projected/cb1bedaa-1af9-476e-a082-da9686857763-kube-api-access-vkgkl\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx\" (UID: \"cb1bedaa-1af9-476e-a082-da9686857763\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx"
Jun 02 19:51:12.319959 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:12.319794    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb1bedaa-1af9-476e-a082-da9686857763-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx\" (UID: \"cb1bedaa-1af9-476e-a082-da9686857763\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx"
Jun 02 19:51:12.319959 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:12.319882    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cb1bedaa-1af9-476e-a082-da9686857763-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx\" (UID: \"cb1bedaa-1af9-476e-a082-da9686857763\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx"
Jun 02 19:51:12.319959 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:12.319915    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb1bedaa-1af9-476e-a082-da9686857763-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx\" (UID: \"cb1bedaa-1af9-476e-a082-da9686857763\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx"
Jun 02 19:51:12.320115 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:12.320065    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb1bedaa-1af9-476e-a082-da9686857763-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx\" (UID: \"cb1bedaa-1af9-476e-a082-da9686857763\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx"
Jun 02 19:51:12.320336 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:12.320310    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb1bedaa-1af9-476e-a082-da9686857763-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx\" (UID: \"cb1bedaa-1af9-476e-a082-da9686857763\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx"
Jun 02 19:51:12.320413 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:12.320371    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cb1bedaa-1af9-476e-a082-da9686857763-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx\" (UID: \"cb1bedaa-1af9-476e-a082-da9686857763\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx"
Jun 02 19:51:12.322141 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:12.322114    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb1bedaa-1af9-476e-a082-da9686857763-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx\" (UID: \"cb1bedaa-1af9-476e-a082-da9686857763\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx"
Jun 02 19:51:12.322783 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:12.322750    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb1bedaa-1af9-476e-a082-da9686857763-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx\" (UID: \"cb1bedaa-1af9-476e-a082-da9686857763\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx"
Jun 02 19:51:12.338017 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:12.337991    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkgkl\" (UniqueName: \"kubernetes.io/projected/cb1bedaa-1af9-476e-a082-da9686857763-kube-api-access-vkgkl\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx\" (UID: \"cb1bedaa-1af9-476e-a082-da9686857763\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx"
Jun 02 19:51:12.422600 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:12.422523    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx"
Jun 02 19:51:12.567646 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:12.567480    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx"]
Jun 02 19:51:12.570213 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:51:12.570191    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb1bedaa_1af9_476e_a082_da9686857763.slice/crio-590fef2104e9b5cab29dfb5a82b12aca19de050bf33964248f16d1880f4ab583 WatchSource:0}: Error finding container 590fef2104e9b5cab29dfb5a82b12aca19de050bf33964248f16d1880f4ab583: Status 404 returned error can't find the container with id 590fef2104e9b5cab29dfb5a82b12aca19de050bf33964248f16d1880f4ab583
Jun 02 19:51:12.966430 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:12.966395    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx" event={"ID":"cb1bedaa-1af9-476e-a082-da9686857763","Type":"ContainerStarted","Data":"590fef2104e9b5cab29dfb5a82b12aca19de050bf33964248f16d1880f4ab583"}
Jun 02 19:51:16.983205 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:16.983164    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx" event={"ID":"cb1bedaa-1af9-476e-a082-da9686857763","Type":"ContainerStarted","Data":"08849fa08a8cb18fc92bafcef948e2256a5b5f88373dc0f4aa38df88c0d07f4c"}
Jun 02 19:51:18.990955 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:18.990921    2564 generic.go:358] "Generic (PLEG): container finished" podID="cb1bedaa-1af9-476e-a082-da9686857763" containerID="08849fa08a8cb18fc92bafcef948e2256a5b5f88373dc0f4aa38df88c0d07f4c" exitCode=0
Jun 02 19:51:18.991411 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:18.990970    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx" event={"ID":"cb1bedaa-1af9-476e-a082-da9686857763","Type":"ContainerDied","Data":"08849fa08a8cb18fc92bafcef948e2256a5b5f88373dc0f4aa38df88c0d07f4c"}
Jun 02 19:51:21.000437 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:21.000398    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx" event={"ID":"cb1bedaa-1af9-476e-a082-da9686857763","Type":"ContainerStarted","Data":"7befae1acd5d1f7cb531c729299c155051620456a032545d558cf5e4728ad6b5"}
Jun 02 19:51:21.022089 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:21.022030    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx" podStartSLOduration=1.345242089 podStartE2EDuration="9.022015022s" podCreationTimestamp="2026-06-02 19:51:12 +0000 UTC" firstStartedPulling="2026-06-02 19:51:12.571951567 +0000 UTC m=+665.426371841" lastFinishedPulling="2026-06-02 19:51:20.248724499 +0000 UTC m=+673.103144774" observedRunningTime="2026-06-02 19:51:21.020834975 +0000 UTC m=+673.875255271" watchObservedRunningTime="2026-06-02 19:51:21.022015022 +0000 UTC m=+673.876435316"
Jun 02 19:51:22.423197 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:22.423156    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx"
Jun 02 19:51:22.423635 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:22.423226    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx"
Jun 02 19:51:22.437114 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:22.437083    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx"
Jun 02 19:51:23.021093 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:23.021057    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx"
Jun 02 19:51:25.885540 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:25.885505    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl"]
Jun 02 19:51:25.890112 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:25.890090    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl"
Jun 02 19:51:25.892693 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:25.892672    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jun 02 19:51:25.900084 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:25.900061    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl"]
Jun 02 19:51:25.926932 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:25.926907    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fc790a4-e41d-4c1a-8e62-49e89dfafa51-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl\" (UID: \"8fc790a4-e41d-4c1a-8e62-49e89dfafa51\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl"
Jun 02 19:51:25.927068 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:25.926949    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blbjl\" (UniqueName: \"kubernetes.io/projected/8fc790a4-e41d-4c1a-8e62-49e89dfafa51-kube-api-access-blbjl\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl\" (UID: \"8fc790a4-e41d-4c1a-8e62-49e89dfafa51\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl"
Jun 02 19:51:25.927068 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:25.927039    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fc790a4-e41d-4c1a-8e62-49e89dfafa51-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl\" (UID: \"8fc790a4-e41d-4c1a-8e62-49e89dfafa51\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl"
Jun 02 19:51:25.927169 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:25.927068    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fc790a4-e41d-4c1a-8e62-49e89dfafa51-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl\" (UID: \"8fc790a4-e41d-4c1a-8e62-49e89dfafa51\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl"
Jun 02 19:51:25.927169 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:25.927103    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fc790a4-e41d-4c1a-8e62-49e89dfafa51-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl\" (UID: \"8fc790a4-e41d-4c1a-8e62-49e89dfafa51\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl"
Jun 02 19:51:25.927169 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:25.927118    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8fc790a4-e41d-4c1a-8e62-49e89dfafa51-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl\" (UID: \"8fc790a4-e41d-4c1a-8e62-49e89dfafa51\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl"
Jun 02 19:51:26.027597 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:26.027568    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fc790a4-e41d-4c1a-8e62-49e89dfafa51-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl\" (UID: \"8fc790a4-e41d-4c1a-8e62-49e89dfafa51\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl"
Jun 02 19:51:26.027785 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:26.027604    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-blbjl\" (UniqueName: \"kubernetes.io/projected/8fc790a4-e41d-4c1a-8e62-49e89dfafa51-kube-api-access-blbjl\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl\" (UID: \"8fc790a4-e41d-4c1a-8e62-49e89dfafa51\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl"
Jun 02 19:51:26.027785 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:26.027649    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fc790a4-e41d-4c1a-8e62-49e89dfafa51-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl\" (UID: \"8fc790a4-e41d-4c1a-8e62-49e89dfafa51\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl"
Jun 02 19:51:26.027785 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:26.027668    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fc790a4-e41d-4c1a-8e62-49e89dfafa51-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl\" (UID: \"8fc790a4-e41d-4c1a-8e62-49e89dfafa51\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl"
Jun 02 19:51:26.027785 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:26.027702    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fc790a4-e41d-4c1a-8e62-49e89dfafa51-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl\" (UID: \"8fc790a4-e41d-4c1a-8e62-49e89dfafa51\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl"
Jun 02 19:51:26.028044 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:26.027814    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8fc790a4-e41d-4c1a-8e62-49e89dfafa51-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl\" (UID: \"8fc790a4-e41d-4c1a-8e62-49e89dfafa51\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl"
Jun 02 19:51:26.028169 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:26.028146    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fc790a4-e41d-4c1a-8e62-49e89dfafa51-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl\" (UID: \"8fc790a4-e41d-4c1a-8e62-49e89dfafa51\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl"
Jun 02 19:51:26.028294 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:26.028186    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8fc790a4-e41d-4c1a-8e62-49e89dfafa51-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl\" (UID: \"8fc790a4-e41d-4c1a-8e62-49e89dfafa51\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl"
Jun 02 19:51:26.028294 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:26.028250    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fc790a4-e41d-4c1a-8e62-49e89dfafa51-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl\" (UID: \"8fc790a4-e41d-4c1a-8e62-49e89dfafa51\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl"
Jun 02 19:51:26.029982 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:26.029964    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fc790a4-e41d-4c1a-8e62-49e89dfafa51-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl\" (UID: \"8fc790a4-e41d-4c1a-8e62-49e89dfafa51\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl"
Jun 02 19:51:26.030254 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:26.030236    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fc790a4-e41d-4c1a-8e62-49e89dfafa51-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl\" (UID: \"8fc790a4-e41d-4c1a-8e62-49e89dfafa51\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl"
Jun 02 19:51:26.041721 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:26.041694    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blbjl\" (UniqueName: \"kubernetes.io/projected/8fc790a4-e41d-4c1a-8e62-49e89dfafa51-kube-api-access-blbjl\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl\" (UID: \"8fc790a4-e41d-4c1a-8e62-49e89dfafa51\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl"
Jun 02 19:51:26.201886 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:26.201784    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl"
Jun 02 19:51:26.340956 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:26.340926    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl"]
Jun 02 19:51:26.342610 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:51:26.342584    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fc790a4_e41d_4c1a_8e62_49e89dfafa51.slice/crio-eeab649e75a8e383e5ebfb003c76574fa3e3377f38683838b2168564deca4201 WatchSource:0}: Error finding container eeab649e75a8e383e5ebfb003c76574fa3e3377f38683838b2168564deca4201: Status 404 returned error can't find the container with id eeab649e75a8e383e5ebfb003c76574fa3e3377f38683838b2168564deca4201
Jun 02 19:51:27.023966 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:27.023927    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl" event={"ID":"8fc790a4-e41d-4c1a-8e62-49e89dfafa51","Type":"ContainerStarted","Data":"92301452c74802ddc5123a6bf707eb2b27a7adefbd7276e055f3fd39b2a836bd"}
Jun 02 19:51:27.023966 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:27.023965    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl" event={"ID":"8fc790a4-e41d-4c1a-8e62-49e89dfafa51","Type":"ContainerStarted","Data":"eeab649e75a8e383e5ebfb003c76574fa3e3377f38683838b2168564deca4201"}
Jun 02 19:51:27.691464 ip-10-0-130-103 kubenswrapper[2564]: E0602 19:51:27.691421    2564 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fc790a4_e41d_4c1a_8e62_49e89dfafa51.slice/crio-conmon-92301452c74802ddc5123a6bf707eb2b27a7adefbd7276e055f3fd39b2a836bd.scope\": RecentStats: unable to find data in memory cache]"
Jun 02 19:51:28.028613 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:28.028577    2564 generic.go:358] "Generic (PLEG): container finished" podID="8fc790a4-e41d-4c1a-8e62-49e89dfafa51" containerID="92301452c74802ddc5123a6bf707eb2b27a7adefbd7276e055f3fd39b2a836bd" exitCode=0
Jun 02 19:51:28.029040 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:28.028658    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl" event={"ID":"8fc790a4-e41d-4c1a-8e62-49e89dfafa51","Type":"ContainerDied","Data":"92301452c74802ddc5123a6bf707eb2b27a7adefbd7276e055f3fd39b2a836bd"}
Jun 02 19:51:29.033325 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:29.033293    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl" event={"ID":"8fc790a4-e41d-4c1a-8e62-49e89dfafa51","Type":"ContainerStarted","Data":"7131de865db9a4af703c45d1db08a64193d12b621de5ce93ba73c1fddd7709ec"}
Jun 02 19:51:29.055311 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:29.055264    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl" podStartSLOduration=3.827058667 podStartE2EDuration="4.055251255s" podCreationTimestamp="2026-06-02 19:51:25 +0000 UTC" firstStartedPulling="2026-06-02 19:51:28.029240327 +0000 UTC m=+680.883660601" lastFinishedPulling="2026-06-02 19:51:28.257432915 +0000 UTC m=+681.111853189" observedRunningTime="2026-06-02 19:51:29.053049629 +0000 UTC m=+681.907469924" watchObservedRunningTime="2026-06-02 19:51:29.055251255 +0000 UTC m=+681.909671547"
Jun 02 19:51:36.202631 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:36.202593    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl"
Jun 02 19:51:36.203022 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:36.202647    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl"
Jun 02 19:51:36.215918 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:36.215890    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl"
Jun 02 19:51:37.072668 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:37.072640    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl"
Jun 02 19:51:44.662262 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:44.662230    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w"]
Jun 02 19:51:44.679469 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:44.679428    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w"]
Jun 02 19:51:44.679631 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:44.679580    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w"
Jun 02 19:51:44.682412 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:44.682387    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jun 02 19:51:44.789216 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:44.789182    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af98bf34-4970-408b-a203-f35c1db0a3f6-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w\" (UID: \"af98bf34-4970-408b-a203-f35c1db0a3f6\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w"
Jun 02 19:51:44.789373 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:44.789238    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af98bf34-4970-408b-a203-f35c1db0a3f6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w\" (UID: \"af98bf34-4970-408b-a203-f35c1db0a3f6\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w"
Jun 02 19:51:44.789373 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:44.789276    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmwzv\" (UniqueName: \"kubernetes.io/projected/af98bf34-4970-408b-a203-f35c1db0a3f6-kube-api-access-pmwzv\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w\" (UID: \"af98bf34-4970-408b-a203-f35c1db0a3f6\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w"
Jun 02 19:51:44.789373 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:44.789295    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af98bf34-4970-408b-a203-f35c1db0a3f6-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w\" (UID: \"af98bf34-4970-408b-a203-f35c1db0a3f6\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w"
Jun 02 19:51:44.789373 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:44.789346    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/af98bf34-4970-408b-a203-f35c1db0a3f6-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w\" (UID: \"af98bf34-4970-408b-a203-f35c1db0a3f6\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w"
Jun 02 19:51:44.789504 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:44.789412    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af98bf34-4970-408b-a203-f35c1db0a3f6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w\" (UID: \"af98bf34-4970-408b-a203-f35c1db0a3f6\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w"
Jun 02 19:51:44.890056 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:44.890027    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af98bf34-4970-408b-a203-f35c1db0a3f6-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w\" (UID: \"af98bf34-4970-408b-a203-f35c1db0a3f6\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w"
Jun 02 19:51:44.890214 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:44.890066    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/af98bf34-4970-408b-a203-f35c1db0a3f6-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w\" (UID: \"af98bf34-4970-408b-a203-f35c1db0a3f6\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w"
Jun 02 19:51:44.890214 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:44.890110    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af98bf34-4970-408b-a203-f35c1db0a3f6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w\" (UID: \"af98bf34-4970-408b-a203-f35c1db0a3f6\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w"
Jun 02 19:51:44.890214 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:44.890134    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af98bf34-4970-408b-a203-f35c1db0a3f6-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w\" (UID: \"af98bf34-4970-408b-a203-f35c1db0a3f6\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w"
Jun 02 19:51:44.890214 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:44.890170    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af98bf34-4970-408b-a203-f35c1db0a3f6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w\" (UID: \"af98bf34-4970-408b-a203-f35c1db0a3f6\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w"
Jun 02 19:51:44.890214 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:44.890192    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pmwzv\" (UniqueName: \"kubernetes.io/projected/af98bf34-4970-408b-a203-f35c1db0a3f6-kube-api-access-pmwzv\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w\" (UID: \"af98bf34-4970-408b-a203-f35c1db0a3f6\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w"
Jun 02 19:51:44.890550 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:44.890520    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/af98bf34-4970-408b-a203-f35c1db0a3f6-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w\" (UID: \"af98bf34-4970-408b-a203-f35c1db0a3f6\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w"
Jun 02 19:51:44.890617 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:44.890534    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af98bf34-4970-408b-a203-f35c1db0a3f6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w\" (UID: \"af98bf34-4970-408b-a203-f35c1db0a3f6\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w"
Jun 02 19:51:44.890617 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:44.890577    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af98bf34-4970-408b-a203-f35c1db0a3f6-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w\" (UID: \"af98bf34-4970-408b-a203-f35c1db0a3f6\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w"
Jun 02 19:51:44.892280 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:44.892257    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af98bf34-4970-408b-a203-f35c1db0a3f6-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w\" (UID: \"af98bf34-4970-408b-a203-f35c1db0a3f6\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w"
Jun 02 19:51:44.892656 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:44.892635    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af98bf34-4970-408b-a203-f35c1db0a3f6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w\" (UID: \"af98bf34-4970-408b-a203-f35c1db0a3f6\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w"
Jun 02 19:51:44.899566 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:44.899540    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmwzv\" (UniqueName: \"kubernetes.io/projected/af98bf34-4970-408b-a203-f35c1db0a3f6-kube-api-access-pmwzv\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w\" (UID: \"af98bf34-4970-408b-a203-f35c1db0a3f6\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w"
Jun 02 19:51:44.993414 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:44.993384    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w"
Jun 02 19:51:45.132041 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:45.132013    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w"]
Jun 02 19:51:45.133117 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:51:45.133084    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf98bf34_4970_408b_a203_f35c1db0a3f6.slice/crio-76786f906faa697ac933438d77d06fd26fee1c821365bca133057ac80c5987d0 WatchSource:0}: Error finding container 76786f906faa697ac933438d77d06fd26fee1c821365bca133057ac80c5987d0: Status 404 returned error can't find the container with id 76786f906faa697ac933438d77d06fd26fee1c821365bca133057ac80c5987d0
Jun 02 19:51:46.098601 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:46.098560    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w" event={"ID":"af98bf34-4970-408b-a203-f35c1db0a3f6","Type":"ContainerStarted","Data":"4c2eb965b501f4a81264da727ddd333c60b03a50d3580cde2f7dbe03ae0fd6ea"}
Jun 02 19:51:46.099088 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:46.098610    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w" event={"ID":"af98bf34-4970-408b-a203-f35c1db0a3f6","Type":"ContainerStarted","Data":"76786f906faa697ac933438d77d06fd26fee1c821365bca133057ac80c5987d0"}
Jun 02 19:51:47.103146 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:47.103111    2564 generic.go:358] "Generic (PLEG): container finished" podID="af98bf34-4970-408b-a203-f35c1db0a3f6" containerID="4c2eb965b501f4a81264da727ddd333c60b03a50d3580cde2f7dbe03ae0fd6ea" exitCode=0
Jun 02 19:51:47.103520 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:47.103188    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w" event={"ID":"af98bf34-4970-408b-a203-f35c1db0a3f6","Type":"ContainerDied","Data":"4c2eb965b501f4a81264da727ddd333c60b03a50d3580cde2f7dbe03ae0fd6ea"}
Jun 02 19:51:48.108741 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:48.108709    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w" event={"ID":"af98bf34-4970-408b-a203-f35c1db0a3f6","Type":"ContainerStarted","Data":"4a83166c4293af5f527689a8cfdca95aa217cbc2fcf7bf72dd6e88ecb317e647"}
Jun 02 19:51:48.129262 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:48.129217    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w" podStartSLOduration=3.928098003 podStartE2EDuration="4.129203101s" podCreationTimestamp="2026-06-02 19:51:44 +0000 UTC" firstStartedPulling="2026-06-02 19:51:47.103662466 +0000 UTC m=+699.958082736" lastFinishedPulling="2026-06-02 19:51:47.304767556 +0000 UTC m=+700.159187834" observedRunningTime="2026-06-02 19:51:48.127418184 +0000 UTC m=+700.981838469" watchObservedRunningTime="2026-06-02 19:51:48.129203101 +0000 UTC m=+700.983623393"
Jun 02 19:51:54.993902 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:54.993864    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w"
Jun 02 19:51:54.993902 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:54.993907    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w"
Jun 02 19:51:55.006158 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:55.006126    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w"
Jun 02 19:51:55.147514 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:51:55.147481    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w"
Jun 02 19:54:07.627340 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:54:07.627311    2564 scope.go:117] "RemoveContainer" containerID="147c923f8e31cd9882e5809ec922a49dcbb8897f6d122ceb5edd04e9cfdc3f60"
Jun 02 19:54:30.554741 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:54:30.554702    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8d84675b-tmfbj"]
Jun 02 19:54:30.555219 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:54:30.554937    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-8d84675b-tmfbj" podUID="fb81404c-b9e2-4574-bc1b-1be79acecbce" containerName="manager" containerID="cri-o://6c042256ff092814eb4d16ccbb9b079c3322290adb5ea6f4b294166f06741640" gracePeriod=30
Jun 02 19:54:30.677736 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:54:30.677707    2564 generic.go:358] "Generic (PLEG): container finished" podID="fb81404c-b9e2-4574-bc1b-1be79acecbce" containerID="6c042256ff092814eb4d16ccbb9b079c3322290adb5ea6f4b294166f06741640" exitCode=0
Jun 02 19:54:30.677869 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:54:30.677782    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8d84675b-tmfbj" event={"ID":"fb81404c-b9e2-4574-bc1b-1be79acecbce","Type":"ContainerDied","Data":"6c042256ff092814eb4d16ccbb9b079c3322290adb5ea6f4b294166f06741640"}
Jun 02 19:54:30.809336 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:54:30.809281    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8d84675b-tmfbj"
Jun 02 19:54:30.975679 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:54:30.975641    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t24zd\" (UniqueName: \"kubernetes.io/projected/fb81404c-b9e2-4574-bc1b-1be79acecbce-kube-api-access-t24zd\") pod \"fb81404c-b9e2-4574-bc1b-1be79acecbce\" (UID: \"fb81404c-b9e2-4574-bc1b-1be79acecbce\") "
Jun 02 19:54:30.977914 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:54:30.977877    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb81404c-b9e2-4574-bc1b-1be79acecbce-kube-api-access-t24zd" (OuterVolumeSpecName: "kube-api-access-t24zd") pod "fb81404c-b9e2-4574-bc1b-1be79acecbce" (UID: "fb81404c-b9e2-4574-bc1b-1be79acecbce"). InnerVolumeSpecName "kube-api-access-t24zd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 02 19:54:31.076778 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:54:31.076710    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t24zd\" (UniqueName: \"kubernetes.io/projected/fb81404c-b9e2-4574-bc1b-1be79acecbce-kube-api-access-t24zd\") on node \"ip-10-0-130-103.ec2.internal\" DevicePath \"\""
Jun 02 19:54:31.682497 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:54:31.682473    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8d84675b-tmfbj"
Jun 02 19:54:31.682898 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:54:31.682477    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8d84675b-tmfbj" event={"ID":"fb81404c-b9e2-4574-bc1b-1be79acecbce","Type":"ContainerDied","Data":"fe5697cc6bc22b35317a462097369034134e14951d173711ba08175d10b9f296"}
Jun 02 19:54:31.682898 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:54:31.682578    2564 scope.go:117] "RemoveContainer" containerID="6c042256ff092814eb4d16ccbb9b079c3322290adb5ea6f4b294166f06741640"
Jun 02 19:54:31.701948 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:54:31.701925    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8d84675b-tmfbj"]
Jun 02 19:54:31.705693 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:54:31.705674    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8d84675b-tmfbj"]
Jun 02 19:54:32.455690 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:54:32.455654    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8d84675b-jbmbz"]
Jun 02 19:54:32.456067 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:54:32.456045    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb81404c-b9e2-4574-bc1b-1be79acecbce" containerName="manager"
Jun 02 19:54:32.456067 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:54:32.456061    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb81404c-b9e2-4574-bc1b-1be79acecbce" containerName="manager"
Jun 02 19:54:32.456251 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:54:32.456135    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="fb81404c-b9e2-4574-bc1b-1be79acecbce" containerName="manager"
Jun 02 19:54:32.460536 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:54:32.460516    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8d84675b-jbmbz"
Jun 02 19:54:32.467512 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:54:32.463593    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jun 02 19:54:32.467512 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:54:32.463698    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6tp78\""
Jun 02 19:54:32.470365 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:54:32.470339    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8d84675b-jbmbz"]
Jun 02 19:54:32.590551 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:54:32.590513    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llwv7\" (UniqueName: \"kubernetes.io/projected/ce3676ee-9113-4022-abe9-9789fffaf559-kube-api-access-llwv7\") pod \"maas-controller-8d84675b-jbmbz\" (UID: \"ce3676ee-9113-4022-abe9-9789fffaf559\") " pod="opendatahub/maas-controller-8d84675b-jbmbz"
Jun 02 19:54:32.691450 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:54:32.691409    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-llwv7\" (UniqueName: \"kubernetes.io/projected/ce3676ee-9113-4022-abe9-9789fffaf559-kube-api-access-llwv7\") pod \"maas-controller-8d84675b-jbmbz\" (UID: \"ce3676ee-9113-4022-abe9-9789fffaf559\") " pod="opendatahub/maas-controller-8d84675b-jbmbz"
Jun 02 19:54:32.700220 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:54:32.700188    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llwv7\" (UniqueName: \"kubernetes.io/projected/ce3676ee-9113-4022-abe9-9789fffaf559-kube-api-access-llwv7\") pod \"maas-controller-8d84675b-jbmbz\" (UID: \"ce3676ee-9113-4022-abe9-9789fffaf559\") " pod="opendatahub/maas-controller-8d84675b-jbmbz"
Jun 02 19:54:32.778051 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:54:32.778025    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8d84675b-jbmbz"
Jun 02 19:54:32.937881 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:54:32.935219    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8d84675b-jbmbz"]
Jun 02 19:54:32.939170 ip-10-0-130-103 kubenswrapper[2564]: W0602 19:54:32.939140    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce3676ee_9113_4022_abe9_9789fffaf559.slice/crio-6d72e545cebcb1b17420a1827029eb974f0594c9b11101fb229c08245703397d WatchSource:0}: Error finding container 6d72e545cebcb1b17420a1827029eb974f0594c9b11101fb229c08245703397d: Status 404 returned error can't find the container with id 6d72e545cebcb1b17420a1827029eb974f0594c9b11101fb229c08245703397d
Jun 02 19:54:33.646795 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:54:33.646723    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb81404c-b9e2-4574-bc1b-1be79acecbce" path="/var/lib/kubelet/pods/fb81404c-b9e2-4574-bc1b-1be79acecbce/volumes"
Jun 02 19:54:33.691039 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:54:33.691003    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8d84675b-jbmbz" event={"ID":"ce3676ee-9113-4022-abe9-9789fffaf559","Type":"ContainerStarted","Data":"0aac94724ed92116acefe0f027144800258e55edb417c7f84c49763781fa4a08"}
Jun 02 19:54:33.691039 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:54:33.691041    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8d84675b-jbmbz" event={"ID":"ce3676ee-9113-4022-abe9-9789fffaf559","Type":"ContainerStarted","Data":"6d72e545cebcb1b17420a1827029eb974f0594c9b11101fb229c08245703397d"}
Jun 02 19:54:33.691268 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:54:33.691133    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8d84675b-jbmbz"
Jun 02 19:54:33.709329 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:54:33.709281    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-8d84675b-jbmbz" podStartSLOduration=1.258000895 podStartE2EDuration="1.709269008s" podCreationTimestamp="2026-06-02 19:54:32 +0000 UTC" firstStartedPulling="2026-06-02 19:54:32.940596823 +0000 UTC m=+865.795017095" lastFinishedPulling="2026-06-02 19:54:33.391864933 +0000 UTC m=+866.246285208" observedRunningTime="2026-06-02 19:54:33.70713365 +0000 UTC m=+866.561553937" watchObservedRunningTime="2026-06-02 19:54:33.709269008 +0000 UTC m=+866.563689301"
Jun 02 19:54:44.701055 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:54:44.701016    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8d84675b-jbmbz"
Jun 02 19:55:08.745273 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:55:08.745245    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9jgn2_7c1244c6-6d55-4cff-8099-4fc240c590f4/console-operator/2.log"
Jun 02 19:55:08.747698 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:55:08.747678    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9jgn2_7c1244c6-6d55-4cff-8099-4fc240c590f4/console-operator/2.log"
Jun 02 19:55:08.749500 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:55:08.749479    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-79xzx_278707d7-17c9-4a6c-917e-1d2d056db08e/ovn-acl-logging/0.log"
Jun 02 19:55:08.751749 ip-10-0-130-103 kubenswrapper[2564]: I0602 19:55:08.751729    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-79xzx_278707d7-17c9-4a6c-917e-1d2d056db08e/ovn-acl-logging/0.log"
Jun 02 20:00:08.771316 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:00:08.771203    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9jgn2_7c1244c6-6d55-4cff-8099-4fc240c590f4/console-operator/2.log"
Jun 02 20:00:08.776976 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:00:08.776956    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9jgn2_7c1244c6-6d55-4cff-8099-4fc240c590f4/console-operator/2.log"
Jun 02 20:00:08.778718 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:00:08.778702    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-79xzx_278707d7-17c9-4a6c-917e-1d2d056db08e/ovn-acl-logging/0.log"
Jun 02 20:00:08.781214 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:00:08.781196    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-79xzx_278707d7-17c9-4a6c-917e-1d2d056db08e/ovn-acl-logging/0.log"
Jun 02 20:05:08.799603 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:05:08.799499    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9jgn2_7c1244c6-6d55-4cff-8099-4fc240c590f4/console-operator/2.log"
Jun 02 20:05:08.803498 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:05:08.803274    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9jgn2_7c1244c6-6d55-4cff-8099-4fc240c590f4/console-operator/2.log"
Jun 02 20:05:08.803690 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:05:08.803674    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-79xzx_278707d7-17c9-4a6c-917e-1d2d056db08e/ovn-acl-logging/0.log"
Jun 02 20:05:08.807335 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:05:08.807320    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-79xzx_278707d7-17c9-4a6c-917e-1d2d056db08e/ovn-acl-logging/0.log"
Jun 02 20:10:08.824555 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:10:08.824446    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9jgn2_7c1244c6-6d55-4cff-8099-4fc240c590f4/console-operator/2.log"
Jun 02 20:10:08.828747 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:10:08.828723    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-79xzx_278707d7-17c9-4a6c-917e-1d2d056db08e/ovn-acl-logging/0.log"
Jun 02 20:10:08.829106 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:10:08.829088    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9jgn2_7c1244c6-6d55-4cff-8099-4fc240c590f4/console-operator/2.log"
Jun 02 20:10:08.833407 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:10:08.833390    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-79xzx_278707d7-17c9-4a6c-917e-1d2d056db08e/ovn-acl-logging/0.log"
Jun 02 20:15:08.856943 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:15:08.856828    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9jgn2_7c1244c6-6d55-4cff-8099-4fc240c590f4/console-operator/2.log"
Jun 02 20:15:08.861149 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:15:08.861124    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-79xzx_278707d7-17c9-4a6c-917e-1d2d056db08e/ovn-acl-logging/0.log"
Jun 02 20:15:08.862271 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:15:08.862250    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9jgn2_7c1244c6-6d55-4cff-8099-4fc240c590f4/console-operator/2.log"
Jun 02 20:15:08.869064 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:15:08.869047    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-79xzx_278707d7-17c9-4a6c-917e-1d2d056db08e/ovn-acl-logging/0.log"
Jun 02 20:16:16.417066 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:16.416984    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-fd65b6c4c-czhgt_07b4643f-605a-4b4d-b52d-84bb7e9054cd/nginx/0.log"
Jun 02 20:16:16.529312 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:16.529284    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-52tkm_685f3707-55c9-4abd-b61a-239c7895fa07/manager/0.log"
Jun 02 20:16:16.650514 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:16.650468    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-5jhhm_1b7c2f3c-f17d-46b9-a325-0ee7b73562ec/manager/0.log"
Jun 02 20:16:16.772577 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:16.772551    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-fbbd484dc-vv28p_6154ff1a-bd8a-4239-beca-ab7fb998ec9f/maas-api/0.log"
Jun 02 20:16:16.891086 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:16.891052    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8d84675b-jbmbz_ce3676ee-9113-4022-abe9-9789fffaf559/manager/0.log"
Jun 02 20:16:17.008832 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:17.008805    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-56vdd_cf36fd81-89e0-4217-8459-1881b5c313dc/server/0.log"
Jun 02 20:16:17.132223 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:17.132145    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-ptxcz_b8397dcd-5188-4618-adc9-e7df76a812aa/manager/0.log"
Jun 02 20:16:17.254160 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:17.254132    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw_72d000cc-cc28-4d24-ada9-44f8ec4316e9/copy-manifests/0.log"
Jun 02 20:16:17.270383 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:17.270357    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw_72d000cc-cc28-4d24-ada9-44f8ec4316e9/manager/0.log"
Jun 02 20:16:17.648188 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:17.648157    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-qjcwg_4c0e04db-98b0-43ec-97e1-47b2fe32fb11/postgres/0.log"
Jun 02 20:16:20.341013 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:20.340975    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-jztww_6dd287ae-a743-4660-a0aa-79043fbc4e03/discovery/0.log"
Jun 02 20:16:20.602193 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:20.602116    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-757778c8b9-l4tzj_f770bd82-d20d-4641-a17d-1f00c9cb3746/kube-auth-proxy/0.log"
Jun 02 20:16:20.742576 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:20.742548    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-gw2mp_e20c07ea-b3ed-4016-ac3f-56ed150f52fb/istio-proxy/0.log"
Jun 02 20:16:20.862330 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:20.862253    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-hz998_b3070c55-4e27-4b34-ba28-8185b2eca577/payload-processing/0.log"
Jun 02 20:16:20.978326 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:20.978298    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c796fd74c-l2p9g_8620c80b-baae-412c-9d06-3e2fdb65665c/router/0.log"
Jun 02 20:16:21.341624 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:21.341589    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx_cb1bedaa-1af9-476e-a082-da9686857763/storage-initializer/0.log"
Jun 02 20:16:21.351580 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:21.351557    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-8cmpx_cb1bedaa-1af9-476e-a082-da9686857763/main/0.log"
Jun 02 20:16:21.586441 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:21.586415    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl_8fc790a4-e41d-4c1a-8e62-49e89dfafa51/storage-initializer/0.log"
Jun 02 20:16:21.594645 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:21.594578    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-rhdtl_8fc790a4-e41d-4c1a-8e62-49e89dfafa51/main/0.log"
Jun 02 20:16:21.828791 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:21.828765    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w_af98bf34-4970-408b-a203-f35c1db0a3f6/storage-initializer/0.log"
Jun 02 20:16:21.836654 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:21.836637    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-fr64w_af98bf34-4970-408b-a203-f35c1db0a3f6/main/0.log"
Jun 02 20:16:29.189535 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:29.189501    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pn7k7_382834b8-2464-4874-b852-66124dc7ddab/global-pull-secret-syncer/0.log"
Jun 02 20:16:29.266195 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:29.266165    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cxcr4_ce248b5e-f37f-4b11-b95d-5cef45bf2cba/konnectivity-agent/0.log"
Jun 02 20:16:29.327054 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:29.327025    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-103.ec2.internal_3d5ef594b0a6f2e96051da648ad4a60d/haproxy/0.log"
Jun 02 20:16:34.947076 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:34.947041    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-9rbdk_fa48db29-a46c-418f-80db-cc2c39f225d7/cluster-monitoring-operator/0.log"
Jun 02 20:16:35.283744 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:35.283711    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zzfzp_4bfbddfa-0b6e-4efa-a153-25ce321c6bea/node-exporter/0.log"
Jun 02 20:16:35.316229 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:35.316200    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zzfzp_4bfbddfa-0b6e-4efa-a153-25ce321c6bea/kube-rbac-proxy/0.log"
Jun 02 20:16:35.343194 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:35.343168    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zzfzp_4bfbddfa-0b6e-4efa-a153-25ce321c6bea/init-textfile/0.log"
Jun 02 20:16:37.340541 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:37.340507    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-76c9bb5fdf-95ppp_912780cc-8979-4267-9189-ec7f34a66078/networking-console-plugin/0.log"
Jun 02 20:16:37.941660 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:37.941634    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9jgn2_7c1244c6-6d55-4cff-8099-4fc240c590f4/console-operator/2.log"
Jun 02 20:16:37.945580 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:37.945559    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9jgn2_7c1244c6-6d55-4cff-8099-4fc240c590f4/console-operator/3.log"
Jun 02 20:16:39.080177 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:39.080149    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-h4rgf_03f84c87-e6c2-4b90-be42-138de83f59ef/volume-data-source-validator/0.log"
Jun 02 20:16:39.879128 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:39.879091    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6mtqp/perf-node-gather-daemonset-gp7xj"]
Jun 02 20:16:39.882620 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:39.882596    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6mtqp/perf-node-gather-daemonset-gp7xj"
Jun 02 20:16:39.885392 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:39.885366    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6mtqp\"/\"openshift-service-ca.crt\""
Jun 02 20:16:39.885507 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:39.885390    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6mtqp\"/\"kube-root-ca.crt\""
Jun 02 20:16:39.886328 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:39.886313    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6mtqp\"/\"default-dockercfg-hwcz8\""
Jun 02 20:16:39.893493 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:39.893468    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6mtqp/perf-node-gather-daemonset-gp7xj"]
Jun 02 20:16:39.924679 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:39.924652    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/27c9561c-349c-463a-836e-e056e002aa86-proc\") pod \"perf-node-gather-daemonset-gp7xj\" (UID: \"27c9561c-349c-463a-836e-e056e002aa86\") " pod="openshift-must-gather-6mtqp/perf-node-gather-daemonset-gp7xj"
Jun 02 20:16:39.924815 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:39.924689    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/27c9561c-349c-463a-836e-e056e002aa86-podres\") pod \"perf-node-gather-daemonset-gp7xj\" (UID: \"27c9561c-349c-463a-836e-e056e002aa86\") " pod="openshift-must-gather-6mtqp/perf-node-gather-daemonset-gp7xj"
Jun 02 20:16:39.924815 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:39.924714    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27c9561c-349c-463a-836e-e056e002aa86-sys\") pod \"perf-node-gather-daemonset-gp7xj\" (UID: \"27c9561c-349c-463a-836e-e056e002aa86\") " pod="openshift-must-gather-6mtqp/perf-node-gather-daemonset-gp7xj"
Jun 02 20:16:39.924815 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:39.924752    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/27c9561c-349c-463a-836e-e056e002aa86-lib-modules\") pod \"perf-node-gather-daemonset-gp7xj\" (UID: \"27c9561c-349c-463a-836e-e056e002aa86\") " pod="openshift-must-gather-6mtqp/perf-node-gather-daemonset-gp7xj"
Jun 02 20:16:39.924815 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:39.924796    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpdmt\" (UniqueName: \"kubernetes.io/projected/27c9561c-349c-463a-836e-e056e002aa86-kube-api-access-cpdmt\") pod \"perf-node-gather-daemonset-gp7xj\" (UID: \"27c9561c-349c-463a-836e-e056e002aa86\") " pod="openshift-must-gather-6mtqp/perf-node-gather-daemonset-gp7xj"
Jun 02 20:16:40.025979 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:40.025943    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cpdmt\" (UniqueName: \"kubernetes.io/projected/27c9561c-349c-463a-836e-e056e002aa86-kube-api-access-cpdmt\") pod \"perf-node-gather-daemonset-gp7xj\" (UID: \"27c9561c-349c-463a-836e-e056e002aa86\") " pod="openshift-must-gather-6mtqp/perf-node-gather-daemonset-gp7xj"
Jun 02 20:16:40.026161 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:40.026020    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/27c9561c-349c-463a-836e-e056e002aa86-proc\") pod \"perf-node-gather-daemonset-gp7xj\" (UID: \"27c9561c-349c-463a-836e-e056e002aa86\") " pod="openshift-must-gather-6mtqp/perf-node-gather-daemonset-gp7xj"
Jun 02 20:16:40.026161 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:40.026041    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/27c9561c-349c-463a-836e-e056e002aa86-podres\") pod \"perf-node-gather-daemonset-gp7xj\" (UID: \"27c9561c-349c-463a-836e-e056e002aa86\") " pod="openshift-must-gather-6mtqp/perf-node-gather-daemonset-gp7xj"
Jun 02 20:16:40.026161 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:40.026067    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27c9561c-349c-463a-836e-e056e002aa86-sys\") pod \"perf-node-gather-daemonset-gp7xj\" (UID: \"27c9561c-349c-463a-836e-e056e002aa86\") " pod="openshift-must-gather-6mtqp/perf-node-gather-daemonset-gp7xj"
Jun 02 20:16:40.026161 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:40.026085    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/27c9561c-349c-463a-836e-e056e002aa86-lib-modules\") pod \"perf-node-gather-daemonset-gp7xj\" (UID: \"27c9561c-349c-463a-836e-e056e002aa86\") " pod="openshift-must-gather-6mtqp/perf-node-gather-daemonset-gp7xj"
Jun 02 20:16:40.026161 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:40.026142    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/27c9561c-349c-463a-836e-e056e002aa86-proc\") pod \"perf-node-gather-daemonset-gp7xj\" (UID: \"27c9561c-349c-463a-836e-e056e002aa86\") " pod="openshift-must-gather-6mtqp/perf-node-gather-daemonset-gp7xj"
Jun 02 20:16:40.026355 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:40.026178    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27c9561c-349c-463a-836e-e056e002aa86-sys\") pod \"perf-node-gather-daemonset-gp7xj\" (UID: \"27c9561c-349c-463a-836e-e056e002aa86\") " pod="openshift-must-gather-6mtqp/perf-node-gather-daemonset-gp7xj"
Jun 02 20:16:40.026355 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:40.026218    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/27c9561c-349c-463a-836e-e056e002aa86-podres\") pod \"perf-node-gather-daemonset-gp7xj\" (UID: \"27c9561c-349c-463a-836e-e056e002aa86\") " pod="openshift-must-gather-6mtqp/perf-node-gather-daemonset-gp7xj"
Jun 02 20:16:40.026355 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:40.026218    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/27c9561c-349c-463a-836e-e056e002aa86-lib-modules\") pod \"perf-node-gather-daemonset-gp7xj\" (UID: \"27c9561c-349c-463a-836e-e056e002aa86\") " pod="openshift-must-gather-6mtqp/perf-node-gather-daemonset-gp7xj"
Jun 02 20:16:40.033977 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:40.033955    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpdmt\" (UniqueName: \"kubernetes.io/projected/27c9561c-349c-463a-836e-e056e002aa86-kube-api-access-cpdmt\") pod \"perf-node-gather-daemonset-gp7xj\" (UID: \"27c9561c-349c-463a-836e-e056e002aa86\") " pod="openshift-must-gather-6mtqp/perf-node-gather-daemonset-gp7xj"
Jun 02 20:16:40.055852 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:40.055811    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kwwz5_099a66f9-dfe1-4ef7-b849-3e6951bd23f2/dns/0.log"
Jun 02 20:16:40.077507 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:40.077483    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kwwz5_099a66f9-dfe1-4ef7-b849-3e6951bd23f2/kube-rbac-proxy/0.log"
Jun 02 20:16:40.149106 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:40.149025    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4lnzn_bcbb7e95-e1e4-4ebe-a7b8-460d29d57a26/dns-node-resolver/0.log"
Jun 02 20:16:40.193185 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:40.193151    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6mtqp/perf-node-gather-daemonset-gp7xj"
Jun 02 20:16:40.326405 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:40.326367    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6mtqp/perf-node-gather-daemonset-gp7xj"]
Jun 02 20:16:40.328690 ip-10-0-130-103 kubenswrapper[2564]: W0602 20:16:40.328660    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod27c9561c_349c_463a_836e_e056e002aa86.slice/crio-0ae54d99a3945e1d978e1abed0dcbffc667f007f45b0626d01f128f5a77553c9 WatchSource:0}: Error finding container 0ae54d99a3945e1d978e1abed0dcbffc667f007f45b0626d01f128f5a77553c9: Status 404 returned error can't find the container with id 0ae54d99a3945e1d978e1abed0dcbffc667f007f45b0626d01f128f5a77553c9
Jun 02 20:16:40.330144 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:40.330127    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 02 20:16:40.346285 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:40.346260    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6mtqp/perf-node-gather-daemonset-gp7xj" event={"ID":"27c9561c-349c-463a-836e-e056e002aa86","Type":"ContainerStarted","Data":"0ae54d99a3945e1d978e1abed0dcbffc667f007f45b0626d01f128f5a77553c9"}
Jun 02 20:16:40.817002 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:40.815813    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2rvfs_830bda40-f0ea-4921-9555-49dd81e23f11/node-ca/0.log"
Jun 02 20:16:41.350798 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:41.350759    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6mtqp/perf-node-gather-daemonset-gp7xj" event={"ID":"27c9561c-349c-463a-836e-e056e002aa86","Type":"ContainerStarted","Data":"a2903dffce205ee2b08ef74837ff2bea5e2bdf5561236da0cce5a5fe622cb076"}
Jun 02 20:16:41.351214 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:41.350907    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6mtqp/perf-node-gather-daemonset-gp7xj"
Jun 02 20:16:41.371120 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:41.371076    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-6mtqp/perf-node-gather-daemonset-gp7xj" podStartSLOduration=2.371063 podStartE2EDuration="2.371063s" podCreationTimestamp="2026-06-02 20:16:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 20:16:41.369597878 +0000 UTC m=+2194.224018173" watchObservedRunningTime="2026-06-02 20:16:41.371063 +0000 UTC m=+2194.225483292"
Jun 02 20:16:41.895241 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:41.895210    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-jztww_6dd287ae-a743-4660-a0aa-79043fbc4e03/discovery/0.log"
Jun 02 20:16:41.947639 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:41.947609    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-757778c8b9-l4tzj_f770bd82-d20d-4641-a17d-1f00c9cb3746/kube-auth-proxy/0.log"
Jun 02 20:16:42.006070 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:42.006043    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-gw2mp_e20c07ea-b3ed-4016-ac3f-56ed150f52fb/istio-proxy/0.log"
Jun 02 20:16:42.064455 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:42.064423    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-hz998_b3070c55-4e27-4b34-ba28-8185b2eca577/payload-processing/0.log"
Jun 02 20:16:42.085498 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:42.085474    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c796fd74c-l2p9g_8620c80b-baae-412c-9d06-3e2fdb65665c/router/0.log"
Jun 02 20:16:42.632906 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:42.632870    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lnzsg_53c539fd-aeda-4f98-9450-4f7f05782e32/serve-healthcheck-canary/0.log"
Jun 02 20:16:43.159834 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:43.159808    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-4t95b_8c521bf4-fe5d-4188-a7ea-001c7e8c2255/insights-operator/0.log"
Jun 02 20:16:43.161827 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:43.161806    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-4t95b_8c521bf4-fe5d-4188-a7ea-001c7e8c2255/insights-operator/1.log"
Jun 02 20:16:43.186801 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:43.186776    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b5c54_29020b86-4d7e-426a-b87f-5db87a284cdb/kube-rbac-proxy/0.log"
Jun 02 20:16:43.210184 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:43.210161    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b5c54_29020b86-4d7e-426a-b87f-5db87a284cdb/exporter/0.log"
Jun 02 20:16:43.231750 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:43.231729    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b5c54_29020b86-4d7e-426a-b87f-5db87a284cdb/extractor/0.log"
Jun 02 20:16:45.439988 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:45.439963    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-fd65b6c4c-czhgt_07b4643f-605a-4b4d-b52d-84bb7e9054cd/nginx/0.log"
Jun 02 20:16:45.464417 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:45.464394    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-52tkm_685f3707-55c9-4abd-b61a-239c7895fa07/manager/0.log"
Jun 02 20:16:45.552876 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:45.552832    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-5jhhm_1b7c2f3c-f17d-46b9-a325-0ee7b73562ec/manager/0.log"
Jun 02 20:16:45.587027 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:45.587005    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-fbbd484dc-vv28p_6154ff1a-bd8a-4239-beca-ab7fb998ec9f/maas-api/0.log"
Jun 02 20:16:45.657042 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:45.656991    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8d84675b-jbmbz_ce3676ee-9113-4022-abe9-9789fffaf559/manager/0.log"
Jun 02 20:16:45.677165 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:45.677143    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-56vdd_cf36fd81-89e0-4217-8459-1881b5c313dc/server/0.log"
Jun 02 20:16:45.725651 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:45.725584    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-ptxcz_b8397dcd-5188-4618-adc9-e7df76a812aa/manager/0.log"
Jun 02 20:16:45.756779 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:45.756756    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw_72d000cc-cc28-4d24-ada9-44f8ec4316e9/manager/0.log"
Jun 02 20:16:45.780901 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:45.780882    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fd4f5f58b-7rdzw_72d000cc-cc28-4d24-ada9-44f8ec4316e9/copy-manifests/0.log"
Jun 02 20:16:45.979909 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:45.979891    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-qjcwg_4c0e04db-98b0-43ec-97e1-47b2fe32fb11/postgres/0.log"
Jun 02 20:16:47.365098 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:47.365071    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6mtqp/perf-node-gather-daemonset-gp7xj"
Jun 02 20:16:53.068822 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:53.068788    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-mt424_8c3ecc02-7b08-42ef-9078-60a7a2a271f2/kube-storage-version-migrator-operator/1.log"
Jun 02 20:16:53.069591 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:53.069561    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-mt424_8c3ecc02-7b08-42ef-9078-60a7a2a271f2/kube-storage-version-migrator-operator/0.log"
Jun 02 20:16:54.538384 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:54.538353    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wrvzk_7b6cbcad-e6ac-4814-92f0-ab915efd8844/kube-multus-additional-cni-plugins/0.log"
Jun 02 20:16:54.563666 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:54.563636    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wrvzk_7b6cbcad-e6ac-4814-92f0-ab915efd8844/egress-router-binary-copy/0.log"
Jun 02 20:16:54.589687 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:54.589653    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wrvzk_7b6cbcad-e6ac-4814-92f0-ab915efd8844/cni-plugins/0.log"
Jun 02 20:16:54.613693 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:54.613666    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wrvzk_7b6cbcad-e6ac-4814-92f0-ab915efd8844/bond-cni-plugin/0.log"
Jun 02 20:16:54.638564 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:54.638526    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wrvzk_7b6cbcad-e6ac-4814-92f0-ab915efd8844/routeoverride-cni/0.log"
Jun 02 20:16:54.673899 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:54.673869    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wrvzk_7b6cbcad-e6ac-4814-92f0-ab915efd8844/whereabouts-cni-bincopy/0.log"
Jun 02 20:16:54.717185 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:54.717148    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wrvzk_7b6cbcad-e6ac-4814-92f0-ab915efd8844/whereabouts-cni/0.log"
Jun 02 20:16:54.780605 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:54.780571    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zq5ll_9e2ad36f-0e51-473d-ab0f-96a54ad90b41/kube-multus/0.log"
Jun 02 20:16:54.853899 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:54.853790    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xlffd_91837c0a-ed65-44e8-b6f4-461981ef22b2/network-metrics-daemon/0.log"
Jun 02 20:16:54.878396 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:54.878368    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xlffd_91837c0a-ed65-44e8-b6f4-461981ef22b2/kube-rbac-proxy/0.log"
Jun 02 20:16:55.969185 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:55.969150    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-79xzx_278707d7-17c9-4a6c-917e-1d2d056db08e/ovn-controller/0.log"
Jun 02 20:16:55.995937 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:55.995915    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-79xzx_278707d7-17c9-4a6c-917e-1d2d056db08e/ovn-acl-logging/0.log"
Jun 02 20:16:56.006043 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:56.006016    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-79xzx_278707d7-17c9-4a6c-917e-1d2d056db08e/ovn-acl-logging/1.log"
Jun 02 20:16:56.028583 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:56.028553    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-79xzx_278707d7-17c9-4a6c-917e-1d2d056db08e/kube-rbac-proxy-node/0.log"
Jun 02 20:16:56.061302 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:56.061274    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-79xzx_278707d7-17c9-4a6c-917e-1d2d056db08e/kube-rbac-proxy-ovn-metrics/0.log"
Jun 02 20:16:56.084456 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:56.084434    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-79xzx_278707d7-17c9-4a6c-917e-1d2d056db08e/northd/0.log"
Jun 02 20:16:56.150184 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:56.150158    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-79xzx_278707d7-17c9-4a6c-917e-1d2d056db08e/nbdb/0.log"
Jun 02 20:16:56.171456 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:56.171421    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-79xzx_278707d7-17c9-4a6c-917e-1d2d056db08e/sbdb/0.log"
Jun 02 20:16:56.268544 ip-10-0-130-103 kubenswrapper[2564]: I0602 20:16:56.268464    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-79xzx_278707d7-17c9-4a6c-917e-1d2d056db08e/ovnkube-controller/0.log"