Jun 05 15:08:05.975236 ip-10-0-138-97 systemd[1]: Starting Kubernetes Kubelet... Jun 05 15:08:06.425634 ip-10-0-138-97 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 15:08:06.425634 ip-10-0-138-97 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 05 15:08:06.425634 ip-10-0-138-97 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 15:08:06.425634 ip-10-0-138-97 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 05 15:08:06.425634 ip-10-0-138-97 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 15:08:06.427792 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.427706 2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 05 15:08:06.436119 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436089 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 15:08:06.436119 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436108 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 15:08:06.436119 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436111 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 15:08:06.436119 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436120 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 15:08:06.436119 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436123 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 15:08:06.436318 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436128 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 15:08:06.436318 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436132 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 15:08:06.436318 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436136 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 15:08:06.436318 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436139 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 15:08:06.436318 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436142 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 15:08:06.436318 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436145 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 15:08:06.436318 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436148 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 15:08:06.436318 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436150 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 15:08:06.436318 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436153 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 15:08:06.436318 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436156 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 15:08:06.436318 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436159 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 15:08:06.436318 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436161 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 15:08:06.436318 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436164 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 15:08:06.436318 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436166 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 15:08:06.436318 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436169 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 05 15:08:06.436318 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436172 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 15:08:06.436318 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436174 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 15:08:06.436318 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436177 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 15:08:06.436318 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436179 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 15:08:06.436318 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436182 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 15:08:06.436796 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436185 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 15:08:06.436796 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436187 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 15:08:06.436796 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436190 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 15:08:06.436796 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436192 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 15:08:06.436796 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436195 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 15:08:06.436796 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436197 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 15:08:06.436796 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436211 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 15:08:06.436796 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436214 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 15:08:06.436796 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436217 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 15:08:06.436796 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436220 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 15:08:06.436796 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436222 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 15:08:06.436796 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436225 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 15:08:06.436796 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436227 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 15:08:06.436796 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436231 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 15:08:06.436796 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436234 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 15:08:06.436796 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436237 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 15:08:06.436796 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436239 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 15:08:06.436796 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436242 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 15:08:06.436796 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436245 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 15:08:06.436796 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436248 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 15:08:06.437347 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436251 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 15:08:06.437347 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436253 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 15:08:06.437347 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436256 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 15:08:06.437347 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436260 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 15:08:06.437347 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436264 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 15:08:06.437347 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436267 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 15:08:06.437347 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436270 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 15:08:06.437347 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436272 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 15:08:06.437347 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436276 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 15:08:06.437347 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436279 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 15:08:06.437347 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436281 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 15:08:06.437347 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436284 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 15:08:06.437347 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436287 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 15:08:06.437347 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436291 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 15:08:06.437347 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436294 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 15:08:06.437347 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436297 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 15:08:06.437347 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436299 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 15:08:06.437347 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436302 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 15:08:06.437347 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436305 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 15:08:06.437347 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436308 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 15:08:06.437822 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436311 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 15:08:06.437822 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436313 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 15:08:06.437822 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436316 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 15:08:06.437822 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436319 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 15:08:06.437822 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436322 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 15:08:06.437822 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436325 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 15:08:06.437822 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436327 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 15:08:06.437822 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436330 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 15:08:06.437822 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436333 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 15:08:06.437822 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436335 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 15:08:06.437822 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436338 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 15:08:06.437822 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436340 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 15:08:06.437822 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436343 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 15:08:06.437822 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436345 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 15:08:06.437822 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436350 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 15:08:06.437822 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436354 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 15:08:06.437822 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436357 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 15:08:06.437822 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436359 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 15:08:06.437822 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436369 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 15:08:06.438286 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436372 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 15:08:06.438286 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436374 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 15:08:06.438286 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436377 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 15:08:06.438286 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436380 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 15:08:06.438286 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436382 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 15:08:06.438286 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436385 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 15:08:06.438286 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436388 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 15:08:06.438286 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436391 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 15:08:06.438286 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436393 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 15:08:06.438286 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436396 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 15:08:06.438286 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436399 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 15:08:06.438286 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436402 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 15:08:06.438286 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436404 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 15:08:06.438286 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436407 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 15:08:06.438286 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.436410 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 15:08:06.438286 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437151 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 15:08:06.438286 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437160 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 15:08:06.438286 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437164 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 15:08:06.438286 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437167 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 15:08:06.438751 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437170 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 15:08:06.438751 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437173 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 15:08:06.438751 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437175 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 15:08:06.438751 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437178 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 15:08:06.438751 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437181 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 15:08:06.438751 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437184 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 15:08:06.438751 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437187 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 15:08:06.438751 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437189 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 15:08:06.438751 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437192 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 15:08:06.438751 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437195 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 15:08:06.438751 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437197 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 15:08:06.438751 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437200 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 15:08:06.438751 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437202 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 15:08:06.438751 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437212 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 15:08:06.438751 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437215 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 15:08:06.438751 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437217 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 15:08:06.438751 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437220 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 15:08:06.438751 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437222 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 15:08:06.438751 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437225 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 15:08:06.439233 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437228 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 15:08:06.439233 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437231 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 15:08:06.439233 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437233 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 15:08:06.439233 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437236 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 15:08:06.439233 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437240 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 15:08:06.439233 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437243 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 15:08:06.439233 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437245 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 15:08:06.439233 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437248 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 15:08:06.439233 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437251 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 15:08:06.439233 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437253 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 15:08:06.439233 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437256 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 15:08:06.439233 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437258 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 15:08:06.439233 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437261 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 15:08:06.439233 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437264 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 15:08:06.439233 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437266 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 15:08:06.439233 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437269 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 05 15:08:06.439233 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437271 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 15:08:06.439233 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437274 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 15:08:06.439233 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437276 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 15:08:06.439233 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437280 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 15:08:06.439722 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437283 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 15:08:06.439722 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437285 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 15:08:06.439722 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437288 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 15:08:06.439722 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437290 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 15:08:06.439722 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437293 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 15:08:06.439722 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437295 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 15:08:06.439722 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437298 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 15:08:06.439722 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437301 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 15:08:06.439722 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437304 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 15:08:06.439722 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437306 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 15:08:06.439722 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437309 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 15:08:06.439722 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437311 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 15:08:06.439722 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437314 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 15:08:06.439722 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437317 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 15:08:06.439722 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437319 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 15:08:06.439722 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437322 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 15:08:06.439722 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437325 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 15:08:06.439722 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437328 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 15:08:06.439722 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437330 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 15:08:06.439722 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437333 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 15:08:06.440217 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437336 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 15:08:06.440217 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437338 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 15:08:06.440217 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437341 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 15:08:06.440217 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437343 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 15:08:06.440217 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437346 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 15:08:06.440217 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437349 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 15:08:06.440217 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437353 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 15:08:06.440217 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437355 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 15:08:06.440217 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437358 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 15:08:06.440217 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437361 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 15:08:06.440217 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437364 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 15:08:06.440217 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437368 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 15:08:06.440217 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437371 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 15:08:06.440217 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437374 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 15:08:06.440217 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437377 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 15:08:06.440217 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437380 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 15:08:06.440217 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437383 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 15:08:06.440217 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437386 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 15:08:06.440217 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437390 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 15:08:06.440681 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437394 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 15:08:06.440681 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437397 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 15:08:06.440681 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437400 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 15:08:06.440681 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437402 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 15:08:06.440681 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437405 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 15:08:06.440681 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437409 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 15:08:06.440681 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437411 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 15:08:06.440681 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437414 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 15:08:06.440681 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437417 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 15:08:06.440681 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437420 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 15:08:06.440681 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437422 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 15:08:06.440681 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437425 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 15:08:06.440681 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437427 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 15:08:06.440681 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437430 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 15:08:06.440681 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437432 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 15:08:06.440681 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437435 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 15:08:06.440681 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437438 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 15:08:06.440681 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437817 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 15:08:06.440681 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437822 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 15:08:06.440681 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437825 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 15:08:06.440681 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437827 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 15:08:06.441203 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437830 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 05 15:08:06.441203 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437833 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 15:08:06.441203 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437836 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 15:08:06.441203 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437839 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 15:08:06.441203 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437842 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 15:08:06.441203 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437845 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 15:08:06.441203 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437847 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 15:08:06.441203 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437850 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 15:08:06.441203 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437852 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 15:08:06.441203 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437857 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 15:08:06.441203 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437860 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 15:08:06.441203 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437863 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 15:08:06.441203 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437866 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 15:08:06.441203 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437869 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 15:08:06.441203 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437872 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 15:08:06.441203 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437875 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 15:08:06.441203 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437877 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 15:08:06.441203 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437880 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 15:08:06.441203 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437883 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 15:08:06.441663 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437886 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 15:08:06.441663 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437889 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 15:08:06.441663 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437891 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 15:08:06.441663 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437894 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 15:08:06.441663 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437896 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 15:08:06.441663 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437899 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 15:08:06.441663 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437917 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 15:08:06.441663 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437920 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 15:08:06.441663 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437923 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 15:08:06.441663 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437925 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 15:08:06.441663 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437928 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 15:08:06.441663 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437931 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 15:08:06.441663 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437933 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 15:08:06.441663 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437936 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 15:08:06.441663 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437939 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 15:08:06.441663 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437941 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 15:08:06.441663 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437944 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 15:08:06.441663 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437947 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 15:08:06.441663 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437949 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 15:08:06.441663 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437952 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 15:08:06.442190 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437954 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 15:08:06.442190 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437957 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 15:08:06.442190 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437960 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 15:08:06.442190 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437963 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 15:08:06.442190 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437965 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 15:08:06.442190 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437968 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 15:08:06.442190 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437977 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 15:08:06.442190 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437980 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 15:08:06.442190 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437983 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 15:08:06.442190 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437987 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 15:08:06.442190 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437990 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 15:08:06.442190 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437993 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 15:08:06.442190 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437996 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 15:08:06.442190 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.437999 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 15:08:06.442190 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438001 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 15:08:06.442190 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438004 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 15:08:06.442190 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438006 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 15:08:06.442190 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438009 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 15:08:06.442190 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438011 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 15:08:06.442658 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438014 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 15:08:06.442658 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438016 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 15:08:06.442658 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438019 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 15:08:06.442658 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438022 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 15:08:06.442658 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438024 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 15:08:06.442658 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438027 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 15:08:06.442658 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438030 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 15:08:06.442658 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438032 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 15:08:06.442658 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438035 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 15:08:06.442658 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438041 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 15:08:06.442658 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438045 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 15:08:06.442658 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438048 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 15:08:06.442658 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438050 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 15:08:06.442658 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438053 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 15:08:06.442658 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438056 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 15:08:06.442658 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438060 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 15:08:06.442658 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438063 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 15:08:06.442658 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438066 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 15:08:06.442658 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438068 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 15:08:06.443129 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438071 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 15:08:06.443129 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438074 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 15:08:06.443129 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438076 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 15:08:06.443129 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438079 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 15:08:06.443129 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438082 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 15:08:06.443129 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438084 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 15:08:06.443129 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438087 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 15:08:06.443129 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438089 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 15:08:06.443129 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438092 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 15:08:06.443129 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438094 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 15:08:06.443129 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438097 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 15:08:06.443129 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438099 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 15:08:06.443129 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438102 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 15:08:06.443129 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438104 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 15:08:06.443129 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438107 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 15:08:06.443129 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438109 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 15:08:06.443129 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438112 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 15:08:06.443129 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438114 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 15:08:06.443129 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438183 2560 flags.go:64] FLAG: --address="0.0.0.0" Jun 05 15:08:06.443129 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438190 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 05 15:08:06.443129 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438197 2560 flags.go:64] FLAG: --anonymous-auth="true" Jun 05 15:08:06.443656 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438202 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 05 15:08:06.443656 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438208 2560 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 05 15:08:06.443656 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438211 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 05 15:08:06.443656 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438215 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 05 15:08:06.443656 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438219 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 05 15:08:06.443656 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438223 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 05 15:08:06.443656 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438225 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 05 15:08:06.443656 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438229 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 05 15:08:06.443656 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438232 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 05 15:08:06.443656 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438235 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 05 15:08:06.443656 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438238 2560 flags.go:64] FLAG: --cgroup-root="" Jun 05 15:08:06.443656 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438241 2560 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 05 15:08:06.443656 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438244 2560 flags.go:64] FLAG: --client-ca-file="" Jun 05 15:08:06.443656 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438253 2560 flags.go:64] FLAG: --cloud-provider="external" Jun 05 15:08:06.443656 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438257 2560 flags.go:64] FLAG: --cluster-dns="[]" Jun 05 15:08:06.443656 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438263 2560 flags.go:64] FLAG: --cluster-domain="" Jun 05 15:08:06.443656 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438266 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 05 15:08:06.443656 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438269 2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 05 15:08:06.443656 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438272 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 05 15:08:06.443656 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438276 2560 flags.go:64] FLAG: --container-log-max-files="5" Jun 05 15:08:06.443656 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438279 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 05 15:08:06.443656 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438282 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 05 15:08:06.443656 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438286 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 05 15:08:06.444216 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438289 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 05 15:08:06.444216 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438292 2560 flags.go:64] FLAG: --contention-profiling="false" Jun 05 15:08:06.444216 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438295 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 05 15:08:06.444216 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438298 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 05 15:08:06.444216 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438302 2560 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 05 15:08:06.444216 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438305 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 05 15:08:06.444216 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438309 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 05 15:08:06.444216 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438312 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 05 15:08:06.444216 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438315 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 05 15:08:06.444216 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438318 2560 flags.go:64] FLAG: --enable-load-reader="false" Jun 05 15:08:06.444216 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438321 2560 flags.go:64] FLAG: --enable-server="true" Jun 05 15:08:06.444216 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438324 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 05 15:08:06.444216 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438329 2560 flags.go:64] FLAG: --event-burst="100" Jun 05 15:08:06.444216 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438332 2560 flags.go:64] FLAG: --event-qps="50" Jun 05 15:08:06.444216 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438335 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 05 15:08:06.444216 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438338 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 05 15:08:06.444216 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438341 2560 flags.go:64] FLAG: --eviction-hard="" Jun 05 15:08:06.444216 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438344 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 05 15:08:06.444216 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438347 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 05 15:08:06.444216 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438350 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 05 15:08:06.444216 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438353 2560 flags.go:64] FLAG: --eviction-soft="" Jun 05 15:08:06.444216 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438356 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 05 15:08:06.444216 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438360 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 05 15:08:06.444216 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438363 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 05 15:08:06.444216 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438366 2560 flags.go:64] FLAG: --experimental-mounter-path="" Jun 05 15:08:06.444854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438369 2560 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 05 15:08:06.444854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438372 2560 flags.go:64] FLAG: --fail-swap-on="true" Jun 05 15:08:06.444854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438375 2560 flags.go:64] FLAG: --feature-gates="" Jun 05 15:08:06.444854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438378 2560 flags.go:64] FLAG: --file-check-frequency="20s" Jun 05 15:08:06.444854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438381 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 05 15:08:06.444854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438384 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 05 15:08:06.444854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438387 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 05 15:08:06.444854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438390 2560 flags.go:64] FLAG: --healthz-port="10248" Jun 05 15:08:06.444854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438393 2560 flags.go:64] FLAG: --help="false" Jun 05 15:08:06.444854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438397 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-138-97.ec2.internal" Jun 05 15:08:06.444854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438400 2560 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 05 15:08:06.444854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438403 2560 flags.go:64] FLAG: --http-check-frequency="20s" Jun 05 15:08:06.444854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438406 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 05 15:08:06.444854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438409 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 05 15:08:06.444854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438413 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 05 15:08:06.444854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438416 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 05 15:08:06.444854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438419 2560 flags.go:64] FLAG: --image-service-endpoint="" Jun 05 15:08:06.444854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438422 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 05 15:08:06.444854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438424 2560 flags.go:64] FLAG: --kube-api-burst="100" Jun 05 15:08:06.444854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438428 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 05 15:08:06.444854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438431 2560 flags.go:64] FLAG: --kube-api-qps="50" Jun 05 15:08:06.444854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438434 2560 flags.go:64] FLAG: --kube-reserved="" Jun 05 15:08:06.444854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438437 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 05 15:08:06.444854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438440 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 05 15:08:06.445554 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438443 2560 flags.go:64] FLAG: --kubelet-cgroups="" Jun 05 15:08:06.445554 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438446 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 05 15:08:06.445554 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438449 2560 flags.go:64] FLAG: --lock-file="" Jun 05 15:08:06.445554 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438452 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 05 15:08:06.445554 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438455 2560 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 05 15:08:06.445554 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438459 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 05 15:08:06.445554 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438464 2560 flags.go:64] FLAG: --log-json-split-stream="false" Jun 05 15:08:06.445554 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438468 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 05 15:08:06.445554 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438471 2560 flags.go:64] FLAG: --log-text-split-stream="false" Jun 05 15:08:06.445554 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438474 2560 flags.go:64] FLAG: --logging-format="text" Jun 05 15:08:06.445554 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438476 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 05 15:08:06.445554 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438479 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 05 15:08:06.445554 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438482 2560 flags.go:64] FLAG: --manifest-url="" Jun 05 15:08:06.445554 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438485 2560 flags.go:64] FLAG: --manifest-url-header="" Jun 05 15:08:06.445554 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438489 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 05 15:08:06.445554 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438492 2560 flags.go:64] FLAG: --max-open-files="1000000" Jun 05 15:08:06.445554 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438496 2560 flags.go:64] FLAG: --max-pods="110" Jun 05 15:08:06.445554 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438499 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 05 15:08:06.445554 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438502 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 05 15:08:06.445554 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438505 2560 flags.go:64] FLAG: --memory-manager-policy="None" Jun 05 15:08:06.445554 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438507 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 05 15:08:06.445554 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438510 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 05 15:08:06.445554 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438513 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 05 15:08:06.445554 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438516 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 05 15:08:06.445554 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438524 2560 flags.go:64] FLAG: --node-status-max-images="50" Jun 05 15:08:06.446197 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438527 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 05 15:08:06.446197 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438530 2560 flags.go:64] FLAG: --oom-score-adj="-999" Jun 05 15:08:06.446197 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438533 2560 flags.go:64] FLAG: --pod-cidr="" Jun 05 15:08:06.446197 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438536 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 05 15:08:06.446197 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438541 2560 flags.go:64] FLAG: --pod-manifest-path="" Jun 05 15:08:06.446197 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438544 2560 flags.go:64] FLAG: --pod-max-pids="-1" Jun 05 15:08:06.446197 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438547 2560 flags.go:64] FLAG: --pods-per-core="0" Jun 05 15:08:06.446197 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438550 2560 flags.go:64] FLAG: --port="10250" Jun 05 15:08:06.446197 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438553 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 05 15:08:06.446197 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438563 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-005e81f6246b03665" Jun 05 15:08:06.446197 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438567 2560 flags.go:64] FLAG: --qos-reserved="" Jun 05 15:08:06.446197 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438570 2560 flags.go:64] FLAG: --read-only-port="10255" Jun 05 15:08:06.446197 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438573 2560 flags.go:64] FLAG: --register-node="true" Jun 05 15:08:06.446197 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438577 2560 flags.go:64] FLAG: --register-with-taints="" Jun 05 15:08:06.446197 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438581 2560 flags.go:64] FLAG: --registry-burst="10" Jun 05 15:08:06.446197 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438584 2560 flags.go:64] FLAG: --registry-qps="5" Jun 05 15:08:06.446197 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438587 2560 flags.go:64] FLAG: --reserved-cpus="" Jun 05 15:08:06.446197 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438590 2560 flags.go:64] FLAG: --reserved-memory="" Jun 05 15:08:06.446197 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438593 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 05 15:08:06.446197 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438597 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 05 15:08:06.446197 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438600 2560 flags.go:64] FLAG: --rotate-certificates="false" Jun 05 15:08:06.446197 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438602 2560 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 05 15:08:06.446197 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438605 2560 flags.go:64] FLAG: --runonce="false" Jun 05 15:08:06.446197 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438608 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 05 15:08:06.446197 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438611 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 05 15:08:06.446808 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438614 2560 flags.go:64] FLAG: --seccomp-default="false" Jun 05 15:08:06.446808 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438616 2560 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 05 15:08:06.446808 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438619 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 05 15:08:06.446808 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438622 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 05 15:08:06.446808 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438625 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 05 15:08:06.446808 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438628 2560 flags.go:64] FLAG: --storage-driver-password="root" Jun 05 15:08:06.446808 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438631 2560 flags.go:64] FLAG: --storage-driver-secure="false" Jun 05 15:08:06.446808 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438634 2560 flags.go:64] FLAG: --storage-driver-table="stats" Jun 05 15:08:06.446808 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438638 2560 flags.go:64] FLAG: --storage-driver-user="root" Jun 05 15:08:06.446808 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438641 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 05 15:08:06.446808 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438644 2560 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 05 15:08:06.446808 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438646 2560 flags.go:64] FLAG: --system-cgroups="" Jun 05 15:08:06.446808 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438649 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 05 15:08:06.446808 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438654 2560 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 05 15:08:06.446808 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438658 2560 flags.go:64] FLAG: --tls-cert-file="" Jun 05 15:08:06.446808 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438660 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 05 15:08:06.446808 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438664 2560 flags.go:64] FLAG: --tls-min-version="" Jun 05 15:08:06.446808 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438667 2560 flags.go:64] FLAG: --tls-private-key-file="" Jun 05 15:08:06.446808 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438670 2560 flags.go:64] FLAG: --topology-manager-policy="none" Jun 05 15:08:06.446808 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438672 2560 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 05 15:08:06.446808 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438677 2560 flags.go:64] FLAG: --topology-manager-scope="container" Jun 05 15:08:06.446808 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438680 2560 flags.go:64] FLAG: --v="2" Jun 05 15:08:06.446808 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438684 2560 flags.go:64] FLAG: --version="false" Jun 05 15:08:06.446808 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438689 2560 flags.go:64] FLAG: --vmodule="" Jun 05 15:08:06.446808 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438693 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 05 15:08:06.447433 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.438696 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 05 15:08:06.447433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438829 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 15:08:06.447433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438833 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 15:08:06.447433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438836 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 15:08:06.447433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438838 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 15:08:06.447433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438841 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 15:08:06.447433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438845 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 15:08:06.447433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438847 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 15:08:06.447433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438850 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 15:08:06.447433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438853 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 15:08:06.447433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438855 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 15:08:06.447433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438859 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 15:08:06.447433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438863 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 15:08:06.447433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438866 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 15:08:06.447433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438869 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 15:08:06.447433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438872 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 15:08:06.447433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438875 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 15:08:06.447433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438878 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 15:08:06.447433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438881 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 15:08:06.447433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438884 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 15:08:06.447945 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438887 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 15:08:06.447945 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438890 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 15:08:06.447945 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438893 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 15:08:06.447945 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438895 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 15:08:06.447945 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438898 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 15:08:06.447945 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438914 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 15:08:06.447945 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438917 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 15:08:06.447945 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438921 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 15:08:06.447945 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438923 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 15:08:06.447945 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438926 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 15:08:06.447945 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438929 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 15:08:06.447945 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438932 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 15:08:06.447945 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438934 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 15:08:06.447945 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438937 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 15:08:06.447945 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438940 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 15:08:06.447945 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438942 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 15:08:06.447945 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438945 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 15:08:06.447945 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438947 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 15:08:06.447945 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438951 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 15:08:06.447945 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438954 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 15:08:06.448433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438956 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 15:08:06.448433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438959 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 15:08:06.448433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438962 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 15:08:06.448433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438964 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 15:08:06.448433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438967 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 15:08:06.448433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438969 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 15:08:06.448433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438972 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 15:08:06.448433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438975 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 15:08:06.448433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438977 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 15:08:06.448433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438980 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 15:08:06.448433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438983 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 15:08:06.448433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438985 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 15:08:06.448433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438988 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 15:08:06.448433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438990 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 15:08:06.448433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438993 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 15:08:06.448433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438995 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 15:08:06.448433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.438998 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 15:08:06.448433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439002 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 15:08:06.448433 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439006 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 15:08:06.448888 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439009 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 15:08:06.448888 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439013 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 15:08:06.448888 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439016 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 15:08:06.448888 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439019 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 15:08:06.448888 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439022 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 15:08:06.448888 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439025 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 15:08:06.448888 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439027 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 15:08:06.448888 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439030 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 15:08:06.448888 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439032 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 15:08:06.448888 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439035 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 15:08:06.448888 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439037 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 15:08:06.448888 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439042 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 15:08:06.448888 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439045 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 15:08:06.448888 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439047 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 15:08:06.448888 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439050 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 15:08:06.448888 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439052 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 15:08:06.448888 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439055 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 15:08:06.448888 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439057 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 15:08:06.448888 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439060 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 15:08:06.449407 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439062 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 15:08:06.449407 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439065 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 15:08:06.449407 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439067 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 15:08:06.449407 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439070 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 15:08:06.449407 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439073 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 15:08:06.449407 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439075 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 15:08:06.449407 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439078 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 15:08:06.449407 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439080 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 15:08:06.449407 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439083 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 15:08:06.449407 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439085 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 15:08:06.449407 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439088 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 05 15:08:06.449407 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439090 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 15:08:06.449407 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439093 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 15:08:06.449407 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439095 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 15:08:06.449407 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439098 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 15:08:06.449407 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439101 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 15:08:06.449407 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439103 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 15:08:06.449407 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439106 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 15:08:06.449407 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439108 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 15:08:06.449407 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439119 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 15:08:06.449896 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439121 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 15:08:06.449896 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.439124 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 15:08:06.449896 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.439874 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 15:08:06.449896 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.447049 2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 05 15:08:06.449896 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.447067 2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 05 15:08:06.449896 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.447975 2560 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 05 15:08:06.449896 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.447982 2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 05 15:08:06.449896 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448040 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 15:08:06.449896 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448045 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 15:08:06.449896 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448048 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 15:08:06.449896 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448051 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 15:08:06.449896 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448055 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 15:08:06.449896 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448058 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 15:08:06.449896 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448061 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 15:08:06.449896 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448065 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 15:08:06.450291 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448068 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 15:08:06.450291 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448071 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 15:08:06.450291 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448074 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 15:08:06.450291 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448076 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 05 15:08:06.450291 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448081 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 15:08:06.450291 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448084 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 15:08:06.450291 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448088 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 15:08:06.450291 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448091 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 15:08:06.450291 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448093 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 15:08:06.450291 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448096 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 15:08:06.450291 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448099 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 15:08:06.450291 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448102 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 15:08:06.450291 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448105 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 15:08:06.450291 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448109 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 15:08:06.450291 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448112 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 15:08:06.450291 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448115 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 15:08:06.450291 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448118 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 15:08:06.450291 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448121 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 15:08:06.450291 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448124 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 15:08:06.450291 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448127 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 15:08:06.450786 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448130 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 15:08:06.450786 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448134 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 15:08:06.450786 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448137 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 15:08:06.450786 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448139 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 15:08:06.450786 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448142 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 15:08:06.450786 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448145 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 15:08:06.450786 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448148 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 15:08:06.450786 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448150 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 15:08:06.450786 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448153 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 15:08:06.450786 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448156 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 15:08:06.450786 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448158 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 15:08:06.450786 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448161 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 15:08:06.450786 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448163 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 15:08:06.450786 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448166 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 15:08:06.450786 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448170 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 15:08:06.450786 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448174 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 15:08:06.450786 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448177 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 15:08:06.450786 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448180 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 15:08:06.450786 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448183 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 15:08:06.450786 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448185 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 15:08:06.451292 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448188 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 15:08:06.451292 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448190 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 15:08:06.451292 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448193 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 15:08:06.451292 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448195 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 15:08:06.451292 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448198 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 15:08:06.451292 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448201 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 15:08:06.451292 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448204 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 15:08:06.451292 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448206 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 15:08:06.451292 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448209 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 15:08:06.451292 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448213 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 15:08:06.451292 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448216 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 15:08:06.451292 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448219 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 15:08:06.451292 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448221 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 15:08:06.451292 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448225 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 15:08:06.451292 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448228 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 15:08:06.451292 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448230 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 15:08:06.451292 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448233 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 15:08:06.451292 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448236 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 15:08:06.451292 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448238 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 15:08:06.451292 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448241 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 15:08:06.451783 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448243 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 15:08:06.451783 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448246 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 15:08:06.451783 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448248 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 15:08:06.451783 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448251 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 15:08:06.451783 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448255 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 15:08:06.451783 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448258 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 15:08:06.451783 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448261 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 15:08:06.451783 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448264 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 15:08:06.451783 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448267 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 15:08:06.451783 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448269 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 15:08:06.451783 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448272 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 15:08:06.451783 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448275 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 15:08:06.451783 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448277 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 15:08:06.451783 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448280 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 15:08:06.451783 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448283 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 15:08:06.451783 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448285 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 15:08:06.451783 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448288 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 15:08:06.451783 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448290 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 15:08:06.451783 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448293 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 15:08:06.452272 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448296 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 15:08:06.452272 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448299 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 15:08:06.452272 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448301 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 15:08:06.452272 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448304 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 15:08:06.452272 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448306 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 15:08:06.452272 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448309 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 15:08:06.452272 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448312 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 15:08:06.452272 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448315 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 15:08:06.452272 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448318 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 15:08:06.452272 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448320 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 15:08:06.452272 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448323 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 15:08:06.452272 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448325 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 15:08:06.452272 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.448330 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 15:08:06.452272 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448447 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 15:08:06.452272 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448451 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 15:08:06.452645 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448454 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 15:08:06.452645 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448457 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 15:08:06.452645 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448460 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 15:08:06.452645 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448463 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 15:08:06.452645 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448466 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 15:08:06.452645 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448469 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 15:08:06.452645 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448472 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 15:08:06.452645 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448474 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 15:08:06.452645 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448477 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 15:08:06.452645 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448480 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 15:08:06.452645 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448483 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 15:08:06.452645 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448485 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 15:08:06.452645 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448488 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 15:08:06.452645 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448490 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 15:08:06.452645 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448493 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 15:08:06.452645 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448496 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 15:08:06.452645 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448498 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 15:08:06.452645 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448501 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 15:08:06.452645 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448503 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 15:08:06.452645 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448506 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 15:08:06.453276 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448508 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 15:08:06.453276 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448511 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 15:08:06.453276 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448513 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 15:08:06.453276 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448516 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 15:08:06.453276 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448519 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 15:08:06.453276 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448521 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 15:08:06.453276 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448524 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 15:08:06.453276 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448527 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 15:08:06.453276 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448529 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 15:08:06.453276 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448532 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 15:08:06.453276 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448535 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 15:08:06.453276 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448537 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 15:08:06.453276 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448539 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 15:08:06.453276 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448542 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 15:08:06.453276 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448544 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 15:08:06.453276 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448547 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 15:08:06.453276 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448549 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 15:08:06.453276 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448552 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 15:08:06.453276 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448554 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 15:08:06.453276 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448556 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 15:08:06.453757 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448559 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 15:08:06.453757 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448562 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 15:08:06.453757 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448564 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 15:08:06.453757 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448567 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 15:08:06.453757 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448570 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 15:08:06.453757 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448572 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 15:08:06.453757 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448576 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 15:08:06.453757 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448580 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 15:08:06.453757 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448583 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 15:08:06.453757 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448585 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 15:08:06.453757 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448588 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 15:08:06.453757 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448591 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 15:08:06.453757 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448593 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 15:08:06.453757 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448596 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 15:08:06.453757 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448598 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 15:08:06.453757 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448601 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 15:08:06.453757 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448603 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 15:08:06.453757 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448606 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 15:08:06.453757 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448608 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 15:08:06.454314 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448611 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 15:08:06.454314 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448614 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 15:08:06.454314 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448616 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 15:08:06.454314 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448620 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 15:08:06.454314 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448623 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 15:08:06.454314 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448626 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 15:08:06.454314 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448629 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 15:08:06.454314 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448631 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 15:08:06.454314 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448634 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 15:08:06.454314 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448636 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 15:08:06.454314 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448639 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 15:08:06.454314 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448641 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 05 15:08:06.454314 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448644 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 15:08:06.454314 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448647 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 15:08:06.454314 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448650 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 15:08:06.454314 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448654 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 15:08:06.454314 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448656 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 15:08:06.454314 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448659 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 15:08:06.454314 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448662 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 15:08:06.454816 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448665 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 15:08:06.454816 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448667 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 15:08:06.454816 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448670 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 15:08:06.454816 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448672 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 15:08:06.454816 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448674 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 15:08:06.454816 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448677 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 15:08:06.454816 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448680 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 15:08:06.454816 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448682 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 15:08:06.454816 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448685 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 15:08:06.454816 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448688 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 15:08:06.454816 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448691 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 15:08:06.454816 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448693 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 15:08:06.454816 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448696 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 15:08:06.454816 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448698 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 15:08:06.454816 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448701 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 15:08:06.454816 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448704 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 15:08:06.454816 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448707 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 15:08:06.454816 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448709 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 15:08:06.454816 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:06.448711 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 15:08:06.455578 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.448717 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 15:08:06.455578 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.448818 2560 server.go:962] "Client rotation is on, will bootstrap in background" Jun 05 15:08:06.455578 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.451143 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 05 15:08:06.455578 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.452891 2560 server.go:1019] "Starting client certificate rotation" Jun 05 15:08:06.455578 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.453022 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 15:08:06.455578 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.453064 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 15:08:06.455837 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.455753 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 15:08:06.458735 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.458670 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 15:08:06.468146 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.468127 2560 log.go:25] "Validated CRI v1 runtime API" Jun 05 15:08:06.471315 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.471296 2560 log.go:25] "Validated CRI v1 image API" Jun 05 15:08:06.472211 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.472191 2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 05 15:08:06.474765 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.474742 2560 fs.go:135] Filesystem UUIDs: map[2592175d-35f4-47ab-8742-d94260a7275d:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 abb46342-251c-4961-a1d4-8975afb3d953:/dev/nvme0n1p4] Jun 05 15:08:06.474860 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.474763 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 05 15:08:06.480047 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.479930 2560 manager.go:216] Machine: {Timestamp:2026-06-05 15:08:06.478473755 +0000 UTC m=+0.373991847 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100637 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e1930833c253b7a165633803dd479 SystemUUID:ec2e1930-833c-253b-7a16-5633803dd479 BootID:82ac710a-e819-478b-8784-959212d563fc Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4c:18:f7:0e:d9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4c:18:f7:0e:d9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:06:b4:a8:9e:98 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 05 15:08:06.480047 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.480034 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 05 15:08:06.480198 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.480140 2560 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 05 15:08:06.482914 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.482875 2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 05 15:08:06.483045 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.482917 2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-97.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 05 15:08:06.483343 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.483325 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 15:08:06.483810 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.483798 2560 topology_manager.go:138] "Creating topology manager with none policy" Jun 05 15:08:06.483852 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.483812 2560 container_manager_linux.go:309] "Creating device plugin manager" Jun 05 15:08:06.483852 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.483820 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 15:08:06.483852 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.483836 2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 15:08:06.485138 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.485128 2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 05 15:08:06.489497 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.489485 2560 state_mem.go:36] "Initialized new in-memory state store" Jun 05 15:08:06.489616 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.489606 2560 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 05 15:08:06.489650 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.489636 2560 kubelet.go:486] "Attempting to sync node with API server" Jun 05 15:08:06.489650 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.489646 2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 05 15:08:06.489704 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.489658 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 05 15:08:06.489704 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.489667 2560 kubelet.go:398] "Adding apiserver pod source" Jun 05 15:08:06.489704 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.489676 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 05 15:08:06.490203 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.490038 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 15:08:06.490203 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.490056 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 15:08:06.492652 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.492628 2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 05 15:08:06.494513 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.494499 2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 05 15:08:06.494580 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.494529 2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 05 15:08:06.495253 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.495241 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 05 15:08:06.495288 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.495257 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 05 15:08:06.495288 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.495264 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 05 15:08:06.495288 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.495269 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 05 15:08:06.495288 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.495277 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 05 15:08:06.495288 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.495282 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 05 15:08:06.495435 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.495426 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 05 15:08:06.495435 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.495435 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 05 15:08:06.495488 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.495442 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 05 15:08:06.495488 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.495448 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 05 15:08:06.495488 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.495456 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 05 15:08:06.495488 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.495463 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 05 15:08:06.496335 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.496326 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 05 15:08:06.496335 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.496335 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 05 15:08:06.499778 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:06.499757 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 05 15:08:06.499778 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:06.499759 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-97.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 05 15:08:06.499882 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.499797 2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-97.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 05 15:08:06.499882 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.499826 2560 server.go:1268] "Started kubelet" Jun 05 15:08:06.499991 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.499945 2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 05 15:08:06.500045 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.500010 2560 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 05 15:08:06.500129 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.499919 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 05 15:08:06.504842 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.504519 2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 05 15:08:06.504829 ip-10-0-138-97 systemd[1]: Started Kubernetes Kubelet. Jun 05 15:08:06.507543 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.507522 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vl259" Jun 05 15:08:06.508620 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.508601 2560 server.go:310] "Adding debug handlers to kubelet server" Jun 05 15:08:06.508845 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:06.508830 2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 05 15:08:06.509389 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:06.508222 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-97.ec2.internal.18b637d4094653b0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-97.ec2.internal,UID:ip-10-0-138-97.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-97.ec2.internal,},FirstTimestamp:2026-06-05 15:08:06.499808176 +0000 UTC m=+0.395326267,LastTimestamp:2026-06-05 15:08:06.499808176 +0000 UTC m=+0.395326267,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-97.ec2.internal,}" Jun 05 15:08:06.513026 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.513007 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vl259" Jun 05 15:08:06.514502 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.514481 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 05 15:08:06.514502 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.514486 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 05 15:08:06.514658 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:06.514567 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-97.ec2.internal\" not found" Jun 05 15:08:06.515086 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.515070 2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 05 15:08:06.515223 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.515069 2560 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 05 15:08:06.515223 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.515226 2560 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 05 15:08:06.515361 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.515293 2560 factory.go:55] Registering systemd factory Jun 05 15:08:06.515361 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.515332 2560 factory.go:223] Registration of the systemd container factory successfully Jun 05 15:08:06.515361 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.515336 2560 reconstruct.go:97] "Volume reconstruction finished" Jun 05 15:08:06.515361 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.515345 2560 reconciler.go:29] "Reconciler: start to sync state" Jun 05 15:08:06.515601 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.515588 2560 factory.go:153] Registering CRI-O factory Jun 05 15:08:06.515664 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.515604 2560 factory.go:223] Registration of the crio container factory successfully Jun 05 15:08:06.515711 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.515673 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 05 15:08:06.515711 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.515697 2560 factory.go:103] Registering Raw factory Jun 05 15:08:06.515820 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.515714 2560 manager.go:1196] Started watching for new ooms in manager Jun 05 15:08:06.516148 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.516129 2560 manager.go:349] Starting recovery of all containers Jun 05 15:08:06.524097 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.524075 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 15:08:06.525700 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.525684 2560 manager.go:354] Recovery completed Jun 05 15:08:06.527625 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:06.527609 2560 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-97.ec2.internal\" not found" node="ip-10-0-138-97.ec2.internal" Jun 05 15:08:06.530467 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.530451 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 15:08:06.532275 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.532256 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-97.ec2.internal" event="NodeHasSufficientMemory" Jun 05 15:08:06.532340 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.532291 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-97.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 15:08:06.532340 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.532307 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-97.ec2.internal" event="NodeHasSufficientPID" Jun 05 15:08:06.532948 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.532933 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 15:08:06.532948 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.532942 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 05 15:08:06.533090 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.532958 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 05 15:08:06.533090 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.532979 2560 state_mem.go:36] "Initialized new in-memory state store" Jun 05 15:08:06.533657 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.533638 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-97.ec2.internal" event="NodeHasSufficientMemory" Jun 05 15:08:06.533715 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.533667 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-97.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 15:08:06.533715 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.533678 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-97.ec2.internal" event="NodeHasSufficientPID" Jun 05 15:08:06.535162 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.535151 2560 policy_none.go:49] "None policy: Start" Jun 05 15:08:06.535205 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.535166 2560 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 05 15:08:06.535205 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.535177 2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 05 15:08:06.536864 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.536854 2560 policy_none.go:47] "Start" Jun 05 15:08:06.571485 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.571466 2560 manager.go:337] "Starting Device Plugin manager" Jun 05 15:08:06.571589 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:06.571501 2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 05 15:08:06.571589 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.571511 2560 server.go:87] "Starting device plugin registration server" Jun 05 15:08:06.571806 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.571789 2560 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 05 15:08:06.571927 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.571805 2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 05 15:08:06.572145 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.572015 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 05 15:08:06.572145 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.572096 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 05 15:08:06.572145 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.572104 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 05 15:08:06.573102 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:06.573056 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 05 15:08:06.595834 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:06.573112 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-97.ec2.internal\" not found" Jun 05 15:08:06.595834 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.589268 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 05 15:08:06.595834 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.590433 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 05 15:08:06.595834 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.590463 2560 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 05 15:08:06.595834 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.590482 2560 kubelet.go:2448] "Starting kubelet main sync loop" Jun 05 15:08:06.595834 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:06.590583 2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 05 15:08:06.595834 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.592717 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 15:08:06.672894 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.672868 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 15:08:06.673984 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.673966 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-97.ec2.internal" event="NodeHasSufficientMemory" Jun 05 15:08:06.674072 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.674006 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-97.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 15:08:06.674072 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.674020 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-97.ec2.internal" event="NodeHasSufficientPID" Jun 05 15:08:06.674072 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.674052 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-97.ec2.internal" Jun 05 15:08:06.681983 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.681933 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-97.ec2.internal" Jun 05 15:08:06.681983 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:06.681957 2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-97.ec2.internal\": node \"ip-10-0-138-97.ec2.internal\" not found" Jun 05 15:08:06.690967 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.690936 2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-97.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-97.ec2.internal"] Jun 05 15:08:06.691044 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.691007 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 15:08:06.691695 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.691680 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-97.ec2.internal" event="NodeHasSufficientMemory" Jun 05 15:08:06.691751 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.691707 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-97.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 15:08:06.691751 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.691717 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-97.ec2.internal" event="NodeHasSufficientPID" Jun 05 15:08:06.694215 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.694203 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 15:08:06.694340 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.694326 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-97.ec2.internal" Jun 05 15:08:06.694377 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.694357 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 15:08:06.695798 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.695785 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-97.ec2.internal" event="NodeHasSufficientMemory" Jun 05 15:08:06.695859 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.695796 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-97.ec2.internal" event="NodeHasSufficientMemory" Jun 05 15:08:06.695859 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.695812 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-97.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 15:08:06.695859 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.695817 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-97.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 15:08:06.695859 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.695826 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-97.ec2.internal" event="NodeHasSufficientPID" Jun 05 15:08:06.695859 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.695830 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-97.ec2.internal" event="NodeHasSufficientPID" Jun 05 15:08:06.696327 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:06.696309 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-97.ec2.internal\" not found" Jun 05 15:08:06.698055 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.698040 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-97.ec2.internal" Jun 05 15:08:06.698156 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.698063 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 15:08:06.698881 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.698863 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-97.ec2.internal" event="NodeHasSufficientMemory" Jun 05 15:08:06.698967 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.698887 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-97.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 15:08:06.698967 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.698897 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-97.ec2.internal" event="NodeHasSufficientPID" Jun 05 15:08:06.719627 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:06.719605 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-97.ec2.internal\" not found" node="ip-10-0-138-97.ec2.internal" Jun 05 15:08:06.724148 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:06.724131 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-97.ec2.internal\" not found" node="ip-10-0-138-97.ec2.internal" Jun 05 15:08:06.796618 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:06.796585 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-97.ec2.internal\" not found" Jun 05 15:08:06.816602 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.816584 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/662b71b6c5497bdd12105b5f3133c1f7-config\") pod \"kube-apiserver-proxy-ip-10-0-138-97.ec2.internal\" (UID: \"662b71b6c5497bdd12105b5f3133c1f7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-97.ec2.internal" Jun 05 15:08:06.816688 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.816609 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/917b11840b3884a42d5a7e3a3cc7879e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-97.ec2.internal\" (UID: \"917b11840b3884a42d5a7e3a3cc7879e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-97.ec2.internal" Jun 05 15:08:06.816688 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.816628 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/917b11840b3884a42d5a7e3a3cc7879e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-97.ec2.internal\" (UID: \"917b11840b3884a42d5a7e3a3cc7879e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-97.ec2.internal" Jun 05 15:08:06.896862 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:06.896833 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-97.ec2.internal\" not found" Jun 05 15:08:06.917196 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.917160 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/662b71b6c5497bdd12105b5f3133c1f7-config\") pod \"kube-apiserver-proxy-ip-10-0-138-97.ec2.internal\" (UID: \"662b71b6c5497bdd12105b5f3133c1f7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-97.ec2.internal" Jun 05 15:08:06.917285 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.917214 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/662b71b6c5497bdd12105b5f3133c1f7-config\") pod \"kube-apiserver-proxy-ip-10-0-138-97.ec2.internal\" (UID: \"662b71b6c5497bdd12105b5f3133c1f7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-97.ec2.internal" Jun 05 15:08:06.917285 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.917248 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/917b11840b3884a42d5a7e3a3cc7879e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-97.ec2.internal\" (UID: \"917b11840b3884a42d5a7e3a3cc7879e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-97.ec2.internal" Jun 05 15:08:06.917285 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.917220 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/917b11840b3884a42d5a7e3a3cc7879e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-97.ec2.internal\" (UID: \"917b11840b3884a42d5a7e3a3cc7879e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-97.ec2.internal" Jun 05 15:08:06.917285 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.917283 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/917b11840b3884a42d5a7e3a3cc7879e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-97.ec2.internal\" (UID: \"917b11840b3884a42d5a7e3a3cc7879e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-97.ec2.internal" Jun 05 15:08:06.917422 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:06.917309 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/917b11840b3884a42d5a7e3a3cc7879e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-97.ec2.internal\" (UID: \"917b11840b3884a42d5a7e3a3cc7879e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-97.ec2.internal" Jun 05 15:08:06.997593 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:06.997540 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-97.ec2.internal\" not found" Jun 05 15:08:07.026966 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:07.026949 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-97.ec2.internal" Jun 05 15:08:07.031344 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:07.030959 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-97.ec2.internal" Jun 05 15:08:07.098334 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:07.098310 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-97.ec2.internal\" not found" Jun 05 15:08:07.198807 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:07.198785 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-97.ec2.internal\" not found" Jun 05 15:08:07.299303 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:07.299256 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-97.ec2.internal\" not found" Jun 05 15:08:07.399836 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:07.399814 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-97.ec2.internal\" not found" Jun 05 15:08:07.452339 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:07.452319 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 05 15:08:07.452936 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:07.452462 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 15:08:07.452936 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:07.452483 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 15:08:07.500764 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:07.500745 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-97.ec2.internal\" not found" Jun 05 15:08:07.517488 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:07.517456 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-04 15:03:06 +0000 UTC" deadline="2028-02-15 19:21:46.002736284 +0000 UTC" Jun 05 15:08:07.517488 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:07.517482 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14884h13m38.485257147s" Jun 05 15:08:07.601340 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:07.601290 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-97.ec2.internal\" not found" Jun 05 15:08:07.627158 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:07.627134 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod662b71b6c5497bdd12105b5f3133c1f7.slice/crio-bc69cca368fd2733c4bd61771cf6ddcf8e8b9b603dc8fdec6be24bb8f4b3efe5 WatchSource:0}: Error finding container bc69cca368fd2733c4bd61771cf6ddcf8e8b9b603dc8fdec6be24bb8f4b3efe5: Status 404 returned error can't find the container with id bc69cca368fd2733c4bd61771cf6ddcf8e8b9b603dc8fdec6be24bb8f4b3efe5 Jun 05 15:08:07.627486 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:07.627467 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod917b11840b3884a42d5a7e3a3cc7879e.slice/crio-281eb4fa101d278b2e3d711a6484349504317090d4e7ec16e41fbceec0aa63e4 WatchSource:0}: Error finding container 281eb4fa101d278b2e3d711a6484349504317090d4e7ec16e41fbceec0aa63e4: Status 404 returned error can't find the container with id 281eb4fa101d278b2e3d711a6484349504317090d4e7ec16e41fbceec0aa63e4 Jun 05 15:08:07.633370 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:07.633357 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 15:08:07.702071 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:07.702046 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-97.ec2.internal\" not found" Jun 05 15:08:07.802604 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:07.802576 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-97.ec2.internal\" not found" Jun 05 15:08:07.863496 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:07.863442 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 15:08:07.915465 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:07.915445 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-97.ec2.internal" Jun 05 15:08:07.931872 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:07.931857 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 15:08:07.933951 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:07.933939 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-97.ec2.internal" Jun 05 15:08:07.942132 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:07.942119 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 15:08:07.977952 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:07.977933 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 15:08:08.416248 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.416221 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 15:08:08.491671 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.491628 2560 apiserver.go:52] "Watching apiserver" Jun 05 15:08:08.506670 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.506645 2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 05 15:08:08.508241 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.508153 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-97.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xkmsq","openshift-cluster-node-tuning-operator/tuned-6t5jj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-97.ec2.internal","openshift-network-diagnostics/network-check-target-wz2bw","openshift-ovn-kubernetes/ovnkube-node-c7wnx","kube-system/global-pull-secret-syncer-rmrn7","openshift-dns/node-resolver-69xsz","openshift-image-registry/node-ca-2nrvs","openshift-multus/multus-additional-cni-plugins-jqpvb","openshift-multus/multus-njqmz","openshift-multus/network-metrics-daemon-j2lpj","openshift-network-operator/iptables-alerter-j8kft","kube-system/konnectivity-agent-chbh5"] Jun 05 15:08:08.510978 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.510951 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jqpvb" Jun 05 15:08:08.513182 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.513160 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j8kft" Jun 05 15:08:08.514615 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.514595 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 05 15:08:08.514716 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.514618 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 05 15:08:08.514716 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.514600 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 05 15:08:08.514716 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.514684 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-l9r5g\"" Jun 05 15:08:08.514867 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.514816 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 05 15:08:08.514934 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.514923 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 05 15:08:08.515194 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.515177 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.515332 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.515315 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ppz4v\"" Jun 05 15:08:08.515579 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.515557 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 05 15:08:08.515724 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.515708 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 05 15:08:08.515795 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.515724 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 05 15:08:08.515849 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.515835 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 05 15:08:08.517184 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.517165 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-chbh5" Jun 05 15:08:08.517948 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.517929 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 05 15:08:08.518045 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.518033 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vcqqn\"" Jun 05 15:08:08.518130 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.518115 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 05 15:08:08.519484 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.519465 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 05 15:08:08.519706 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.519691 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dfpts\"" Jun 05 15:08:08.519782 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.519766 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wz2bw" Jun 05 15:08:08.520127 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:08.519827 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wz2bw" podUID="dc87e3e2-2e9f-405d-9aa5-a7c444528874" Jun 05 15:08:08.520127 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.519876 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 05 15:08:08.521656 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.521639 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.524134 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.524113 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2nrvs" Jun 05 15:08:08.524321 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.524305 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 05 15:08:08.524446 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.524434 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 05 15:08:08.524503 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.524485 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 05 15:08:08.525410 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.525388 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 05 15:08:08.525501 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.525415 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 05 15:08:08.525557 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.525415 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-g979n\"" Jun 05 15:08:08.525557 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.525519 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 05 15:08:08.525651 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.525633 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/95d1fafb-0436-4863-a157-1d3776569b4d-etc-sysconfig\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.525703 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.525659 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/95d1fafb-0436-4863-a157-1d3776569b4d-run\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.525703 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.525686 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcb9g\" (UniqueName: \"kubernetes.io/projected/2a40ce2e-4726-44e7-aea3-0278d610c96d-kube-api-access-wcb9g\") pod \"multus-additional-cni-plugins-jqpvb\" (UID: \"2a40ce2e-4726-44e7-aea3-0278d610c96d\") " pod="openshift-multus/multus-additional-cni-plugins-jqpvb" Jun 05 15:08:08.525803 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.525720 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2a40ce2e-4726-44e7-aea3-0278d610c96d-os-release\") pod \"multus-additional-cni-plugins-jqpvb\" (UID: \"2a40ce2e-4726-44e7-aea3-0278d610c96d\") " pod="openshift-multus/multus-additional-cni-plugins-jqpvb" Jun 05 15:08:08.525803 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.525749 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2a40ce2e-4726-44e7-aea3-0278d610c96d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jqpvb\" (UID: \"2a40ce2e-4726-44e7-aea3-0278d610c96d\") " pod="openshift-multus/multus-additional-cni-plugins-jqpvb" Jun 05 15:08:08.525803 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.525788 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95d1fafb-0436-4863-a157-1d3776569b4d-var-lib-kubelet\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.525972 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.525813 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95d1fafb-0436-4863-a157-1d3776569b4d-etc-kubernetes\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.525972 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.525829 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/95d1fafb-0436-4863-a157-1d3776569b4d-etc-sysctl-d\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.525972 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.525857 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/95d1fafb-0436-4863-a157-1d3776569b4d-etc-systemd\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.525972 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.525880 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjtpp\" (UniqueName: \"kubernetes.io/projected/95d1fafb-0436-4863-a157-1d3776569b4d-kube-api-access-gjtpp\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.525972 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.525924 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2a40ce2e-4726-44e7-aea3-0278d610c96d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jqpvb\" (UID: \"2a40ce2e-4726-44e7-aea3-0278d610c96d\") " pod="openshift-multus/multus-additional-cni-plugins-jqpvb" Jun 05 15:08:08.526209 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.526012 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95d1fafb-0436-4863-a157-1d3776569b4d-lib-modules\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.526209 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.526037 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95d1fafb-0436-4863-a157-1d3776569b4d-tmp\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.526209 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.526079 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2a40ce2e-4726-44e7-aea3-0278d610c96d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jqpvb\" (UID: \"2a40ce2e-4726-44e7-aea3-0278d610c96d\") " pod="openshift-multus/multus-additional-cni-plugins-jqpvb" Jun 05 15:08:08.526209 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.526107 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fad1c381-03d0-4779-8116-f8537742c2a4-host-slash\") pod \"iptables-alerter-j8kft\" (UID: \"fad1c381-03d0-4779-8116-f8537742c2a4\") " pod="openshift-network-operator/iptables-alerter-j8kft" Jun 05 15:08:08.526209 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.526131 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chdst\" (UniqueName: \"kubernetes.io/projected/fad1c381-03d0-4779-8116-f8537742c2a4-kube-api-access-chdst\") pod \"iptables-alerter-j8kft\" (UID: \"fad1c381-03d0-4779-8116-f8537742c2a4\") " pod="openshift-network-operator/iptables-alerter-j8kft" Jun 05 15:08:08.526209 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.526168 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95d1fafb-0436-4863-a157-1d3776569b4d-host\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.526209 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.526191 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/95d1fafb-0436-4863-a157-1d3776569b4d-etc-modprobe-d\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.526525 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.526214 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/95d1fafb-0436-4863-a157-1d3776569b4d-etc-sysctl-conf\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.526525 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.526254 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bf33dc4e-b571-415e-817d-e1985a4f656a-agent-certs\") pod \"konnectivity-agent-chbh5\" (UID: \"bf33dc4e-b571-415e-817d-e1985a4f656a\") " pod="kube-system/konnectivity-agent-chbh5" Jun 05 15:08:08.526525 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.526276 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95d1fafb-0436-4863-a157-1d3776569b4d-sys\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.526525 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.526328 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a40ce2e-4726-44e7-aea3-0278d610c96d-system-cni-dir\") pod \"multus-additional-cni-plugins-jqpvb\" (UID: \"2a40ce2e-4726-44e7-aea3-0278d610c96d\") " pod="openshift-multus/multus-additional-cni-plugins-jqpvb" Jun 05 15:08:08.526525 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.526352 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2a40ce2e-4726-44e7-aea3-0278d610c96d-cnibin\") pod \"multus-additional-cni-plugins-jqpvb\" (UID: \"2a40ce2e-4726-44e7-aea3-0278d610c96d\") " pod="openshift-multus/multus-additional-cni-plugins-jqpvb" Jun 05 15:08:08.526525 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.526392 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fad1c381-03d0-4779-8116-f8537742c2a4-iptables-alerter-script\") pod \"iptables-alerter-j8kft\" (UID: \"fad1c381-03d0-4779-8116-f8537742c2a4\") " pod="openshift-network-operator/iptables-alerter-j8kft" Jun 05 15:08:08.526525 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.526416 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/95d1fafb-0436-4863-a157-1d3776569b4d-etc-tuned\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.526525 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.526470 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bf33dc4e-b571-415e-817d-e1985a4f656a-konnectivity-ca\") pod \"konnectivity-agent-chbh5\" (UID: \"bf33dc4e-b571-415e-817d-e1985a4f656a\") " pod="kube-system/konnectivity-agent-chbh5" Jun 05 15:08:08.526525 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.526496 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2a40ce2e-4726-44e7-aea3-0278d610c96d-cni-binary-copy\") pod \"multus-additional-cni-plugins-jqpvb\" (UID: \"2a40ce2e-4726-44e7-aea3-0278d610c96d\") " pod="openshift-multus/multus-additional-cni-plugins-jqpvb" Jun 05 15:08:08.526963 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.526608 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rmrn7" Jun 05 15:08:08.526963 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:08.526662 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rmrn7" podUID="70a59546-d9b0-43b7-aa6c-72d294856aed" Jun 05 15:08:08.527065 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.527031 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-l7kml\"" Jun 05 15:08:08.527244 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.527227 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 05 15:08:08.527310 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.527267 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 15:08:08.527492 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.527476 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 05 15:08:08.527553 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.527519 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 05 15:08:08.528852 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.528832 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xkmsq" Jun 05 15:08:08.531195 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.531140 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gk2n4\"" Jun 05 15:08:08.531195 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.531157 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 05 15:08:08.531195 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.531161 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 05 15:08:08.531438 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.531338 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-69xsz" Jun 05 15:08:08.531685 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.531665 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 05 15:08:08.534443 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.533891 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.536559 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.536525 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 05 15:08:08.536794 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.536779 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6vvnd\"" Jun 05 15:08:08.536843 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.536832 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 05 15:08:08.537276 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.537258 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-n4mfh\"" Jun 05 15:08:08.537447 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.537365 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 05 15:08:08.541192 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.541142 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lpj" Jun 05 15:08:08.541315 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:08.541292 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2lpj" podUID="9137360a-945f-4be7-a6da-25d3be6241fa" Jun 05 15:08:08.551400 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.551379 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-z9zzn" Jun 05 15:08:08.558463 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.558429 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-z9zzn" Jun 05 15:08:08.595085 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.595036 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-97.ec2.internal" event={"ID":"917b11840b3884a42d5a7e3a3cc7879e","Type":"ContainerStarted","Data":"281eb4fa101d278b2e3d711a6484349504317090d4e7ec16e41fbceec0aa63e4"} Jun 05 15:08:08.596274 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.596228 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-97.ec2.internal" event={"ID":"662b71b6c5497bdd12105b5f3133c1f7","Type":"ContainerStarted","Data":"bc69cca368fd2733c4bd61771cf6ddcf8e8b9b603dc8fdec6be24bb8f4b3efe5"} Jun 05 15:08:08.617173 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.617153 2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 05 15:08:08.626935 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.626895 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/70a59546-d9b0-43b7-aa6c-72d294856aed-dbus\") pod \"global-pull-secret-syncer-rmrn7\" (UID: \"70a59546-d9b0-43b7-aa6c-72d294856aed\") " pod="kube-system/global-pull-secret-syncer-rmrn7" Jun 05 15:08:08.627022 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.626946 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cc603818-b45b-4274-b792-47b121c133a7-serviceca\") pod \"node-ca-2nrvs\" (UID: \"cc603818-b45b-4274-b792-47b121c133a7\") " pod="openshift-image-registry/node-ca-2nrvs" Jun 05 15:08:08.627022 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.626973 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8be0d1c2-caab-4e33-beca-14b2a59dd3f6-registration-dir\") pod \"aws-ebs-csi-driver-node-xkmsq\" (UID: \"8be0d1c2-caab-4e33-beca-14b2a59dd3f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xkmsq" Jun 05 15:08:08.627022 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.626997 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3e51389e-8fe0-48a4-b902-493bfa632cf8-env-overrides\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.627176 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.627052 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlxf2\" (UniqueName: \"kubernetes.io/projected/3e51389e-8fe0-48a4-b902-493bfa632cf8-kube-api-access-vlxf2\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.627176 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.627095 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70a59546-d9b0-43b7-aa6c-72d294856aed-original-pull-secret\") pod \"global-pull-secret-syncer-rmrn7\" (UID: \"70a59546-d9b0-43b7-aa6c-72d294856aed\") " pod="kube-system/global-pull-secret-syncer-rmrn7" Jun 05 15:08:08.627176 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.627119 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e8542cc3-5226-41a3-b049-76c6e0aafd54-multus-daemon-config\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.627176 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.627142 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s68l6\" (UniqueName: \"kubernetes.io/projected/dc87e3e2-2e9f-405d-9aa5-a7c444528874-kube-api-access-s68l6\") pod \"network-check-target-wz2bw\" (UID: \"dc87e3e2-2e9f-405d-9aa5-a7c444528874\") " pod="openshift-network-diagnostics/network-check-target-wz2bw" Jun 05 15:08:08.627176 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.627170 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2a40ce2e-4726-44e7-aea3-0278d610c96d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jqpvb\" (UID: \"2a40ce2e-4726-44e7-aea3-0278d610c96d\") " pod="openshift-multus/multus-additional-cni-plugins-jqpvb" Jun 05 15:08:08.627393 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.627192 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/95d1fafb-0436-4863-a157-1d3776569b4d-etc-sysctl-d\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.627393 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.627214 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/95d1fafb-0436-4863-a157-1d3776569b4d-etc-systemd\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.627393 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.627237 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjtpp\" (UniqueName: \"kubernetes.io/projected/95d1fafb-0436-4863-a157-1d3776569b4d-kube-api-access-gjtpp\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.627393 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.627258 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-multus-cni-dir\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.627393 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.627278 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-host-var-lib-cni-multus\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.627634 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.627330 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-etc-kubernetes\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.627634 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.627601 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9137360a-945f-4be7-a6da-25d3be6241fa-metrics-certs\") pod \"network-metrics-daemon-j2lpj\" (UID: \"9137360a-945f-4be7-a6da-25d3be6241fa\") " pod="openshift-multus/network-metrics-daemon-j2lpj" Jun 05 15:08:08.627715 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.627634 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95d1fafb-0436-4863-a157-1d3776569b4d-lib-modules\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.627715 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.627355 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/95d1fafb-0436-4863-a157-1d3776569b4d-etc-sysctl-d\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.627715 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.627479 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/95d1fafb-0436-4863-a157-1d3776569b4d-etc-systemd\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.627715 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.627662 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2a40ce2e-4726-44e7-aea3-0278d610c96d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jqpvb\" (UID: \"2a40ce2e-4726-44e7-aea3-0278d610c96d\") " pod="openshift-multus/multus-additional-cni-plugins-jqpvb" Jun 05 15:08:08.627715 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.627706 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chdst\" (UniqueName: \"kubernetes.io/projected/fad1c381-03d0-4779-8116-f8537742c2a4-kube-api-access-chdst\") pod \"iptables-alerter-j8kft\" (UID: \"fad1c381-03d0-4779-8116-f8537742c2a4\") " pod="openshift-network-operator/iptables-alerter-j8kft" Jun 05 15:08:08.627896 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.627713 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2a40ce2e-4726-44e7-aea3-0278d610c96d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jqpvb\" (UID: \"2a40ce2e-4726-44e7-aea3-0278d610c96d\") " pod="openshift-multus/multus-additional-cni-plugins-jqpvb" Jun 05 15:08:08.627896 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.627736 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-host-slash\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.627896 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.627764 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-host-run-ovn-kubernetes\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.627896 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.627788 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-host-cni-bin\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.627896 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.627810 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-multus-socket-dir-parent\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.627896 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.627836 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8be0d1c2-caab-4e33-beca-14b2a59dd3f6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xkmsq\" (UID: \"8be0d1c2-caab-4e33-beca-14b2a59dd3f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xkmsq" Jun 05 15:08:08.627896 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.627859 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95d1fafb-0436-4863-a157-1d3776569b4d-lib-modules\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.628241 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.627997 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/95d1fafb-0436-4863-a157-1d3776569b4d-etc-sysctl-conf\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.628241 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.627860 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/95d1fafb-0436-4863-a157-1d3776569b4d-etc-sysctl-conf\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.628241 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.628041 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bf33dc4e-b571-415e-817d-e1985a4f656a-agent-certs\") pod \"konnectivity-agent-chbh5\" (UID: \"bf33dc4e-b571-415e-817d-e1985a4f656a\") " pod="kube-system/konnectivity-agent-chbh5" Jun 05 15:08:08.628241 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.628069 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-log-socket\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.628241 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.628085 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2a40ce2e-4726-44e7-aea3-0278d610c96d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jqpvb\" (UID: \"2a40ce2e-4726-44e7-aea3-0278d610c96d\") " pod="openshift-multus/multus-additional-cni-plugins-jqpvb" Jun 05 15:08:08.628241 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.628094 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-os-release\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.628241 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.628132 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-host-run-k8s-cni-cncf-io\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.628241 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.628159 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8be0d1c2-caab-4e33-beca-14b2a59dd3f6-device-dir\") pod \"aws-ebs-csi-driver-node-xkmsq\" (UID: \"8be0d1c2-caab-4e33-beca-14b2a59dd3f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xkmsq" Jun 05 15:08:08.628241 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.628204 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fad1c381-03d0-4779-8116-f8537742c2a4-iptables-alerter-script\") pod \"iptables-alerter-j8kft\" (UID: \"fad1c381-03d0-4779-8116-f8537742c2a4\") " pod="openshift-network-operator/iptables-alerter-j8kft" Jun 05 15:08:08.628241 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.628226 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-etc-openvswitch\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.628854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.628248 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3e51389e-8fe0-48a4-b902-493bfa632cf8-ovnkube-config\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.628854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.628272 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-host-run-multus-certs\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.628854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.628295 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/95d1fafb-0436-4863-a157-1d3776569b4d-etc-tuned\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.628854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.628317 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-run-ovn\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.628854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.628339 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c7936f0-3a4d-4553-b67c-90eea6c1fcd6-tmp-dir\") pod \"node-resolver-69xsz\" (UID: \"9c7936f0-3a4d-4553-b67c-90eea6c1fcd6\") " pod="openshift-dns/node-resolver-69xsz" Jun 05 15:08:08.628854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.628362 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-cnibin\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.628854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.628385 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 05 15:08:08.628854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.628384 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-hostroot\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.628854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.628416 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bf33dc4e-b571-415e-817d-e1985a4f656a-konnectivity-ca\") pod \"konnectivity-agent-chbh5\" (UID: \"bf33dc4e-b571-415e-817d-e1985a4f656a\") " pod="kube-system/konnectivity-agent-chbh5" Jun 05 15:08:08.628854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.628452 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2a40ce2e-4726-44e7-aea3-0278d610c96d-cni-binary-copy\") pod \"multus-additional-cni-plugins-jqpvb\" (UID: \"2a40ce2e-4726-44e7-aea3-0278d610c96d\") " pod="openshift-multus/multus-additional-cni-plugins-jqpvb" Jun 05 15:08:08.628854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.628472 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9c7936f0-3a4d-4553-b67c-90eea6c1fcd6-hosts-file\") pod \"node-resolver-69xsz\" (UID: \"9c7936f0-3a4d-4553-b67c-90eea6c1fcd6\") " pod="openshift-dns/node-resolver-69xsz" Jun 05 15:08:08.628854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.628492 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-host-run-netns\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.628854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.628529 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-multus-conf-dir\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.628854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.628572 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5ltb\" (UniqueName: \"kubernetes.io/projected/9137360a-945f-4be7-a6da-25d3be6241fa-kube-api-access-s5ltb\") pod \"network-metrics-daemon-j2lpj\" (UID: \"9137360a-945f-4be7-a6da-25d3be6241fa\") " pod="openshift-multus/network-metrics-daemon-j2lpj" Jun 05 15:08:08.628854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.628597 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/95d1fafb-0436-4863-a157-1d3776569b4d-etc-sysconfig\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.628854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.628632 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/95d1fafb-0436-4863-a157-1d3776569b4d-run\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.628854 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.628665 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/95d1fafb-0436-4863-a157-1d3776569b4d-etc-sysconfig\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.629631 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.628670 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcb9g\" (UniqueName: \"kubernetes.io/projected/2a40ce2e-4726-44e7-aea3-0278d610c96d-kube-api-access-wcb9g\") pod \"multus-additional-cni-plugins-jqpvb\" (UID: \"2a40ce2e-4726-44e7-aea3-0278d610c96d\") " pod="openshift-multus/multus-additional-cni-plugins-jqpvb" Jun 05 15:08:08.629631 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.628701 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-systemd-units\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.629631 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.628725 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3e51389e-8fe0-48a4-b902-493bfa632cf8-ovnkube-script-lib\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.629631 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.628750 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lfn8\" (UniqueName: \"kubernetes.io/projected/9c7936f0-3a4d-4553-b67c-90eea6c1fcd6-kube-api-access-5lfn8\") pod \"node-resolver-69xsz\" (UID: \"9c7936f0-3a4d-4553-b67c-90eea6c1fcd6\") " pod="openshift-dns/node-resolver-69xsz" Jun 05 15:08:08.629631 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.628765 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fad1c381-03d0-4779-8116-f8537742c2a4-iptables-alerter-script\") pod \"iptables-alerter-j8kft\" (UID: \"fad1c381-03d0-4779-8116-f8537742c2a4\") " pod="openshift-network-operator/iptables-alerter-j8kft" Jun 05 15:08:08.629631 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.628773 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-system-cni-dir\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.629631 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.628798 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8be0d1c2-caab-4e33-beca-14b2a59dd3f6-etc-selinux\") pod \"aws-ebs-csi-driver-node-xkmsq\" (UID: \"8be0d1c2-caab-4e33-beca-14b2a59dd3f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xkmsq" Jun 05 15:08:08.629631 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.628833 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2a40ce2e-4726-44e7-aea3-0278d610c96d-os-release\") pod \"multus-additional-cni-plugins-jqpvb\" (UID: \"2a40ce2e-4726-44e7-aea3-0278d610c96d\") " pod="openshift-multus/multus-additional-cni-plugins-jqpvb" Jun 05 15:08:08.629631 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.628934 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/95d1fafb-0436-4863-a157-1d3776569b4d-run\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.629631 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.628968 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2a40ce2e-4726-44e7-aea3-0278d610c96d-os-release\") pod \"multus-additional-cni-plugins-jqpvb\" (UID: \"2a40ce2e-4726-44e7-aea3-0278d610c96d\") " pod="openshift-multus/multus-additional-cni-plugins-jqpvb" Jun 05 15:08:08.629631 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.628982 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-run-systemd\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.629631 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.629198 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bf33dc4e-b571-415e-817d-e1985a4f656a-konnectivity-ca\") pod \"konnectivity-agent-chbh5\" (UID: \"bf33dc4e-b571-415e-817d-e1985a4f656a\") " pod="kube-system/konnectivity-agent-chbh5" Jun 05 15:08:08.629631 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.629306 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.629631 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.629348 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8542cc3-5226-41a3-b049-76c6e0aafd54-cni-binary-copy\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.629631 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.629378 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ln5x\" (UniqueName: \"kubernetes.io/projected/e8542cc3-5226-41a3-b049-76c6e0aafd54-kube-api-access-6ln5x\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.629631 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.629403 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl869\" (UniqueName: \"kubernetes.io/projected/cc603818-b45b-4274-b792-47b121c133a7-kube-api-access-dl869\") pod \"node-ca-2nrvs\" (UID: \"cc603818-b45b-4274-b792-47b121c133a7\") " pod="openshift-image-registry/node-ca-2nrvs" Jun 05 15:08:08.630391 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.629438 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2a40ce2e-4726-44e7-aea3-0278d610c96d-cni-binary-copy\") pod \"multus-additional-cni-plugins-jqpvb\" (UID: \"2a40ce2e-4726-44e7-aea3-0278d610c96d\") " pod="openshift-multus/multus-additional-cni-plugins-jqpvb" Jun 05 15:08:08.630391 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.629438 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8be0d1c2-caab-4e33-beca-14b2a59dd3f6-sys-fs\") pod \"aws-ebs-csi-driver-node-xkmsq\" (UID: \"8be0d1c2-caab-4e33-beca-14b2a59dd3f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xkmsq" Jun 05 15:08:08.630391 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.629495 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95d1fafb-0436-4863-a157-1d3776569b4d-var-lib-kubelet\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.630391 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.629521 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95d1fafb-0436-4863-a157-1d3776569b4d-etc-kubernetes\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.630391 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.629545 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2a40ce2e-4726-44e7-aea3-0278d610c96d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jqpvb\" (UID: \"2a40ce2e-4726-44e7-aea3-0278d610c96d\") " pod="openshift-multus/multus-additional-cni-plugins-jqpvb" Jun 05 15:08:08.630391 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.629570 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-host-kubelet\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.630391 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.629590 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95d1fafb-0436-4863-a157-1d3776569b4d-var-lib-kubelet\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.630391 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.629602 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95d1fafb-0436-4863-a157-1d3776569b4d-etc-kubernetes\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.630391 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.629596 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-run-openvswitch\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.630391 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.629648 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3e51389e-8fe0-48a4-b902-493bfa632cf8-ovn-node-metrics-cert\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.630391 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.629677 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95d1fafb-0436-4863-a157-1d3776569b4d-tmp\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.630391 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.629701 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fad1c381-03d0-4779-8116-f8537742c2a4-host-slash\") pod \"iptables-alerter-j8kft\" (UID: \"fad1c381-03d0-4779-8116-f8537742c2a4\") " pod="openshift-network-operator/iptables-alerter-j8kft" Jun 05 15:08:08.630391 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.629726 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-host-cni-netd\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.630391 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.629754 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-host-var-lib-kubelet\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.630391 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.629764 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fad1c381-03d0-4779-8116-f8537742c2a4-host-slash\") pod \"iptables-alerter-j8kft\" (UID: \"fad1c381-03d0-4779-8116-f8537742c2a4\") " pod="openshift-network-operator/iptables-alerter-j8kft" Jun 05 15:08:08.630391 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.629775 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc603818-b45b-4274-b792-47b121c133a7-host\") pod \"node-ca-2nrvs\" (UID: \"cc603818-b45b-4274-b792-47b121c133a7\") " pod="openshift-image-registry/node-ca-2nrvs" Jun 05 15:08:08.630391 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.629799 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95d1fafb-0436-4863-a157-1d3776569b4d-host\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.631207 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.629727 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2a40ce2e-4726-44e7-aea3-0278d610c96d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jqpvb\" (UID: \"2a40ce2e-4726-44e7-aea3-0278d610c96d\") " pod="openshift-multus/multus-additional-cni-plugins-jqpvb" Jun 05 15:08:08.631207 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.629822 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/95d1fafb-0436-4863-a157-1d3776569b4d-etc-modprobe-d\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.631207 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.629844 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-node-log\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.631207 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.629854 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95d1fafb-0436-4863-a157-1d3776569b4d-host\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.631207 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.629868 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhlhs\" (UniqueName: \"kubernetes.io/projected/8be0d1c2-caab-4e33-beca-14b2a59dd3f6-kube-api-access-jhlhs\") pod \"aws-ebs-csi-driver-node-xkmsq\" (UID: \"8be0d1c2-caab-4e33-beca-14b2a59dd3f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xkmsq" Jun 05 15:08:08.631207 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.629892 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95d1fafb-0436-4863-a157-1d3776569b4d-sys\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.631207 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.629933 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a40ce2e-4726-44e7-aea3-0278d610c96d-system-cni-dir\") pod \"multus-additional-cni-plugins-jqpvb\" (UID: \"2a40ce2e-4726-44e7-aea3-0278d610c96d\") " pod="openshift-multus/multus-additional-cni-plugins-jqpvb" Jun 05 15:08:08.631207 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.629961 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/95d1fafb-0436-4863-a157-1d3776569b4d-etc-modprobe-d\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.631207 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.629985 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a40ce2e-4726-44e7-aea3-0278d610c96d-system-cni-dir\") pod \"multus-additional-cni-plugins-jqpvb\" (UID: \"2a40ce2e-4726-44e7-aea3-0278d610c96d\") " pod="openshift-multus/multus-additional-cni-plugins-jqpvb" Jun 05 15:08:08.631207 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.630006 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95d1fafb-0436-4863-a157-1d3776569b4d-sys\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.631207 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.630012 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2a40ce2e-4726-44e7-aea3-0278d610c96d-cnibin\") pod \"multus-additional-cni-plugins-jqpvb\" (UID: \"2a40ce2e-4726-44e7-aea3-0278d610c96d\") " pod="openshift-multus/multus-additional-cni-plugins-jqpvb" Jun 05 15:08:08.631207 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.630044 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-var-lib-openvswitch\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.631207 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.630045 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2a40ce2e-4726-44e7-aea3-0278d610c96d-cnibin\") pod \"multus-additional-cni-plugins-jqpvb\" (UID: \"2a40ce2e-4726-44e7-aea3-0278d610c96d\") " pod="openshift-multus/multus-additional-cni-plugins-jqpvb" Jun 05 15:08:08.631207 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.630096 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/70a59546-d9b0-43b7-aa6c-72d294856aed-kubelet-config\") pod \"global-pull-secret-syncer-rmrn7\" (UID: \"70a59546-d9b0-43b7-aa6c-72d294856aed\") " pod="kube-system/global-pull-secret-syncer-rmrn7" Jun 05 15:08:08.631207 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.630146 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-host-var-lib-cni-bin\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.631207 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.630169 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8be0d1c2-caab-4e33-beca-14b2a59dd3f6-socket-dir\") pod \"aws-ebs-csi-driver-node-xkmsq\" (UID: \"8be0d1c2-caab-4e33-beca-14b2a59dd3f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xkmsq" Jun 05 15:08:08.631207 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.630190 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-host-run-netns\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.631947 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.631775 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/95d1fafb-0436-4863-a157-1d3776569b4d-etc-tuned\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.632488 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.632461 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95d1fafb-0436-4863-a157-1d3776569b4d-tmp\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.632583 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.632539 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bf33dc4e-b571-415e-817d-e1985a4f656a-agent-certs\") pod \"konnectivity-agent-chbh5\" (UID: \"bf33dc4e-b571-415e-817d-e1985a4f656a\") " pod="kube-system/konnectivity-agent-chbh5" Jun 05 15:08:08.647995 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.647972 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chdst\" (UniqueName: \"kubernetes.io/projected/fad1c381-03d0-4779-8116-f8537742c2a4-kube-api-access-chdst\") pod \"iptables-alerter-j8kft\" (UID: \"fad1c381-03d0-4779-8116-f8537742c2a4\") " pod="openshift-network-operator/iptables-alerter-j8kft" Jun 05 15:08:08.648185 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.648162 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcb9g\" (UniqueName: \"kubernetes.io/projected/2a40ce2e-4726-44e7-aea3-0278d610c96d-kube-api-access-wcb9g\") pod \"multus-additional-cni-plugins-jqpvb\" (UID: \"2a40ce2e-4726-44e7-aea3-0278d610c96d\") " pod="openshift-multus/multus-additional-cni-plugins-jqpvb" Jun 05 15:08:08.660310 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.660283 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjtpp\" (UniqueName: \"kubernetes.io/projected/95d1fafb-0436-4863-a157-1d3776569b4d-kube-api-access-gjtpp\") pod \"tuned-6t5jj\" (UID: \"95d1fafb-0436-4863-a157-1d3776569b4d\") " pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.730729 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.730705 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-host-run-k8s-cni-cncf-io\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.730887 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.730740 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8be0d1c2-caab-4e33-beca-14b2a59dd3f6-device-dir\") pod \"aws-ebs-csi-driver-node-xkmsq\" (UID: \"8be0d1c2-caab-4e33-beca-14b2a59dd3f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xkmsq" Jun 05 15:08:08.730887 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.730763 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-etc-openvswitch\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.730887 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.730783 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3e51389e-8fe0-48a4-b902-493bfa632cf8-ovnkube-config\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.730887 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.730803 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-host-run-multus-certs\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.730887 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.730826 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-run-ovn\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.730887 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.730847 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c7936f0-3a4d-4553-b67c-90eea6c1fcd6-tmp-dir\") pod \"node-resolver-69xsz\" (UID: \"9c7936f0-3a4d-4553-b67c-90eea6c1fcd6\") " pod="openshift-dns/node-resolver-69xsz" Jun 05 15:08:08.730887 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.730844 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8be0d1c2-caab-4e33-beca-14b2a59dd3f6-device-dir\") pod \"aws-ebs-csi-driver-node-xkmsq\" (UID: \"8be0d1c2-caab-4e33-beca-14b2a59dd3f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xkmsq" Jun 05 15:08:08.730887 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.730868 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-cnibin\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.730887 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.730843 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-etc-openvswitch\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.730887 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.730880 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-run-ovn\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.730887 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.730888 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-hostroot\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.731419 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.730880 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-host-run-multus-certs\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.731419 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.730844 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-host-run-k8s-cni-cncf-io\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.731419 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.730938 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9c7936f0-3a4d-4553-b67c-90eea6c1fcd6-hosts-file\") pod \"node-resolver-69xsz\" (UID: \"9c7936f0-3a4d-4553-b67c-90eea6c1fcd6\") " pod="openshift-dns/node-resolver-69xsz" Jun 05 15:08:08.731419 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.730938 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-cnibin\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.731419 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.730955 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-hostroot\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.731419 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.730963 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-host-run-netns\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.731419 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.730977 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9c7936f0-3a4d-4553-b67c-90eea6c1fcd6-hosts-file\") pod \"node-resolver-69xsz\" (UID: \"9c7936f0-3a4d-4553-b67c-90eea6c1fcd6\") " pod="openshift-dns/node-resolver-69xsz" Jun 05 15:08:08.731419 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.730994 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-host-run-netns\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.731419 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731003 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-multus-conf-dir\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.731419 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731031 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5ltb\" (UniqueName: \"kubernetes.io/projected/9137360a-945f-4be7-a6da-25d3be6241fa-kube-api-access-s5ltb\") pod \"network-metrics-daemon-j2lpj\" (UID: \"9137360a-945f-4be7-a6da-25d3be6241fa\") " pod="openshift-multus/network-metrics-daemon-j2lpj" Jun 05 15:08:08.731419 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731058 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-multus-conf-dir\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.731419 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731059 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-systemd-units\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.731419 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731092 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-systemd-units\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.731419 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731157 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c7936f0-3a4d-4553-b67c-90eea6c1fcd6-tmp-dir\") pod \"node-resolver-69xsz\" (UID: \"9c7936f0-3a4d-4553-b67c-90eea6c1fcd6\") " pod="openshift-dns/node-resolver-69xsz" Jun 05 15:08:08.731419 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731093 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3e51389e-8fe0-48a4-b902-493bfa632cf8-ovnkube-script-lib\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.731419 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731205 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lfn8\" (UniqueName: \"kubernetes.io/projected/9c7936f0-3a4d-4553-b67c-90eea6c1fcd6-kube-api-access-5lfn8\") pod \"node-resolver-69xsz\" (UID: \"9c7936f0-3a4d-4553-b67c-90eea6c1fcd6\") " pod="openshift-dns/node-resolver-69xsz" Jun 05 15:08:08.731419 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731231 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-system-cni-dir\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.731419 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731253 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8be0d1c2-caab-4e33-beca-14b2a59dd3f6-etc-selinux\") pod \"aws-ebs-csi-driver-node-xkmsq\" (UID: \"8be0d1c2-caab-4e33-beca-14b2a59dd3f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xkmsq" Jun 05 15:08:08.732292 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731277 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-run-systemd\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.732292 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731302 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.732292 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731325 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8542cc3-5226-41a3-b049-76c6e0aafd54-cni-binary-copy\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.732292 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731338 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-system-cni-dir\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.732292 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731348 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ln5x\" (UniqueName: \"kubernetes.io/projected/e8542cc3-5226-41a3-b049-76c6e0aafd54-kube-api-access-6ln5x\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.732292 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731371 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl869\" (UniqueName: \"kubernetes.io/projected/cc603818-b45b-4274-b792-47b121c133a7-kube-api-access-dl869\") pod \"node-ca-2nrvs\" (UID: \"cc603818-b45b-4274-b792-47b121c133a7\") " pod="openshift-image-registry/node-ca-2nrvs" Jun 05 15:08:08.732292 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731399 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8be0d1c2-caab-4e33-beca-14b2a59dd3f6-sys-fs\") pod \"aws-ebs-csi-driver-node-xkmsq\" (UID: \"8be0d1c2-caab-4e33-beca-14b2a59dd3f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xkmsq" Jun 05 15:08:08.732292 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731397 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3e51389e-8fe0-48a4-b902-493bfa632cf8-ovnkube-config\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.732292 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731401 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8be0d1c2-caab-4e33-beca-14b2a59dd3f6-etc-selinux\") pod \"aws-ebs-csi-driver-node-xkmsq\" (UID: \"8be0d1c2-caab-4e33-beca-14b2a59dd3f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xkmsq" Jun 05 15:08:08.732292 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731442 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.732292 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731463 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-run-systemd\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.732292 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731479 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-host-kubelet\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.732292 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731508 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-run-openvswitch\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.732292 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731515 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8be0d1c2-caab-4e33-beca-14b2a59dd3f6-sys-fs\") pod \"aws-ebs-csi-driver-node-xkmsq\" (UID: \"8be0d1c2-caab-4e33-beca-14b2a59dd3f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xkmsq" Jun 05 15:08:08.732292 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731534 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3e51389e-8fe0-48a4-b902-493bfa632cf8-ovn-node-metrics-cert\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.732292 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731577 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3e51389e-8fe0-48a4-b902-493bfa632cf8-ovnkube-script-lib\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.732292 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731594 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-run-openvswitch\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.733094 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731594 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-host-kubelet\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.733094 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731628 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-host-cni-netd\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.733094 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731652 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-host-var-lib-kubelet\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.733094 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731676 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc603818-b45b-4274-b792-47b121c133a7-host\") pod \"node-ca-2nrvs\" (UID: \"cc603818-b45b-4274-b792-47b121c133a7\") " pod="openshift-image-registry/node-ca-2nrvs" Jun 05 15:08:08.733094 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731700 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-node-log\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.733094 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731719 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-host-cni-netd\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.733094 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731724 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-host-var-lib-kubelet\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.733094 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731724 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhlhs\" (UniqueName: \"kubernetes.io/projected/8be0d1c2-caab-4e33-beca-14b2a59dd3f6-kube-api-access-jhlhs\") pod \"aws-ebs-csi-driver-node-xkmsq\" (UID: \"8be0d1c2-caab-4e33-beca-14b2a59dd3f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xkmsq" Jun 05 15:08:08.733094 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731758 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc603818-b45b-4274-b792-47b121c133a7-host\") pod \"node-ca-2nrvs\" (UID: \"cc603818-b45b-4274-b792-47b121c133a7\") " pod="openshift-image-registry/node-ca-2nrvs" Jun 05 15:08:08.733094 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731766 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-node-log\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.733094 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731771 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-var-lib-openvswitch\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.733094 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731797 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/70a59546-d9b0-43b7-aa6c-72d294856aed-kubelet-config\") pod \"global-pull-secret-syncer-rmrn7\" (UID: \"70a59546-d9b0-43b7-aa6c-72d294856aed\") " pod="kube-system/global-pull-secret-syncer-rmrn7" Jun 05 15:08:08.733094 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731819 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-host-var-lib-cni-bin\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.733094 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731830 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-var-lib-openvswitch\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.733094 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731842 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8be0d1c2-caab-4e33-beca-14b2a59dd3f6-socket-dir\") pod \"aws-ebs-csi-driver-node-xkmsq\" (UID: \"8be0d1c2-caab-4e33-beca-14b2a59dd3f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xkmsq" Jun 05 15:08:08.733094 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731868 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-host-run-netns\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.733094 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731886 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/70a59546-d9b0-43b7-aa6c-72d294856aed-kubelet-config\") pod \"global-pull-secret-syncer-rmrn7\" (UID: \"70a59546-d9b0-43b7-aa6c-72d294856aed\") " pod="kube-system/global-pull-secret-syncer-rmrn7" Jun 05 15:08:08.733094 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731891 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/70a59546-d9b0-43b7-aa6c-72d294856aed-dbus\") pod \"global-pull-secret-syncer-rmrn7\" (UID: \"70a59546-d9b0-43b7-aa6c-72d294856aed\") " pod="kube-system/global-pull-secret-syncer-rmrn7" Jun 05 15:08:08.733937 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731952 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cc603818-b45b-4274-b792-47b121c133a7-serviceca\") pod \"node-ca-2nrvs\" (UID: \"cc603818-b45b-4274-b792-47b121c133a7\") " pod="openshift-image-registry/node-ca-2nrvs" Jun 05 15:08:08.733937 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731956 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-host-run-netns\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.733937 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731891 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-host-var-lib-cni-bin\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.733937 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731987 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8be0d1c2-caab-4e33-beca-14b2a59dd3f6-registration-dir\") pod \"aws-ebs-csi-driver-node-xkmsq\" (UID: \"8be0d1c2-caab-4e33-beca-14b2a59dd3f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xkmsq" Jun 05 15:08:08.733937 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.731997 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8542cc3-5226-41a3-b049-76c6e0aafd54-cni-binary-copy\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.733937 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.732016 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3e51389e-8fe0-48a4-b902-493bfa632cf8-env-overrides\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.733937 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.732041 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlxf2\" (UniqueName: \"kubernetes.io/projected/3e51389e-8fe0-48a4-b902-493bfa632cf8-kube-api-access-vlxf2\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.733937 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.732064 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70a59546-d9b0-43b7-aa6c-72d294856aed-original-pull-secret\") pod \"global-pull-secret-syncer-rmrn7\" (UID: \"70a59546-d9b0-43b7-aa6c-72d294856aed\") " pod="kube-system/global-pull-secret-syncer-rmrn7" Jun 05 15:08:08.733937 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.732066 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8be0d1c2-caab-4e33-beca-14b2a59dd3f6-registration-dir\") pod \"aws-ebs-csi-driver-node-xkmsq\" (UID: \"8be0d1c2-caab-4e33-beca-14b2a59dd3f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xkmsq" Jun 05 15:08:08.733937 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.732087 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e8542cc3-5226-41a3-b049-76c6e0aafd54-multus-daemon-config\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.733937 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.732091 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/70a59546-d9b0-43b7-aa6c-72d294856aed-dbus\") pod \"global-pull-secret-syncer-rmrn7\" (UID: \"70a59546-d9b0-43b7-aa6c-72d294856aed\") " pod="kube-system/global-pull-secret-syncer-rmrn7" Jun 05 15:08:08.733937 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.732000 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8be0d1c2-caab-4e33-beca-14b2a59dd3f6-socket-dir\") pod \"aws-ebs-csi-driver-node-xkmsq\" (UID: \"8be0d1c2-caab-4e33-beca-14b2a59dd3f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xkmsq" Jun 05 15:08:08.733937 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.732110 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s68l6\" (UniqueName: \"kubernetes.io/projected/dc87e3e2-2e9f-405d-9aa5-a7c444528874-kube-api-access-s68l6\") pod \"network-check-target-wz2bw\" (UID: \"dc87e3e2-2e9f-405d-9aa5-a7c444528874\") " pod="openshift-network-diagnostics/network-check-target-wz2bw" Jun 05 15:08:08.733937 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.732145 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-multus-cni-dir\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.733937 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.732173 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-host-var-lib-cni-multus\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.733937 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.732197 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-etc-kubernetes\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.733937 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.732221 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9137360a-945f-4be7-a6da-25d3be6241fa-metrics-certs\") pod \"network-metrics-daemon-j2lpj\" (UID: \"9137360a-945f-4be7-a6da-25d3be6241fa\") " pod="openshift-multus/network-metrics-daemon-j2lpj" Jun 05 15:08:08.734755 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.732245 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-multus-cni-dir\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.734755 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.732246 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-host-slash\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.734755 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.732271 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-host-run-ovn-kubernetes\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.734755 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:08.732300 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 15:08:08.734755 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.732337 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-host-cni-bin\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.734755 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:08.732351 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70a59546-d9b0-43b7-aa6c-72d294856aed-original-pull-secret podName:70a59546-d9b0-43b7-aa6c-72d294856aed nodeName:}" failed. No retries permitted until 2026-06-05 15:08:09.23233294 +0000 UTC m=+3.127851020 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/70a59546-d9b0-43b7-aa6c-72d294856aed-original-pull-secret") pod "global-pull-secret-syncer-rmrn7" (UID: "70a59546-d9b0-43b7-aa6c-72d294856aed") : object "kube-system"/"original-pull-secret" not registered Jun 05 15:08:08.734755 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.732374 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-host-run-ovn-kubernetes\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.734755 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.732370 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-host-var-lib-cni-multus\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.734755 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.732405 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-host-slash\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.734755 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.732419 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cc603818-b45b-4274-b792-47b121c133a7-serviceca\") pod \"node-ca-2nrvs\" (UID: \"cc603818-b45b-4274-b792-47b121c133a7\") " pod="openshift-image-registry/node-ca-2nrvs" Jun 05 15:08:08.734755 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:08.732409 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:08:08.734755 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:08.732549 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9137360a-945f-4be7-a6da-25d3be6241fa-metrics-certs podName:9137360a-945f-4be7-a6da-25d3be6241fa nodeName:}" failed. No retries permitted until 2026-06-05 15:08:09.232530934 +0000 UTC m=+3.128049019 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9137360a-945f-4be7-a6da-25d3be6241fa-metrics-certs") pod "network-metrics-daemon-j2lpj" (UID: "9137360a-945f-4be7-a6da-25d3be6241fa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:08:08.734755 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.732294 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-host-cni-bin\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.734755 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.732589 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-multus-socket-dir-parent\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.734755 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.732614 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8be0d1c2-caab-4e33-beca-14b2a59dd3f6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xkmsq\" (UID: \"8be0d1c2-caab-4e33-beca-14b2a59dd3f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xkmsq" Jun 05 15:08:08.734755 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.732424 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-etc-kubernetes\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.734755 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.732426 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3e51389e-8fe0-48a4-b902-493bfa632cf8-env-overrides\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.735566 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.732656 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-log-socket\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.735566 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.732691 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e8542cc3-5226-41a3-b049-76c6e0aafd54-multus-daemon-config\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.735566 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.732710 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-os-release\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.735566 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.732683 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-multus-socket-dir-parent\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.735566 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.732717 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3e51389e-8fe0-48a4-b902-493bfa632cf8-log-socket\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.735566 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.732726 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8be0d1c2-caab-4e33-beca-14b2a59dd3f6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xkmsq\" (UID: \"8be0d1c2-caab-4e33-beca-14b2a59dd3f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xkmsq" Jun 05 15:08:08.735566 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.732790 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8542cc3-5226-41a3-b049-76c6e0aafd54-os-release\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.735566 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.734303 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3e51389e-8fe0-48a4-b902-493bfa632cf8-ovn-node-metrics-cert\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.744731 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:08.744713 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 15:08:08.744833 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:08.744740 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 15:08:08.744833 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:08.744754 2560 projected.go:196] Error preparing data for projected volume kube-api-access-s68l6 for pod openshift-network-diagnostics/network-check-target-wz2bw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:08:08.744833 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:08.744814 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc87e3e2-2e9f-405d-9aa5-a7c444528874-kube-api-access-s68l6 podName:dc87e3e2-2e9f-405d-9aa5-a7c444528874 nodeName:}" failed. No retries permitted until 2026-06-05 15:08:09.244799882 +0000 UTC m=+3.140317984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-s68l6" (UniqueName: "kubernetes.io/projected/dc87e3e2-2e9f-405d-9aa5-a7c444528874-kube-api-access-s68l6") pod "network-check-target-wz2bw" (UID: "dc87e3e2-2e9f-405d-9aa5-a7c444528874") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:08:08.746402 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.746378 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl869\" (UniqueName: \"kubernetes.io/projected/cc603818-b45b-4274-b792-47b121c133a7-kube-api-access-dl869\") pod \"node-ca-2nrvs\" (UID: \"cc603818-b45b-4274-b792-47b121c133a7\") " pod="openshift-image-registry/node-ca-2nrvs" Jun 05 15:08:08.746915 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.746880 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lfn8\" (UniqueName: \"kubernetes.io/projected/9c7936f0-3a4d-4553-b67c-90eea6c1fcd6-kube-api-access-5lfn8\") pod \"node-resolver-69xsz\" (UID: \"9c7936f0-3a4d-4553-b67c-90eea6c1fcd6\") " pod="openshift-dns/node-resolver-69xsz" Jun 05 15:08:08.747206 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.747164 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5ltb\" (UniqueName: \"kubernetes.io/projected/9137360a-945f-4be7-a6da-25d3be6241fa-kube-api-access-s5ltb\") pod \"network-metrics-daemon-j2lpj\" (UID: \"9137360a-945f-4be7-a6da-25d3be6241fa\") " pod="openshift-multus/network-metrics-daemon-j2lpj" Jun 05 15:08:08.747590 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.747570 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlxf2\" (UniqueName: \"kubernetes.io/projected/3e51389e-8fe0-48a4-b902-493bfa632cf8-kube-api-access-vlxf2\") pod \"ovnkube-node-c7wnx\" (UID: \"3e51389e-8fe0-48a4-b902-493bfa632cf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.748098 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.748079 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ln5x\" (UniqueName: \"kubernetes.io/projected/e8542cc3-5226-41a3-b049-76c6e0aafd54-kube-api-access-6ln5x\") pod \"multus-njqmz\" (UID: \"e8542cc3-5226-41a3-b049-76c6e0aafd54\") " pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.748236 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.748211 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhlhs\" (UniqueName: \"kubernetes.io/projected/8be0d1c2-caab-4e33-beca-14b2a59dd3f6-kube-api-access-jhlhs\") pod \"aws-ebs-csi-driver-node-xkmsq\" (UID: \"8be0d1c2-caab-4e33-beca-14b2a59dd3f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xkmsq" Jun 05 15:08:08.824210 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.824186 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jqpvb" Jun 05 15:08:08.836891 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.836866 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j8kft" Jun 05 15:08:08.842578 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.842558 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" Jun 05 15:08:08.848141 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.848124 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-chbh5" Jun 05 15:08:08.855600 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.855583 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:08.864117 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.864098 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2nrvs" Jun 05 15:08:08.869696 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.869677 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xkmsq" Jun 05 15:08:08.877130 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.877113 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-69xsz" Jun 05 15:08:08.882654 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.882637 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-njqmz" Jun 05 15:08:08.886192 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:08.886172 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 15:08:09.236349 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:09.236320 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70a59546-d9b0-43b7-aa6c-72d294856aed-original-pull-secret\") pod \"global-pull-secret-syncer-rmrn7\" (UID: \"70a59546-d9b0-43b7-aa6c-72d294856aed\") " pod="kube-system/global-pull-secret-syncer-rmrn7" Jun 05 15:08:09.236528 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:09.236359 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9137360a-945f-4be7-a6da-25d3be6241fa-metrics-certs\") pod \"network-metrics-daemon-j2lpj\" (UID: \"9137360a-945f-4be7-a6da-25d3be6241fa\") " pod="openshift-multus/network-metrics-daemon-j2lpj" Jun 05 15:08:09.236528 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:09.236472 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 15:08:09.236528 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:09.236521 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:08:09.236699 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:09.236546 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70a59546-d9b0-43b7-aa6c-72d294856aed-original-pull-secret podName:70a59546-d9b0-43b7-aa6c-72d294856aed nodeName:}" failed. No retries permitted until 2026-06-05 15:08:10.236514277 +0000 UTC m=+4.132032366 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/70a59546-d9b0-43b7-aa6c-72d294856aed-original-pull-secret") pod "global-pull-secret-syncer-rmrn7" (UID: "70a59546-d9b0-43b7-aa6c-72d294856aed") : object "kube-system"/"original-pull-secret" not registered Jun 05 15:08:09.236699 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:09.236568 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9137360a-945f-4be7-a6da-25d3be6241fa-metrics-certs podName:9137360a-945f-4be7-a6da-25d3be6241fa nodeName:}" failed. No retries permitted until 2026-06-05 15:08:10.23655585 +0000 UTC m=+4.132073929 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9137360a-945f-4be7-a6da-25d3be6241fa-metrics-certs") pod "network-metrics-daemon-j2lpj" (UID: "9137360a-945f-4be7-a6da-25d3be6241fa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:08:09.336985 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:09.336958 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s68l6\" (UniqueName: \"kubernetes.io/projected/dc87e3e2-2e9f-405d-9aa5-a7c444528874-kube-api-access-s68l6\") pod \"network-check-target-wz2bw\" (UID: \"dc87e3e2-2e9f-405d-9aa5-a7c444528874\") " pod="openshift-network-diagnostics/network-check-target-wz2bw" Jun 05 15:08:09.337145 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:09.337103 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 15:08:09.337145 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:09.337122 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 15:08:09.337145 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:09.337131 2560 projected.go:196] Error preparing data for projected volume kube-api-access-s68l6 for pod openshift-network-diagnostics/network-check-target-wz2bw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:08:09.337314 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:09.337187 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc87e3e2-2e9f-405d-9aa5-a7c444528874-kube-api-access-s68l6 podName:dc87e3e2-2e9f-405d-9aa5-a7c444528874 nodeName:}" failed. No retries permitted until 2026-06-05 15:08:10.337167992 +0000 UTC m=+4.232686074 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-s68l6" (UniqueName: "kubernetes.io/projected/dc87e3e2-2e9f-405d-9aa5-a7c444528874-kube-api-access-s68l6") pod "network-check-target-wz2bw" (UID: "dc87e3e2-2e9f-405d-9aa5-a7c444528874") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:08:09.480830 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:09.480801 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95d1fafb_0436_4863_a157_1d3776569b4d.slice/crio-5153c00cd457961ab26804256c10db51f2e43616406d4bdf492e127fad22e5d4 WatchSource:0}: Error finding container 5153c00cd457961ab26804256c10db51f2e43616406d4bdf492e127fad22e5d4: Status 404 returned error can't find the container with id 5153c00cd457961ab26804256c10db51f2e43616406d4bdf492e127fad22e5d4 Jun 05 15:08:09.482250 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:09.482159 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c7936f0_3a4d_4553_b67c_90eea6c1fcd6.slice/crio-3e4ff5c48b850cbd05238e8f5fa5db4e2be7cabd93c13fb4914ce44fa4bdac3f WatchSource:0}: Error finding container 3e4ff5c48b850cbd05238e8f5fa5db4e2be7cabd93c13fb4914ce44fa4bdac3f: Status 404 returned error can't find the container with id 3e4ff5c48b850cbd05238e8f5fa5db4e2be7cabd93c13fb4914ce44fa4bdac3f Jun 05 15:08:09.483004 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:09.482932 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfad1c381_03d0_4779_8116_f8537742c2a4.slice/crio-173b24beac2b6808c4d706e3456deb7d581af101c890aadf9af362dcc84b1022 WatchSource:0}: Error finding container 173b24beac2b6808c4d706e3456deb7d581af101c890aadf9af362dcc84b1022: Status 404 returned error can't find the container with id 173b24beac2b6808c4d706e3456deb7d581af101c890aadf9af362dcc84b1022 Jun 05 15:08:09.485989 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:09.485968 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8be0d1c2_caab_4e33_beca_14b2a59dd3f6.slice/crio-9ec47b54d84a49cc6b59e860d2832a12b1d653e6127237d03bb79c34a68fabcb WatchSource:0}: Error finding container 9ec47b54d84a49cc6b59e860d2832a12b1d653e6127237d03bb79c34a68fabcb: Status 404 returned error can't find the container with id 9ec47b54d84a49cc6b59e860d2832a12b1d653e6127237d03bb79c34a68fabcb Jun 05 15:08:09.487417 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:09.487364 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e51389e_8fe0_48a4_b902_493bfa632cf8.slice/crio-ac322258e905264174d6657b2b70422d81b79906e7f891c2a24b49561b57c13f WatchSource:0}: Error finding container ac322258e905264174d6657b2b70422d81b79906e7f891c2a24b49561b57c13f: Status 404 returned error can't find the container with id ac322258e905264174d6657b2b70422d81b79906e7f891c2a24b49561b57c13f Jun 05 15:08:09.489939 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:09.489916 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a40ce2e_4726_44e7_aea3_0278d610c96d.slice/crio-4cb613a98869706ce519803181bcdf8085a88a6303c1a35268fca0c5e8f2a5d0 WatchSource:0}: Error finding container 4cb613a98869706ce519803181bcdf8085a88a6303c1a35268fca0c5e8f2a5d0: Status 404 returned error can't find the container with id 4cb613a98869706ce519803181bcdf8085a88a6303c1a35268fca0c5e8f2a5d0 Jun 05 15:08:09.490673 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:09.490653 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc603818_b45b_4274_b792_47b121c133a7.slice/crio-9ba7e97d3bf421c1ecc4a75c161ee712165b2998679fa48b7dc00461679a3500 WatchSource:0}: Error finding container 9ba7e97d3bf421c1ecc4a75c161ee712165b2998679fa48b7dc00461679a3500: Status 404 returned error can't find the container with id 9ba7e97d3bf421c1ecc4a75c161ee712165b2998679fa48b7dc00461679a3500 Jun 05 15:08:09.491368 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:09.491319 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8542cc3_5226_41a3_b049_76c6e0aafd54.slice/crio-a28b9df178632f8a49fde5a7a03b8c709bffbff5030d7b6f65489086aba496c8 WatchSource:0}: Error finding container a28b9df178632f8a49fde5a7a03b8c709bffbff5030d7b6f65489086aba496c8: Status 404 returned error can't find the container with id a28b9df178632f8a49fde5a7a03b8c709bffbff5030d7b6f65489086aba496c8 Jun 05 15:08:09.492113 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:09.492094 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf33dc4e_b571_415e_817d_e1985a4f656a.slice/crio-9922f6da0f13e3804a7f89ad24895899769c1eea987bc5fc64308491abeb00ec WatchSource:0}: Error finding container 9922f6da0f13e3804a7f89ad24895899769c1eea987bc5fc64308491abeb00ec: Status 404 returned error can't find the container with id 9922f6da0f13e3804a7f89ad24895899769c1eea987bc5fc64308491abeb00ec Jun 05 15:08:09.561756 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:09.561728 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 15:03:08 +0000 UTC" deadline="2027-11-29 05:57:38.353277495 +0000 UTC" Jun 05 15:08:09.561836 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:09.561760 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12998h49m28.791525007s" Jun 05 15:08:09.590693 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:09.590673 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wz2bw" Jun 05 15:08:09.590780 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:09.590757 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wz2bw" podUID="dc87e3e2-2e9f-405d-9aa5-a7c444528874" Jun 05 15:08:09.599048 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:09.599023 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" event={"ID":"95d1fafb-0436-4863-a157-1d3776569b4d","Type":"ContainerStarted","Data":"5153c00cd457961ab26804256c10db51f2e43616406d4bdf492e127fad22e5d4"} Jun 05 15:08:09.600131 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:09.600111 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-njqmz" event={"ID":"e8542cc3-5226-41a3-b049-76c6e0aafd54","Type":"ContainerStarted","Data":"a28b9df178632f8a49fde5a7a03b8c709bffbff5030d7b6f65489086aba496c8"} Jun 05 15:08:09.601316 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:09.601296 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2nrvs" event={"ID":"cc603818-b45b-4274-b792-47b121c133a7","Type":"ContainerStarted","Data":"9ba7e97d3bf421c1ecc4a75c161ee712165b2998679fa48b7dc00461679a3500"} Jun 05 15:08:09.602357 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:09.602315 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jqpvb" event={"ID":"2a40ce2e-4726-44e7-aea3-0278d610c96d","Type":"ContainerStarted","Data":"4cb613a98869706ce519803181bcdf8085a88a6303c1a35268fca0c5e8f2a5d0"} Jun 05 15:08:09.603432 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:09.603413 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-69xsz" event={"ID":"9c7936f0-3a4d-4553-b67c-90eea6c1fcd6","Type":"ContainerStarted","Data":"3e4ff5c48b850cbd05238e8f5fa5db4e2be7cabd93c13fb4914ce44fa4bdac3f"} Jun 05 15:08:09.605166 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:09.605138 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-97.ec2.internal" event={"ID":"662b71b6c5497bdd12105b5f3133c1f7","Type":"ContainerStarted","Data":"1a5250956c0e537b46bd3101f042be46bfaf62047f61225720f2346e47a98c13"} Jun 05 15:08:09.606292 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:09.606273 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-chbh5" event={"ID":"bf33dc4e-b571-415e-817d-e1985a4f656a","Type":"ContainerStarted","Data":"9922f6da0f13e3804a7f89ad24895899769c1eea987bc5fc64308491abeb00ec"} Jun 05 15:08:09.607358 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:09.607336 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" event={"ID":"3e51389e-8fe0-48a4-b902-493bfa632cf8","Type":"ContainerStarted","Data":"ac322258e905264174d6657b2b70422d81b79906e7f891c2a24b49561b57c13f"} Jun 05 15:08:09.608489 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:09.608455 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xkmsq" event={"ID":"8be0d1c2-caab-4e33-beca-14b2a59dd3f6","Type":"ContainerStarted","Data":"9ec47b54d84a49cc6b59e860d2832a12b1d653e6127237d03bb79c34a68fabcb"} Jun 05 15:08:09.609431 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:09.609410 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j8kft" event={"ID":"fad1c381-03d0-4779-8116-f8537742c2a4","Type":"ContainerStarted","Data":"173b24beac2b6808c4d706e3456deb7d581af101c890aadf9af362dcc84b1022"} Jun 05 15:08:09.617881 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:09.617843 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-97.ec2.internal" podStartSLOduration=2.617831846 podStartE2EDuration="2.617831846s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:08:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:08:09.617622875 +0000 UTC m=+3.513140975" watchObservedRunningTime="2026-06-05 15:08:09.617831846 +0000 UTC m=+3.513349946" Jun 05 15:08:10.242330 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:10.242284 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70a59546-d9b0-43b7-aa6c-72d294856aed-original-pull-secret\") pod \"global-pull-secret-syncer-rmrn7\" (UID: \"70a59546-d9b0-43b7-aa6c-72d294856aed\") " pod="kube-system/global-pull-secret-syncer-rmrn7" Jun 05 15:08:10.242532 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:10.242359 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9137360a-945f-4be7-a6da-25d3be6241fa-metrics-certs\") pod \"network-metrics-daemon-j2lpj\" (UID: \"9137360a-945f-4be7-a6da-25d3be6241fa\") " pod="openshift-multus/network-metrics-daemon-j2lpj" Jun 05 15:08:10.242532 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:10.242504 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:08:10.242659 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:10.242573 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9137360a-945f-4be7-a6da-25d3be6241fa-metrics-certs podName:9137360a-945f-4be7-a6da-25d3be6241fa nodeName:}" failed. No retries permitted until 2026-06-05 15:08:12.242554266 +0000 UTC m=+6.138072347 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9137360a-945f-4be7-a6da-25d3be6241fa-metrics-certs") pod "network-metrics-daemon-j2lpj" (UID: "9137360a-945f-4be7-a6da-25d3be6241fa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:08:10.243014 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:10.242994 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 15:08:10.243102 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:10.243048 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70a59546-d9b0-43b7-aa6c-72d294856aed-original-pull-secret podName:70a59546-d9b0-43b7-aa6c-72d294856aed nodeName:}" failed. No retries permitted until 2026-06-05 15:08:12.243033733 +0000 UTC m=+6.138551816 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/70a59546-d9b0-43b7-aa6c-72d294856aed-original-pull-secret") pod "global-pull-secret-syncer-rmrn7" (UID: "70a59546-d9b0-43b7-aa6c-72d294856aed") : object "kube-system"/"original-pull-secret" not registered Jun 05 15:08:10.344464 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:10.343850 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s68l6\" (UniqueName: \"kubernetes.io/projected/dc87e3e2-2e9f-405d-9aa5-a7c444528874-kube-api-access-s68l6\") pod \"network-check-target-wz2bw\" (UID: \"dc87e3e2-2e9f-405d-9aa5-a7c444528874\") " pod="openshift-network-diagnostics/network-check-target-wz2bw" Jun 05 15:08:10.344464 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:10.344028 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 15:08:10.344464 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:10.344050 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 15:08:10.344464 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:10.344064 2560 projected.go:196] Error preparing data for projected volume kube-api-access-s68l6 for pod openshift-network-diagnostics/network-check-target-wz2bw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:08:10.344464 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:10.344125 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc87e3e2-2e9f-405d-9aa5-a7c444528874-kube-api-access-s68l6 podName:dc87e3e2-2e9f-405d-9aa5-a7c444528874 nodeName:}" failed. No retries permitted until 2026-06-05 15:08:12.344107218 +0000 UTC m=+6.239625299 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-s68l6" (UniqueName: "kubernetes.io/projected/dc87e3e2-2e9f-405d-9aa5-a7c444528874-kube-api-access-s68l6") pod "network-check-target-wz2bw" (UID: "dc87e3e2-2e9f-405d-9aa5-a7c444528874") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:08:10.562214 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:10.562080 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 15:03:08 +0000 UTC" deadline="2028-02-13 05:48:59.74169324 +0000 UTC" Jun 05 15:08:10.562214 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:10.562135 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14822h40m49.179562256s" Jun 05 15:08:10.594742 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:10.593424 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rmrn7" Jun 05 15:08:10.594742 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:10.593552 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rmrn7" podUID="70a59546-d9b0-43b7-aa6c-72d294856aed" Jun 05 15:08:10.594742 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:10.594545 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lpj" Jun 05 15:08:10.594742 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:10.594654 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2lpj" podUID="9137360a-945f-4be7-a6da-25d3be6241fa" Jun 05 15:08:10.635537 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:10.635499 2560 generic.go:356] "Generic (PLEG): container finished" podID="917b11840b3884a42d5a7e3a3cc7879e" containerID="18ac263484c31de7c7425cccbe14ec4936629050d82e1770f01984bdac8d0ec1" exitCode=0 Jun 05 15:08:10.636530 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:10.636499 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-97.ec2.internal" event={"ID":"917b11840b3884a42d5a7e3a3cc7879e","Type":"ContainerDied","Data":"18ac263484c31de7c7425cccbe14ec4936629050d82e1770f01984bdac8d0ec1"} Jun 05 15:08:11.591172 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:11.591138 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wz2bw" Jun 05 15:08:11.591629 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:11.591265 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wz2bw" podUID="dc87e3e2-2e9f-405d-9aa5-a7c444528874" Jun 05 15:08:11.652185 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:11.651473 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-97.ec2.internal" event={"ID":"917b11840b3884a42d5a7e3a3cc7879e","Type":"ContainerStarted","Data":"23e81fdb26b22bff4a600ca08d568345eed738cee2e3688ea7eea0335f80af29"} Jun 05 15:08:12.260410 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:12.260371 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70a59546-d9b0-43b7-aa6c-72d294856aed-original-pull-secret\") pod \"global-pull-secret-syncer-rmrn7\" (UID: \"70a59546-d9b0-43b7-aa6c-72d294856aed\") " pod="kube-system/global-pull-secret-syncer-rmrn7" Jun 05 15:08:12.260598 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:12.260438 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9137360a-945f-4be7-a6da-25d3be6241fa-metrics-certs\") pod \"network-metrics-daemon-j2lpj\" (UID: \"9137360a-945f-4be7-a6da-25d3be6241fa\") " pod="openshift-multus/network-metrics-daemon-j2lpj" Jun 05 15:08:12.260598 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:12.260541 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 15:08:12.260598 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:12.260569 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:08:12.260754 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:12.260625 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70a59546-d9b0-43b7-aa6c-72d294856aed-original-pull-secret podName:70a59546-d9b0-43b7-aa6c-72d294856aed nodeName:}" failed. No retries permitted until 2026-06-05 15:08:16.260602513 +0000 UTC m=+10.156120605 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/70a59546-d9b0-43b7-aa6c-72d294856aed-original-pull-secret") pod "global-pull-secret-syncer-rmrn7" (UID: "70a59546-d9b0-43b7-aa6c-72d294856aed") : object "kube-system"/"original-pull-secret" not registered Jun 05 15:08:12.260754 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:12.260645 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9137360a-945f-4be7-a6da-25d3be6241fa-metrics-certs podName:9137360a-945f-4be7-a6da-25d3be6241fa nodeName:}" failed. No retries permitted until 2026-06-05 15:08:16.260636087 +0000 UTC m=+10.156154170 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9137360a-945f-4be7-a6da-25d3be6241fa-metrics-certs") pod "network-metrics-daemon-j2lpj" (UID: "9137360a-945f-4be7-a6da-25d3be6241fa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:08:12.360898 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:12.360860 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s68l6\" (UniqueName: \"kubernetes.io/projected/dc87e3e2-2e9f-405d-9aa5-a7c444528874-kube-api-access-s68l6\") pod \"network-check-target-wz2bw\" (UID: \"dc87e3e2-2e9f-405d-9aa5-a7c444528874\") " pod="openshift-network-diagnostics/network-check-target-wz2bw" Jun 05 15:08:12.361080 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:12.361053 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 15:08:12.361139 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:12.361082 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 15:08:12.361139 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:12.361096 2560 projected.go:196] Error preparing data for projected volume kube-api-access-s68l6 for pod openshift-network-diagnostics/network-check-target-wz2bw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:08:12.361284 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:12.361158 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc87e3e2-2e9f-405d-9aa5-a7c444528874-kube-api-access-s68l6 podName:dc87e3e2-2e9f-405d-9aa5-a7c444528874 nodeName:}" failed. No retries permitted until 2026-06-05 15:08:16.361135851 +0000 UTC m=+10.256653932 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-s68l6" (UniqueName: "kubernetes.io/projected/dc87e3e2-2e9f-405d-9aa5-a7c444528874-kube-api-access-s68l6") pod "network-check-target-wz2bw" (UID: "dc87e3e2-2e9f-405d-9aa5-a7c444528874") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:08:12.593487 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:12.592774 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rmrn7" Jun 05 15:08:12.593487 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:12.592896 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rmrn7" podUID="70a59546-d9b0-43b7-aa6c-72d294856aed" Jun 05 15:08:12.593487 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:12.593229 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lpj" Jun 05 15:08:12.593487 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:12.593340 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2lpj" podUID="9137360a-945f-4be7-a6da-25d3be6241fa" Jun 05 15:08:13.590699 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:13.590663 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wz2bw" Jun 05 15:08:13.590920 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:13.590819 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wz2bw" podUID="dc87e3e2-2e9f-405d-9aa5-a7c444528874" Jun 05 15:08:14.591674 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:14.591635 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rmrn7" Jun 05 15:08:14.592159 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:14.591841 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rmrn7" podUID="70a59546-d9b0-43b7-aa6c-72d294856aed" Jun 05 15:08:14.592353 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:14.591635 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lpj" Jun 05 15:08:14.592489 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:14.592464 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2lpj" podUID="9137360a-945f-4be7-a6da-25d3be6241fa" Jun 05 15:08:15.591444 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:15.591350 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wz2bw" Jun 05 15:08:15.591681 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:15.591483 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wz2bw" podUID="dc87e3e2-2e9f-405d-9aa5-a7c444528874" Jun 05 15:08:16.297027 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:16.296924 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9137360a-945f-4be7-a6da-25d3be6241fa-metrics-certs\") pod \"network-metrics-daemon-j2lpj\" (UID: \"9137360a-945f-4be7-a6da-25d3be6241fa\") " pod="openshift-multus/network-metrics-daemon-j2lpj" Jun 05 15:08:16.297027 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:16.297027 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70a59546-d9b0-43b7-aa6c-72d294856aed-original-pull-secret\") pod \"global-pull-secret-syncer-rmrn7\" (UID: \"70a59546-d9b0-43b7-aa6c-72d294856aed\") " pod="kube-system/global-pull-secret-syncer-rmrn7" Jun 05 15:08:16.297534 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:16.297028 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:08:16.297534 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:16.297110 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9137360a-945f-4be7-a6da-25d3be6241fa-metrics-certs podName:9137360a-945f-4be7-a6da-25d3be6241fa nodeName:}" failed. No retries permitted until 2026-06-05 15:08:24.297086553 +0000 UTC m=+18.192604643 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9137360a-945f-4be7-a6da-25d3be6241fa-metrics-certs") pod "network-metrics-daemon-j2lpj" (UID: "9137360a-945f-4be7-a6da-25d3be6241fa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:08:16.297534 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:16.297146 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 15:08:16.297534 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:16.297201 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70a59546-d9b0-43b7-aa6c-72d294856aed-original-pull-secret podName:70a59546-d9b0-43b7-aa6c-72d294856aed nodeName:}" failed. No retries permitted until 2026-06-05 15:08:24.297184906 +0000 UTC m=+18.192702986 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/70a59546-d9b0-43b7-aa6c-72d294856aed-original-pull-secret") pod "global-pull-secret-syncer-rmrn7" (UID: "70a59546-d9b0-43b7-aa6c-72d294856aed") : object "kube-system"/"original-pull-secret" not registered Jun 05 15:08:16.397537 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:16.397484 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s68l6\" (UniqueName: \"kubernetes.io/projected/dc87e3e2-2e9f-405d-9aa5-a7c444528874-kube-api-access-s68l6\") pod \"network-check-target-wz2bw\" (UID: \"dc87e3e2-2e9f-405d-9aa5-a7c444528874\") " pod="openshift-network-diagnostics/network-check-target-wz2bw" Jun 05 15:08:16.397724 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:16.397664 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 15:08:16.397724 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:16.397690 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 15:08:16.397724 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:16.397703 2560 projected.go:196] Error preparing data for projected volume kube-api-access-s68l6 for pod openshift-network-diagnostics/network-check-target-wz2bw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:08:16.397871 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:16.397773 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc87e3e2-2e9f-405d-9aa5-a7c444528874-kube-api-access-s68l6 podName:dc87e3e2-2e9f-405d-9aa5-a7c444528874 nodeName:}" failed. No retries permitted until 2026-06-05 15:08:24.397752769 +0000 UTC m=+18.293270861 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-s68l6" (UniqueName: "kubernetes.io/projected/dc87e3e2-2e9f-405d-9aa5-a7c444528874-kube-api-access-s68l6") pod "network-check-target-wz2bw" (UID: "dc87e3e2-2e9f-405d-9aa5-a7c444528874") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:08:16.592051 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:16.591963 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lpj" Jun 05 15:08:16.592210 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:16.592098 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2lpj" podUID="9137360a-945f-4be7-a6da-25d3be6241fa" Jun 05 15:08:16.592210 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:16.592131 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rmrn7" Jun 05 15:08:16.592328 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:16.592258 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rmrn7" podUID="70a59546-d9b0-43b7-aa6c-72d294856aed" Jun 05 15:08:17.590761 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:17.590685 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wz2bw" Jun 05 15:08:17.591214 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:17.590806 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wz2bw" podUID="dc87e3e2-2e9f-405d-9aa5-a7c444528874" Jun 05 15:08:18.591482 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:18.591438 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lpj" Jun 05 15:08:18.591921 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:18.591491 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rmrn7" Jun 05 15:08:18.591921 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:18.591575 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2lpj" podUID="9137360a-945f-4be7-a6da-25d3be6241fa" Jun 05 15:08:18.591921 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:18.591722 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rmrn7" podUID="70a59546-d9b0-43b7-aa6c-72d294856aed" Jun 05 15:08:19.590869 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:19.590813 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wz2bw" Jun 05 15:08:19.591077 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:19.590963 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wz2bw" podUID="dc87e3e2-2e9f-405d-9aa5-a7c444528874" Jun 05 15:08:20.591702 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:20.591663 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rmrn7" Jun 05 15:08:20.592221 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:20.591663 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lpj" Jun 05 15:08:20.592221 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:20.591808 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rmrn7" podUID="70a59546-d9b0-43b7-aa6c-72d294856aed" Jun 05 15:08:20.592221 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:20.591918 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2lpj" podUID="9137360a-945f-4be7-a6da-25d3be6241fa" Jun 05 15:08:21.591317 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:21.591286 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wz2bw" Jun 05 15:08:21.591509 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:21.591386 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wz2bw" podUID="dc87e3e2-2e9f-405d-9aa5-a7c444528874" Jun 05 15:08:22.590918 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:22.590871 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lpj" Jun 05 15:08:22.590918 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:22.590888 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rmrn7" Jun 05 15:08:22.591401 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:22.591023 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2lpj" podUID="9137360a-945f-4be7-a6da-25d3be6241fa" Jun 05 15:08:22.591401 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:22.591144 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rmrn7" podUID="70a59546-d9b0-43b7-aa6c-72d294856aed" Jun 05 15:08:23.590865 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:23.590658 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wz2bw" Jun 05 15:08:23.591063 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:23.590968 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wz2bw" podUID="dc87e3e2-2e9f-405d-9aa5-a7c444528874" Jun 05 15:08:24.358183 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:24.358144 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70a59546-d9b0-43b7-aa6c-72d294856aed-original-pull-secret\") pod \"global-pull-secret-syncer-rmrn7\" (UID: \"70a59546-d9b0-43b7-aa6c-72d294856aed\") " pod="kube-system/global-pull-secret-syncer-rmrn7" Jun 05 15:08:24.358358 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:24.358200 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9137360a-945f-4be7-a6da-25d3be6241fa-metrics-certs\") pod \"network-metrics-daemon-j2lpj\" (UID: \"9137360a-945f-4be7-a6da-25d3be6241fa\") " pod="openshift-multus/network-metrics-daemon-j2lpj" Jun 05 15:08:24.358358 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:24.358305 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 15:08:24.358358 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:24.358345 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:08:24.358547 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:24.358368 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70a59546-d9b0-43b7-aa6c-72d294856aed-original-pull-secret podName:70a59546-d9b0-43b7-aa6c-72d294856aed nodeName:}" failed. No retries permitted until 2026-06-05 15:08:40.358353037 +0000 UTC m=+34.253871119 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/70a59546-d9b0-43b7-aa6c-72d294856aed-original-pull-secret") pod "global-pull-secret-syncer-rmrn7" (UID: "70a59546-d9b0-43b7-aa6c-72d294856aed") : object "kube-system"/"original-pull-secret" not registered Jun 05 15:08:24.358547 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:24.358397 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9137360a-945f-4be7-a6da-25d3be6241fa-metrics-certs podName:9137360a-945f-4be7-a6da-25d3be6241fa nodeName:}" failed. No retries permitted until 2026-06-05 15:08:40.358379861 +0000 UTC m=+34.253897943 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9137360a-945f-4be7-a6da-25d3be6241fa-metrics-certs") pod "network-metrics-daemon-j2lpj" (UID: "9137360a-945f-4be7-a6da-25d3be6241fa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:08:24.459392 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:24.459357 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s68l6\" (UniqueName: \"kubernetes.io/projected/dc87e3e2-2e9f-405d-9aa5-a7c444528874-kube-api-access-s68l6\") pod \"network-check-target-wz2bw\" (UID: \"dc87e3e2-2e9f-405d-9aa5-a7c444528874\") " pod="openshift-network-diagnostics/network-check-target-wz2bw" Jun 05 15:08:24.459570 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:24.459492 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 15:08:24.459570 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:24.459507 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 15:08:24.459570 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:24.459517 2560 projected.go:196] Error preparing data for projected volume kube-api-access-s68l6 for pod openshift-network-diagnostics/network-check-target-wz2bw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:08:24.459712 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:24.459583 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc87e3e2-2e9f-405d-9aa5-a7c444528874-kube-api-access-s68l6 podName:dc87e3e2-2e9f-405d-9aa5-a7c444528874 nodeName:}" failed. No retries permitted until 2026-06-05 15:08:40.45956355 +0000 UTC m=+34.355081628 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-s68l6" (UniqueName: "kubernetes.io/projected/dc87e3e2-2e9f-405d-9aa5-a7c444528874-kube-api-access-s68l6") pod "network-check-target-wz2bw" (UID: "dc87e3e2-2e9f-405d-9aa5-a7c444528874") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:08:24.591292 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:24.591261 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rmrn7" Jun 05 15:08:24.591698 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:24.591267 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lpj" Jun 05 15:08:24.591698 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:24.591397 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rmrn7" podUID="70a59546-d9b0-43b7-aa6c-72d294856aed" Jun 05 15:08:24.591698 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:24.591450 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2lpj" podUID="9137360a-945f-4be7-a6da-25d3be6241fa" Jun 05 15:08:25.591083 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:25.591043 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wz2bw" Jun 05 15:08:25.591261 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:25.591159 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wz2bw" podUID="dc87e3e2-2e9f-405d-9aa5-a7c444528874" Jun 05 15:08:26.591395 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:26.591368 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rmrn7" Jun 05 15:08:26.591874 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:26.591455 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lpj" Jun 05 15:08:26.591874 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:26.591475 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rmrn7" podUID="70a59546-d9b0-43b7-aa6c-72d294856aed" Jun 05 15:08:26.591874 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:26.591595 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2lpj" podUID="9137360a-945f-4be7-a6da-25d3be6241fa" Jun 05 15:08:27.591440 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:27.591411 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wz2bw" Jun 05 15:08:27.591791 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:27.591510 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wz2bw" podUID="dc87e3e2-2e9f-405d-9aa5-a7c444528874" Jun 05 15:08:28.591021 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:28.590866 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rmrn7" Jun 05 15:08:28.591185 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:28.590877 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lpj" Jun 05 15:08:28.591185 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:28.591105 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rmrn7" podUID="70a59546-d9b0-43b7-aa6c-72d294856aed" Jun 05 15:08:28.591299 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:28.591222 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2lpj" podUID="9137360a-945f-4be7-a6da-25d3be6241fa" Jun 05 15:08:28.689872 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:28.689839 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2nrvs" event={"ID":"cc603818-b45b-4274-b792-47b121c133a7","Type":"ContainerStarted","Data":"5a9cd92a60fee6448cc1cce664423c22e915654e9512905817b30888aa3338e3"} Jun 05 15:08:28.691775 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:28.691748 2560 generic.go:356] "Generic (PLEG): container finished" podID="2a40ce2e-4726-44e7-aea3-0278d610c96d" containerID="fd98af20fd0a192847050a85aff21e3d03cb2489ed1cf65fc507a439714e67b7" exitCode=0 Jun 05 15:08:28.691889 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:28.691843 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jqpvb" event={"ID":"2a40ce2e-4726-44e7-aea3-0278d610c96d","Type":"ContainerDied","Data":"fd98af20fd0a192847050a85aff21e3d03cb2489ed1cf65fc507a439714e67b7"} Jun 05 15:08:28.693872 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:28.693849 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-69xsz" event={"ID":"9c7936f0-3a4d-4553-b67c-90eea6c1fcd6","Type":"ContainerStarted","Data":"5bb3c5c99e1df27cf0984849eb8708078d59f9de07bbaedd4ae68e4e83d76e80"} Jun 05 15:08:28.695616 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:28.695591 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-chbh5" event={"ID":"bf33dc4e-b571-415e-817d-e1985a4f656a","Type":"ContainerStarted","Data":"0c4bd95a1599c16aa494a16331fc95f98e0986e75a08d066b54b8cd016d2d19b"} Jun 05 15:08:28.698117 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:28.698015 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7wnx_3e51389e-8fe0-48a4-b902-493bfa632cf8/ovn-acl-logging/0.log" Jun 05 15:08:28.698367 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:28.698342 2560 generic.go:356] "Generic (PLEG): container finished" podID="3e51389e-8fe0-48a4-b902-493bfa632cf8" containerID="b5de2975fb4a538c4e73356d47b29c8896cb158deb7ea48f99e19bdfbcf634a2" exitCode=1 Jun 05 15:08:28.698480 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:28.698408 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" event={"ID":"3e51389e-8fe0-48a4-b902-493bfa632cf8","Type":"ContainerStarted","Data":"f0478808c2d1257a545941bc6cdaeefadd9d690d59a955939f6a3a3e4bf4e376"} Jun 05 15:08:28.698539 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:28.698503 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" event={"ID":"3e51389e-8fe0-48a4-b902-493bfa632cf8","Type":"ContainerStarted","Data":"80dafdbad6536ea4f2e8020c7361dbc49e95df9ea6ff2661bc733023a2bc5071"} Jun 05 15:08:28.698609 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:28.698557 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" event={"ID":"3e51389e-8fe0-48a4-b902-493bfa632cf8","Type":"ContainerDied","Data":"b5de2975fb4a538c4e73356d47b29c8896cb158deb7ea48f99e19bdfbcf634a2"} Jun 05 15:08:28.698666 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:28.698610 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" event={"ID":"3e51389e-8fe0-48a4-b902-493bfa632cf8","Type":"ContainerStarted","Data":"c90302124c6b9b19ba5cdcb18f9cb1bc1c01677d27e8f90b32a49ee3bc9dab2a"} Jun 05 15:08:28.700176 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:28.700148 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xkmsq" event={"ID":"8be0d1c2-caab-4e33-beca-14b2a59dd3f6","Type":"ContainerStarted","Data":"20a8b042c8ee50263f323d980d69bd39abb2e939fc142bbf3c52d992d25aed40"} Jun 05 15:08:28.701779 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:28.701739 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" event={"ID":"95d1fafb-0436-4863-a157-1d3776569b4d","Type":"ContainerStarted","Data":"a872cf9ea113570fbe1f1a884d7c82576a5e421cda05ff5d491a4deae9e674e8"} Jun 05 15:08:28.703323 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:28.703301 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-njqmz" event={"ID":"e8542cc3-5226-41a3-b049-76c6e0aafd54","Type":"ContainerStarted","Data":"719bdccd546581259566f37c74b3e3b81cd4306c5ecd324dffcfacd1d07a8a8c"} Jun 05 15:08:28.705022 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:28.704979 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2nrvs" podStartSLOduration=4.412026478 podStartE2EDuration="22.704963854s" totalImagesPullingTime="18.292937376s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:08:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:08:28.704885464 +0000 UTC m=+22.600403574" watchObservedRunningTime="2026-06-05 15:08:28.704963854 +0000 UTC m=+22.600481956" Jun 05 15:08:28.705519 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:28.705462 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-97.ec2.internal" podStartSLOduration=21.705449346 podStartE2EDuration="21.705449346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:08:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:08:11.668717901 +0000 UTC m=+5.564236002" watchObservedRunningTime="2026-06-05 15:08:28.705449346 +0000 UTC m=+22.600967447" Jun 05 15:08:28.720073 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:28.720038 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-chbh5" podStartSLOduration=12.764349666 podStartE2EDuration="22.720025979s" totalImagesPullingTime="9.955676313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:08:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:08:28.719893318 +0000 UTC m=+22.615411418" watchObservedRunningTime="2026-06-05 15:08:28.720025979 +0000 UTC m=+22.615544078" Jun 05 15:08:28.758233 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:28.758193 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-69xsz" podStartSLOduration=4.435584388 podStartE2EDuration="22.758177984s" totalImagesPullingTime="18.322593596s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:08:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:08:28.757787863 +0000 UTC m=+22.653305963" watchObservedRunningTime="2026-06-05 15:08:28.758177984 +0000 UTC m=+22.653696083" Jun 05 15:08:28.774079 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:28.774034 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6t5jj" podStartSLOduration=4.448197721 podStartE2EDuration="22.774009832s" totalImagesPullingTime="18.325812111s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:08:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:08:28.773730359 +0000 UTC m=+22.669248458" watchObservedRunningTime="2026-06-05 15:08:28.774009832 +0000 UTC m=+22.669527931" Jun 05 15:08:28.790585 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:28.790534 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-njqmz" podStartSLOduration=4.458658908 podStartE2EDuration="22.790519378s" totalImagesPullingTime="18.33186047s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:08:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:08:28.790022169 +0000 UTC m=+22.685540268" watchObservedRunningTime="2026-06-05 15:08:28.790519378 +0000 UTC m=+22.686037477" Jun 05 15:08:28.996929 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:28.996889 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-chbh5" Jun 05 15:08:28.997344 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:28.997327 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-chbh5" Jun 05 15:08:29.330016 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:29.329769 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 05 15:08:29.585503 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:29.585365 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-05T15:08:29.330008839Z","UUID":"08f6a5ac-a6c9-4169-a098-bacd899a1608","Handler":null,"Name":"","Endpoint":""} Jun 05 15:08:29.587344 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:29.587320 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 05 15:08:29.587492 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:29.587362 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 05 15:08:29.590723 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:29.590699 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wz2bw" Jun 05 15:08:29.590834 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:29.590813 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wz2bw" podUID="dc87e3e2-2e9f-405d-9aa5-a7c444528874" Jun 05 15:08:29.709452 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:29.709431 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7wnx_3e51389e-8fe0-48a4-b902-493bfa632cf8/ovn-acl-logging/0.log" Jun 05 15:08:29.709864 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:29.709839 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" event={"ID":"3e51389e-8fe0-48a4-b902-493bfa632cf8","Type":"ContainerStarted","Data":"773d96a198cefcfc5311e186acfbe7f2db906790efcb132d7ffdb807dbed9dbb"} Jun 05 15:08:29.710007 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:29.709942 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" event={"ID":"3e51389e-8fe0-48a4-b902-493bfa632cf8","Type":"ContainerStarted","Data":"8699d2d1dd265cbc9ea5caee1febb439d5bb6bea218051f5c09c4e834dc74cda"} Jun 05 15:08:29.713292 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:29.713259 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xkmsq" event={"ID":"8be0d1c2-caab-4e33-beca-14b2a59dd3f6","Type":"ContainerStarted","Data":"387d3427cb7514339770c7db063dfc89f5ec634581df8aa8e927566443cd0a57"} Jun 05 15:08:29.715757 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:29.715637 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j8kft" event={"ID":"fad1c381-03d0-4779-8116-f8537742c2a4","Type":"ContainerStarted","Data":"7a2189f94b60cdfd6c030ed3f096fe862f34aeb172de18e53ddbca4bf7d14769"} Jun 05 15:08:29.716454 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:29.716399 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-chbh5" Jun 05 15:08:29.716578 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:29.716561 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-chbh5" Jun 05 15:08:29.730550 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:29.730501 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-j8kft" podStartSLOduration=5.408703364 podStartE2EDuration="23.730483666s" totalImagesPullingTime="18.321780302s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:08:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:08:29.729739551 +0000 UTC m=+23.625257664" watchObservedRunningTime="2026-06-05 15:08:29.730483666 +0000 UTC m=+23.626001766" Jun 05 15:08:30.591264 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:30.591169 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rmrn7" Jun 05 15:08:30.591427 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:30.591273 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lpj" Jun 05 15:08:30.591427 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:30.591330 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rmrn7" podUID="70a59546-d9b0-43b7-aa6c-72d294856aed" Jun 05 15:08:30.591427 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:30.591355 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2lpj" podUID="9137360a-945f-4be7-a6da-25d3be6241fa" Jun 05 15:08:30.720481 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:30.720434 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xkmsq" event={"ID":"8be0d1c2-caab-4e33-beca-14b2a59dd3f6","Type":"ContainerStarted","Data":"95ef1bfd4a5c56c3cba0954ea64befdef9d0bada5aecf2c76a2f212e9bc54e21"} Jun 05 15:08:30.738174 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:30.738123 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xkmsq" podStartSLOduration=4.488778877 podStartE2EDuration="24.738102868s" totalImagesPullingTime="20.249323991s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:08:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:08:30.737977129 +0000 UTC m=+24.633495230" watchObservedRunningTime="2026-06-05 15:08:30.738102868 +0000 UTC m=+24.633620968" Jun 05 15:08:31.591103 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:31.591071 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wz2bw" Jun 05 15:08:31.591273 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:31.591195 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wz2bw" podUID="dc87e3e2-2e9f-405d-9aa5-a7c444528874" Jun 05 15:08:32.590852 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:32.590819 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rmrn7" Jun 05 15:08:32.591455 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:32.590958 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rmrn7" podUID="70a59546-d9b0-43b7-aa6c-72d294856aed" Jun 05 15:08:32.591455 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:32.591016 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lpj" Jun 05 15:08:32.591455 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:32.591111 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2lpj" podUID="9137360a-945f-4be7-a6da-25d3be6241fa" Jun 05 15:08:33.591448 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:33.591416 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wz2bw" Jun 05 15:08:33.591876 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:33.591528 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wz2bw" podUID="dc87e3e2-2e9f-405d-9aa5-a7c444528874" Jun 05 15:08:33.728617 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:33.728585 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7wnx_3e51389e-8fe0-48a4-b902-493bfa632cf8/ovn-acl-logging/0.log" Jun 05 15:08:33.728977 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:33.728951 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" event={"ID":"3e51389e-8fe0-48a4-b902-493bfa632cf8","Type":"ContainerStarted","Data":"ad33df81fa3139149dff66821610824c41cefe3b988e0518cc7fb51b7d6d21a4"} Jun 05 15:08:33.730530 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:33.730508 2560 generic.go:356] "Generic (PLEG): container finished" podID="2a40ce2e-4726-44e7-aea3-0278d610c96d" containerID="f000336433ce8ced828c834e6b1df7236e25168f43d7e47b1453ca1ffe7bd827" exitCode=0 Jun 05 15:08:33.730631 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:33.730544 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jqpvb" event={"ID":"2a40ce2e-4726-44e7-aea3-0278d610c96d","Type":"ContainerDied","Data":"f000336433ce8ced828c834e6b1df7236e25168f43d7e47b1453ca1ffe7bd827"} Jun 05 15:08:34.591471 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:34.591428 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rmrn7" Jun 05 15:08:34.591940 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:34.591540 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rmrn7" podUID="70a59546-d9b0-43b7-aa6c-72d294856aed" Jun 05 15:08:34.591940 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:34.591597 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lpj" Jun 05 15:08:34.591940 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:34.591687 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2lpj" podUID="9137360a-945f-4be7-a6da-25d3be6241fa" Jun 05 15:08:35.590867 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:35.590680 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wz2bw" Jun 05 15:08:35.591050 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:35.590972 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wz2bw" podUID="dc87e3e2-2e9f-405d-9aa5-a7c444528874" Jun 05 15:08:35.736435 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:35.736402 2560 generic.go:356] "Generic (PLEG): container finished" podID="2a40ce2e-4726-44e7-aea3-0278d610c96d" containerID="e2b82ccf61bcd02e8ca5cdba9148ce3dceb5f6bd15aa604db1317724b1836cc0" exitCode=0 Jun 05 15:08:35.736978 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:35.736486 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jqpvb" event={"ID":"2a40ce2e-4726-44e7-aea3-0278d610c96d","Type":"ContainerDied","Data":"e2b82ccf61bcd02e8ca5cdba9148ce3dceb5f6bd15aa604db1317724b1836cc0"} Jun 05 15:08:35.740117 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:35.740093 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7wnx_3e51389e-8fe0-48a4-b902-493bfa632cf8/ovn-acl-logging/0.log" Jun 05 15:08:35.740466 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:35.740442 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" event={"ID":"3e51389e-8fe0-48a4-b902-493bfa632cf8","Type":"ContainerStarted","Data":"132027c8d677923e3c2f85dcdaa82029eb92f8aee244c163a93d7b507dfee20c"} Jun 05 15:08:35.740721 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:35.740703 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:35.740794 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:35.740766 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:35.740894 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:35.740879 2560 scope.go:117] "RemoveContainer" containerID="b5de2975fb4a538c4e73356d47b29c8896cb158deb7ea48f99e19bdfbcf634a2" Jun 05 15:08:35.757734 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:35.757716 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:36.591951 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:36.591899 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lpj" Jun 05 15:08:36.592112 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:36.592024 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2lpj" podUID="9137360a-945f-4be7-a6da-25d3be6241fa" Jun 05 15:08:36.592112 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:36.592076 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rmrn7" Jun 05 15:08:36.592233 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:36.592159 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rmrn7" podUID="70a59546-d9b0-43b7-aa6c-72d294856aed" Jun 05 15:08:36.752921 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:36.752813 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7wnx_3e51389e-8fe0-48a4-b902-493bfa632cf8/ovn-acl-logging/0.log" Jun 05 15:08:36.753581 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:36.753432 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" event={"ID":"3e51389e-8fe0-48a4-b902-493bfa632cf8","Type":"ContainerStarted","Data":"1caac479a5ab14401e0b7293f6efc6c45b7798d9b9a76a80514e00fbbe77cb66"} Jun 05 15:08:36.754768 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:36.754330 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:36.777402 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:36.777142 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:08:36.784116 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:36.784003 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" podStartSLOduration=12.048841308 podStartE2EDuration="30.78398254s" totalImagesPullingTime="18.735141232s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:08:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:08:36.783376762 +0000 UTC m=+30.678894886" watchObservedRunningTime="2026-06-05 15:08:36.78398254 +0000 UTC m=+30.679500641" Jun 05 15:08:37.013945 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:37.013894 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rmrn7"] Jun 05 15:08:37.014117 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:37.014048 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rmrn7" Jun 05 15:08:37.014202 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:37.014162 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rmrn7" podUID="70a59546-d9b0-43b7-aa6c-72d294856aed" Jun 05 15:08:37.017801 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:37.017527 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j2lpj"] Jun 05 15:08:37.017801 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:37.017653 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lpj" Jun 05 15:08:37.017801 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:37.017762 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2lpj" podUID="9137360a-945f-4be7-a6da-25d3be6241fa" Jun 05 15:08:37.018349 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:37.018297 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wz2bw"] Jun 05 15:08:37.018491 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:37.018389 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wz2bw" Jun 05 15:08:37.018570 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:37.018483 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wz2bw" podUID="dc87e3e2-2e9f-405d-9aa5-a7c444528874" Jun 05 15:08:37.757679 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:37.757649 2560 generic.go:356] "Generic (PLEG): container finished" podID="2a40ce2e-4726-44e7-aea3-0278d610c96d" containerID="2168f2dd93cd45ce607142ff0b3e18cd3a1384b382ad42bb080633b7791eb53a" exitCode=0 Jun 05 15:08:37.758454 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:37.757730 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jqpvb" event={"ID":"2a40ce2e-4726-44e7-aea3-0278d610c96d","Type":"ContainerDied","Data":"2168f2dd93cd45ce607142ff0b3e18cd3a1384b382ad42bb080633b7791eb53a"} Jun 05 15:08:38.591333 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:38.591301 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lpj" Jun 05 15:08:38.591503 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:38.591302 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wz2bw" Jun 05 15:08:38.591503 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:38.591442 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2lpj" podUID="9137360a-945f-4be7-a6da-25d3be6241fa" Jun 05 15:08:38.591503 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:38.591460 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rmrn7" Jun 05 15:08:38.591645 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:38.591546 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wz2bw" podUID="dc87e3e2-2e9f-405d-9aa5-a7c444528874" Jun 05 15:08:38.591696 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:38.591639 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rmrn7" podUID="70a59546-d9b0-43b7-aa6c-72d294856aed" Jun 05 15:08:40.383096 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:40.383053 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70a59546-d9b0-43b7-aa6c-72d294856aed-original-pull-secret\") pod \"global-pull-secret-syncer-rmrn7\" (UID: \"70a59546-d9b0-43b7-aa6c-72d294856aed\") " pod="kube-system/global-pull-secret-syncer-rmrn7" Jun 05 15:08:40.383813 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:40.383120 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9137360a-945f-4be7-a6da-25d3be6241fa-metrics-certs\") pod \"network-metrics-daemon-j2lpj\" (UID: \"9137360a-945f-4be7-a6da-25d3be6241fa\") " pod="openshift-multus/network-metrics-daemon-j2lpj" Jun 05 15:08:40.383813 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:40.383208 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 15:08:40.383813 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:40.383238 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:08:40.383813 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:40.383280 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70a59546-d9b0-43b7-aa6c-72d294856aed-original-pull-secret podName:70a59546-d9b0-43b7-aa6c-72d294856aed nodeName:}" failed. No retries permitted until 2026-06-05 15:09:12.383260309 +0000 UTC m=+66.278778391 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/70a59546-d9b0-43b7-aa6c-72d294856aed-original-pull-secret") pod "global-pull-secret-syncer-rmrn7" (UID: "70a59546-d9b0-43b7-aa6c-72d294856aed") : object "kube-system"/"original-pull-secret" not registered Jun 05 15:08:40.383813 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:40.383299 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9137360a-945f-4be7-a6da-25d3be6241fa-metrics-certs podName:9137360a-945f-4be7-a6da-25d3be6241fa nodeName:}" failed. No retries permitted until 2026-06-05 15:09:12.383288746 +0000 UTC m=+66.278806836 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9137360a-945f-4be7-a6da-25d3be6241fa-metrics-certs") pod "network-metrics-daemon-j2lpj" (UID: "9137360a-945f-4be7-a6da-25d3be6241fa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:08:40.484461 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:40.484413 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s68l6\" (UniqueName: \"kubernetes.io/projected/dc87e3e2-2e9f-405d-9aa5-a7c444528874-kube-api-access-s68l6\") pod \"network-check-target-wz2bw\" (UID: \"dc87e3e2-2e9f-405d-9aa5-a7c444528874\") " pod="openshift-network-diagnostics/network-check-target-wz2bw" Jun 05 15:08:40.484638 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:40.484589 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 15:08:40.484638 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:40.484616 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 15:08:40.484638 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:40.484629 2560 projected.go:196] Error preparing data for projected volume kube-api-access-s68l6 for pod openshift-network-diagnostics/network-check-target-wz2bw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:08:40.484802 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:40.484692 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc87e3e2-2e9f-405d-9aa5-a7c444528874-kube-api-access-s68l6 podName:dc87e3e2-2e9f-405d-9aa5-a7c444528874 nodeName:}" failed. No retries permitted until 2026-06-05 15:09:12.484671439 +0000 UTC m=+66.380189526 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-s68l6" (UniqueName: "kubernetes.io/projected/dc87e3e2-2e9f-405d-9aa5-a7c444528874-kube-api-access-s68l6") pod "network-check-target-wz2bw" (UID: "dc87e3e2-2e9f-405d-9aa5-a7c444528874") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:08:40.591577 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:40.591545 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rmrn7" Jun 05 15:08:40.591577 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:40.591556 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lpj" Jun 05 15:08:40.591805 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:40.591600 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wz2bw" Jun 05 15:08:40.591805 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:40.591724 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2lpj" podUID="9137360a-945f-4be7-a6da-25d3be6241fa" Jun 05 15:08:40.591942 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:40.591797 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wz2bw" podUID="dc87e3e2-2e9f-405d-9aa5-a7c444528874" Jun 05 15:08:40.591942 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:40.591877 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rmrn7" podUID="70a59546-d9b0-43b7-aa6c-72d294856aed" Jun 05 15:08:41.865799 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:41.865731 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-97.ec2.internal" event="NodeReady" Jun 05 15:08:41.866170 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:41.865845 2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 05 15:08:41.910897 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:41.910853 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8d5qm"] Jun 05 15:08:41.932822 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:41.932802 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-g4qm9"] Jun 05 15:08:41.932946 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:41.932929 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8d5qm" Jun 05 15:08:41.935226 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:41.935207 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rncfk\"" Jun 05 15:08:41.935328 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:41.935246 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 05 15:08:41.935328 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:41.935258 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 05 15:08:41.949104 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:41.949082 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-g4qm9"] Jun 05 15:08:41.949192 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:41.949110 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8d5qm"] Jun 05 15:08:41.949237 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:41.949191 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g4qm9" Jun 05 15:08:41.951606 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:41.951583 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 05 15:08:41.951706 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:41.951630 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 05 15:08:41.951706 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:41.951636 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-66bp6\"" Jun 05 15:08:41.951805 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:41.951719 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 05 15:08:42.097615 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:42.097431 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkksw\" (UniqueName: \"kubernetes.io/projected/c521bb9d-3aae-47f9-b597-6ef61f55b131-kube-api-access-fkksw\") pod \"dns-default-8d5qm\" (UID: \"c521bb9d-3aae-47f9-b597-6ef61f55b131\") " pod="openshift-dns/dns-default-8d5qm" Jun 05 15:08:42.097740 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:42.097636 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c521bb9d-3aae-47f9-b597-6ef61f55b131-metrics-tls\") pod \"dns-default-8d5qm\" (UID: \"c521bb9d-3aae-47f9-b597-6ef61f55b131\") " pod="openshift-dns/dns-default-8d5qm" Jun 05 15:08:42.097740 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:42.097662 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c521bb9d-3aae-47f9-b597-6ef61f55b131-tmp-dir\") pod \"dns-default-8d5qm\" (UID: \"c521bb9d-3aae-47f9-b597-6ef61f55b131\") " pod="openshift-dns/dns-default-8d5qm" Jun 05 15:08:42.097740 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:42.097713 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c521bb9d-3aae-47f9-b597-6ef61f55b131-config-volume\") pod \"dns-default-8d5qm\" (UID: \"c521bb9d-3aae-47f9-b597-6ef61f55b131\") " pod="openshift-dns/dns-default-8d5qm" Jun 05 15:08:42.097894 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:42.097820 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b540521-50dd-4407-9756-824f14cfeaaf-cert\") pod \"ingress-canary-g4qm9\" (UID: \"0b540521-50dd-4407-9756-824f14cfeaaf\") " pod="openshift-ingress-canary/ingress-canary-g4qm9" Jun 05 15:08:42.097894 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:42.097861 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfrfx\" (UniqueName: \"kubernetes.io/projected/0b540521-50dd-4407-9756-824f14cfeaaf-kube-api-access-mfrfx\") pod \"ingress-canary-g4qm9\" (UID: \"0b540521-50dd-4407-9756-824f14cfeaaf\") " pod="openshift-ingress-canary/ingress-canary-g4qm9" Jun 05 15:08:42.198287 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:42.198260 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c521bb9d-3aae-47f9-b597-6ef61f55b131-config-volume\") pod \"dns-default-8d5qm\" (UID: \"c521bb9d-3aae-47f9-b597-6ef61f55b131\") " pod="openshift-dns/dns-default-8d5qm" Jun 05 15:08:42.198374 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:42.198301 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b540521-50dd-4407-9756-824f14cfeaaf-cert\") pod \"ingress-canary-g4qm9\" (UID: \"0b540521-50dd-4407-9756-824f14cfeaaf\") " pod="openshift-ingress-canary/ingress-canary-g4qm9" Jun 05 15:08:42.198430 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:42.198395 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfrfx\" (UniqueName: \"kubernetes.io/projected/0b540521-50dd-4407-9756-824f14cfeaaf-kube-api-access-mfrfx\") pod \"ingress-canary-g4qm9\" (UID: \"0b540521-50dd-4407-9756-824f14cfeaaf\") " pod="openshift-ingress-canary/ingress-canary-g4qm9" Jun 05 15:08:42.198430 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:42.198423 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkksw\" (UniqueName: \"kubernetes.io/projected/c521bb9d-3aae-47f9-b597-6ef61f55b131-kube-api-access-fkksw\") pod \"dns-default-8d5qm\" (UID: \"c521bb9d-3aae-47f9-b597-6ef61f55b131\") " pod="openshift-dns/dns-default-8d5qm" Jun 05 15:08:42.198514 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:42.198446 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c521bb9d-3aae-47f9-b597-6ef61f55b131-metrics-tls\") pod \"dns-default-8d5qm\" (UID: \"c521bb9d-3aae-47f9-b597-6ef61f55b131\") " pod="openshift-dns/dns-default-8d5qm" Jun 05 15:08:42.198514 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:42.198464 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c521bb9d-3aae-47f9-b597-6ef61f55b131-tmp-dir\") pod \"dns-default-8d5qm\" (UID: \"c521bb9d-3aae-47f9-b597-6ef61f55b131\") " pod="openshift-dns/dns-default-8d5qm" Jun 05 15:08:42.198609 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:42.198591 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 15:08:42.198688 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:42.198676 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c521bb9d-3aae-47f9-b597-6ef61f55b131-metrics-tls podName:c521bb9d-3aae-47f9-b597-6ef61f55b131 nodeName:}" failed. No retries permitted until 2026-06-05 15:08:42.698652343 +0000 UTC m=+36.594170433 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c521bb9d-3aae-47f9-b597-6ef61f55b131-metrics-tls") pod "dns-default-8d5qm" (UID: "c521bb9d-3aae-47f9-b597-6ef61f55b131") : secret "dns-default-metrics-tls" not found Jun 05 15:08:42.198749 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:42.198736 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c521bb9d-3aae-47f9-b597-6ef61f55b131-tmp-dir\") pod \"dns-default-8d5qm\" (UID: \"c521bb9d-3aae-47f9-b597-6ef61f55b131\") " pod="openshift-dns/dns-default-8d5qm" Jun 05 15:08:42.199032 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:42.199012 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c521bb9d-3aae-47f9-b597-6ef61f55b131-config-volume\") pod \"dns-default-8d5qm\" (UID: \"c521bb9d-3aae-47f9-b597-6ef61f55b131\") " pod="openshift-dns/dns-default-8d5qm" Jun 05 15:08:42.202411 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:42.202386 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b540521-50dd-4407-9756-824f14cfeaaf-cert\") pod \"ingress-canary-g4qm9\" (UID: \"0b540521-50dd-4407-9756-824f14cfeaaf\") " pod="openshift-ingress-canary/ingress-canary-g4qm9" Jun 05 15:08:42.206816 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:42.206797 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkksw\" (UniqueName: \"kubernetes.io/projected/c521bb9d-3aae-47f9-b597-6ef61f55b131-kube-api-access-fkksw\") pod \"dns-default-8d5qm\" (UID: \"c521bb9d-3aae-47f9-b597-6ef61f55b131\") " pod="openshift-dns/dns-default-8d5qm" Jun 05 15:08:42.207020 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:42.207004 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfrfx\" (UniqueName: \"kubernetes.io/projected/0b540521-50dd-4407-9756-824f14cfeaaf-kube-api-access-mfrfx\") pod \"ingress-canary-g4qm9\" (UID: \"0b540521-50dd-4407-9756-824f14cfeaaf\") " pod="openshift-ingress-canary/ingress-canary-g4qm9" Jun 05 15:08:42.258034 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:42.258014 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g4qm9" Jun 05 15:08:42.379999 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:42.379964 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-g4qm9"] Jun 05 15:08:42.384208 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:42.384141 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b540521_50dd_4407_9756_824f14cfeaaf.slice/crio-3ddbe263be9f329d10e377e14518e68e2c4c12242f4b27c2dd51bf1096ff8149 WatchSource:0}: Error finding container 3ddbe263be9f329d10e377e14518e68e2c4c12242f4b27c2dd51bf1096ff8149: Status 404 returned error can't find the container with id 3ddbe263be9f329d10e377e14518e68e2c4c12242f4b27c2dd51bf1096ff8149 Jun 05 15:08:42.590768 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:42.590746 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rmrn7" Jun 05 15:08:42.590768 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:42.590756 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lpj" Jun 05 15:08:42.590928 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:42.590746 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wz2bw" Jun 05 15:08:42.593717 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:42.593695 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 15:08:42.593841 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:42.593804 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tc9d6\"" Jun 05 15:08:42.593934 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:42.593919 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 15:08:42.593984 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:42.593969 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 15:08:42.594032 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:42.593977 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 15:08:42.594032 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:42.594013 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8hlll\"" Jun 05 15:08:42.701839 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:42.701820 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c521bb9d-3aae-47f9-b597-6ef61f55b131-metrics-tls\") pod \"dns-default-8d5qm\" (UID: \"c521bb9d-3aae-47f9-b597-6ef61f55b131\") " pod="openshift-dns/dns-default-8d5qm" Jun 05 15:08:42.701968 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:42.701938 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 15:08:42.702019 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:42.701996 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c521bb9d-3aae-47f9-b597-6ef61f55b131-metrics-tls podName:c521bb9d-3aae-47f9-b597-6ef61f55b131 nodeName:}" failed. No retries permitted until 2026-06-05 15:08:43.70197891 +0000 UTC m=+37.597496996 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c521bb9d-3aae-47f9-b597-6ef61f55b131-metrics-tls") pod "dns-default-8d5qm" (UID: "c521bb9d-3aae-47f9-b597-6ef61f55b131") : secret "dns-default-metrics-tls" not found Jun 05 15:08:42.771549 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:42.771523 2560 generic.go:356] "Generic (PLEG): container finished" podID="2a40ce2e-4726-44e7-aea3-0278d610c96d" containerID="6b976c103b13e786dd04312b632a2cee6e8d77db983c7ad18f5d558fc13ad866" exitCode=0 Jun 05 15:08:42.771670 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:42.771608 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jqpvb" event={"ID":"2a40ce2e-4726-44e7-aea3-0278d610c96d","Type":"ContainerDied","Data":"6b976c103b13e786dd04312b632a2cee6e8d77db983c7ad18f5d558fc13ad866"} Jun 05 15:08:42.773100 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:42.773019 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-g4qm9" event={"ID":"0b540521-50dd-4407-9756-824f14cfeaaf","Type":"ContainerStarted","Data":"3ddbe263be9f329d10e377e14518e68e2c4c12242f4b27c2dd51bf1096ff8149"} Jun 05 15:08:43.708213 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:43.708175 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c521bb9d-3aae-47f9-b597-6ef61f55b131-metrics-tls\") pod \"dns-default-8d5qm\" (UID: \"c521bb9d-3aae-47f9-b597-6ef61f55b131\") " pod="openshift-dns/dns-default-8d5qm" Jun 05 15:08:43.708751 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:43.708354 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 15:08:43.708751 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:43.708420 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c521bb9d-3aae-47f9-b597-6ef61f55b131-metrics-tls podName:c521bb9d-3aae-47f9-b597-6ef61f55b131 nodeName:}" failed. No retries permitted until 2026-06-05 15:08:45.708402879 +0000 UTC m=+39.603920958 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c521bb9d-3aae-47f9-b597-6ef61f55b131-metrics-tls") pod "dns-default-8d5qm" (UID: "c521bb9d-3aae-47f9-b597-6ef61f55b131") : secret "dns-default-metrics-tls" not found Jun 05 15:08:43.779984 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:43.779884 2560 generic.go:356] "Generic (PLEG): container finished" podID="2a40ce2e-4726-44e7-aea3-0278d610c96d" containerID="15c9a8dbdc889448075f677de5dce4e192f36e3474cba93fd0d0383edb24ffc3" exitCode=0 Jun 05 15:08:43.779984 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:43.779955 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jqpvb" event={"ID":"2a40ce2e-4726-44e7-aea3-0278d610c96d","Type":"ContainerDied","Data":"15c9a8dbdc889448075f677de5dce4e192f36e3474cba93fd0d0383edb24ffc3"} Jun 05 15:08:44.785692 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:44.785491 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jqpvb" event={"ID":"2a40ce2e-4726-44e7-aea3-0278d610c96d","Type":"ContainerStarted","Data":"b5c42478c63f9da4e4fb5ecb4fd67b4f7a0d4342a0751b22d229d12c787e01b2"} Jun 05 15:08:44.786872 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:44.786852 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-g4qm9" event={"ID":"0b540521-50dd-4407-9756-824f14cfeaaf","Type":"ContainerStarted","Data":"dc070842ff8722c8f7e1dd56d1cd7560090991e3c30f71203b126ebf3b5d4acc"} Jun 05 15:08:44.812782 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:44.812731 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jqpvb" podStartSLOduration=9.915580186 podStartE2EDuration="38.812714835s" totalImagesPullingTime="28.897134649s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:08:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:08:44.812511429 +0000 UTC m=+38.708029540" watchObservedRunningTime="2026-06-05 15:08:44.812714835 +0000 UTC m=+38.708232936" Jun 05 15:08:44.831781 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:44.831734 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-g4qm9" podStartSLOduration=2.306721667 podStartE2EDuration="3.831718038s" totalImagesPullingTime="1.524996371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:08:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:08:44.83115448 +0000 UTC m=+38.726672600" watchObservedRunningTime="2026-06-05 15:08:44.831718038 +0000 UTC m=+38.727236138" Jun 05 15:08:45.723848 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:45.723809 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c521bb9d-3aae-47f9-b597-6ef61f55b131-metrics-tls\") pod \"dns-default-8d5qm\" (UID: \"c521bb9d-3aae-47f9-b597-6ef61f55b131\") " pod="openshift-dns/dns-default-8d5qm" Jun 05 15:08:45.724094 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:45.724078 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 15:08:45.724148 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:45.724138 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c521bb9d-3aae-47f9-b597-6ef61f55b131-metrics-tls podName:c521bb9d-3aae-47f9-b597-6ef61f55b131 nodeName:}" failed. No retries permitted until 2026-06-05 15:08:49.724123868 +0000 UTC m=+43.619641946 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c521bb9d-3aae-47f9-b597-6ef61f55b131-metrics-tls") pod "dns-default-8d5qm" (UID: "c521bb9d-3aae-47f9-b597-6ef61f55b131") : secret "dns-default-metrics-tls" not found Jun 05 15:08:49.749238 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:49.749191 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c521bb9d-3aae-47f9-b597-6ef61f55b131-metrics-tls\") pod \"dns-default-8d5qm\" (UID: \"c521bb9d-3aae-47f9-b597-6ef61f55b131\") " pod="openshift-dns/dns-default-8d5qm" Jun 05 15:08:49.749703 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:49.749366 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 15:08:49.749703 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:49.749435 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c521bb9d-3aae-47f9-b597-6ef61f55b131-metrics-tls podName:c521bb9d-3aae-47f9-b597-6ef61f55b131 nodeName:}" failed. No retries permitted until 2026-06-05 15:08:57.749416057 +0000 UTC m=+51.644934144 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c521bb9d-3aae-47f9-b597-6ef61f55b131-metrics-tls") pod "dns-default-8d5qm" (UID: "c521bb9d-3aae-47f9-b597-6ef61f55b131") : secret "dns-default-metrics-tls" not found Jun 05 15:08:57.229039 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.229007 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8864bb6dd-ftwqw"] Jun 05 15:08:57.276486 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.276457 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d477d498f-sd7js"] Jun 05 15:08:57.276626 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.276559 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8864bb6dd-ftwqw" Jun 05 15:08:57.279735 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.279707 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 05 15:08:57.279869 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.279799 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 05 15:08:57.279983 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.279967 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 05 15:08:57.280560 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.280540 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 05 15:08:57.300094 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.300072 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8864bb6dd-ftwqw"] Jun 05 15:08:57.300184 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.300105 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d477d498f-sd7js"] Jun 05 15:08:57.300231 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.300181 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d477d498f-sd7js" Jun 05 15:08:57.303717 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.303700 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 05 15:08:57.303933 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.303918 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 05 15:08:57.304020 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.303983 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 05 15:08:57.304020 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.304000 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 05 15:08:57.403972 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.403941 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e17c9f4e-6809-4547-b082-752aea375266-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d477d498f-sd7js\" (UID: \"e17c9f4e-6809-4547-b082-752aea375266\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d477d498f-sd7js" Jun 05 15:08:57.404104 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.403981 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e17c9f4e-6809-4547-b082-752aea375266-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d477d498f-sd7js\" (UID: \"e17c9f4e-6809-4547-b082-752aea375266\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d477d498f-sd7js" Jun 05 15:08:57.404104 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.404020 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28a13201-8259-4d39-85a1-a1e6f58c778b-tmp\") pod \"klusterlet-addon-workmgr-8864bb6dd-ftwqw\" (UID: \"28a13201-8259-4d39-85a1-a1e6f58c778b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8864bb6dd-ftwqw" Jun 05 15:08:57.404104 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.404053 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx59g\" (UniqueName: \"kubernetes.io/projected/28a13201-8259-4d39-85a1-a1e6f58c778b-kube-api-access-dx59g\") pod \"klusterlet-addon-workmgr-8864bb6dd-ftwqw\" (UID: \"28a13201-8259-4d39-85a1-a1e6f58c778b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8864bb6dd-ftwqw" Jun 05 15:08:57.404104 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.404074 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e17c9f4e-6809-4547-b082-752aea375266-hub\") pod \"cluster-proxy-proxy-agent-5d477d498f-sd7js\" (UID: \"e17c9f4e-6809-4547-b082-752aea375266\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d477d498f-sd7js" Jun 05 15:08:57.404245 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.404157 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e17c9f4e-6809-4547-b082-752aea375266-ca\") pod \"cluster-proxy-proxy-agent-5d477d498f-sd7js\" (UID: \"e17c9f4e-6809-4547-b082-752aea375266\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d477d498f-sd7js" Jun 05 15:08:57.404245 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.404182 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e17c9f4e-6809-4547-b082-752aea375266-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d477d498f-sd7js\" (UID: \"e17c9f4e-6809-4547-b082-752aea375266\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d477d498f-sd7js" Jun 05 15:08:57.404245 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.404215 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/28a13201-8259-4d39-85a1-a1e6f58c778b-klusterlet-config\") pod \"klusterlet-addon-workmgr-8864bb6dd-ftwqw\" (UID: \"28a13201-8259-4d39-85a1-a1e6f58c778b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8864bb6dd-ftwqw" Jun 05 15:08:57.404245 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.404230 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5znwc\" (UniqueName: \"kubernetes.io/projected/e17c9f4e-6809-4547-b082-752aea375266-kube-api-access-5znwc\") pod \"cluster-proxy-proxy-agent-5d477d498f-sd7js\" (UID: \"e17c9f4e-6809-4547-b082-752aea375266\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d477d498f-sd7js" Jun 05 15:08:57.505161 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.505098 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e17c9f4e-6809-4547-b082-752aea375266-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d477d498f-sd7js\" (UID: \"e17c9f4e-6809-4547-b082-752aea375266\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d477d498f-sd7js" Jun 05 15:08:57.505161 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.505148 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28a13201-8259-4d39-85a1-a1e6f58c778b-tmp\") pod \"klusterlet-addon-workmgr-8864bb6dd-ftwqw\" (UID: \"28a13201-8259-4d39-85a1-a1e6f58c778b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8864bb6dd-ftwqw" Jun 05 15:08:57.505362 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.505165 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dx59g\" (UniqueName: \"kubernetes.io/projected/28a13201-8259-4d39-85a1-a1e6f58c778b-kube-api-access-dx59g\") pod \"klusterlet-addon-workmgr-8864bb6dd-ftwqw\" (UID: \"28a13201-8259-4d39-85a1-a1e6f58c778b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8864bb6dd-ftwqw" Jun 05 15:08:57.505362 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.505179 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e17c9f4e-6809-4547-b082-752aea375266-hub\") pod \"cluster-proxy-proxy-agent-5d477d498f-sd7js\" (UID: \"e17c9f4e-6809-4547-b082-752aea375266\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d477d498f-sd7js" Jun 05 15:08:57.505362 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.505199 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e17c9f4e-6809-4547-b082-752aea375266-ca\") pod \"cluster-proxy-proxy-agent-5d477d498f-sd7js\" (UID: \"e17c9f4e-6809-4547-b082-752aea375266\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d477d498f-sd7js" Jun 05 15:08:57.505362 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.505217 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e17c9f4e-6809-4547-b082-752aea375266-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d477d498f-sd7js\" (UID: \"e17c9f4e-6809-4547-b082-752aea375266\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d477d498f-sd7js" Jun 05 15:08:57.505362 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.505297 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/28a13201-8259-4d39-85a1-a1e6f58c778b-klusterlet-config\") pod \"klusterlet-addon-workmgr-8864bb6dd-ftwqw\" (UID: \"28a13201-8259-4d39-85a1-a1e6f58c778b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8864bb6dd-ftwqw" Jun 05 15:08:57.505362 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.505339 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5znwc\" (UniqueName: \"kubernetes.io/projected/e17c9f4e-6809-4547-b082-752aea375266-kube-api-access-5znwc\") pod \"cluster-proxy-proxy-agent-5d477d498f-sd7js\" (UID: \"e17c9f4e-6809-4547-b082-752aea375266\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d477d498f-sd7js" Jun 05 15:08:57.505661 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.505398 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e17c9f4e-6809-4547-b082-752aea375266-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d477d498f-sd7js\" (UID: \"e17c9f4e-6809-4547-b082-752aea375266\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d477d498f-sd7js" Jun 05 15:08:57.506059 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.506033 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e17c9f4e-6809-4547-b082-752aea375266-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d477d498f-sd7js\" (UID: \"e17c9f4e-6809-4547-b082-752aea375266\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d477d498f-sd7js" Jun 05 15:08:57.506206 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.506189 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28a13201-8259-4d39-85a1-a1e6f58c778b-tmp\") pod \"klusterlet-addon-workmgr-8864bb6dd-ftwqw\" (UID: \"28a13201-8259-4d39-85a1-a1e6f58c778b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8864bb6dd-ftwqw" Jun 05 15:08:57.508785 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.508753 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e17c9f4e-6809-4547-b082-752aea375266-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d477d498f-sd7js\" (UID: \"e17c9f4e-6809-4547-b082-752aea375266\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d477d498f-sd7js" Jun 05 15:08:57.508900 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.508835 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e17c9f4e-6809-4547-b082-752aea375266-ca\") pod \"cluster-proxy-proxy-agent-5d477d498f-sd7js\" (UID: \"e17c9f4e-6809-4547-b082-752aea375266\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d477d498f-sd7js" Jun 05 15:08:57.508900 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.508862 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/28a13201-8259-4d39-85a1-a1e6f58c778b-klusterlet-config\") pod \"klusterlet-addon-workmgr-8864bb6dd-ftwqw\" (UID: \"28a13201-8259-4d39-85a1-a1e6f58c778b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8864bb6dd-ftwqw" Jun 05 15:08:57.509028 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.508957 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e17c9f4e-6809-4547-b082-752aea375266-hub\") pod \"cluster-proxy-proxy-agent-5d477d498f-sd7js\" (UID: \"e17c9f4e-6809-4547-b082-752aea375266\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d477d498f-sd7js" Jun 05 15:08:57.509028 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.508977 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e17c9f4e-6809-4547-b082-752aea375266-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d477d498f-sd7js\" (UID: \"e17c9f4e-6809-4547-b082-752aea375266\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d477d498f-sd7js" Jun 05 15:08:57.513073 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.513045 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5znwc\" (UniqueName: \"kubernetes.io/projected/e17c9f4e-6809-4547-b082-752aea375266-kube-api-access-5znwc\") pod \"cluster-proxy-proxy-agent-5d477d498f-sd7js\" (UID: \"e17c9f4e-6809-4547-b082-752aea375266\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d477d498f-sd7js" Jun 05 15:08:57.513240 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.513221 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx59g\" (UniqueName: \"kubernetes.io/projected/28a13201-8259-4d39-85a1-a1e6f58c778b-kube-api-access-dx59g\") pod \"klusterlet-addon-workmgr-8864bb6dd-ftwqw\" (UID: \"28a13201-8259-4d39-85a1-a1e6f58c778b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8864bb6dd-ftwqw" Jun 05 15:08:57.585332 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.585312 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8864bb6dd-ftwqw" Jun 05 15:08:57.617395 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.617235 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d477d498f-sd7js" Jun 05 15:08:57.741344 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.740732 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8864bb6dd-ftwqw"] Jun 05 15:08:57.746528 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:57.746500 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28a13201_8259_4d39_85a1_a1e6f58c778b.slice/crio-f6dc8d722ae5e97d5d6c20c68d3ca2faaa66062b9fc82e1991c25de12cac7b5f WatchSource:0}: Error finding container f6dc8d722ae5e97d5d6c20c68d3ca2faaa66062b9fc82e1991c25de12cac7b5f: Status 404 returned error can't find the container with id f6dc8d722ae5e97d5d6c20c68d3ca2faaa66062b9fc82e1991c25de12cac7b5f Jun 05 15:08:57.758126 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.758072 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d477d498f-sd7js"] Jun 05 15:08:57.760939 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:08:57.760916 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode17c9f4e_6809_4547_b082_752aea375266.slice/crio-951297a1ba007d9e5e3e11fc6f7252aa4ec3e79728b059d466d3ad35ccff7f3a WatchSource:0}: Error finding container 951297a1ba007d9e5e3e11fc6f7252aa4ec3e79728b059d466d3ad35ccff7f3a: Status 404 returned error can't find the container with id 951297a1ba007d9e5e3e11fc6f7252aa4ec3e79728b059d466d3ad35ccff7f3a Jun 05 15:08:57.808413 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.808388 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c521bb9d-3aae-47f9-b597-6ef61f55b131-metrics-tls\") pod \"dns-default-8d5qm\" (UID: \"c521bb9d-3aae-47f9-b597-6ef61f55b131\") " pod="openshift-dns/dns-default-8d5qm" Jun 05 15:08:57.808533 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:57.808516 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 15:08:57.808584 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:08:57.808567 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c521bb9d-3aae-47f9-b597-6ef61f55b131-metrics-tls podName:c521bb9d-3aae-47f9-b597-6ef61f55b131 nodeName:}" failed. No retries permitted until 2026-06-05 15:09:13.808553361 +0000 UTC m=+67.704071442 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c521bb9d-3aae-47f9-b597-6ef61f55b131-metrics-tls") pod "dns-default-8d5qm" (UID: "c521bb9d-3aae-47f9-b597-6ef61f55b131") : secret "dns-default-metrics-tls" not found Jun 05 15:08:57.817185 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.817158 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d477d498f-sd7js" event={"ID":"e17c9f4e-6809-4547-b082-752aea375266","Type":"ContainerStarted","Data":"951297a1ba007d9e5e3e11fc6f7252aa4ec3e79728b059d466d3ad35ccff7f3a"} Jun 05 15:08:57.818215 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:08:57.818197 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8864bb6dd-ftwqw" event={"ID":"28a13201-8259-4d39-85a1-a1e6f58c778b","Type":"ContainerStarted","Data":"f6dc8d722ae5e97d5d6c20c68d3ca2faaa66062b9fc82e1991c25de12cac7b5f"} Jun 05 15:09:04.841444 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:09:04.841406 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d477d498f-sd7js" event={"ID":"e17c9f4e-6809-4547-b082-752aea375266","Type":"ContainerStarted","Data":"bd7cdf2e4715b904e719fd90389f56baeed796c487319f9fb29f5a8b8eccc4c6"} Jun 05 15:09:04.841860 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:09:04.841455 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d477d498f-sd7js" event={"ID":"e17c9f4e-6809-4547-b082-752aea375266","Type":"ContainerStarted","Data":"e3657220311ca6171fe130e40ba20c860195999d073de8ef2aa6c0428960baa7"} Jun 05 15:09:04.841860 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:09:04.841470 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d477d498f-sd7js" event={"ID":"e17c9f4e-6809-4547-b082-752aea375266","Type":"ContainerStarted","Data":"30cb265e80ab7bbbfebe40f822266483dbb88a51fc6df82aff227379dbe40a9c"} Jun 05 15:09:04.842839 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:09:04.842816 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8864bb6dd-ftwqw" event={"ID":"28a13201-8259-4d39-85a1-a1e6f58c778b","Type":"ContainerStarted","Data":"d94024b471221975b85560b621b56b61551453adc1eb0c2d0f93ccc91f1e5fe9"} Jun 05 15:09:04.843031 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:09:04.843014 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8864bb6dd-ftwqw" Jun 05 15:09:04.844664 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:09:04.844644 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8864bb6dd-ftwqw" Jun 05 15:09:04.860703 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:09:04.860663 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d477d498f-sd7js" podStartSLOduration=1.823591642 podStartE2EDuration="7.860650049s" totalImagesPullingTime="6.037058407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:08:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:09:04.859681244 +0000 UTC m=+58.755199355" watchObservedRunningTime="2026-06-05 15:09:04.860650049 +0000 UTC m=+58.756168127" Jun 05 15:09:08.769772 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:09:08.769737 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c7wnx" Jun 05 15:09:08.797711 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:09:08.797666 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8864bb6dd-ftwqw" podStartSLOduration=5.760163974 podStartE2EDuration="11.797652692s" totalImagesPullingTime="6.037488718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:08:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:09:04.876078079 +0000 UTC m=+58.771596180" watchObservedRunningTime="2026-06-05 15:09:08.797652692 +0000 UTC m=+62.693170792" Jun 05 15:09:12.416096 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:09:12.416063 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70a59546-d9b0-43b7-aa6c-72d294856aed-original-pull-secret\") pod \"global-pull-secret-syncer-rmrn7\" (UID: \"70a59546-d9b0-43b7-aa6c-72d294856aed\") " pod="kube-system/global-pull-secret-syncer-rmrn7" Jun 05 15:09:12.416520 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:09:12.416105 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9137360a-945f-4be7-a6da-25d3be6241fa-metrics-certs\") pod \"network-metrics-daemon-j2lpj\" (UID: \"9137360a-945f-4be7-a6da-25d3be6241fa\") " pod="openshift-multus/network-metrics-daemon-j2lpj" Jun 05 15:09:12.419048 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:09:12.419029 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 15:09:12.419215 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:09:12.419198 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 15:09:12.427238 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:09:12.427218 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 15:09:12.427313 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:09:12.427271 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9137360a-945f-4be7-a6da-25d3be6241fa-metrics-certs podName:9137360a-945f-4be7-a6da-25d3be6241fa nodeName:}" failed. No retries permitted until 2026-06-05 15:10:16.427255213 +0000 UTC m=+130.322773291 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9137360a-945f-4be7-a6da-25d3be6241fa-metrics-certs") pod "network-metrics-daemon-j2lpj" (UID: "9137360a-945f-4be7-a6da-25d3be6241fa") : secret "metrics-daemon-secret" not found Jun 05 15:09:12.429322 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:09:12.429302 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70a59546-d9b0-43b7-aa6c-72d294856aed-original-pull-secret\") pod \"global-pull-secret-syncer-rmrn7\" (UID: \"70a59546-d9b0-43b7-aa6c-72d294856aed\") " pod="kube-system/global-pull-secret-syncer-rmrn7" Jun 05 15:09:12.516828 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:09:12.516808 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s68l6\" (UniqueName: \"kubernetes.io/projected/dc87e3e2-2e9f-405d-9aa5-a7c444528874-kube-api-access-s68l6\") pod \"network-check-target-wz2bw\" (UID: \"dc87e3e2-2e9f-405d-9aa5-a7c444528874\") " pod="openshift-network-diagnostics/network-check-target-wz2bw" Jun 05 15:09:12.519539 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:09:12.519523 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 15:09:12.529628 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:09:12.529612 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 15:09:12.539776 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:09:12.539752 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s68l6\" (UniqueName: \"kubernetes.io/projected/dc87e3e2-2e9f-405d-9aa5-a7c444528874-kube-api-access-s68l6\") pod \"network-check-target-wz2bw\" (UID: \"dc87e3e2-2e9f-405d-9aa5-a7c444528874\") " pod="openshift-network-diagnostics/network-check-target-wz2bw" Jun 05 15:09:12.601679 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:09:12.601650 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rmrn7" Jun 05 15:09:12.613440 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:09:12.613418 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tc9d6\"" Jun 05 15:09:12.621723 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:09:12.621706 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wz2bw" Jun 05 15:09:12.731271 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:09:12.731245 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rmrn7"] Jun 05 15:09:12.734497 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:09:12.734474 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70a59546_d9b0_43b7_aa6c_72d294856aed.slice/crio-e2f05d7e8f224b8ac8ba97d9b3dc4c313570ce5a9ff2a52409ecbbc4f55def69 WatchSource:0}: Error finding container e2f05d7e8f224b8ac8ba97d9b3dc4c313570ce5a9ff2a52409ecbbc4f55def69: Status 404 returned error can't find the container with id e2f05d7e8f224b8ac8ba97d9b3dc4c313570ce5a9ff2a52409ecbbc4f55def69 Jun 05 15:09:12.747999 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:09:12.747975 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wz2bw"] Jun 05 15:09:12.750709 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:09:12.750685 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc87e3e2_2e9f_405d_9aa5_a7c444528874.slice/crio-ed59161681be59a26b033fe0bde6950cee68dde54bcfa46eaea3470e7a1b0678 WatchSource:0}: Error finding container ed59161681be59a26b033fe0bde6950cee68dde54bcfa46eaea3470e7a1b0678: Status 404 returned error can't find the container with id ed59161681be59a26b033fe0bde6950cee68dde54bcfa46eaea3470e7a1b0678 Jun 05 15:09:12.861699 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:09:12.861666 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wz2bw" event={"ID":"dc87e3e2-2e9f-405d-9aa5-a7c444528874","Type":"ContainerStarted","Data":"ed59161681be59a26b033fe0bde6950cee68dde54bcfa46eaea3470e7a1b0678"} Jun 05 15:09:12.862732 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:09:12.862708 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rmrn7" event={"ID":"70a59546-d9b0-43b7-aa6c-72d294856aed","Type":"ContainerStarted","Data":"e2f05d7e8f224b8ac8ba97d9b3dc4c313570ce5a9ff2a52409ecbbc4f55def69"} Jun 05 15:09:13.827061 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:09:13.827027 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c521bb9d-3aae-47f9-b597-6ef61f55b131-metrics-tls\") pod \"dns-default-8d5qm\" (UID: \"c521bb9d-3aae-47f9-b597-6ef61f55b131\") " pod="openshift-dns/dns-default-8d5qm" Jun 05 15:09:13.827437 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:09:13.827185 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 15:09:13.827437 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:09:13.827251 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c521bb9d-3aae-47f9-b597-6ef61f55b131-metrics-tls podName:c521bb9d-3aae-47f9-b597-6ef61f55b131 nodeName:}" failed. No retries permitted until 2026-06-05 15:09:45.827235634 +0000 UTC m=+99.722753711 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c521bb9d-3aae-47f9-b597-6ef61f55b131-metrics-tls") pod "dns-default-8d5qm" (UID: "c521bb9d-3aae-47f9-b597-6ef61f55b131") : secret "dns-default-metrics-tls" not found Jun 05 15:09:17.880507 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:09:17.880465 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wz2bw" event={"ID":"dc87e3e2-2e9f-405d-9aa5-a7c444528874","Type":"ContainerStarted","Data":"85b83f90e5ed8069cd51c38b781135f3a17a46c94f991e0e53dbe89aa5b88311"} Jun 05 15:09:17.880931 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:09:17.880575 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wz2bw" Jun 05 15:09:17.881866 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:09:17.881845 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rmrn7" event={"ID":"70a59546-d9b0-43b7-aa6c-72d294856aed","Type":"ContainerStarted","Data":"541032c698a1d407bd64904fc83b3c68f03e68714a33cd1fe4df824043cb7229"} Jun 05 15:09:17.896357 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:09:17.896315 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wz2bw" podStartSLOduration=67.459304895 podStartE2EDuration="1m11.896302916s" totalImagesPullingTime="4.436998021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:08:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:09:17.895577156 +0000 UTC m=+71.791095256" watchObservedRunningTime="2026-06-05 15:09:17.896302916 +0000 UTC m=+71.791821015" Jun 05 15:09:17.908635 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:09:17.908597 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rmrn7" podStartSLOduration=67.451902294 podStartE2EDuration="1m11.908585888s" totalImagesPullingTime="4.456683594s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:08:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:09:17.908496045 +0000 UTC m=+71.804014151" watchObservedRunningTime="2026-06-05 15:09:17.908585888 +0000 UTC m=+71.804103985" Jun 05 15:09:45.837940 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:09:45.837891 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c521bb9d-3aae-47f9-b597-6ef61f55b131-metrics-tls\") pod \"dns-default-8d5qm\" (UID: \"c521bb9d-3aae-47f9-b597-6ef61f55b131\") " pod="openshift-dns/dns-default-8d5qm" Jun 05 15:09:45.838510 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:09:45.838060 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 15:09:45.838510 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:09:45.838147 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c521bb9d-3aae-47f9-b597-6ef61f55b131-metrics-tls podName:c521bb9d-3aae-47f9-b597-6ef61f55b131 nodeName:}" failed. No retries permitted until 2026-06-05 15:10:49.838122677 +0000 UTC m=+163.733640755 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c521bb9d-3aae-47f9-b597-6ef61f55b131-metrics-tls") pod "dns-default-8d5qm" (UID: "c521bb9d-3aae-47f9-b597-6ef61f55b131") : secret "dns-default-metrics-tls" not found Jun 05 15:09:48.887525 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:09:48.887496 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wz2bw" Jun 05 15:10:16.429945 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:10:16.429887 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9137360a-945f-4be7-a6da-25d3be6241fa-metrics-certs\") pod \"network-metrics-daemon-j2lpj\" (UID: \"9137360a-945f-4be7-a6da-25d3be6241fa\") " pod="openshift-multus/network-metrics-daemon-j2lpj" Jun 05 15:10:16.430386 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:10:16.430037 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 15:10:16.430386 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:10:16.430104 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9137360a-945f-4be7-a6da-25d3be6241fa-metrics-certs podName:9137360a-945f-4be7-a6da-25d3be6241fa nodeName:}" failed. No retries permitted until 2026-06-05 15:12:18.430085983 +0000 UTC m=+252.325604060 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9137360a-945f-4be7-a6da-25d3be6241fa-metrics-certs") pod "network-metrics-daemon-j2lpj" (UID: "9137360a-945f-4be7-a6da-25d3be6241fa") : secret "metrics-daemon-secret" not found Jun 05 15:10:44.942770 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:10:44.942725 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8d5qm" podUID="c521bb9d-3aae-47f9-b597-6ef61f55b131" Jun 05 15:10:45.139003 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:10:45.138967 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8d5qm" Jun 05 15:10:45.606975 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:10:45.606933 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-j2lpj" podUID="9137360a-945f-4be7-a6da-25d3be6241fa" Jun 05 15:10:49.937431 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:10:49.937382 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c521bb9d-3aae-47f9-b597-6ef61f55b131-metrics-tls\") pod \"dns-default-8d5qm\" (UID: \"c521bb9d-3aae-47f9-b597-6ef61f55b131\") " pod="openshift-dns/dns-default-8d5qm" Jun 05 15:10:49.937839 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:10:49.937525 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 15:10:49.937839 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:10:49.937590 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c521bb9d-3aae-47f9-b597-6ef61f55b131-metrics-tls podName:c521bb9d-3aae-47f9-b597-6ef61f55b131 nodeName:}" failed. No retries permitted until 2026-06-05 15:12:51.937572475 +0000 UTC m=+285.833090556 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c521bb9d-3aae-47f9-b597-6ef61f55b131-metrics-tls") pod "dns-default-8d5qm" (UID: "c521bb9d-3aae-47f9-b597-6ef61f55b131") : secret "dns-default-metrics-tls" not found Jun 05 15:10:58.591523 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:10:58.591478 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lpj" Jun 05 15:11:04.197610 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:04.197584 2560 generic.go:356] "Generic (PLEG): container finished" podID="28a13201-8259-4d39-85a1-a1e6f58c778b" containerID="d94024b471221975b85560b621b56b61551453adc1eb0c2d0f93ccc91f1e5fe9" exitCode=1 Jun 05 15:11:04.197924 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:04.197632 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8864bb6dd-ftwqw" event={"ID":"28a13201-8259-4d39-85a1-a1e6f58c778b","Type":"ContainerDied","Data":"d94024b471221975b85560b621b56b61551453adc1eb0c2d0f93ccc91f1e5fe9"} Jun 05 15:11:04.197968 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:04.197921 2560 scope.go:117] "RemoveContainer" containerID="d94024b471221975b85560b621b56b61551453adc1eb0c2d0f93ccc91f1e5fe9" Jun 05 15:11:04.843475 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:04.843442 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8864bb6dd-ftwqw" Jun 05 15:11:05.201690 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:05.201657 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8864bb6dd-ftwqw" event={"ID":"28a13201-8259-4d39-85a1-a1e6f58c778b","Type":"ContainerStarted","Data":"f0a669eef848348c9883a100d73bdfe6980bbb4c1b38e94645f8a3ad25333792"} Jun 05 15:11:05.202083 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:05.201928 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8864bb6dd-ftwqw" Jun 05 15:11:05.202453 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:05.202436 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8864bb6dd-ftwqw" Jun 05 15:11:35.188859 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:35.188830 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-69xsz_9c7936f0-3a4d-4553-b67c-90eea6c1fcd6/dns-node-resolver/0.log" Jun 05 15:11:36.192133 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:36.192099 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2nrvs_cc603818-b45b-4274-b792-47b121c133a7/node-ca/0.log" Jun 05 15:11:36.990392 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:36.990362 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-g4qm9_0b540521-50dd-4407-9756-824f14cfeaaf/serve-healthcheck-canary/0.log" Jun 05 15:11:57.027292 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.027261 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-55qbh"] Jun 05 15:11:57.030390 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.030370 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-55qbh" Jun 05 15:11:57.043703 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.043682 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 05 15:11:57.043994 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.043979 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zvk7z\"" Jun 05 15:11:57.044068 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.044052 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 05 15:11:57.045698 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.045680 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 05 15:11:57.050170 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.050156 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 05 15:11:57.062744 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.062727 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/84a1a20f-fa8f-4c65-8116-4c15a54c2b33-crio-socket\") pod \"insights-runtime-extractor-55qbh\" (UID: \"84a1a20f-fa8f-4c65-8116-4c15a54c2b33\") " pod="openshift-insights/insights-runtime-extractor-55qbh" Jun 05 15:11:57.062853 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.062769 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/84a1a20f-fa8f-4c65-8116-4c15a54c2b33-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-55qbh\" (UID: \"84a1a20f-fa8f-4c65-8116-4c15a54c2b33\") " pod="openshift-insights/insights-runtime-extractor-55qbh" Jun 05 15:11:57.062853 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.062807 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/84a1a20f-fa8f-4c65-8116-4c15a54c2b33-data-volume\") pod \"insights-runtime-extractor-55qbh\" (UID: \"84a1a20f-fa8f-4c65-8116-4c15a54c2b33\") " pod="openshift-insights/insights-runtime-extractor-55qbh" Jun 05 15:11:57.062853 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.062825 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8z2l\" (UniqueName: \"kubernetes.io/projected/84a1a20f-fa8f-4c65-8116-4c15a54c2b33-kube-api-access-r8z2l\") pod \"insights-runtime-extractor-55qbh\" (UID: \"84a1a20f-fa8f-4c65-8116-4c15a54c2b33\") " pod="openshift-insights/insights-runtime-extractor-55qbh" Jun 05 15:11:57.062989 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.062861 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/84a1a20f-fa8f-4c65-8116-4c15a54c2b33-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-55qbh\" (UID: \"84a1a20f-fa8f-4c65-8116-4c15a54c2b33\") " pod="openshift-insights/insights-runtime-extractor-55qbh" Jun 05 15:11:57.063955 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.063929 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-55qbh"] Jun 05 15:11:57.163681 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.163651 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/84a1a20f-fa8f-4c65-8116-4c15a54c2b33-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-55qbh\" (UID: \"84a1a20f-fa8f-4c65-8116-4c15a54c2b33\") " pod="openshift-insights/insights-runtime-extractor-55qbh" Jun 05 15:11:57.163869 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.163716 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/84a1a20f-fa8f-4c65-8116-4c15a54c2b33-data-volume\") pod \"insights-runtime-extractor-55qbh\" (UID: \"84a1a20f-fa8f-4c65-8116-4c15a54c2b33\") " pod="openshift-insights/insights-runtime-extractor-55qbh" Jun 05 15:11:57.163869 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.163742 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8z2l\" (UniqueName: \"kubernetes.io/projected/84a1a20f-fa8f-4c65-8116-4c15a54c2b33-kube-api-access-r8z2l\") pod \"insights-runtime-extractor-55qbh\" (UID: \"84a1a20f-fa8f-4c65-8116-4c15a54c2b33\") " pod="openshift-insights/insights-runtime-extractor-55qbh" Jun 05 15:11:57.163869 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.163770 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/84a1a20f-fa8f-4c65-8116-4c15a54c2b33-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-55qbh\" (UID: \"84a1a20f-fa8f-4c65-8116-4c15a54c2b33\") " pod="openshift-insights/insights-runtime-extractor-55qbh" Jun 05 15:11:57.163869 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.163797 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/84a1a20f-fa8f-4c65-8116-4c15a54c2b33-crio-socket\") pod \"insights-runtime-extractor-55qbh\" (UID: \"84a1a20f-fa8f-4c65-8116-4c15a54c2b33\") " pod="openshift-insights/insights-runtime-extractor-55qbh" Jun 05 15:11:57.163869 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.163868 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/84a1a20f-fa8f-4c65-8116-4c15a54c2b33-crio-socket\") pod \"insights-runtime-extractor-55qbh\" (UID: \"84a1a20f-fa8f-4c65-8116-4c15a54c2b33\") " pod="openshift-insights/insights-runtime-extractor-55qbh" Jun 05 15:11:57.164135 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.164094 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/84a1a20f-fa8f-4c65-8116-4c15a54c2b33-data-volume\") pod \"insights-runtime-extractor-55qbh\" (UID: \"84a1a20f-fa8f-4c65-8116-4c15a54c2b33\") " pod="openshift-insights/insights-runtime-extractor-55qbh" Jun 05 15:11:57.164276 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.164260 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/84a1a20f-fa8f-4c65-8116-4c15a54c2b33-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-55qbh\" (UID: \"84a1a20f-fa8f-4c65-8116-4c15a54c2b33\") " pod="openshift-insights/insights-runtime-extractor-55qbh" Jun 05 15:11:57.166016 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.165998 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/84a1a20f-fa8f-4c65-8116-4c15a54c2b33-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-55qbh\" (UID: \"84a1a20f-fa8f-4c65-8116-4c15a54c2b33\") " pod="openshift-insights/insights-runtime-extractor-55qbh" Jun 05 15:11:57.182201 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.182178 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8z2l\" (UniqueName: \"kubernetes.io/projected/84a1a20f-fa8f-4c65-8116-4c15a54c2b33-kube-api-access-r8z2l\") pod \"insights-runtime-extractor-55qbh\" (UID: \"84a1a20f-fa8f-4c65-8116-4c15a54c2b33\") " pod="openshift-insights/insights-runtime-extractor-55qbh" Jun 05 15:11:57.250741 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.250714 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-559cbfcb8d-2mtxn"] Jun 05 15:11:57.253591 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.253577 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" Jun 05 15:11:57.260677 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.260655 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tvwpw\"" Jun 05 15:11:57.261668 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.261649 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 05 15:11:57.261760 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.261743 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 05 15:11:57.261803 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.261750 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 05 15:11:57.273376 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.273360 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 05 15:11:57.285975 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.285929 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-559cbfcb8d-2mtxn"] Jun 05 15:11:57.338466 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.338446 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-55qbh" Jun 05 15:11:57.364714 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.364679 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff186964-efd3-44ce-9132-b5d532084e36-installation-pull-secrets\") pod \"image-registry-559cbfcb8d-2mtxn\" (UID: \"ff186964-efd3-44ce-9132-b5d532084e36\") " pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" Jun 05 15:11:57.364820 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.364743 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqhzl\" (UniqueName: \"kubernetes.io/projected/ff186964-efd3-44ce-9132-b5d532084e36-kube-api-access-lqhzl\") pod \"image-registry-559cbfcb8d-2mtxn\" (UID: \"ff186964-efd3-44ce-9132-b5d532084e36\") " pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" Jun 05 15:11:57.364820 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.364786 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff186964-efd3-44ce-9132-b5d532084e36-image-registry-private-configuration\") pod \"image-registry-559cbfcb8d-2mtxn\" (UID: \"ff186964-efd3-44ce-9132-b5d532084e36\") " pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" Jun 05 15:11:57.364820 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.364813 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff186964-efd3-44ce-9132-b5d532084e36-registry-tls\") pod \"image-registry-559cbfcb8d-2mtxn\" (UID: \"ff186964-efd3-44ce-9132-b5d532084e36\") " pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" Jun 05 15:11:57.364947 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.364922 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff186964-efd3-44ce-9132-b5d532084e36-bound-sa-token\") pod \"image-registry-559cbfcb8d-2mtxn\" (UID: \"ff186964-efd3-44ce-9132-b5d532084e36\") " pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" Jun 05 15:11:57.364991 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.364973 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff186964-efd3-44ce-9132-b5d532084e36-registry-certificates\") pod \"image-registry-559cbfcb8d-2mtxn\" (UID: \"ff186964-efd3-44ce-9132-b5d532084e36\") " pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" Jun 05 15:11:57.365025 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.365001 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff186964-efd3-44ce-9132-b5d532084e36-trusted-ca\") pod \"image-registry-559cbfcb8d-2mtxn\" (UID: \"ff186964-efd3-44ce-9132-b5d532084e36\") " pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" Jun 05 15:11:57.365065 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.365028 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff186964-efd3-44ce-9132-b5d532084e36-ca-trust-extracted\") pod \"image-registry-559cbfcb8d-2mtxn\" (UID: \"ff186964-efd3-44ce-9132-b5d532084e36\") " pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" Jun 05 15:11:57.465779 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.465751 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff186964-efd3-44ce-9132-b5d532084e36-installation-pull-secrets\") pod \"image-registry-559cbfcb8d-2mtxn\" (UID: \"ff186964-efd3-44ce-9132-b5d532084e36\") " pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" Jun 05 15:11:57.465939 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.465803 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqhzl\" (UniqueName: \"kubernetes.io/projected/ff186964-efd3-44ce-9132-b5d532084e36-kube-api-access-lqhzl\") pod \"image-registry-559cbfcb8d-2mtxn\" (UID: \"ff186964-efd3-44ce-9132-b5d532084e36\") " pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" Jun 05 15:11:57.465939 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.465821 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff186964-efd3-44ce-9132-b5d532084e36-image-registry-private-configuration\") pod \"image-registry-559cbfcb8d-2mtxn\" (UID: \"ff186964-efd3-44ce-9132-b5d532084e36\") " pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" Jun 05 15:11:57.465939 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.465836 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff186964-efd3-44ce-9132-b5d532084e36-registry-tls\") pod \"image-registry-559cbfcb8d-2mtxn\" (UID: \"ff186964-efd3-44ce-9132-b5d532084e36\") " pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" Jun 05 15:11:57.466104 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.465996 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff186964-efd3-44ce-9132-b5d532084e36-bound-sa-token\") pod \"image-registry-559cbfcb8d-2mtxn\" (UID: \"ff186964-efd3-44ce-9132-b5d532084e36\") " pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" Jun 05 15:11:57.466104 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.466057 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff186964-efd3-44ce-9132-b5d532084e36-registry-certificates\") pod \"image-registry-559cbfcb8d-2mtxn\" (UID: \"ff186964-efd3-44ce-9132-b5d532084e36\") " pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" Jun 05 15:11:57.466262 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.466104 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff186964-efd3-44ce-9132-b5d532084e36-trusted-ca\") pod \"image-registry-559cbfcb8d-2mtxn\" (UID: \"ff186964-efd3-44ce-9132-b5d532084e36\") " pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" Jun 05 15:11:57.466262 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.466133 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff186964-efd3-44ce-9132-b5d532084e36-ca-trust-extracted\") pod \"image-registry-559cbfcb8d-2mtxn\" (UID: \"ff186964-efd3-44ce-9132-b5d532084e36\") " pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" Jun 05 15:11:57.466586 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.466556 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff186964-efd3-44ce-9132-b5d532084e36-ca-trust-extracted\") pod \"image-registry-559cbfcb8d-2mtxn\" (UID: \"ff186964-efd3-44ce-9132-b5d532084e36\") " pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" Jun 05 15:11:57.466962 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.466941 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff186964-efd3-44ce-9132-b5d532084e36-registry-certificates\") pod \"image-registry-559cbfcb8d-2mtxn\" (UID: \"ff186964-efd3-44ce-9132-b5d532084e36\") " pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" Jun 05 15:11:57.467014 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.466985 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff186964-efd3-44ce-9132-b5d532084e36-trusted-ca\") pod \"image-registry-559cbfcb8d-2mtxn\" (UID: \"ff186964-efd3-44ce-9132-b5d532084e36\") " pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" Jun 05 15:11:57.468140 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.468122 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff186964-efd3-44ce-9132-b5d532084e36-registry-tls\") pod \"image-registry-559cbfcb8d-2mtxn\" (UID: \"ff186964-efd3-44ce-9132-b5d532084e36\") " pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" Jun 05 15:11:57.468534 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.468510 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff186964-efd3-44ce-9132-b5d532084e36-image-registry-private-configuration\") pod \"image-registry-559cbfcb8d-2mtxn\" (UID: \"ff186964-efd3-44ce-9132-b5d532084e36\") " pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" Jun 05 15:11:57.468709 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.468690 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff186964-efd3-44ce-9132-b5d532084e36-installation-pull-secrets\") pod \"image-registry-559cbfcb8d-2mtxn\" (UID: \"ff186964-efd3-44ce-9132-b5d532084e36\") " pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" Jun 05 15:11:57.494554 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:11:57.494532 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84a1a20f_fa8f_4c65_8116_4c15a54c2b33.slice/crio-b42045401c3d45825b8d3e536c87502a3b52440eb8eec943fe1890ef0895d64b WatchSource:0}: Error finding container b42045401c3d45825b8d3e536c87502a3b52440eb8eec943fe1890ef0895d64b: Status 404 returned error can't find the container with id b42045401c3d45825b8d3e536c87502a3b52440eb8eec943fe1890ef0895d64b Jun 05 15:11:57.495703 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.495682 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqhzl\" (UniqueName: \"kubernetes.io/projected/ff186964-efd3-44ce-9132-b5d532084e36-kube-api-access-lqhzl\") pod \"image-registry-559cbfcb8d-2mtxn\" (UID: \"ff186964-efd3-44ce-9132-b5d532084e36\") " pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" Jun 05 15:11:57.496503 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.496483 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-55qbh"] Jun 05 15:11:57.497123 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.497108 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff186964-efd3-44ce-9132-b5d532084e36-bound-sa-token\") pod \"image-registry-559cbfcb8d-2mtxn\" (UID: \"ff186964-efd3-44ce-9132-b5d532084e36\") " pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" Jun 05 15:11:57.562052 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.562032 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" Jun 05 15:11:57.813044 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:57.812976 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-559cbfcb8d-2mtxn"] Jun 05 15:11:57.816127 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:11:57.816108 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff186964_efd3_44ce_9132_b5d532084e36.slice/crio-582794eaa04c7b837411b057edafe5179955e70624f1658078f093f768d2dfe0 WatchSource:0}: Error finding container 582794eaa04c7b837411b057edafe5179955e70624f1658078f093f768d2dfe0: Status 404 returned error can't find the container with id 582794eaa04c7b837411b057edafe5179955e70624f1658078f093f768d2dfe0 Jun 05 15:11:58.365152 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:58.365062 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" event={"ID":"ff186964-efd3-44ce-9132-b5d532084e36","Type":"ContainerStarted","Data":"66224286c4ca7b84bc1e676aa0e76e2df0a38c1464ad553cc3c7cf875fee4be0"} Jun 05 15:11:58.365152 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:58.365115 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" event={"ID":"ff186964-efd3-44ce-9132-b5d532084e36","Type":"ContainerStarted","Data":"582794eaa04c7b837411b057edafe5179955e70624f1658078f093f768d2dfe0"} Jun 05 15:11:58.365152 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:58.365142 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" Jun 05 15:11:58.366785 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:58.366763 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-55qbh" event={"ID":"84a1a20f-fa8f-4c65-8116-4c15a54c2b33","Type":"ContainerStarted","Data":"e8594cbfd784088cf173a50661794960831bed2813df10612d10f36910a5fc38"} Jun 05 15:11:58.366934 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:58.366813 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-55qbh" event={"ID":"84a1a20f-fa8f-4c65-8116-4c15a54c2b33","Type":"ContainerStarted","Data":"d4699df2db62d5fc1bd86558f2bf4750275dbedf8dabd725928600cbcfb51290"} Jun 05 15:11:58.366934 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:58.366842 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-55qbh" event={"ID":"84a1a20f-fa8f-4c65-8116-4c15a54c2b33","Type":"ContainerStarted","Data":"b42045401c3d45825b8d3e536c87502a3b52440eb8eec943fe1890ef0895d64b"} Jun 05 15:11:58.403732 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:11:58.403693 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" podStartSLOduration=1.403680058 podStartE2EDuration="1.403680058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:11:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:11:58.402346289 +0000 UTC m=+232.297864390" watchObservedRunningTime="2026-06-05 15:11:58.403680058 +0000 UTC m=+232.299198158" Jun 05 15:12:00.374638 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:00.374599 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-55qbh" event={"ID":"84a1a20f-fa8f-4c65-8116-4c15a54c2b33","Type":"ContainerStarted","Data":"d331370ada1c871fa5493f63059dc5960a9ee3e593e3d56d5193069292b0d148"} Jun 05 15:12:00.407811 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:00.407759 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-55qbh" podStartSLOduration=2.401539745 podStartE2EDuration="4.407741582s" totalImagesPullingTime="2.006201837s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:11:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:12:00.406398606 +0000 UTC m=+234.301916707" watchObservedRunningTime="2026-06-05 15:12:00.407741582 +0000 UTC m=+234.303259683" Jun 05 15:12:11.884531 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:11.884495 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-c9dst"] Jun 05 15:12:11.891428 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:11.891393 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c9dst" Jun 05 15:12:11.894609 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:11.894588 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 05 15:12:11.894833 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:11.894810 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 05 15:12:11.896032 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:11.896012 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 05 15:12:11.896118 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:11.896101 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-h5449\"" Jun 05 15:12:11.907686 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:11.907661 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 05 15:12:11.907779 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:11.907737 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 05 15:12:11.908066 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:11.908047 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 05 15:12:11.966689 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:11.966668 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3ecef66d-2f1a-4043-9d84-1b0dac9cb22e-node-exporter-accelerators-collector-config\") pod \"node-exporter-c9dst\" (UID: \"3ecef66d-2f1a-4043-9d84-1b0dac9cb22e\") " pod="openshift-monitoring/node-exporter-c9dst" Jun 05 15:12:11.966795 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:11.966695 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ecef66d-2f1a-4043-9d84-1b0dac9cb22e-sys\") pod \"node-exporter-c9dst\" (UID: \"3ecef66d-2f1a-4043-9d84-1b0dac9cb22e\") " pod="openshift-monitoring/node-exporter-c9dst" Jun 05 15:12:11.966795 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:11.966732 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3ecef66d-2f1a-4043-9d84-1b0dac9cb22e-node-exporter-wtmp\") pod \"node-exporter-c9dst\" (UID: \"3ecef66d-2f1a-4043-9d84-1b0dac9cb22e\") " pod="openshift-monitoring/node-exporter-c9dst" Jun 05 15:12:11.966795 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:11.966748 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ecef66d-2f1a-4043-9d84-1b0dac9cb22e-node-exporter-tls\") pod \"node-exporter-c9dst\" (UID: \"3ecef66d-2f1a-4043-9d84-1b0dac9cb22e\") " pod="openshift-monitoring/node-exporter-c9dst" Jun 05 15:12:11.966970 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:11.966869 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3ecef66d-2f1a-4043-9d84-1b0dac9cb22e-node-exporter-textfile\") pod \"node-exporter-c9dst\" (UID: \"3ecef66d-2f1a-4043-9d84-1b0dac9cb22e\") " pod="openshift-monitoring/node-exporter-c9dst" Jun 05 15:12:11.966970 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:11.966923 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ecef66d-2f1a-4043-9d84-1b0dac9cb22e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c9dst\" (UID: \"3ecef66d-2f1a-4043-9d84-1b0dac9cb22e\") " pod="openshift-monitoring/node-exporter-c9dst" Jun 05 15:12:11.966970 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:11.966958 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72lvs\" (UniqueName: \"kubernetes.io/projected/3ecef66d-2f1a-4043-9d84-1b0dac9cb22e-kube-api-access-72lvs\") pod \"node-exporter-c9dst\" (UID: \"3ecef66d-2f1a-4043-9d84-1b0dac9cb22e\") " pod="openshift-monitoring/node-exporter-c9dst" Jun 05 15:12:11.967099 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:11.966991 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3ecef66d-2f1a-4043-9d84-1b0dac9cb22e-root\") pod \"node-exporter-c9dst\" (UID: \"3ecef66d-2f1a-4043-9d84-1b0dac9cb22e\") " pod="openshift-monitoring/node-exporter-c9dst" Jun 05 15:12:11.967099 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:11.967008 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ecef66d-2f1a-4043-9d84-1b0dac9cb22e-metrics-client-ca\") pod \"node-exporter-c9dst\" (UID: \"3ecef66d-2f1a-4043-9d84-1b0dac9cb22e\") " pod="openshift-monitoring/node-exporter-c9dst" Jun 05 15:12:12.067583 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:12.067557 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3ecef66d-2f1a-4043-9d84-1b0dac9cb22e-node-exporter-textfile\") pod \"node-exporter-c9dst\" (UID: \"3ecef66d-2f1a-4043-9d84-1b0dac9cb22e\") " pod="openshift-monitoring/node-exporter-c9dst" Jun 05 15:12:12.067675 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:12.067584 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ecef66d-2f1a-4043-9d84-1b0dac9cb22e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c9dst\" (UID: \"3ecef66d-2f1a-4043-9d84-1b0dac9cb22e\") " pod="openshift-monitoring/node-exporter-c9dst" Jun 05 15:12:12.067675 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:12.067600 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72lvs\" (UniqueName: \"kubernetes.io/projected/3ecef66d-2f1a-4043-9d84-1b0dac9cb22e-kube-api-access-72lvs\") pod \"node-exporter-c9dst\" (UID: \"3ecef66d-2f1a-4043-9d84-1b0dac9cb22e\") " pod="openshift-monitoring/node-exporter-c9dst" Jun 05 15:12:12.067675 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:12.067616 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3ecef66d-2f1a-4043-9d84-1b0dac9cb22e-root\") pod \"node-exporter-c9dst\" (UID: \"3ecef66d-2f1a-4043-9d84-1b0dac9cb22e\") " pod="openshift-monitoring/node-exporter-c9dst" Jun 05 15:12:12.067675 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:12.067658 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3ecef66d-2f1a-4043-9d84-1b0dac9cb22e-root\") pod \"node-exporter-c9dst\" (UID: \"3ecef66d-2f1a-4043-9d84-1b0dac9cb22e\") " pod="openshift-monitoring/node-exporter-c9dst" Jun 05 15:12:12.067883 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:12.067871 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ecef66d-2f1a-4043-9d84-1b0dac9cb22e-metrics-client-ca\") pod \"node-exporter-c9dst\" (UID: \"3ecef66d-2f1a-4043-9d84-1b0dac9cb22e\") " pod="openshift-monitoring/node-exporter-c9dst" Jun 05 15:12:12.067948 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:12.067919 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3ecef66d-2f1a-4043-9d84-1b0dac9cb22e-node-exporter-accelerators-collector-config\") pod \"node-exporter-c9dst\" (UID: \"3ecef66d-2f1a-4043-9d84-1b0dac9cb22e\") " pod="openshift-monitoring/node-exporter-c9dst" Jun 05 15:12:12.068037 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:12.068020 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3ecef66d-2f1a-4043-9d84-1b0dac9cb22e-node-exporter-textfile\") pod \"node-exporter-c9dst\" (UID: \"3ecef66d-2f1a-4043-9d84-1b0dac9cb22e\") " pod="openshift-monitoring/node-exporter-c9dst" Jun 05 15:12:12.068074 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:12.068064 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ecef66d-2f1a-4043-9d84-1b0dac9cb22e-sys\") pod \"node-exporter-c9dst\" (UID: \"3ecef66d-2f1a-4043-9d84-1b0dac9cb22e\") " pod="openshift-monitoring/node-exporter-c9dst" Jun 05 15:12:12.068125 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:12.068109 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3ecef66d-2f1a-4043-9d84-1b0dac9cb22e-node-exporter-wtmp\") pod \"node-exporter-c9dst\" (UID: \"3ecef66d-2f1a-4043-9d84-1b0dac9cb22e\") " pod="openshift-monitoring/node-exporter-c9dst" Jun 05 15:12:12.068180 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:12.068119 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ecef66d-2f1a-4043-9d84-1b0dac9cb22e-sys\") pod \"node-exporter-c9dst\" (UID: \"3ecef66d-2f1a-4043-9d84-1b0dac9cb22e\") " pod="openshift-monitoring/node-exporter-c9dst" Jun 05 15:12:12.068180 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:12.068129 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ecef66d-2f1a-4043-9d84-1b0dac9cb22e-node-exporter-tls\") pod \"node-exporter-c9dst\" (UID: \"3ecef66d-2f1a-4043-9d84-1b0dac9cb22e\") " pod="openshift-monitoring/node-exporter-c9dst" Jun 05 15:12:12.068246 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:12:12.068203 2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 05 15:12:12.068285 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:12.068247 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3ecef66d-2f1a-4043-9d84-1b0dac9cb22e-node-exporter-wtmp\") pod \"node-exporter-c9dst\" (UID: \"3ecef66d-2f1a-4043-9d84-1b0dac9cb22e\") " pod="openshift-monitoring/node-exporter-c9dst" Jun 05 15:12:12.068285 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:12:12.068271 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ecef66d-2f1a-4043-9d84-1b0dac9cb22e-node-exporter-tls podName:3ecef66d-2f1a-4043-9d84-1b0dac9cb22e nodeName:}" failed. No retries permitted until 2026-06-05 15:12:12.568252935 +0000 UTC m=+246.463771017 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3ecef66d-2f1a-4043-9d84-1b0dac9cb22e-node-exporter-tls") pod "node-exporter-c9dst" (UID: "3ecef66d-2f1a-4043-9d84-1b0dac9cb22e") : secret "node-exporter-tls" not found Jun 05 15:12:12.068469 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:12.068450 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ecef66d-2f1a-4043-9d84-1b0dac9cb22e-metrics-client-ca\") pod \"node-exporter-c9dst\" (UID: \"3ecef66d-2f1a-4043-9d84-1b0dac9cb22e\") " pod="openshift-monitoring/node-exporter-c9dst" Jun 05 15:12:12.068502 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:12.068459 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3ecef66d-2f1a-4043-9d84-1b0dac9cb22e-node-exporter-accelerators-collector-config\") pod \"node-exporter-c9dst\" (UID: \"3ecef66d-2f1a-4043-9d84-1b0dac9cb22e\") " pod="openshift-monitoring/node-exporter-c9dst" Jun 05 15:12:12.070141 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:12.070110 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ecef66d-2f1a-4043-9d84-1b0dac9cb22e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c9dst\" (UID: \"3ecef66d-2f1a-4043-9d84-1b0dac9cb22e\") " pod="openshift-monitoring/node-exporter-c9dst" Jun 05 15:12:12.078607 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:12.078586 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72lvs\" (UniqueName: \"kubernetes.io/projected/3ecef66d-2f1a-4043-9d84-1b0dac9cb22e-kube-api-access-72lvs\") pod \"node-exporter-c9dst\" (UID: \"3ecef66d-2f1a-4043-9d84-1b0dac9cb22e\") " pod="openshift-monitoring/node-exporter-c9dst" Jun 05 15:12:12.571784 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:12.571746 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ecef66d-2f1a-4043-9d84-1b0dac9cb22e-node-exporter-tls\") pod \"node-exporter-c9dst\" (UID: \"3ecef66d-2f1a-4043-9d84-1b0dac9cb22e\") " pod="openshift-monitoring/node-exporter-c9dst" Jun 05 15:12:12.573947 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:12.573929 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ecef66d-2f1a-4043-9d84-1b0dac9cb22e-node-exporter-tls\") pod \"node-exporter-c9dst\" (UID: \"3ecef66d-2f1a-4043-9d84-1b0dac9cb22e\") " pod="openshift-monitoring/node-exporter-c9dst" Jun 05 15:12:12.800266 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:12.800227 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c9dst" Jun 05 15:12:12.811281 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:12:12.811255 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ecef66d_2f1a_4043_9d84_1b0dac9cb22e.slice/crio-32c5e0c8470fd0a84ef3f4d0c7bb575637dfbc530f6783a8f13c7c23af4d23d4 WatchSource:0}: Error finding container 32c5e0c8470fd0a84ef3f4d0c7bb575637dfbc530f6783a8f13c7c23af4d23d4: Status 404 returned error can't find the container with id 32c5e0c8470fd0a84ef3f4d0c7bb575637dfbc530f6783a8f13c7c23af4d23d4 Jun 05 15:12:13.416947 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:13.416896 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c9dst" event={"ID":"3ecef66d-2f1a-4043-9d84-1b0dac9cb22e","Type":"ContainerStarted","Data":"32c5e0c8470fd0a84ef3f4d0c7bb575637dfbc530f6783a8f13c7c23af4d23d4"} Jun 05 15:12:14.421748 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:14.421719 2560 generic.go:356] "Generic (PLEG): container finished" podID="3ecef66d-2f1a-4043-9d84-1b0dac9cb22e" containerID="66707f698716ea500b3ecc06d2e1e929d959b591a0012bc948500cd3ace1354c" exitCode=0 Jun 05 15:12:14.422117 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:14.421766 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c9dst" event={"ID":"3ecef66d-2f1a-4043-9d84-1b0dac9cb22e","Type":"ContainerDied","Data":"66707f698716ea500b3ecc06d2e1e929d959b591a0012bc948500cd3ace1354c"} Jun 05 15:12:15.426989 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:15.426954 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c9dst" event={"ID":"3ecef66d-2f1a-4043-9d84-1b0dac9cb22e","Type":"ContainerStarted","Data":"9233813b397f9deda1eefbf4832a55511409c514e159f8496b875ae50801e580"} Jun 05 15:12:15.427334 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:15.427006 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c9dst" event={"ID":"3ecef66d-2f1a-4043-9d84-1b0dac9cb22e","Type":"ContainerStarted","Data":"f31e0b50ef68cc14831f47ac95cb69965ed9a5f790b809a8c3b5274ee4d4df1b"} Jun 05 15:12:15.452534 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:15.452486 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-c9dst" podStartSLOduration=3.540886748 podStartE2EDuration="4.452471885s" totalImagesPullingTime="847.138779ms" totalInitContainerRuntime="64.446358ms" isStatefulPod=true podCreationTimestamp="2026-06-05 15:12:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:12:15.450549722 +0000 UTC m=+249.346067824" watchObservedRunningTime="2026-06-05 15:12:15.452471885 +0000 UTC m=+249.347990032" Jun 05 15:12:17.042368 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.042331 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-78dc664dbc-k47v6"] Jun 05 15:12:17.045440 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.045425 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-78dc664dbc-k47v6" Jun 05 15:12:17.054080 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.054058 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 05 15:12:17.054200 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.054057 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 05 15:12:17.054200 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.054154 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 05 15:12:17.054602 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.054587 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 05 15:12:17.054666 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.054649 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-nsdf4\"" Jun 05 15:12:17.054710 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.054692 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 05 15:12:17.060652 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.060638 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 05 15:12:17.067294 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.067263 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-78dc664dbc-k47v6"] Jun 05 15:12:17.105644 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.105618 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78dc664dbc-k47v6\" (UID: \"ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312\") " pod="openshift-monitoring/telemeter-client-78dc664dbc-k47v6" Jun 05 15:12:17.105791 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.105650 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312-federate-client-tls\") pod \"telemeter-client-78dc664dbc-k47v6\" (UID: \"ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312\") " pod="openshift-monitoring/telemeter-client-78dc664dbc-k47v6" Jun 05 15:12:17.105791 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.105686 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312-metrics-client-ca\") pod \"telemeter-client-78dc664dbc-k47v6\" (UID: \"ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312\") " pod="openshift-monitoring/telemeter-client-78dc664dbc-k47v6" Jun 05 15:12:17.105791 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.105748 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78dc664dbc-k47v6\" (UID: \"ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312\") " pod="openshift-monitoring/telemeter-client-78dc664dbc-k47v6" Jun 05 15:12:17.105945 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.105794 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312-serving-certs-ca-bundle\") pod \"telemeter-client-78dc664dbc-k47v6\" (UID: \"ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312\") " pod="openshift-monitoring/telemeter-client-78dc664dbc-k47v6" Jun 05 15:12:17.105945 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.105828 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312-secret-telemeter-client\") pod \"telemeter-client-78dc664dbc-k47v6\" (UID: \"ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312\") " pod="openshift-monitoring/telemeter-client-78dc664dbc-k47v6" Jun 05 15:12:17.105945 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.105860 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2f62\" (UniqueName: \"kubernetes.io/projected/ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312-kube-api-access-r2f62\") pod \"telemeter-client-78dc664dbc-k47v6\" (UID: \"ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312\") " pod="openshift-monitoring/telemeter-client-78dc664dbc-k47v6" Jun 05 15:12:17.105945 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.105937 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312-telemeter-client-tls\") pod \"telemeter-client-78dc664dbc-k47v6\" (UID: \"ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312\") " pod="openshift-monitoring/telemeter-client-78dc664dbc-k47v6" Jun 05 15:12:17.207319 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.207291 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2f62\" (UniqueName: \"kubernetes.io/projected/ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312-kube-api-access-r2f62\") pod \"telemeter-client-78dc664dbc-k47v6\" (UID: \"ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312\") " pod="openshift-monitoring/telemeter-client-78dc664dbc-k47v6" Jun 05 15:12:17.207477 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.207329 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312-telemeter-client-tls\") pod \"telemeter-client-78dc664dbc-k47v6\" (UID: \"ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312\") " pod="openshift-monitoring/telemeter-client-78dc664dbc-k47v6" Jun 05 15:12:17.207477 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.207382 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78dc664dbc-k47v6\" (UID: \"ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312\") " pod="openshift-monitoring/telemeter-client-78dc664dbc-k47v6" Jun 05 15:12:17.207477 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.207402 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312-federate-client-tls\") pod \"telemeter-client-78dc664dbc-k47v6\" (UID: \"ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312\") " pod="openshift-monitoring/telemeter-client-78dc664dbc-k47v6" Jun 05 15:12:17.207477 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.207439 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312-metrics-client-ca\") pod \"telemeter-client-78dc664dbc-k47v6\" (UID: \"ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312\") " pod="openshift-monitoring/telemeter-client-78dc664dbc-k47v6" Jun 05 15:12:17.207477 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.207474 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78dc664dbc-k47v6\" (UID: \"ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312\") " pod="openshift-monitoring/telemeter-client-78dc664dbc-k47v6" Jun 05 15:12:17.207707 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.207501 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312-serving-certs-ca-bundle\") pod \"telemeter-client-78dc664dbc-k47v6\" (UID: \"ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312\") " pod="openshift-monitoring/telemeter-client-78dc664dbc-k47v6" Jun 05 15:12:17.207707 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.207527 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312-secret-telemeter-client\") pod \"telemeter-client-78dc664dbc-k47v6\" (UID: \"ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312\") " pod="openshift-monitoring/telemeter-client-78dc664dbc-k47v6" Jun 05 15:12:17.208374 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.208343 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312-metrics-client-ca\") pod \"telemeter-client-78dc664dbc-k47v6\" (UID: \"ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312\") " pod="openshift-monitoring/telemeter-client-78dc664dbc-k47v6" Jun 05 15:12:17.208496 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.208398 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312-serving-certs-ca-bundle\") pod \"telemeter-client-78dc664dbc-k47v6\" (UID: \"ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312\") " pod="openshift-monitoring/telemeter-client-78dc664dbc-k47v6" Jun 05 15:12:17.208496 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.208474 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78dc664dbc-k47v6\" (UID: \"ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312\") " pod="openshift-monitoring/telemeter-client-78dc664dbc-k47v6" Jun 05 15:12:17.210153 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.210131 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312-telemeter-client-tls\") pod \"telemeter-client-78dc664dbc-k47v6\" (UID: \"ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312\") " pod="openshift-monitoring/telemeter-client-78dc664dbc-k47v6" Jun 05 15:12:17.210240 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.210191 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78dc664dbc-k47v6\" (UID: \"ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312\") " pod="openshift-monitoring/telemeter-client-78dc664dbc-k47v6" Jun 05 15:12:17.210505 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.210477 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312-secret-telemeter-client\") pod \"telemeter-client-78dc664dbc-k47v6\" (UID: \"ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312\") " pod="openshift-monitoring/telemeter-client-78dc664dbc-k47v6" Jun 05 15:12:17.210549 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.210508 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312-federate-client-tls\") pod \"telemeter-client-78dc664dbc-k47v6\" (UID: \"ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312\") " pod="openshift-monitoring/telemeter-client-78dc664dbc-k47v6" Jun 05 15:12:17.221343 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.221320 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2f62\" (UniqueName: \"kubernetes.io/projected/ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312-kube-api-access-r2f62\") pod \"telemeter-client-78dc664dbc-k47v6\" (UID: \"ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312\") " pod="openshift-monitoring/telemeter-client-78dc664dbc-k47v6" Jun 05 15:12:17.353388 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.353302 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-78dc664dbc-k47v6" Jun 05 15:12:17.490879 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.490834 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-78dc664dbc-k47v6"] Jun 05 15:12:17.494877 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:12:17.494839 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba5ecd83_51b0_41f5_bbfa_a50ffc1f4312.slice/crio-5858466ee777d2ad5856a9770013e48920322dc9cf37aba88fb9b3b95b4d3e6a WatchSource:0}: Error finding container 5858466ee777d2ad5856a9770013e48920322dc9cf37aba88fb9b3b95b4d3e6a: Status 404 returned error can't find the container with id 5858466ee777d2ad5856a9770013e48920322dc9cf37aba88fb9b3b95b4d3e6a Jun 05 15:12:17.566196 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.566160 2560 patch_prober.go:28] interesting pod/image-registry-559cbfcb8d-2mtxn container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 15:12:17.566424 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:17.566212 2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" podUID="ff186964-efd3-44ce-9132-b5d532084e36" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 15:12:18.439523 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:18.439482 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78dc664dbc-k47v6" event={"ID":"ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312","Type":"ContainerStarted","Data":"5858466ee777d2ad5856a9770013e48920322dc9cf37aba88fb9b3b95b4d3e6a"} Jun 05 15:12:18.517391 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:18.517336 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9137360a-945f-4be7-a6da-25d3be6241fa-metrics-certs\") pod \"network-metrics-daemon-j2lpj\" (UID: \"9137360a-945f-4be7-a6da-25d3be6241fa\") " pod="openshift-multus/network-metrics-daemon-j2lpj" Jun 05 15:12:18.519711 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:18.519690 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9137360a-945f-4be7-a6da-25d3be6241fa-metrics-certs\") pod \"network-metrics-daemon-j2lpj\" (UID: \"9137360a-945f-4be7-a6da-25d3be6241fa\") " pod="openshift-multus/network-metrics-daemon-j2lpj" Jun 05 15:12:18.694449 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:18.694365 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8hlll\"" Jun 05 15:12:18.702867 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:18.702839 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lpj" Jun 05 15:12:18.834927 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:18.834882 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j2lpj"] Jun 05 15:12:18.837755 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:12:18.837731 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9137360a_945f_4be7_a6da_25d3be6241fa.slice/crio-b569a3b5525616742a9db08094a35dac49a567c5a6b84f5681d1967c3652bd2c WatchSource:0}: Error finding container b569a3b5525616742a9db08094a35dac49a567c5a6b84f5681d1967c3652bd2c: Status 404 returned error can't find the container with id b569a3b5525616742a9db08094a35dac49a567c5a6b84f5681d1967c3652bd2c Jun 05 15:12:19.376439 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:19.376292 2560 patch_prober.go:28] interesting pod/image-registry-559cbfcb8d-2mtxn container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 15:12:19.376439 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:19.376376 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" podUID="ff186964-efd3-44ce-9132-b5d532084e36" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 15:12:19.444865 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:19.444833 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j2lpj" event={"ID":"9137360a-945f-4be7-a6da-25d3be6241fa","Type":"ContainerStarted","Data":"b569a3b5525616742a9db08094a35dac49a567c5a6b84f5681d1967c3652bd2c"} Jun 05 15:12:19.724703 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:19.724670 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75cf89cbdc-hvgzd"] Jun 05 15:12:19.727693 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:19.727674 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75cf89cbdc-hvgzd" Jun 05 15:12:19.731518 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:19.731497 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 05 15:12:19.731518 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:19.731511 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 05 15:12:19.731696 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:19.731645 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 05 15:12:19.732023 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:19.731766 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 05 15:12:19.732023 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:19.731882 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 05 15:12:19.732023 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:19.731930 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qvwrz\"" Jun 05 15:12:19.732023 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:19.731998 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 05 15:12:19.732241 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:19.732189 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 05 15:12:19.736590 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:19.736471 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 05 15:12:19.740008 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:19.739987 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75cf89cbdc-hvgzd"] Jun 05 15:12:19.828689 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:19.828654 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c503204-9eb0-4c20-bdd5-0e2c82e34119-trusted-ca-bundle\") pod \"console-75cf89cbdc-hvgzd\" (UID: \"4c503204-9eb0-4c20-bdd5-0e2c82e34119\") " pod="openshift-console/console-75cf89cbdc-hvgzd" Jun 05 15:12:19.828689 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:19.828690 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c503204-9eb0-4c20-bdd5-0e2c82e34119-console-oauth-config\") pod \"console-75cf89cbdc-hvgzd\" (UID: \"4c503204-9eb0-4c20-bdd5-0e2c82e34119\") " pod="openshift-console/console-75cf89cbdc-hvgzd" Jun 05 15:12:19.828953 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:19.828741 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c503204-9eb0-4c20-bdd5-0e2c82e34119-service-ca\") pod \"console-75cf89cbdc-hvgzd\" (UID: \"4c503204-9eb0-4c20-bdd5-0e2c82e34119\") " pod="openshift-console/console-75cf89cbdc-hvgzd" Jun 05 15:12:19.828953 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:19.828774 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c503204-9eb0-4c20-bdd5-0e2c82e34119-console-serving-cert\") pod \"console-75cf89cbdc-hvgzd\" (UID: \"4c503204-9eb0-4c20-bdd5-0e2c82e34119\") " pod="openshift-console/console-75cf89cbdc-hvgzd" Jun 05 15:12:19.828953 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:19.828809 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c503204-9eb0-4c20-bdd5-0e2c82e34119-console-config\") pod \"console-75cf89cbdc-hvgzd\" (UID: \"4c503204-9eb0-4c20-bdd5-0e2c82e34119\") " pod="openshift-console/console-75cf89cbdc-hvgzd" Jun 05 15:12:19.828953 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:19.828849 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c503204-9eb0-4c20-bdd5-0e2c82e34119-oauth-serving-cert\") pod \"console-75cf89cbdc-hvgzd\" (UID: \"4c503204-9eb0-4c20-bdd5-0e2c82e34119\") " pod="openshift-console/console-75cf89cbdc-hvgzd" Jun 05 15:12:19.828953 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:19.828874 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzcc7\" (UniqueName: \"kubernetes.io/projected/4c503204-9eb0-4c20-bdd5-0e2c82e34119-kube-api-access-rzcc7\") pod \"console-75cf89cbdc-hvgzd\" (UID: \"4c503204-9eb0-4c20-bdd5-0e2c82e34119\") " pod="openshift-console/console-75cf89cbdc-hvgzd" Jun 05 15:12:19.929750 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:19.929715 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c503204-9eb0-4c20-bdd5-0e2c82e34119-service-ca\") pod \"console-75cf89cbdc-hvgzd\" (UID: \"4c503204-9eb0-4c20-bdd5-0e2c82e34119\") " pod="openshift-console/console-75cf89cbdc-hvgzd" Jun 05 15:12:19.929750 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:19.929754 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c503204-9eb0-4c20-bdd5-0e2c82e34119-console-serving-cert\") pod \"console-75cf89cbdc-hvgzd\" (UID: \"4c503204-9eb0-4c20-bdd5-0e2c82e34119\") " pod="openshift-console/console-75cf89cbdc-hvgzd" Jun 05 15:12:19.930032 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:19.929788 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c503204-9eb0-4c20-bdd5-0e2c82e34119-console-config\") pod \"console-75cf89cbdc-hvgzd\" (UID: \"4c503204-9eb0-4c20-bdd5-0e2c82e34119\") " pod="openshift-console/console-75cf89cbdc-hvgzd" Jun 05 15:12:19.930032 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:19.929815 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c503204-9eb0-4c20-bdd5-0e2c82e34119-oauth-serving-cert\") pod \"console-75cf89cbdc-hvgzd\" (UID: \"4c503204-9eb0-4c20-bdd5-0e2c82e34119\") " pod="openshift-console/console-75cf89cbdc-hvgzd" Jun 05 15:12:19.930032 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:19.929837 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzcc7\" (UniqueName: \"kubernetes.io/projected/4c503204-9eb0-4c20-bdd5-0e2c82e34119-kube-api-access-rzcc7\") pod \"console-75cf89cbdc-hvgzd\" (UID: \"4c503204-9eb0-4c20-bdd5-0e2c82e34119\") " pod="openshift-console/console-75cf89cbdc-hvgzd" Jun 05 15:12:19.930032 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:19.929900 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c503204-9eb0-4c20-bdd5-0e2c82e34119-trusted-ca-bundle\") pod \"console-75cf89cbdc-hvgzd\" (UID: \"4c503204-9eb0-4c20-bdd5-0e2c82e34119\") " pod="openshift-console/console-75cf89cbdc-hvgzd" Jun 05 15:12:19.930032 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:19.929949 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c503204-9eb0-4c20-bdd5-0e2c82e34119-console-oauth-config\") pod \"console-75cf89cbdc-hvgzd\" (UID: \"4c503204-9eb0-4c20-bdd5-0e2c82e34119\") " pod="openshift-console/console-75cf89cbdc-hvgzd" Jun 05 15:12:19.930637 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:19.930613 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c503204-9eb0-4c20-bdd5-0e2c82e34119-service-ca\") pod \"console-75cf89cbdc-hvgzd\" (UID: \"4c503204-9eb0-4c20-bdd5-0e2c82e34119\") " pod="openshift-console/console-75cf89cbdc-hvgzd" Jun 05 15:12:19.930747 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:19.930667 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c503204-9eb0-4c20-bdd5-0e2c82e34119-oauth-serving-cert\") pod \"console-75cf89cbdc-hvgzd\" (UID: \"4c503204-9eb0-4c20-bdd5-0e2c82e34119\") " pod="openshift-console/console-75cf89cbdc-hvgzd" Jun 05 15:12:19.930809 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:19.930747 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c503204-9eb0-4c20-bdd5-0e2c82e34119-console-config\") pod \"console-75cf89cbdc-hvgzd\" (UID: \"4c503204-9eb0-4c20-bdd5-0e2c82e34119\") " pod="openshift-console/console-75cf89cbdc-hvgzd" Jun 05 15:12:19.931075 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:19.931050 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c503204-9eb0-4c20-bdd5-0e2c82e34119-trusted-ca-bundle\") pod \"console-75cf89cbdc-hvgzd\" (UID: \"4c503204-9eb0-4c20-bdd5-0e2c82e34119\") " pod="openshift-console/console-75cf89cbdc-hvgzd" Jun 05 15:12:19.932715 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:19.932692 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c503204-9eb0-4c20-bdd5-0e2c82e34119-console-serving-cert\") pod \"console-75cf89cbdc-hvgzd\" (UID: \"4c503204-9eb0-4c20-bdd5-0e2c82e34119\") " pod="openshift-console/console-75cf89cbdc-hvgzd" Jun 05 15:12:19.932813 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:19.932767 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c503204-9eb0-4c20-bdd5-0e2c82e34119-console-oauth-config\") pod \"console-75cf89cbdc-hvgzd\" (UID: \"4c503204-9eb0-4c20-bdd5-0e2c82e34119\") " pod="openshift-console/console-75cf89cbdc-hvgzd" Jun 05 15:12:19.941353 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:19.941333 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzcc7\" (UniqueName: \"kubernetes.io/projected/4c503204-9eb0-4c20-bdd5-0e2c82e34119-kube-api-access-rzcc7\") pod \"console-75cf89cbdc-hvgzd\" (UID: \"4c503204-9eb0-4c20-bdd5-0e2c82e34119\") " pod="openshift-console/console-75cf89cbdc-hvgzd" Jun 05 15:12:20.039720 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:20.039633 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75cf89cbdc-hvgzd" Jun 05 15:12:20.295179 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:20.295156 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75cf89cbdc-hvgzd"] Jun 05 15:12:20.449532 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:20.449491 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j2lpj" event={"ID":"9137360a-945f-4be7-a6da-25d3be6241fa","Type":"ContainerStarted","Data":"72d2c46db7c579467901e7f270e65f55f7d9a353784f0d3fd4b36a10c4dbf533"} Jun 05 15:12:20.450015 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:20.449561 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j2lpj" event={"ID":"9137360a-945f-4be7-a6da-25d3be6241fa","Type":"ContainerStarted","Data":"8486c33b89a0e877c1d7e37f49bb6758def7815afe5d100de207107975fe2e26"} Jun 05 15:12:20.450728 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:20.450706 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75cf89cbdc-hvgzd" event={"ID":"4c503204-9eb0-4c20-bdd5-0e2c82e34119","Type":"ContainerStarted","Data":"3420d1a37a71b245a84a7e8289525a33bb0f40d793aaba0cfd20cce93d74ed0e"} Jun 05 15:12:20.452049 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:20.452032 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78dc664dbc-k47v6" event={"ID":"ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312","Type":"ContainerStarted","Data":"796460bf6926dd66ef511397ba22b3c43a40751c9d623ef3cb863a260cca1191"} Jun 05 15:12:20.486116 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:20.486018 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-j2lpj" podStartSLOduration=253.174431683 podStartE2EDuration="4m14.486001446s" totalImagesPullingTime="1.311569763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:08:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:12:20.485093015 +0000 UTC m=+254.380611115" watchObservedRunningTime="2026-06-05 15:12:20.486001446 +0000 UTC m=+254.381519545" Jun 05 15:12:21.458267 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:21.458228 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78dc664dbc-k47v6" event={"ID":"ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312","Type":"ContainerStarted","Data":"a7e1368fd16b731f47fd3b1b0e4ff682b15321092901f20fb92060ce522e33ae"} Jun 05 15:12:21.458728 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:21.458306 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78dc664dbc-k47v6" event={"ID":"ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312","Type":"ContainerStarted","Data":"d27aed2bab8cecb815449bf0937edd5fb58994b506afef7adaaa7518c5547b67"} Jun 05 15:12:21.486226 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:21.486173 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-78dc664dbc-k47v6" podStartSLOduration=0.890274068 podStartE2EDuration="4.486155528s" totalImagesPullingTime="3.59588146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:12:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:12:21.48353623 +0000 UTC m=+255.379054343" watchObservedRunningTime="2026-06-05 15:12:21.486155528 +0000 UTC m=+255.381673628" Jun 05 15:12:23.467913 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:23.467879 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75cf89cbdc-hvgzd" event={"ID":"4c503204-9eb0-4c20-bdd5-0e2c82e34119","Type":"ContainerStarted","Data":"695b4fa5c3de22a5eac3db435e164952ed73b05c0093a1438fb01a92cdf8b809"} Jun 05 15:12:23.502396 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:23.502342 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75cf89cbdc-hvgzd" podStartSLOduration=1.82258253 podStartE2EDuration="4.502327838s" totalImagesPullingTime="2.679745308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:12:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:12:23.50226474 +0000 UTC m=+257.397782842" watchObservedRunningTime="2026-06-05 15:12:23.502327838 +0000 UTC m=+257.397845937" Jun 05 15:12:27.568178 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:27.568143 2560 patch_prober.go:28] interesting pod/image-registry-559cbfcb8d-2mtxn container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 15:12:27.568533 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:27.568206 2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" podUID="ff186964-efd3-44ce-9132-b5d532084e36" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 15:12:29.373834 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:29.373804 2560 patch_prober.go:28] interesting pod/image-registry-559cbfcb8d-2mtxn container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 15:12:29.374235 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:29.373850 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" podUID="ff186964-efd3-44ce-9132-b5d532084e36" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 15:12:30.040253 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:30.040218 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75cf89cbdc-hvgzd" Jun 05 15:12:30.040422 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:30.040281 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75cf89cbdc-hvgzd" Jun 05 15:12:30.041601 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:30.041575 2560 patch_prober.go:28] interesting pod/console-75cf89cbdc-hvgzd container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.13:8443/health\": dial tcp 10.134.0.13:8443: connect: connection refused" start-of-body= Jun 05 15:12:30.041712 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:30.041616 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-75cf89cbdc-hvgzd" podUID="4c503204-9eb0-4c20-bdd5-0e2c82e34119" containerName="console" probeResult="failure" output="Get \"https://10.134.0.13:8443/health\": dial tcp 10.134.0.13:8443: connect: connection refused" Jun 05 15:12:37.567185 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:37.567148 2560 patch_prober.go:28] interesting pod/image-registry-559cbfcb8d-2mtxn container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 15:12:37.567573 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:37.567207 2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" podUID="ff186964-efd3-44ce-9132-b5d532084e36" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 15:12:37.567573 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:37.567247 2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" Jun 05 15:12:37.567695 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:37.567657 2560 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"66224286c4ca7b84bc1e676aa0e76e2df0a38c1464ad553cc3c7cf875fee4be0"} pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" containerMessage="Container registry failed liveness probe, will be restarted" Jun 05 15:12:37.571179 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:37.571155 2560 patch_prober.go:28] interesting pod/image-registry-559cbfcb8d-2mtxn container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 15:12:37.571313 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:37.571189 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" podUID="ff186964-efd3-44ce-9132-b5d532084e36" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 15:12:40.040513 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:40.040478 2560 patch_prober.go:28] interesting pod/console-75cf89cbdc-hvgzd container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.13:8443/health\": dial tcp 10.134.0.13:8443: connect: connection refused" start-of-body= Jun 05 15:12:40.040924 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:40.040534 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-75cf89cbdc-hvgzd" podUID="4c503204-9eb0-4c20-bdd5-0e2c82e34119" containerName="console" probeResult="failure" output="Get \"https://10.134.0.13:8443/health\": dial tcp 10.134.0.13:8443: connect: connection refused" Jun 05 15:12:47.572246 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:47.572211 2560 patch_prober.go:28] interesting pod/image-registry-559cbfcb8d-2mtxn container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 15:12:47.572625 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:47.572282 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" podUID="ff186964-efd3-44ce-9132-b5d532084e36" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 15:12:48.139581 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:12:48.139540 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8d5qm" podUID="c521bb9d-3aae-47f9-b597-6ef61f55b131" Jun 05 15:12:48.553727 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:48.553699 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8d5qm" Jun 05 15:12:50.040405 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:50.040367 2560 patch_prober.go:28] interesting pod/console-75cf89cbdc-hvgzd container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.13:8443/health\": dial tcp 10.134.0.13:8443: connect: connection refused" start-of-body= Jun 05 15:12:50.040790 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:50.040426 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-75cf89cbdc-hvgzd" podUID="4c503204-9eb0-4c20-bdd5-0e2c82e34119" containerName="console" probeResult="failure" output="Get \"https://10.134.0.13:8443/health\": dial tcp 10.134.0.13:8443: connect: connection refused" Jun 05 15:12:51.982378 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:51.982337 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c521bb9d-3aae-47f9-b597-6ef61f55b131-metrics-tls\") pod \"dns-default-8d5qm\" (UID: \"c521bb9d-3aae-47f9-b597-6ef61f55b131\") " pod="openshift-dns/dns-default-8d5qm" Jun 05 15:12:51.984666 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:51.984640 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c521bb9d-3aae-47f9-b597-6ef61f55b131-metrics-tls\") pod \"dns-default-8d5qm\" (UID: \"c521bb9d-3aae-47f9-b597-6ef61f55b131\") " pod="openshift-dns/dns-default-8d5qm" Jun 05 15:12:52.157542 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:52.157509 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rncfk\"" Jun 05 15:12:52.165230 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:52.165212 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8d5qm" Jun 05 15:12:52.313757 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:52.313726 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8d5qm"] Jun 05 15:12:52.317445 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:12:52.317409 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc521bb9d_3aae_47f9_b597_6ef61f55b131.slice/crio-5b1228e92ec5433b4a10484896fca97a5dbc929631ebf7dd58951a7234f35e97 WatchSource:0}: Error finding container 5b1228e92ec5433b4a10484896fca97a5dbc929631ebf7dd58951a7234f35e97: Status 404 returned error can't find the container with id 5b1228e92ec5433b4a10484896fca97a5dbc929631ebf7dd58951a7234f35e97 Jun 05 15:12:52.567390 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:52.567305 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8d5qm" event={"ID":"c521bb9d-3aae-47f9-b597-6ef61f55b131","Type":"ContainerStarted","Data":"5b1228e92ec5433b4a10484896fca97a5dbc929631ebf7dd58951a7234f35e97"} Jun 05 15:12:54.577468 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:54.577428 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8d5qm" event={"ID":"c521bb9d-3aae-47f9-b597-6ef61f55b131","Type":"ContainerStarted","Data":"3b52180cb962c2910146066534b1bff3e2c5484ddf9515dd6f881aad6c220561"} Jun 05 15:12:54.577969 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:54.577493 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8d5qm" event={"ID":"c521bb9d-3aae-47f9-b597-6ef61f55b131","Type":"ContainerStarted","Data":"5f78a1fe7b3cb0fa12b6830f51121c5e998afd22f141850d5a2d4ee5596fc9e9"} Jun 05 15:12:54.577969 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:54.577543 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8d5qm" Jun 05 15:12:54.640895 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:54.640845 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8d5qm" podStartSLOduration=252.26851604 podStartE2EDuration="4m13.640829398s" totalImagesPullingTime="1.372313358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:08:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:12:54.640734514 +0000 UTC m=+288.536252638" watchObservedRunningTime="2026-06-05 15:12:54.640829398 +0000 UTC m=+288.536347498" Jun 05 15:12:57.571471 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:57.571437 2560 patch_prober.go:28] interesting pod/image-registry-559cbfcb8d-2mtxn container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 15:12:57.571846 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:12:57.571490 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" podUID="ff186964-efd3-44ce-9132-b5d532084e36" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 15:13:00.043831 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:00.043797 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75cf89cbdc-hvgzd" Jun 05 15:13:00.047761 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:00.047734 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75cf89cbdc-hvgzd" Jun 05 15:13:02.586576 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:02.586532 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" podUID="ff186964-efd3-44ce-9132-b5d532084e36" containerName="registry" containerID="cri-o://66224286c4ca7b84bc1e676aa0e76e2df0a38c1464ad553cc3c7cf875fee4be0" gracePeriod=30 Jun 05 15:13:03.802741 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:03.802696 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8d5qm_c521bb9d-3aae-47f9-b597-6ef61f55b131/dns/0.log" Jun 05 15:13:03.977714 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:03.977630 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8d5qm_c521bb9d-3aae-47f9-b597-6ef61f55b131/kube-rbac-proxy/0.log" Jun 05 15:13:04.583037 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:04.583007 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8d5qm" Jun 05 15:13:04.613037 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:04.613007 2560 generic.go:356] "Generic (PLEG): container finished" podID="ff186964-efd3-44ce-9132-b5d532084e36" containerID="66224286c4ca7b84bc1e676aa0e76e2df0a38c1464ad553cc3c7cf875fee4be0" exitCode=0 Jun 05 15:13:04.613231 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:04.613078 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" event={"ID":"ff186964-efd3-44ce-9132-b5d532084e36","Type":"ContainerDied","Data":"66224286c4ca7b84bc1e676aa0e76e2df0a38c1464ad553cc3c7cf875fee4be0"} Jun 05 15:13:04.613231 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:04.613124 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" event={"ID":"ff186964-efd3-44ce-9132-b5d532084e36","Type":"ContainerStarted","Data":"a5d3a875107ce2ce113a9a9156d2dd13592e7eb1581a40ba6c12b05b650af38f"} Jun 05 15:13:04.613336 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:04.613286 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" Jun 05 15:13:04.614821 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:04.614801 2560 generic.go:356] "Generic (PLEG): container finished" podID="28a13201-8259-4d39-85a1-a1e6f58c778b" containerID="f0a669eef848348c9883a100d73bdfe6980bbb4c1b38e94645f8a3ad25333792" exitCode=1 Jun 05 15:13:04.614932 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:04.614842 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8864bb6dd-ftwqw" event={"ID":"28a13201-8259-4d39-85a1-a1e6f58c778b","Type":"ContainerDied","Data":"f0a669eef848348c9883a100d73bdfe6980bbb4c1b38e94645f8a3ad25333792"} Jun 05 15:13:04.614932 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:04.614877 2560 scope.go:117] "RemoveContainer" containerID="d94024b471221975b85560b621b56b61551453adc1eb0c2d0f93ccc91f1e5fe9" Jun 05 15:13:04.615152 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:04.615138 2560 scope.go:117] "RemoveContainer" containerID="f0a669eef848348c9883a100d73bdfe6980bbb4c1b38e94645f8a3ad25333792" Jun 05 15:13:04.615318 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:13:04.615301 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-8864bb6dd-ftwqw_open-cluster-management-agent-addon(28a13201-8259-4d39-85a1-a1e6f58c778b)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8864bb6dd-ftwqw" podUID="28a13201-8259-4d39-85a1-a1e6f58c778b" Jun 05 15:13:04.976295 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:04.976262 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-69xsz_9c7936f0-3a4d-4553-b67c-90eea6c1fcd6/dns-node-resolver/0.log" Jun 05 15:13:05.201882 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:05.201846 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8864bb6dd-ftwqw" Jun 05 15:13:05.619671 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:05.619637 2560 scope.go:117] "RemoveContainer" containerID="f0a669eef848348c9883a100d73bdfe6980bbb4c1b38e94645f8a3ad25333792" Jun 05 15:13:05.619869 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:13:05.619847 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-8864bb6dd-ftwqw_open-cluster-management-agent-addon(28a13201-8259-4d39-85a1-a1e6f58c778b)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8864bb6dd-ftwqw" podUID="28a13201-8259-4d39-85a1-a1e6f58c778b" Jun 05 15:13:05.775852 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:05.775816 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-g4qm9_0b540521-50dd-4407-9756-824f14cfeaaf/serve-healthcheck-canary/0.log" Jun 05 15:13:06.067656 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:06.067617 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75cf89cbdc-hvgzd"] Jun 05 15:13:06.525556 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:06.525529 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7wnx_3e51389e-8fe0-48a4-b902-493bfa632cf8/ovn-acl-logging/0.log" Jun 05 15:13:06.530017 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:06.529994 2560 kubelet.go:1648] "Image garbage collection succeeded" Jun 05 15:13:06.533397 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:06.533375 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7wnx_3e51389e-8fe0-48a4-b902-493bfa632cf8/ovn-acl-logging/0.log" Jun 05 15:13:07.585491 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:07.585466 2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8864bb6dd-ftwqw" Jun 05 15:13:07.587834 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:07.585805 2560 scope.go:117] "RemoveContainer" containerID="f0a669eef848348c9883a100d73bdfe6980bbb4c1b38e94645f8a3ad25333792" Jun 05 15:13:07.587834 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:13:07.585981 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-8864bb6dd-ftwqw_open-cluster-management-agent-addon(28a13201-8259-4d39-85a1-a1e6f58c778b)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8864bb6dd-ftwqw" podUID="28a13201-8259-4d39-85a1-a1e6f58c778b" Jun 05 15:13:07.618567 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:07.618535 2560 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d477d498f-sd7js" podUID="e17c9f4e-6809-4547-b082-752aea375266" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 05 15:13:17.618642 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:17.618602 2560 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d477d498f-sd7js" podUID="e17c9f4e-6809-4547-b082-752aea375266" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 05 15:13:22.591872 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:22.591841 2560 scope.go:117] "RemoveContainer" containerID="f0a669eef848348c9883a100d73bdfe6980bbb4c1b38e94645f8a3ad25333792" Jun 05 15:13:22.679388 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:22.679347 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8864bb6dd-ftwqw" event={"ID":"28a13201-8259-4d39-85a1-a1e6f58c778b","Type":"ContainerStarted","Data":"3a9e1d1285f009fc0f86017fd0cee941811c1b9ac168b9588479ccc363baa20e"} Jun 05 15:13:22.679698 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:22.679674 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8864bb6dd-ftwqw" Jun 05 15:13:22.680763 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:22.680739 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8864bb6dd-ftwqw" Jun 05 15:13:25.623857 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:25.623832 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-559cbfcb8d-2mtxn" Jun 05 15:13:27.618860 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:27.618815 2560 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d477d498f-sd7js" podUID="e17c9f4e-6809-4547-b082-752aea375266" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 05 15:13:27.619265 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:27.618899 2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d477d498f-sd7js" Jun 05 15:13:27.619384 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:27.619367 2560 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"bd7cdf2e4715b904e719fd90389f56baeed796c487319f9fb29f5a8b8eccc4c6"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d477d498f-sd7js" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 05 15:13:27.619421 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:27.619404 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d477d498f-sd7js" podUID="e17c9f4e-6809-4547-b082-752aea375266" containerName="service-proxy" containerID="cri-o://bd7cdf2e4715b904e719fd90389f56baeed796c487319f9fb29f5a8b8eccc4c6" gracePeriod=30 Jun 05 15:13:28.706471 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:28.706436 2560 generic.go:356] "Generic (PLEG): container finished" podID="e17c9f4e-6809-4547-b082-752aea375266" containerID="bd7cdf2e4715b904e719fd90389f56baeed796c487319f9fb29f5a8b8eccc4c6" exitCode=2 Jun 05 15:13:28.706850 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:28.706498 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d477d498f-sd7js" event={"ID":"e17c9f4e-6809-4547-b082-752aea375266","Type":"ContainerDied","Data":"bd7cdf2e4715b904e719fd90389f56baeed796c487319f9fb29f5a8b8eccc4c6"} Jun 05 15:13:28.706850 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:28.706547 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d477d498f-sd7js" event={"ID":"e17c9f4e-6809-4547-b082-752aea375266","Type":"ContainerStarted","Data":"d4302b84dccae4117608a61cd9f1056a1e704e9e5c19ab7c32e945042d669dd4"} Jun 05 15:13:31.087081 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:31.087038 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-75cf89cbdc-hvgzd" podUID="4c503204-9eb0-4c20-bdd5-0e2c82e34119" containerName="console" containerID="cri-o://695b4fa5c3de22a5eac3db435e164952ed73b05c0093a1438fb01a92cdf8b809" gracePeriod=15 Jun 05 15:13:31.328713 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:31.328690 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75cf89cbdc-hvgzd" Jun 05 15:13:31.482688 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:31.482648 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzcc7\" (UniqueName: \"kubernetes.io/projected/4c503204-9eb0-4c20-bdd5-0e2c82e34119-kube-api-access-rzcc7\") pod \"4c503204-9eb0-4c20-bdd5-0e2c82e34119\" (UID: \"4c503204-9eb0-4c20-bdd5-0e2c82e34119\") " Jun 05 15:13:31.482688 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:31.482696 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c503204-9eb0-4c20-bdd5-0e2c82e34119-console-oauth-config\") pod \"4c503204-9eb0-4c20-bdd5-0e2c82e34119\" (UID: \"4c503204-9eb0-4c20-bdd5-0e2c82e34119\") " Jun 05 15:13:31.482942 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:31.482724 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c503204-9eb0-4c20-bdd5-0e2c82e34119-service-ca\") pod \"4c503204-9eb0-4c20-bdd5-0e2c82e34119\" (UID: \"4c503204-9eb0-4c20-bdd5-0e2c82e34119\") " Jun 05 15:13:31.482942 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:31.482765 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c503204-9eb0-4c20-bdd5-0e2c82e34119-oauth-serving-cert\") pod \"4c503204-9eb0-4c20-bdd5-0e2c82e34119\" (UID: \"4c503204-9eb0-4c20-bdd5-0e2c82e34119\") " Jun 05 15:13:31.482942 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:31.482787 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c503204-9eb0-4c20-bdd5-0e2c82e34119-console-serving-cert\") pod \"4c503204-9eb0-4c20-bdd5-0e2c82e34119\" (UID: \"4c503204-9eb0-4c20-bdd5-0e2c82e34119\") " Jun 05 15:13:31.482942 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:31.482811 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c503204-9eb0-4c20-bdd5-0e2c82e34119-console-config\") pod \"4c503204-9eb0-4c20-bdd5-0e2c82e34119\" (UID: \"4c503204-9eb0-4c20-bdd5-0e2c82e34119\") " Jun 05 15:13:31.482942 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:31.482845 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c503204-9eb0-4c20-bdd5-0e2c82e34119-trusted-ca-bundle\") pod \"4c503204-9eb0-4c20-bdd5-0e2c82e34119\" (UID: \"4c503204-9eb0-4c20-bdd5-0e2c82e34119\") " Jun 05 15:13:31.483196 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:31.483089 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c503204-9eb0-4c20-bdd5-0e2c82e34119-service-ca" (OuterVolumeSpecName: "service-ca") pod "4c503204-9eb0-4c20-bdd5-0e2c82e34119" (UID: "4c503204-9eb0-4c20-bdd5-0e2c82e34119"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:13:31.483343 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:31.483315 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c503204-9eb0-4c20-bdd5-0e2c82e34119-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4c503204-9eb0-4c20-bdd5-0e2c82e34119" (UID: "4c503204-9eb0-4c20-bdd5-0e2c82e34119"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:13:31.483343 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:31.483328 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c503204-9eb0-4c20-bdd5-0e2c82e34119-console-config" (OuterVolumeSpecName: "console-config") pod "4c503204-9eb0-4c20-bdd5-0e2c82e34119" (UID: "4c503204-9eb0-4c20-bdd5-0e2c82e34119"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:13:31.483461 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:31.483343 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c503204-9eb0-4c20-bdd5-0e2c82e34119-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4c503204-9eb0-4c20-bdd5-0e2c82e34119" (UID: "4c503204-9eb0-4c20-bdd5-0e2c82e34119"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:13:31.485062 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:31.485041 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c503204-9eb0-4c20-bdd5-0e2c82e34119-kube-api-access-rzcc7" (OuterVolumeSpecName: "kube-api-access-rzcc7") pod "4c503204-9eb0-4c20-bdd5-0e2c82e34119" (UID: "4c503204-9eb0-4c20-bdd5-0e2c82e34119"). InnerVolumeSpecName "kube-api-access-rzcc7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:13:31.485134 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:31.485076 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c503204-9eb0-4c20-bdd5-0e2c82e34119-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4c503204-9eb0-4c20-bdd5-0e2c82e34119" (UID: "4c503204-9eb0-4c20-bdd5-0e2c82e34119"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:13:31.485285 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:31.485264 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c503204-9eb0-4c20-bdd5-0e2c82e34119-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4c503204-9eb0-4c20-bdd5-0e2c82e34119" (UID: "4c503204-9eb0-4c20-bdd5-0e2c82e34119"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:13:31.583330 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:31.583301 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c503204-9eb0-4c20-bdd5-0e2c82e34119-trusted-ca-bundle\") on node \"ip-10-0-138-97.ec2.internal\" DevicePath \"\"" Jun 05 15:13:31.583330 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:31.583326 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzcc7\" (UniqueName: \"kubernetes.io/projected/4c503204-9eb0-4c20-bdd5-0e2c82e34119-kube-api-access-rzcc7\") on node \"ip-10-0-138-97.ec2.internal\" DevicePath \"\"" Jun 05 15:13:31.583330 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:31.583335 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c503204-9eb0-4c20-bdd5-0e2c82e34119-console-oauth-config\") on node \"ip-10-0-138-97.ec2.internal\" DevicePath \"\"" Jun 05 15:13:31.583572 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:31.583344 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c503204-9eb0-4c20-bdd5-0e2c82e34119-service-ca\") on node \"ip-10-0-138-97.ec2.internal\" DevicePath \"\"" Jun 05 15:13:31.583572 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:31.583352 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c503204-9eb0-4c20-bdd5-0e2c82e34119-oauth-serving-cert\") on node \"ip-10-0-138-97.ec2.internal\" DevicePath \"\"" Jun 05 15:13:31.583572 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:31.583360 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c503204-9eb0-4c20-bdd5-0e2c82e34119-console-serving-cert\") on node \"ip-10-0-138-97.ec2.internal\" DevicePath \"\"" Jun 05 15:13:31.583572 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:31.583370 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c503204-9eb0-4c20-bdd5-0e2c82e34119-console-config\") on node \"ip-10-0-138-97.ec2.internal\" DevicePath \"\"" Jun 05 15:13:31.719481 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:31.719446 2560 generic.go:356] "Generic (PLEG): container finished" podID="4c503204-9eb0-4c20-bdd5-0e2c82e34119" containerID="695b4fa5c3de22a5eac3db435e164952ed73b05c0093a1438fb01a92cdf8b809" exitCode=0 Jun 05 15:13:31.719643 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:31.719487 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75cf89cbdc-hvgzd" Jun 05 15:13:31.719643 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:31.719493 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75cf89cbdc-hvgzd" event={"ID":"4c503204-9eb0-4c20-bdd5-0e2c82e34119","Type":"ContainerDied","Data":"695b4fa5c3de22a5eac3db435e164952ed73b05c0093a1438fb01a92cdf8b809"} Jun 05 15:13:31.719643 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:31.719536 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75cf89cbdc-hvgzd" event={"ID":"4c503204-9eb0-4c20-bdd5-0e2c82e34119","Type":"ContainerDied","Data":"3420d1a37a71b245a84a7e8289525a33bb0f40d793aaba0cfd20cce93d74ed0e"} Jun 05 15:13:31.719643 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:31.719556 2560 scope.go:117] "RemoveContainer" containerID="695b4fa5c3de22a5eac3db435e164952ed73b05c0093a1438fb01a92cdf8b809" Jun 05 15:13:31.731393 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:31.731371 2560 scope.go:117] "RemoveContainer" containerID="695b4fa5c3de22a5eac3db435e164952ed73b05c0093a1438fb01a92cdf8b809" Jun 05 15:13:31.731676 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:13:31.731650 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"695b4fa5c3de22a5eac3db435e164952ed73b05c0093a1438fb01a92cdf8b809\": container with ID starting with 695b4fa5c3de22a5eac3db435e164952ed73b05c0093a1438fb01a92cdf8b809 not found: ID does not exist" containerID="695b4fa5c3de22a5eac3db435e164952ed73b05c0093a1438fb01a92cdf8b809" Jun 05 15:13:31.731789 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:31.731681 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"695b4fa5c3de22a5eac3db435e164952ed73b05c0093a1438fb01a92cdf8b809"} err="failed to get container status \"695b4fa5c3de22a5eac3db435e164952ed73b05c0093a1438fb01a92cdf8b809\": rpc error: code = NotFound desc = could not find container \"695b4fa5c3de22a5eac3db435e164952ed73b05c0093a1438fb01a92cdf8b809\": container with ID starting with 695b4fa5c3de22a5eac3db435e164952ed73b05c0093a1438fb01a92cdf8b809 not found: ID does not exist" Jun 05 15:13:31.745085 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:31.745011 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75cf89cbdc-hvgzd"] Jun 05 15:13:31.748794 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:31.748766 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75cf89cbdc-hvgzd"] Jun 05 15:13:32.595269 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:13:32.595231 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c503204-9eb0-4c20-bdd5-0e2c82e34119" path="/var/lib/kubelet/pods/4c503204-9eb0-4c20-bdd5-0e2c82e34119/volumes" Jun 05 15:14:05.275084 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:05.275045 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7p47w"] Jun 05 15:14:05.275674 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:05.275386 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c503204-9eb0-4c20-bdd5-0e2c82e34119" containerName="console" Jun 05 15:14:05.275674 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:05.275402 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c503204-9eb0-4c20-bdd5-0e2c82e34119" containerName="console" Jun 05 15:14:05.275674 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:05.275457 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c503204-9eb0-4c20-bdd5-0e2c82e34119" containerName="console" Jun 05 15:14:05.278721 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:05.278699 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7p47w" Jun 05 15:14:05.281454 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:05.281426 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-q4kkf\"" Jun 05 15:14:05.281576 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:05.281511 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 15:14:05.282527 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:05.282511 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 15:14:05.294275 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:05.294254 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7p47w"] Jun 05 15:14:05.428848 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:05.428816 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rj6k\" (UniqueName: \"kubernetes.io/projected/799f61fd-e8c5-46f5-b287-52ef171ca325-kube-api-access-9rj6k\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7p47w\" (UID: \"799f61fd-e8c5-46f5-b287-52ef171ca325\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7p47w" Jun 05 15:14:05.428991 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:05.428884 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/799f61fd-e8c5-46f5-b287-52ef171ca325-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7p47w\" (UID: \"799f61fd-e8c5-46f5-b287-52ef171ca325\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7p47w" Jun 05 15:14:05.428991 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:05.428920 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/799f61fd-e8c5-46f5-b287-52ef171ca325-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7p47w\" (UID: \"799f61fd-e8c5-46f5-b287-52ef171ca325\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7p47w" Jun 05 15:14:05.529293 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:05.529232 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/799f61fd-e8c5-46f5-b287-52ef171ca325-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7p47w\" (UID: \"799f61fd-e8c5-46f5-b287-52ef171ca325\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7p47w" Jun 05 15:14:05.529293 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:05.529293 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rj6k\" (UniqueName: \"kubernetes.io/projected/799f61fd-e8c5-46f5-b287-52ef171ca325-kube-api-access-9rj6k\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7p47w\" (UID: \"799f61fd-e8c5-46f5-b287-52ef171ca325\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7p47w" Jun 05 15:14:05.529395 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:05.529352 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/799f61fd-e8c5-46f5-b287-52ef171ca325-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7p47w\" (UID: \"799f61fd-e8c5-46f5-b287-52ef171ca325\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7p47w" Jun 05 15:14:05.529688 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:05.529670 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/799f61fd-e8c5-46f5-b287-52ef171ca325-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7p47w\" (UID: \"799f61fd-e8c5-46f5-b287-52ef171ca325\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7p47w" Jun 05 15:14:05.529688 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:05.529680 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/799f61fd-e8c5-46f5-b287-52ef171ca325-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7p47w\" (UID: \"799f61fd-e8c5-46f5-b287-52ef171ca325\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7p47w" Jun 05 15:14:05.538679 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:05.538657 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rj6k\" (UniqueName: \"kubernetes.io/projected/799f61fd-e8c5-46f5-b287-52ef171ca325-kube-api-access-9rj6k\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7p47w\" (UID: \"799f61fd-e8c5-46f5-b287-52ef171ca325\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7p47w" Jun 05 15:14:05.587527 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:05.587495 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7p47w" Jun 05 15:14:05.726362 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:05.726268 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7p47w"] Jun 05 15:14:05.729042 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:14:05.729015 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod799f61fd_e8c5_46f5_b287_52ef171ca325.slice/crio-2ddcfe01b5ed22b21ffe475a3f04a8fe650a36246b1aecf832c2869faeb17349 WatchSource:0}: Error finding container 2ddcfe01b5ed22b21ffe475a3f04a8fe650a36246b1aecf832c2869faeb17349: Status 404 returned error can't find the container with id 2ddcfe01b5ed22b21ffe475a3f04a8fe650a36246b1aecf832c2869faeb17349 Jun 05 15:14:05.731312 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:05.731297 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 15:14:05.837600 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:05.837513 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7p47w" event={"ID":"799f61fd-e8c5-46f5-b287-52ef171ca325","Type":"ContainerStarted","Data":"2ddcfe01b5ed22b21ffe475a3f04a8fe650a36246b1aecf832c2869faeb17349"} Jun 05 15:14:11.860785 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:11.860749 2560 generic.go:356] "Generic (PLEG): container finished" podID="799f61fd-e8c5-46f5-b287-52ef171ca325" containerID="0ac1f75e182b45807a3af3170aa277e650bba548b0ad5af39f6c8f5f079081cb" exitCode=0 Jun 05 15:14:11.861215 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:11.860801 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7p47w" event={"ID":"799f61fd-e8c5-46f5-b287-52ef171ca325","Type":"ContainerDied","Data":"0ac1f75e182b45807a3af3170aa277e650bba548b0ad5af39f6c8f5f079081cb"} Jun 05 15:14:13.871819 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:13.871790 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7p47w" event={"ID":"799f61fd-e8c5-46f5-b287-52ef171ca325","Type":"ContainerStarted","Data":"706a486043fbdd4055dcf881280c455276da5dd68d6d06904e3391938d3e3ec9"} Jun 05 15:14:14.876538 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:14.876504 2560 generic.go:356] "Generic (PLEG): container finished" podID="799f61fd-e8c5-46f5-b287-52ef171ca325" containerID="706a486043fbdd4055dcf881280c455276da5dd68d6d06904e3391938d3e3ec9" exitCode=0 Jun 05 15:14:14.876899 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:14.876557 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7p47w" event={"ID":"799f61fd-e8c5-46f5-b287-52ef171ca325","Type":"ContainerDied","Data":"706a486043fbdd4055dcf881280c455276da5dd68d6d06904e3391938d3e3ec9"} Jun 05 15:14:19.895954 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:19.895924 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7p47w" event={"ID":"799f61fd-e8c5-46f5-b287-52ef171ca325","Type":"ContainerStarted","Data":"30074a1ef416f78a10a255c171d2d5d397ceab82d4329d3a5a9c451a436f4477"} Jun 05 15:14:19.917715 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:19.917655 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7p47w" podStartSLOduration=1.568779798 podStartE2EDuration="14.917632935s" totalImagesPullingTime="13.348853137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:14:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:14:19.916403473 +0000 UTC m=+373.811921576" watchObservedRunningTime="2026-06-05 15:14:19.917632935 +0000 UTC m=+373.813151036" Jun 05 15:14:20.901251 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:20.901214 2560 generic.go:356] "Generic (PLEG): container finished" podID="799f61fd-e8c5-46f5-b287-52ef171ca325" containerID="30074a1ef416f78a10a255c171d2d5d397ceab82d4329d3a5a9c451a436f4477" exitCode=0 Jun 05 15:14:20.901620 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:20.901303 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7p47w" event={"ID":"799f61fd-e8c5-46f5-b287-52ef171ca325","Type":"ContainerDied","Data":"30074a1ef416f78a10a255c171d2d5d397ceab82d4329d3a5a9c451a436f4477"} Jun 05 15:14:22.029301 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:22.029278 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7p47w" Jun 05 15:14:22.059499 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:22.059470 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rj6k\" (UniqueName: \"kubernetes.io/projected/799f61fd-e8c5-46f5-b287-52ef171ca325-kube-api-access-9rj6k\") pod \"799f61fd-e8c5-46f5-b287-52ef171ca325\" (UID: \"799f61fd-e8c5-46f5-b287-52ef171ca325\") " Jun 05 15:14:22.059651 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:22.059534 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/799f61fd-e8c5-46f5-b287-52ef171ca325-bundle\") pod \"799f61fd-e8c5-46f5-b287-52ef171ca325\" (UID: \"799f61fd-e8c5-46f5-b287-52ef171ca325\") " Jun 05 15:14:22.059651 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:22.059572 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/799f61fd-e8c5-46f5-b287-52ef171ca325-util\") pod \"799f61fd-e8c5-46f5-b287-52ef171ca325\" (UID: \"799f61fd-e8c5-46f5-b287-52ef171ca325\") " Jun 05 15:14:22.060217 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:22.060191 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/799f61fd-e8c5-46f5-b287-52ef171ca325-bundle" (OuterVolumeSpecName: "bundle") pod "799f61fd-e8c5-46f5-b287-52ef171ca325" (UID: "799f61fd-e8c5-46f5-b287-52ef171ca325"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:14:22.061720 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:22.061695 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/799f61fd-e8c5-46f5-b287-52ef171ca325-kube-api-access-9rj6k" (OuterVolumeSpecName: "kube-api-access-9rj6k") pod "799f61fd-e8c5-46f5-b287-52ef171ca325" (UID: "799f61fd-e8c5-46f5-b287-52ef171ca325"). InnerVolumeSpecName "kube-api-access-9rj6k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:14:22.063878 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:22.063855 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/799f61fd-e8c5-46f5-b287-52ef171ca325-util" (OuterVolumeSpecName: "util") pod "799f61fd-e8c5-46f5-b287-52ef171ca325" (UID: "799f61fd-e8c5-46f5-b287-52ef171ca325"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:14:22.160737 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:22.160648 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/799f61fd-e8c5-46f5-b287-52ef171ca325-util\") on node \"ip-10-0-138-97.ec2.internal\" DevicePath \"\"" Jun 05 15:14:22.160737 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:22.160676 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rj6k\" (UniqueName: \"kubernetes.io/projected/799f61fd-e8c5-46f5-b287-52ef171ca325-kube-api-access-9rj6k\") on node \"ip-10-0-138-97.ec2.internal\" DevicePath \"\"" Jun 05 15:14:22.160737 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:22.160689 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/799f61fd-e8c5-46f5-b287-52ef171ca325-bundle\") on node \"ip-10-0-138-97.ec2.internal\" DevicePath \"\"" Jun 05 15:14:22.910564 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:22.910474 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7p47w" event={"ID":"799f61fd-e8c5-46f5-b287-52ef171ca325","Type":"ContainerDied","Data":"2ddcfe01b5ed22b21ffe475a3f04a8fe650a36246b1aecf832c2869faeb17349"} Jun 05 15:14:22.910564 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:22.910496 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7p47w" Jun 05 15:14:22.910564 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:22.910527 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ddcfe01b5ed22b21ffe475a3f04a8fe650a36246b1aecf832c2869faeb17349" Jun 05 15:14:56.598991 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:56.598958 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ljlxq"] Jun 05 15:14:56.599408 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:56.599174 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="799f61fd-e8c5-46f5-b287-52ef171ca325" containerName="pull" Jun 05 15:14:56.599408 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:56.599184 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="799f61fd-e8c5-46f5-b287-52ef171ca325" containerName="pull" Jun 05 15:14:56.599408 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:56.599194 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="799f61fd-e8c5-46f5-b287-52ef171ca325" containerName="extract" Jun 05 15:14:56.599408 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:56.599200 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="799f61fd-e8c5-46f5-b287-52ef171ca325" containerName="extract" Jun 05 15:14:56.599408 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:56.599215 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="799f61fd-e8c5-46f5-b287-52ef171ca325" containerName="util" Jun 05 15:14:56.599408 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:56.599220 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="799f61fd-e8c5-46f5-b287-52ef171ca325" containerName="util" Jun 05 15:14:56.599408 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:56.599259 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="799f61fd-e8c5-46f5-b287-52ef171ca325" containerName="extract" Jun 05 15:14:56.601729 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:56.601714 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ljlxq" Jun 05 15:14:56.610789 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:56.610767 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 05 15:14:56.611730 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:56.611713 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 05 15:14:56.611875 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:56.611784 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-hzk2d\"" Jun 05 15:14:56.620798 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:56.620777 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ljlxq"] Jun 05 15:14:56.699287 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:56.699254 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee599fce-5b54-471f-ae49-0eab34e63c8a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ljlxq\" (UID: \"ee599fce-5b54-471f-ae49-0eab34e63c8a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ljlxq" Jun 05 15:14:56.699466 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:56.699310 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2q4h\" (UniqueName: \"kubernetes.io/projected/ee599fce-5b54-471f-ae49-0eab34e63c8a-kube-api-access-h2q4h\") pod \"openshift-lws-operator-fd8ccff4c-ljlxq\" (UID: \"ee599fce-5b54-471f-ae49-0eab34e63c8a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ljlxq" Jun 05 15:14:56.800461 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:56.800423 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee599fce-5b54-471f-ae49-0eab34e63c8a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ljlxq\" (UID: \"ee599fce-5b54-471f-ae49-0eab34e63c8a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ljlxq" Jun 05 15:14:56.800653 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:56.800482 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2q4h\" (UniqueName: \"kubernetes.io/projected/ee599fce-5b54-471f-ae49-0eab34e63c8a-kube-api-access-h2q4h\") pod \"openshift-lws-operator-fd8ccff4c-ljlxq\" (UID: \"ee599fce-5b54-471f-ae49-0eab34e63c8a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ljlxq" Jun 05 15:14:56.800862 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:56.800841 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee599fce-5b54-471f-ae49-0eab34e63c8a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ljlxq\" (UID: \"ee599fce-5b54-471f-ae49-0eab34e63c8a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ljlxq" Jun 05 15:14:56.816997 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:56.816964 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2q4h\" (UniqueName: \"kubernetes.io/projected/ee599fce-5b54-471f-ae49-0eab34e63c8a-kube-api-access-h2q4h\") pod \"openshift-lws-operator-fd8ccff4c-ljlxq\" (UID: \"ee599fce-5b54-471f-ae49-0eab34e63c8a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ljlxq" Jun 05 15:14:56.909657 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:56.909553 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ljlxq" Jun 05 15:14:57.055129 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:57.055092 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ljlxq"] Jun 05 15:14:57.059561 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:14:57.059527 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee599fce_5b54_471f_ae49_0eab34e63c8a.slice/crio-b622964260bf59abed003b9982b5fcd846bb77bb9d1b9ec0f6d244e85d024b95 WatchSource:0}: Error finding container b622964260bf59abed003b9982b5fcd846bb77bb9d1b9ec0f6d244e85d024b95: Status 404 returned error can't find the container with id b622964260bf59abed003b9982b5fcd846bb77bb9d1b9ec0f6d244e85d024b95 Jun 05 15:14:58.036599 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:14:58.036558 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ljlxq" event={"ID":"ee599fce-5b54-471f-ae49-0eab34e63c8a","Type":"ContainerStarted","Data":"b622964260bf59abed003b9982b5fcd846bb77bb9d1b9ec0f6d244e85d024b95"} Jun 05 15:15:01.050958 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:01.050849 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ljlxq" event={"ID":"ee599fce-5b54-471f-ae49-0eab34e63c8a","Type":"ContainerStarted","Data":"592e1deb54abb6a0040d21f06d5c2ad5fd2c4966dda620065d176b1a73c66ffe"} Jun 05 15:15:01.069335 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:01.069270 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ljlxq" podStartSLOduration=1.404779798 podStartE2EDuration="5.069250021s" totalImagesPullingTime="3.664470223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:14:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:15:01.066996509 +0000 UTC m=+414.962514609" watchObservedRunningTime="2026-06-05 15:15:01.069250021 +0000 UTC m=+414.964768123" Jun 05 15:15:03.359253 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:03.359216 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r5rg"] Jun 05 15:15:03.362442 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:03.362424 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r5rg" Jun 05 15:15:03.365253 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:03.365230 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 15:15:03.365375 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:03.365274 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 15:15:03.366225 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:03.366208 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-q4kkf\"" Jun 05 15:15:03.372535 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:03.372512 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r5rg"] Jun 05 15:15:03.453961 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:03.453893 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv8g4\" (UniqueName: \"kubernetes.io/projected/8dac5173-4a66-48ef-9df7-11b91f6c2447-kube-api-access-rv8g4\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r5rg\" (UID: \"8dac5173-4a66-48ef-9df7-11b91f6c2447\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r5rg" Jun 05 15:15:03.453961 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:03.453965 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8dac5173-4a66-48ef-9df7-11b91f6c2447-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r5rg\" (UID: \"8dac5173-4a66-48ef-9df7-11b91f6c2447\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r5rg" Jun 05 15:15:03.454173 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:03.453986 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8dac5173-4a66-48ef-9df7-11b91f6c2447-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r5rg\" (UID: \"8dac5173-4a66-48ef-9df7-11b91f6c2447\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r5rg" Jun 05 15:15:03.554898 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:03.554871 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv8g4\" (UniqueName: \"kubernetes.io/projected/8dac5173-4a66-48ef-9df7-11b91f6c2447-kube-api-access-rv8g4\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r5rg\" (UID: \"8dac5173-4a66-48ef-9df7-11b91f6c2447\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r5rg" Jun 05 15:15:03.555045 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:03.554922 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8dac5173-4a66-48ef-9df7-11b91f6c2447-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r5rg\" (UID: \"8dac5173-4a66-48ef-9df7-11b91f6c2447\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r5rg" Jun 05 15:15:03.555045 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:03.554946 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8dac5173-4a66-48ef-9df7-11b91f6c2447-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r5rg\" (UID: \"8dac5173-4a66-48ef-9df7-11b91f6c2447\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r5rg" Jun 05 15:15:03.555271 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:03.555254 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8dac5173-4a66-48ef-9df7-11b91f6c2447-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r5rg\" (UID: \"8dac5173-4a66-48ef-9df7-11b91f6c2447\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r5rg" Jun 05 15:15:03.555343 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:03.555302 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8dac5173-4a66-48ef-9df7-11b91f6c2447-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r5rg\" (UID: \"8dac5173-4a66-48ef-9df7-11b91f6c2447\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r5rg" Jun 05 15:15:03.564677 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:03.564656 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv8g4\" (UniqueName: \"kubernetes.io/projected/8dac5173-4a66-48ef-9df7-11b91f6c2447-kube-api-access-rv8g4\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r5rg\" (UID: \"8dac5173-4a66-48ef-9df7-11b91f6c2447\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r5rg" Jun 05 15:15:03.670691 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:03.670663 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r5rg" Jun 05 15:15:03.809006 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:03.808975 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r5rg"] Jun 05 15:15:03.812202 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:15:03.812171 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dac5173_4a66_48ef_9df7_11b91f6c2447.slice/crio-d1ade2b3baf9dc7572b022926e3d48d31eda94e6789fff93b8e179445ee9df4e WatchSource:0}: Error finding container d1ade2b3baf9dc7572b022926e3d48d31eda94e6789fff93b8e179445ee9df4e: Status 404 returned error can't find the container with id d1ade2b3baf9dc7572b022926e3d48d31eda94e6789fff93b8e179445ee9df4e Jun 05 15:15:04.063407 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:04.063312 2560 generic.go:356] "Generic (PLEG): container finished" podID="8dac5173-4a66-48ef-9df7-11b91f6c2447" containerID="ad85fd4b931b20bcbbac32e321cd46471790490d87e46c18e55d85ab02693fa5" exitCode=0 Jun 05 15:15:04.063407 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:04.063354 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r5rg" event={"ID":"8dac5173-4a66-48ef-9df7-11b91f6c2447","Type":"ContainerDied","Data":"ad85fd4b931b20bcbbac32e321cd46471790490d87e46c18e55d85ab02693fa5"} Jun 05 15:15:04.063625 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:04.063431 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r5rg" event={"ID":"8dac5173-4a66-48ef-9df7-11b91f6c2447","Type":"ContainerStarted","Data":"d1ade2b3baf9dc7572b022926e3d48d31eda94e6789fff93b8e179445ee9df4e"} Jun 05 15:15:05.069024 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:05.068984 2560 generic.go:356] "Generic (PLEG): container finished" podID="8dac5173-4a66-48ef-9df7-11b91f6c2447" containerID="a3054bff86d80f19542ef6c16f80d2afed150e5edcaf83173b0efb8446398cb3" exitCode=0 Jun 05 15:15:05.069418 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:05.069069 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r5rg" event={"ID":"8dac5173-4a66-48ef-9df7-11b91f6c2447","Type":"ContainerDied","Data":"a3054bff86d80f19542ef6c16f80d2afed150e5edcaf83173b0efb8446398cb3"} Jun 05 15:15:06.075224 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:06.075186 2560 generic.go:356] "Generic (PLEG): container finished" podID="8dac5173-4a66-48ef-9df7-11b91f6c2447" containerID="fd5846dbbc4bd5147a696aa1fe8d01fc8306498a39e6b20e738baf96f5a092f7" exitCode=0 Jun 05 15:15:06.075589 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:06.075261 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r5rg" event={"ID":"8dac5173-4a66-48ef-9df7-11b91f6c2447","Type":"ContainerDied","Data":"fd5846dbbc4bd5147a696aa1fe8d01fc8306498a39e6b20e738baf96f5a092f7"} Jun 05 15:15:07.206037 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:07.206013 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r5rg" Jun 05 15:15:07.287317 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:07.287280 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rv8g4\" (UniqueName: \"kubernetes.io/projected/8dac5173-4a66-48ef-9df7-11b91f6c2447-kube-api-access-rv8g4\") pod \"8dac5173-4a66-48ef-9df7-11b91f6c2447\" (UID: \"8dac5173-4a66-48ef-9df7-11b91f6c2447\") " Jun 05 15:15:07.287509 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:07.287343 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8dac5173-4a66-48ef-9df7-11b91f6c2447-util\") pod \"8dac5173-4a66-48ef-9df7-11b91f6c2447\" (UID: \"8dac5173-4a66-48ef-9df7-11b91f6c2447\") " Jun 05 15:15:07.287509 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:07.287387 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8dac5173-4a66-48ef-9df7-11b91f6c2447-bundle\") pod \"8dac5173-4a66-48ef-9df7-11b91f6c2447\" (UID: \"8dac5173-4a66-48ef-9df7-11b91f6c2447\") " Jun 05 15:15:07.288140 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:07.288114 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dac5173-4a66-48ef-9df7-11b91f6c2447-bundle" (OuterVolumeSpecName: "bundle") pod "8dac5173-4a66-48ef-9df7-11b91f6c2447" (UID: "8dac5173-4a66-48ef-9df7-11b91f6c2447"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:15:07.289445 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:07.289419 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dac5173-4a66-48ef-9df7-11b91f6c2447-kube-api-access-rv8g4" (OuterVolumeSpecName: "kube-api-access-rv8g4") pod "8dac5173-4a66-48ef-9df7-11b91f6c2447" (UID: "8dac5173-4a66-48ef-9df7-11b91f6c2447"). InnerVolumeSpecName "kube-api-access-rv8g4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:15:07.293080 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:07.293056 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dac5173-4a66-48ef-9df7-11b91f6c2447-util" (OuterVolumeSpecName: "util") pod "8dac5173-4a66-48ef-9df7-11b91f6c2447" (UID: "8dac5173-4a66-48ef-9df7-11b91f6c2447"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:15:07.388052 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:07.387951 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8dac5173-4a66-48ef-9df7-11b91f6c2447-bundle\") on node \"ip-10-0-138-97.ec2.internal\" DevicePath \"\"" Jun 05 15:15:07.388052 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:07.387992 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rv8g4\" (UniqueName: \"kubernetes.io/projected/8dac5173-4a66-48ef-9df7-11b91f6c2447-kube-api-access-rv8g4\") on node \"ip-10-0-138-97.ec2.internal\" DevicePath \"\"" Jun 05 15:15:07.388052 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:07.388003 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8dac5173-4a66-48ef-9df7-11b91f6c2447-util\") on node \"ip-10-0-138-97.ec2.internal\" DevicePath \"\"" Jun 05 15:15:08.083361 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:08.083332 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r5rg" Jun 05 15:15:08.083559 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:08.083332 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r5rg" event={"ID":"8dac5173-4a66-48ef-9df7-11b91f6c2447","Type":"ContainerDied","Data":"d1ade2b3baf9dc7572b022926e3d48d31eda94e6789fff93b8e179445ee9df4e"} Jun 05 15:15:08.083559 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:08.083460 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d1ade2b3baf9dc7572b022926e3d48d31eda94e6789fff93b8e179445ee9df4e" Jun 05 15:15:18.869384 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:18.869291 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-848c5d5886-48qpd"] Jun 05 15:15:18.869976 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:18.869634 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dac5173-4a66-48ef-9df7-11b91f6c2447" containerName="extract" Jun 05 15:15:18.869976 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:18.869654 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dac5173-4a66-48ef-9df7-11b91f6c2447" containerName="extract" Jun 05 15:15:18.869976 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:18.869676 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dac5173-4a66-48ef-9df7-11b91f6c2447" containerName="util" Jun 05 15:15:18.869976 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:18.869684 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dac5173-4a66-48ef-9df7-11b91f6c2447" containerName="util" Jun 05 15:15:18.869976 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:18.869711 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dac5173-4a66-48ef-9df7-11b91f6c2447" containerName="pull" Jun 05 15:15:18.869976 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:18.869721 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dac5173-4a66-48ef-9df7-11b91f6c2447" containerName="pull" Jun 05 15:15:18.869976 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:18.869777 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dac5173-4a66-48ef-9df7-11b91f6c2447" containerName="extract" Jun 05 15:15:18.872738 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:18.872717 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-848c5d5886-48qpd" Jun 05 15:15:18.876453 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:18.876431 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 05 15:15:18.876693 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:18.876670 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wfvzc\"" Jun 05 15:15:18.876693 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:18.876684 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 05 15:15:18.876824 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:18.876788 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 05 15:15:18.877733 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:18.877720 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 05 15:15:18.903303 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:18.903280 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-848c5d5886-48qpd"] Jun 05 15:15:18.977969 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:18.977941 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/647844cb-e727-4c54-a5b4-de27e57410b4-manifests\") pod \"opendatahub-operator-controller-manager-848c5d5886-48qpd\" (UID: \"647844cb-e727-4c54-a5b4-de27e57410b4\") " pod="opendatahub/opendatahub-operator-controller-manager-848c5d5886-48qpd" Jun 05 15:15:18.978092 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:18.977983 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slcx2\" (UniqueName: \"kubernetes.io/projected/647844cb-e727-4c54-a5b4-de27e57410b4-kube-api-access-slcx2\") pod \"opendatahub-operator-controller-manager-848c5d5886-48qpd\" (UID: \"647844cb-e727-4c54-a5b4-de27e57410b4\") " pod="opendatahub/opendatahub-operator-controller-manager-848c5d5886-48qpd" Jun 05 15:15:18.978092 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:18.978021 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/647844cb-e727-4c54-a5b4-de27e57410b4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-848c5d5886-48qpd\" (UID: \"647844cb-e727-4c54-a5b4-de27e57410b4\") " pod="opendatahub/opendatahub-operator-controller-manager-848c5d5886-48qpd" Jun 05 15:15:18.978092 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:18.978051 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/647844cb-e727-4c54-a5b4-de27e57410b4-webhook-cert\") pod \"opendatahub-operator-controller-manager-848c5d5886-48qpd\" (UID: \"647844cb-e727-4c54-a5b4-de27e57410b4\") " pod="opendatahub/opendatahub-operator-controller-manager-848c5d5886-48qpd" Jun 05 15:15:18.978092 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:18.978073 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/647844cb-e727-4c54-a5b4-de27e57410b4-tmp\") pod \"opendatahub-operator-controller-manager-848c5d5886-48qpd\" (UID: \"647844cb-e727-4c54-a5b4-de27e57410b4\") " pod="opendatahub/opendatahub-operator-controller-manager-848c5d5886-48qpd" Jun 05 15:15:19.078583 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:19.078550 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/647844cb-e727-4c54-a5b4-de27e57410b4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-848c5d5886-48qpd\" (UID: \"647844cb-e727-4c54-a5b4-de27e57410b4\") " pod="opendatahub/opendatahub-operator-controller-manager-848c5d5886-48qpd" Jun 05 15:15:19.078714 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:19.078592 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/647844cb-e727-4c54-a5b4-de27e57410b4-webhook-cert\") pod \"opendatahub-operator-controller-manager-848c5d5886-48qpd\" (UID: \"647844cb-e727-4c54-a5b4-de27e57410b4\") " pod="opendatahub/opendatahub-operator-controller-manager-848c5d5886-48qpd" Jun 05 15:15:19.078714 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:19.078630 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/647844cb-e727-4c54-a5b4-de27e57410b4-tmp\") pod \"opendatahub-operator-controller-manager-848c5d5886-48qpd\" (UID: \"647844cb-e727-4c54-a5b4-de27e57410b4\") " pod="opendatahub/opendatahub-operator-controller-manager-848c5d5886-48qpd" Jun 05 15:15:19.078714 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:19.078675 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/647844cb-e727-4c54-a5b4-de27e57410b4-manifests\") pod \"opendatahub-operator-controller-manager-848c5d5886-48qpd\" (UID: \"647844cb-e727-4c54-a5b4-de27e57410b4\") " pod="opendatahub/opendatahub-operator-controller-manager-848c5d5886-48qpd" Jun 05 15:15:19.078860 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:19.078732 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slcx2\" (UniqueName: \"kubernetes.io/projected/647844cb-e727-4c54-a5b4-de27e57410b4-kube-api-access-slcx2\") pod \"opendatahub-operator-controller-manager-848c5d5886-48qpd\" (UID: \"647844cb-e727-4c54-a5b4-de27e57410b4\") " pod="opendatahub/opendatahub-operator-controller-manager-848c5d5886-48qpd" Jun 05 15:15:19.079217 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:19.079185 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/647844cb-e727-4c54-a5b4-de27e57410b4-manifests\") pod \"opendatahub-operator-controller-manager-848c5d5886-48qpd\" (UID: \"647844cb-e727-4c54-a5b4-de27e57410b4\") " pod="opendatahub/opendatahub-operator-controller-manager-848c5d5886-48qpd" Jun 05 15:15:19.080988 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:19.080970 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/647844cb-e727-4c54-a5b4-de27e57410b4-tmp\") pod \"opendatahub-operator-controller-manager-848c5d5886-48qpd\" (UID: \"647844cb-e727-4c54-a5b4-de27e57410b4\") " pod="opendatahub/opendatahub-operator-controller-manager-848c5d5886-48qpd" Jun 05 15:15:19.081124 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:19.081108 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/647844cb-e727-4c54-a5b4-de27e57410b4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-848c5d5886-48qpd\" (UID: \"647844cb-e727-4c54-a5b4-de27e57410b4\") " pod="opendatahub/opendatahub-operator-controller-manager-848c5d5886-48qpd" Jun 05 15:15:19.081286 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:19.081266 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/647844cb-e727-4c54-a5b4-de27e57410b4-webhook-cert\") pod \"opendatahub-operator-controller-manager-848c5d5886-48qpd\" (UID: \"647844cb-e727-4c54-a5b4-de27e57410b4\") " pod="opendatahub/opendatahub-operator-controller-manager-848c5d5886-48qpd" Jun 05 15:15:19.087129 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:19.087106 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slcx2\" (UniqueName: \"kubernetes.io/projected/647844cb-e727-4c54-a5b4-de27e57410b4-kube-api-access-slcx2\") pod \"opendatahub-operator-controller-manager-848c5d5886-48qpd\" (UID: \"647844cb-e727-4c54-a5b4-de27e57410b4\") " pod="opendatahub/opendatahub-operator-controller-manager-848c5d5886-48qpd" Jun 05 15:15:19.183591 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:19.183559 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-848c5d5886-48qpd" Jun 05 15:15:19.316285 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:19.316252 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-848c5d5886-48qpd"] Jun 05 15:15:19.319410 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:15:19.319380 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod647844cb_e727_4c54_a5b4_de27e57410b4.slice/crio-97dca0b43d89a99e3eb51df4bcfe9dcb5b62765b5471db8920d969ca8da6e0ab WatchSource:0}: Error finding container 97dca0b43d89a99e3eb51df4bcfe9dcb5b62765b5471db8920d969ca8da6e0ab: Status 404 returned error can't find the container with id 97dca0b43d89a99e3eb51df4bcfe9dcb5b62765b5471db8920d969ca8da6e0ab Jun 05 15:15:20.129462 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:20.129415 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-848c5d5886-48qpd" event={"ID":"647844cb-e727-4c54-a5b4-de27e57410b4","Type":"ContainerStarted","Data":"97dca0b43d89a99e3eb51df4bcfe9dcb5b62765b5471db8920d969ca8da6e0ab"} Jun 05 15:15:22.139068 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:22.139035 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-848c5d5886-48qpd" event={"ID":"647844cb-e727-4c54-a5b4-de27e57410b4","Type":"ContainerStarted","Data":"233d2bf6a63de7701fbcded90f7cd422d5266ec88d406a10312c35f2002e3515"} Jun 05 15:15:23.144351 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:23.144317 2560 generic.go:356] "Generic (PLEG): container finished" podID="647844cb-e727-4c54-a5b4-de27e57410b4" containerID="233d2bf6a63de7701fbcded90f7cd422d5266ec88d406a10312c35f2002e3515" exitCode=0 Jun 05 15:15:23.144727 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:23.144404 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-848c5d5886-48qpd" event={"ID":"647844cb-e727-4c54-a5b4-de27e57410b4","Type":"ContainerDied","Data":"233d2bf6a63de7701fbcded90f7cd422d5266ec88d406a10312c35f2002e3515"} Jun 05 15:15:24.151035 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:24.150997 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-848c5d5886-48qpd" event={"ID":"647844cb-e727-4c54-a5b4-de27e57410b4","Type":"ContainerStarted","Data":"4674b33f7522958ae3fe7daea31de9f27cf2b27d0373f6a4402e80d8c77b264d"} Jun 05 15:15:24.151431 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:24.151098 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-848c5d5886-48qpd" Jun 05 15:15:24.175231 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:24.175174 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-848c5d5886-48qpd" podStartSLOduration=2.205178342 podStartE2EDuration="6.175159088s" totalImagesPullingTime="3.01529285s" totalInitContainerRuntime="954.687896ms" isStatefulPod=false podCreationTimestamp="2026-06-05 15:15:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:15:24.173408851 +0000 UTC m=+438.068926952" watchObservedRunningTime="2026-06-05 15:15:24.175159088 +0000 UTC m=+438.070677182" Jun 05 15:15:35.156469 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:35.156439 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-848c5d5886-48qpd" Jun 05 15:15:38.041887 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:38.041851 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7696d464b-w6wjn"] Jun 05 15:15:38.056784 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:38.056752 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7696d464b-w6wjn" Jun 05 15:15:38.059296 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:38.059258 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7696d464b-w6wjn"] Jun 05 15:15:38.060005 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:38.059978 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 05 15:15:38.060142 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:38.059984 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 05 15:15:38.060329 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:38.060310 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 05 15:15:38.060424 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:38.060310 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 05 15:15:38.120744 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:38.120709 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6222b53f-0262-45fd-ada8-e159013c3080-tmp\") pod \"kube-auth-proxy-7696d464b-w6wjn\" (UID: \"6222b53f-0262-45fd-ada8-e159013c3080\") " pod="openshift-ingress/kube-auth-proxy-7696d464b-w6wjn" Jun 05 15:15:38.120744 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:38.120744 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xxx6\" (UniqueName: \"kubernetes.io/projected/6222b53f-0262-45fd-ada8-e159013c3080-kube-api-access-7xxx6\") pod \"kube-auth-proxy-7696d464b-w6wjn\" (UID: \"6222b53f-0262-45fd-ada8-e159013c3080\") " pod="openshift-ingress/kube-auth-proxy-7696d464b-w6wjn" Jun 05 15:15:38.120973 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:38.120778 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6222b53f-0262-45fd-ada8-e159013c3080-tls-certs\") pod \"kube-auth-proxy-7696d464b-w6wjn\" (UID: \"6222b53f-0262-45fd-ada8-e159013c3080\") " pod="openshift-ingress/kube-auth-proxy-7696d464b-w6wjn" Jun 05 15:15:38.221800 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:38.221768 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6222b53f-0262-45fd-ada8-e159013c3080-tmp\") pod \"kube-auth-proxy-7696d464b-w6wjn\" (UID: \"6222b53f-0262-45fd-ada8-e159013c3080\") " pod="openshift-ingress/kube-auth-proxy-7696d464b-w6wjn" Jun 05 15:15:38.221800 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:38.221803 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xxx6\" (UniqueName: \"kubernetes.io/projected/6222b53f-0262-45fd-ada8-e159013c3080-kube-api-access-7xxx6\") pod \"kube-auth-proxy-7696d464b-w6wjn\" (UID: \"6222b53f-0262-45fd-ada8-e159013c3080\") " pod="openshift-ingress/kube-auth-proxy-7696d464b-w6wjn" Jun 05 15:15:38.222032 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:38.221862 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6222b53f-0262-45fd-ada8-e159013c3080-tls-certs\") pod \"kube-auth-proxy-7696d464b-w6wjn\" (UID: \"6222b53f-0262-45fd-ada8-e159013c3080\") " pod="openshift-ingress/kube-auth-proxy-7696d464b-w6wjn" Jun 05 15:15:38.224085 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:38.224060 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6222b53f-0262-45fd-ada8-e159013c3080-tmp\") pod \"kube-auth-proxy-7696d464b-w6wjn\" (UID: \"6222b53f-0262-45fd-ada8-e159013c3080\") " pod="openshift-ingress/kube-auth-proxy-7696d464b-w6wjn" Jun 05 15:15:38.224391 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:38.224369 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6222b53f-0262-45fd-ada8-e159013c3080-tls-certs\") pod \"kube-auth-proxy-7696d464b-w6wjn\" (UID: \"6222b53f-0262-45fd-ada8-e159013c3080\") " pod="openshift-ingress/kube-auth-proxy-7696d464b-w6wjn" Jun 05 15:15:38.230879 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:38.230855 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xxx6\" (UniqueName: \"kubernetes.io/projected/6222b53f-0262-45fd-ada8-e159013c3080-kube-api-access-7xxx6\") pod \"kube-auth-proxy-7696d464b-w6wjn\" (UID: \"6222b53f-0262-45fd-ada8-e159013c3080\") " pod="openshift-ingress/kube-auth-proxy-7696d464b-w6wjn" Jun 05 15:15:38.303442 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:38.303360 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-jwqvq"] Jun 05 15:15:38.306856 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:38.306839 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-jwqvq" Jun 05 15:15:38.309502 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:38.309481 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-f5jf5\"" Jun 05 15:15:38.309628 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:38.309488 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 05 15:15:38.318020 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:38.317999 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-jwqvq"] Jun 05 15:15:38.322797 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:38.322773 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mbml\" (UniqueName: \"kubernetes.io/projected/fb5f14c7-9680-4b33-b570-fc7f58bb5918-kube-api-access-8mbml\") pod \"odh-model-controller-6dc94f689f-jwqvq\" (UID: \"fb5f14c7-9680-4b33-b570-fc7f58bb5918\") " pod="opendatahub/odh-model-controller-6dc94f689f-jwqvq" Jun 05 15:15:38.322888 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:38.322822 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb5f14c7-9680-4b33-b570-fc7f58bb5918-cert\") pod \"odh-model-controller-6dc94f689f-jwqvq\" (UID: \"fb5f14c7-9680-4b33-b570-fc7f58bb5918\") " pod="opendatahub/odh-model-controller-6dc94f689f-jwqvq" Jun 05 15:15:38.369541 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:38.369496 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7696d464b-w6wjn" Jun 05 15:15:38.425118 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:38.424007 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb5f14c7-9680-4b33-b570-fc7f58bb5918-cert\") pod \"odh-model-controller-6dc94f689f-jwqvq\" (UID: \"fb5f14c7-9680-4b33-b570-fc7f58bb5918\") " pod="opendatahub/odh-model-controller-6dc94f689f-jwqvq" Jun 05 15:15:38.425118 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:38.424102 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mbml\" (UniqueName: \"kubernetes.io/projected/fb5f14c7-9680-4b33-b570-fc7f58bb5918-kube-api-access-8mbml\") pod \"odh-model-controller-6dc94f689f-jwqvq\" (UID: \"fb5f14c7-9680-4b33-b570-fc7f58bb5918\") " pod="opendatahub/odh-model-controller-6dc94f689f-jwqvq" Jun 05 15:15:38.425118 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:15:38.424564 2560 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 05 15:15:38.425118 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:15:38.424631 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb5f14c7-9680-4b33-b570-fc7f58bb5918-cert podName:fb5f14c7-9680-4b33-b570-fc7f58bb5918 nodeName:}" failed. No retries permitted until 2026-06-05 15:15:38.92460921 +0000 UTC m=+452.820127291 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fb5f14c7-9680-4b33-b570-fc7f58bb5918-cert") pod "odh-model-controller-6dc94f689f-jwqvq" (UID: "fb5f14c7-9680-4b33-b570-fc7f58bb5918") : secret "odh-model-controller-webhook-cert" not found Jun 05 15:15:38.435389 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:38.435334 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mbml\" (UniqueName: \"kubernetes.io/projected/fb5f14c7-9680-4b33-b570-fc7f58bb5918-kube-api-access-8mbml\") pod \"odh-model-controller-6dc94f689f-jwqvq\" (UID: \"fb5f14c7-9680-4b33-b570-fc7f58bb5918\") " pod="opendatahub/odh-model-controller-6dc94f689f-jwqvq" Jun 05 15:15:38.517234 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:38.517211 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7696d464b-w6wjn"] Jun 05 15:15:38.520006 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:15:38.519885 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6222b53f_0262_45fd_ada8_e159013c3080.slice/crio-d82a3850615c1295520a80ba1fc937a5efd14419b26f92c2e3e7913a2db54abf WatchSource:0}: Error finding container d82a3850615c1295520a80ba1fc937a5efd14419b26f92c2e3e7913a2db54abf: Status 404 returned error can't find the container with id d82a3850615c1295520a80ba1fc937a5efd14419b26f92c2e3e7913a2db54abf Jun 05 15:15:38.929259 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:38.929225 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb5f14c7-9680-4b33-b570-fc7f58bb5918-cert\") pod \"odh-model-controller-6dc94f689f-jwqvq\" (UID: \"fb5f14c7-9680-4b33-b570-fc7f58bb5918\") " pod="opendatahub/odh-model-controller-6dc94f689f-jwqvq" Jun 05 15:15:38.931884 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:38.931861 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb5f14c7-9680-4b33-b570-fc7f58bb5918-cert\") pod \"odh-model-controller-6dc94f689f-jwqvq\" (UID: \"fb5f14c7-9680-4b33-b570-fc7f58bb5918\") " pod="opendatahub/odh-model-controller-6dc94f689f-jwqvq" Jun 05 15:15:39.037986 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:39.037948 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-9h8wj"] Jun 05 15:15:39.042438 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:39.042416 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-9h8wj" Jun 05 15:15:39.045493 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:39.045472 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 05 15:15:39.051999 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:39.051068 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-9h8wj"] Jun 05 15:15:39.131338 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:39.131298 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1228a6af-7afe-438f-b6a3-344936281feb-tls-certs\") pod \"model-serving-api-5dd488fc48-9h8wj\" (UID: \"1228a6af-7afe-438f-b6a3-344936281feb\") " pod="opendatahub/model-serving-api-5dd488fc48-9h8wj" Jun 05 15:15:39.131523 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:39.131384 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmlgr\" (UniqueName: \"kubernetes.io/projected/1228a6af-7afe-438f-b6a3-344936281feb-kube-api-access-xmlgr\") pod \"model-serving-api-5dd488fc48-9h8wj\" (UID: \"1228a6af-7afe-438f-b6a3-344936281feb\") " pod="opendatahub/model-serving-api-5dd488fc48-9h8wj" Jun 05 15:15:39.216370 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:39.216256 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7696d464b-w6wjn" event={"ID":"6222b53f-0262-45fd-ada8-e159013c3080","Type":"ContainerStarted","Data":"d82a3850615c1295520a80ba1fc937a5efd14419b26f92c2e3e7913a2db54abf"} Jun 05 15:15:39.216370 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:39.216267 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-jwqvq" Jun 05 15:15:39.232860 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:39.232739 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmlgr\" (UniqueName: \"kubernetes.io/projected/1228a6af-7afe-438f-b6a3-344936281feb-kube-api-access-xmlgr\") pod \"model-serving-api-5dd488fc48-9h8wj\" (UID: \"1228a6af-7afe-438f-b6a3-344936281feb\") " pod="opendatahub/model-serving-api-5dd488fc48-9h8wj" Jun 05 15:15:39.233949 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:39.233569 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1228a6af-7afe-438f-b6a3-344936281feb-tls-certs\") pod \"model-serving-api-5dd488fc48-9h8wj\" (UID: \"1228a6af-7afe-438f-b6a3-344936281feb\") " pod="opendatahub/model-serving-api-5dd488fc48-9h8wj" Jun 05 15:15:39.233949 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:15:39.233700 2560 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 05 15:15:39.233949 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:15:39.233756 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1228a6af-7afe-438f-b6a3-344936281feb-tls-certs podName:1228a6af-7afe-438f-b6a3-344936281feb nodeName:}" failed. No retries permitted until 2026-06-05 15:15:39.733736371 +0000 UTC m=+453.629254449 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/1228a6af-7afe-438f-b6a3-344936281feb-tls-certs") pod "model-serving-api-5dd488fc48-9h8wj" (UID: "1228a6af-7afe-438f-b6a3-344936281feb") : secret "model-serving-api-tls" not found Jun 05 15:15:39.260135 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:39.260104 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmlgr\" (UniqueName: \"kubernetes.io/projected/1228a6af-7afe-438f-b6a3-344936281feb-kube-api-access-xmlgr\") pod \"model-serving-api-5dd488fc48-9h8wj\" (UID: \"1228a6af-7afe-438f-b6a3-344936281feb\") " pod="opendatahub/model-serving-api-5dd488fc48-9h8wj" Jun 05 15:15:39.396255 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:39.395758 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-jwqvq"] Jun 05 15:15:39.399353 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:15:39.399320 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb5f14c7_9680_4b33_b570_fc7f58bb5918.slice/crio-a659a2645af614e220e417eaf2ff6c446c10538cacea05b226b399c1fe379b9c WatchSource:0}: Error finding container a659a2645af614e220e417eaf2ff6c446c10538cacea05b226b399c1fe379b9c: Status 404 returned error can't find the container with id a659a2645af614e220e417eaf2ff6c446c10538cacea05b226b399c1fe379b9c Jun 05 15:15:39.607262 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:39.607181 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066cs6x"] Jun 05 15:15:39.612405 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:39.612375 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066cs6x" Jun 05 15:15:39.615073 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:39.615047 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-q4kkf\"" Jun 05 15:15:39.615220 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:39.615194 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 15:15:39.615220 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:39.615194 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 15:15:39.619863 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:39.619794 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066cs6x"] Jun 05 15:15:39.637298 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:39.637258 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j76js\" (UniqueName: \"kubernetes.io/projected/0d741790-7e38-48e8-869b-c84de63f5e59-kube-api-access-j76js\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066cs6x\" (UID: \"0d741790-7e38-48e8-869b-c84de63f5e59\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066cs6x" Jun 05 15:15:39.637473 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:39.637326 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d741790-7e38-48e8-869b-c84de63f5e59-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066cs6x\" (UID: \"0d741790-7e38-48e8-869b-c84de63f5e59\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066cs6x" Jun 05 15:15:39.637473 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:39.637415 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d741790-7e38-48e8-869b-c84de63f5e59-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066cs6x\" (UID: \"0d741790-7e38-48e8-869b-c84de63f5e59\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066cs6x" Jun 05 15:15:39.738262 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:39.738226 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d741790-7e38-48e8-869b-c84de63f5e59-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066cs6x\" (UID: \"0d741790-7e38-48e8-869b-c84de63f5e59\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066cs6x" Jun 05 15:15:39.738460 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:39.738276 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1228a6af-7afe-438f-b6a3-344936281feb-tls-certs\") pod \"model-serving-api-5dd488fc48-9h8wj\" (UID: \"1228a6af-7afe-438f-b6a3-344936281feb\") " pod="opendatahub/model-serving-api-5dd488fc48-9h8wj" Jun 05 15:15:39.738460 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:39.738311 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d741790-7e38-48e8-869b-c84de63f5e59-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066cs6x\" (UID: \"0d741790-7e38-48e8-869b-c84de63f5e59\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066cs6x" Jun 05 15:15:39.738460 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:39.738397 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j76js\" (UniqueName: \"kubernetes.io/projected/0d741790-7e38-48e8-869b-c84de63f5e59-kube-api-access-j76js\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066cs6x\" (UID: \"0d741790-7e38-48e8-869b-c84de63f5e59\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066cs6x" Jun 05 15:15:39.738722 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:39.738699 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d741790-7e38-48e8-869b-c84de63f5e59-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066cs6x\" (UID: \"0d741790-7e38-48e8-869b-c84de63f5e59\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066cs6x" Jun 05 15:15:39.739010 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:39.738987 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d741790-7e38-48e8-869b-c84de63f5e59-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066cs6x\" (UID: \"0d741790-7e38-48e8-869b-c84de63f5e59\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066cs6x" Jun 05 15:15:39.741323 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:39.741297 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1228a6af-7afe-438f-b6a3-344936281feb-tls-certs\") pod \"model-serving-api-5dd488fc48-9h8wj\" (UID: \"1228a6af-7afe-438f-b6a3-344936281feb\") " pod="opendatahub/model-serving-api-5dd488fc48-9h8wj" Jun 05 15:15:39.750146 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:39.750100 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j76js\" (UniqueName: \"kubernetes.io/projected/0d741790-7e38-48e8-869b-c84de63f5e59-kube-api-access-j76js\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066cs6x\" (UID: \"0d741790-7e38-48e8-869b-c84de63f5e59\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066cs6x" Jun 05 15:15:39.925380 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:39.925344 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066cs6x" Jun 05 15:15:39.955362 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:39.955327 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-9h8wj" Jun 05 15:15:40.223676 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:40.223593 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-jwqvq" event={"ID":"fb5f14c7-9680-4b33-b570-fc7f58bb5918","Type":"ContainerStarted","Data":"a659a2645af614e220e417eaf2ff6c446c10538cacea05b226b399c1fe379b9c"} Jun 05 15:15:40.738183 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:40.738060 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-9h8wj"] Jun 05 15:15:40.742628 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:15:40.742597 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1228a6af_7afe_438f_b6a3_344936281feb.slice/crio-8ce3a21d65d250132f030f4782329590e1d096359ff222fedc4119f9e0f0c144 WatchSource:0}: Error finding container 8ce3a21d65d250132f030f4782329590e1d096359ff222fedc4119f9e0f0c144: Status 404 returned error can't find the container with id 8ce3a21d65d250132f030f4782329590e1d096359ff222fedc4119f9e0f0c144 Jun 05 15:15:40.759524 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:40.759489 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066cs6x"] Jun 05 15:15:40.763052 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:15:40.763023 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d741790_7e38_48e8_869b_c84de63f5e59.slice/crio-212928ca085c737aaedb885dd95f4caa32e9c740ef92501902ece37220360d85 WatchSource:0}: Error finding container 212928ca085c737aaedb885dd95f4caa32e9c740ef92501902ece37220360d85: Status 404 returned error can't find the container with id 212928ca085c737aaedb885dd95f4caa32e9c740ef92501902ece37220360d85 Jun 05 15:15:41.231536 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:41.231461 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-9h8wj" event={"ID":"1228a6af-7afe-438f-b6a3-344936281feb","Type":"ContainerStarted","Data":"8ce3a21d65d250132f030f4782329590e1d096359ff222fedc4119f9e0f0c144"} Jun 05 15:15:41.234129 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:41.234092 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066cs6x" event={"ID":"0d741790-7e38-48e8-869b-c84de63f5e59","Type":"ContainerStarted","Data":"c2d2301a7ecb671518bd5214695a6eb85773c77161df197c7ab3d426d693b42c"} Jun 05 15:15:41.234269 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:41.234160 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066cs6x" event={"ID":"0d741790-7e38-48e8-869b-c84de63f5e59","Type":"ContainerStarted","Data":"212928ca085c737aaedb885dd95f4caa32e9c740ef92501902ece37220360d85"} Jun 05 15:15:42.241353 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:42.241310 2560 generic.go:356] "Generic (PLEG): container finished" podID="0d741790-7e38-48e8-869b-c84de63f5e59" containerID="c2d2301a7ecb671518bd5214695a6eb85773c77161df197c7ab3d426d693b42c" exitCode=0 Jun 05 15:15:42.241978 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:42.241391 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066cs6x" event={"ID":"0d741790-7e38-48e8-869b-c84de63f5e59","Type":"ContainerDied","Data":"c2d2301a7ecb671518bd5214695a6eb85773c77161df197c7ab3d426d693b42c"} Jun 05 15:15:42.243162 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:42.243093 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7696d464b-w6wjn" event={"ID":"6222b53f-0262-45fd-ada8-e159013c3080","Type":"ContainerStarted","Data":"c0a320929d89117eedb844580f1737348d98a2ed1cb7c598857c1d2db782a0a1"} Jun 05 15:15:42.281310 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:42.281248 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7696d464b-w6wjn" podStartSLOduration=1.038178266 podStartE2EDuration="4.281228491s" totalImagesPullingTime="3.243050225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:15:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:15:42.278632905 +0000 UTC m=+456.174151006" watchObservedRunningTime="2026-06-05 15:15:42.281228491 +0000 UTC m=+456.176746592" Jun 05 15:15:44.255123 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:44.255034 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-9h8wj" event={"ID":"1228a6af-7afe-438f-b6a3-344936281feb","Type":"ContainerStarted","Data":"c9c5ebe502cfd48ce2ee3fb2d0a7fb5ecf7327ae4da59b5c4ea8d72035bf2749"} Jun 05 15:15:44.255581 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:44.255155 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-9h8wj" Jun 05 15:15:44.256770 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:44.256739 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-jwqvq" event={"ID":"fb5f14c7-9680-4b33-b570-fc7f58bb5918","Type":"ContainerStarted","Data":"4b9a9d947526950e508dd2b6f8f8f7240737873fdc316d537dfdb3efd7ca453d"} Jun 05 15:15:44.256931 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:44.256832 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-jwqvq" Jun 05 15:15:44.258480 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:44.258457 2560 generic.go:356] "Generic (PLEG): container finished" podID="0d741790-7e38-48e8-869b-c84de63f5e59" containerID="d0891d97e25535453b4edee6ea189844369acd84e11aa6f9e2a1c75a2ae1d306" exitCode=0 Jun 05 15:15:44.258603 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:44.258495 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066cs6x" event={"ID":"0d741790-7e38-48e8-869b-c84de63f5e59","Type":"ContainerDied","Data":"d0891d97e25535453b4edee6ea189844369acd84e11aa6f9e2a1c75a2ae1d306"} Jun 05 15:15:44.274099 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:44.274045 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-9h8wj" podStartSLOduration=2.00207547 podStartE2EDuration="5.274024544s" totalImagesPullingTime="3.271949074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:15:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:15:44.271322489 +0000 UTC m=+458.166840590" watchObservedRunningTime="2026-06-05 15:15:44.274024544 +0000 UTC m=+458.169542645" Jun 05 15:15:44.289090 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:44.289038 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-jwqvq" podStartSLOduration=1.673753219 podStartE2EDuration="6.289021468s" totalImagesPullingTime="4.615268249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:15:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:15:44.287161739 +0000 UTC m=+458.182679849" watchObservedRunningTime="2026-06-05 15:15:44.289021468 +0000 UTC m=+458.184539565" Jun 05 15:15:45.264832 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:45.264799 2560 generic.go:356] "Generic (PLEG): container finished" podID="0d741790-7e38-48e8-869b-c84de63f5e59" containerID="3a17c58abc7436e22720491cc04cf803b213190cd7ed6228ddcf9e7cd8314a71" exitCode=0 Jun 05 15:15:45.265289 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:45.264889 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066cs6x" event={"ID":"0d741790-7e38-48e8-869b-c84de63f5e59","Type":"ContainerDied","Data":"3a17c58abc7436e22720491cc04cf803b213190cd7ed6228ddcf9e7cd8314a71"} Jun 05 15:15:46.396142 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:46.396118 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066cs6x" Jun 05 15:15:46.497095 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:46.497057 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d741790-7e38-48e8-869b-c84de63f5e59-util\") pod \"0d741790-7e38-48e8-869b-c84de63f5e59\" (UID: \"0d741790-7e38-48e8-869b-c84de63f5e59\") " Jun 05 15:15:46.497279 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:46.497105 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d741790-7e38-48e8-869b-c84de63f5e59-bundle\") pod \"0d741790-7e38-48e8-869b-c84de63f5e59\" (UID: \"0d741790-7e38-48e8-869b-c84de63f5e59\") " Jun 05 15:15:46.497279 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:46.497164 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j76js\" (UniqueName: \"kubernetes.io/projected/0d741790-7e38-48e8-869b-c84de63f5e59-kube-api-access-j76js\") pod \"0d741790-7e38-48e8-869b-c84de63f5e59\" (UID: \"0d741790-7e38-48e8-869b-c84de63f5e59\") " Jun 05 15:15:46.498077 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:46.498055 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d741790-7e38-48e8-869b-c84de63f5e59-bundle" (OuterVolumeSpecName: "bundle") pod "0d741790-7e38-48e8-869b-c84de63f5e59" (UID: "0d741790-7e38-48e8-869b-c84de63f5e59"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:15:46.499319 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:46.499301 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d741790-7e38-48e8-869b-c84de63f5e59-kube-api-access-j76js" (OuterVolumeSpecName: "kube-api-access-j76js") pod "0d741790-7e38-48e8-869b-c84de63f5e59" (UID: "0d741790-7e38-48e8-869b-c84de63f5e59"). InnerVolumeSpecName "kube-api-access-j76js". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:15:46.500966 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:46.500932 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d741790-7e38-48e8-869b-c84de63f5e59-util" (OuterVolumeSpecName: "util") pod "0d741790-7e38-48e8-869b-c84de63f5e59" (UID: "0d741790-7e38-48e8-869b-c84de63f5e59"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:15:46.598156 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:46.598125 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j76js\" (UniqueName: \"kubernetes.io/projected/0d741790-7e38-48e8-869b-c84de63f5e59-kube-api-access-j76js\") on node \"ip-10-0-138-97.ec2.internal\" DevicePath \"\"" Jun 05 15:15:46.598156 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:46.598147 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d741790-7e38-48e8-869b-c84de63f5e59-util\") on node \"ip-10-0-138-97.ec2.internal\" DevicePath \"\"" Jun 05 15:15:46.598156 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:46.598156 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d741790-7e38-48e8-869b-c84de63f5e59-bundle\") on node \"ip-10-0-138-97.ec2.internal\" DevicePath \"\"" Jun 05 15:15:47.275571 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:47.275541 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066cs6x" Jun 05 15:15:47.275772 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:47.275572 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066cs6x" event={"ID":"0d741790-7e38-48e8-869b-c84de63f5e59","Type":"ContainerDied","Data":"212928ca085c737aaedb885dd95f4caa32e9c740ef92501902ece37220360d85"} Jun 05 15:15:47.275772 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:47.275619 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="212928ca085c737aaedb885dd95f4caa32e9c740ef92501902ece37220360d85" Jun 05 15:15:49.444416 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:49.444380 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-6g76z"] Jun 05 15:15:49.444803 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:49.444665 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d741790-7e38-48e8-869b-c84de63f5e59" containerName="pull" Jun 05 15:15:49.444803 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:49.444676 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d741790-7e38-48e8-869b-c84de63f5e59" containerName="pull" Jun 05 15:15:49.444803 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:49.444688 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d741790-7e38-48e8-869b-c84de63f5e59" containerName="extract" Jun 05 15:15:49.444803 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:49.444694 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d741790-7e38-48e8-869b-c84de63f5e59" containerName="extract" Jun 05 15:15:49.444803 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:49.444701 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d741790-7e38-48e8-869b-c84de63f5e59" containerName="util" Jun 05 15:15:49.444803 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:49.444708 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d741790-7e38-48e8-869b-c84de63f5e59" containerName="util" Jun 05 15:15:49.444803 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:49.444761 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d741790-7e38-48e8-869b-c84de63f5e59" containerName="extract" Jun 05 15:15:49.447841 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:49.447824 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-6g76z" Jun 05 15:15:49.450837 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:49.450810 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 05 15:15:49.451863 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:49.451841 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-ctq6j\"" Jun 05 15:15:49.452751 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:49.452731 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-5q7gw"] Jun 05 15:15:49.455809 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:49.455791 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5q7gw" Jun 05 15:15:49.458207 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:49.458190 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 05 15:15:49.458348 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:49.458330 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-fnb9n\"" Jun 05 15:15:49.464978 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:49.464955 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-6g76z"] Jun 05 15:15:49.471039 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:49.471017 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-5q7gw"] Jun 05 15:15:49.526437 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:49.526404 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkvw9\" (UniqueName: \"kubernetes.io/projected/1b5f3b03-ef67-446f-b811-a4b897b597fe-kube-api-access-tkvw9\") pod \"kserve-controller-manager-69fc866d76-6g76z\" (UID: \"1b5f3b03-ef67-446f-b811-a4b897b597fe\") " pod="opendatahub/kserve-controller-manager-69fc866d76-6g76z" Jun 05 15:15:49.526603 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:49.526451 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc77w\" (UniqueName: \"kubernetes.io/projected/df2f4fa3-32c3-4f4a-a3c8-8ca1a520955e-kube-api-access-qc77w\") pod \"llmisvc-controller-manager-864bfd7bc9-5q7gw\" (UID: \"df2f4fa3-32c3-4f4a-a3c8-8ca1a520955e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5q7gw" Jun 05 15:15:49.526603 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:49.526471 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b5f3b03-ef67-446f-b811-a4b897b597fe-cert\") pod \"kserve-controller-manager-69fc866d76-6g76z\" (UID: \"1b5f3b03-ef67-446f-b811-a4b897b597fe\") " pod="opendatahub/kserve-controller-manager-69fc866d76-6g76z" Jun 05 15:15:49.526603 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:49.526561 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df2f4fa3-32c3-4f4a-a3c8-8ca1a520955e-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-5q7gw\" (UID: \"df2f4fa3-32c3-4f4a-a3c8-8ca1a520955e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5q7gw" Jun 05 15:15:49.627164 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:49.627128 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkvw9\" (UniqueName: \"kubernetes.io/projected/1b5f3b03-ef67-446f-b811-a4b897b597fe-kube-api-access-tkvw9\") pod \"kserve-controller-manager-69fc866d76-6g76z\" (UID: \"1b5f3b03-ef67-446f-b811-a4b897b597fe\") " pod="opendatahub/kserve-controller-manager-69fc866d76-6g76z" Jun 05 15:15:49.627369 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:49.627183 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc77w\" (UniqueName: \"kubernetes.io/projected/df2f4fa3-32c3-4f4a-a3c8-8ca1a520955e-kube-api-access-qc77w\") pod \"llmisvc-controller-manager-864bfd7bc9-5q7gw\" (UID: \"df2f4fa3-32c3-4f4a-a3c8-8ca1a520955e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5q7gw" Jun 05 15:15:49.627369 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:49.627200 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b5f3b03-ef67-446f-b811-a4b897b597fe-cert\") pod \"kserve-controller-manager-69fc866d76-6g76z\" (UID: \"1b5f3b03-ef67-446f-b811-a4b897b597fe\") " pod="opendatahub/kserve-controller-manager-69fc866d76-6g76z" Jun 05 15:15:49.627369 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:49.627225 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df2f4fa3-32c3-4f4a-a3c8-8ca1a520955e-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-5q7gw\" (UID: \"df2f4fa3-32c3-4f4a-a3c8-8ca1a520955e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5q7gw" Jun 05 15:15:49.627615 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:15:49.627362 2560 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 05 15:15:49.627615 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:15:49.627414 2560 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 05 15:15:49.627615 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:15:49.627443 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b5f3b03-ef67-446f-b811-a4b897b597fe-cert podName:1b5f3b03-ef67-446f-b811-a4b897b597fe nodeName:}" failed. No retries permitted until 2026-06-05 15:15:50.127419754 +0000 UTC m=+464.022937834 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1b5f3b03-ef67-446f-b811-a4b897b597fe-cert") pod "kserve-controller-manager-69fc866d76-6g76z" (UID: "1b5f3b03-ef67-446f-b811-a4b897b597fe") : secret "kserve-webhook-server-cert" not found Jun 05 15:15:49.627615 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:15:49.627482 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df2f4fa3-32c3-4f4a-a3c8-8ca1a520955e-cert podName:df2f4fa3-32c3-4f4a-a3c8-8ca1a520955e nodeName:}" failed. No retries permitted until 2026-06-05 15:15:50.127451378 +0000 UTC m=+464.022969460 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/df2f4fa3-32c3-4f4a-a3c8-8ca1a520955e-cert") pod "llmisvc-controller-manager-864bfd7bc9-5q7gw" (UID: "df2f4fa3-32c3-4f4a-a3c8-8ca1a520955e") : secret "llmisvc-webhook-server-cert" not found Jun 05 15:15:49.637634 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:49.637606 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkvw9\" (UniqueName: \"kubernetes.io/projected/1b5f3b03-ef67-446f-b811-a4b897b597fe-kube-api-access-tkvw9\") pod \"kserve-controller-manager-69fc866d76-6g76z\" (UID: \"1b5f3b03-ef67-446f-b811-a4b897b597fe\") " pod="opendatahub/kserve-controller-manager-69fc866d76-6g76z" Jun 05 15:15:49.637723 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:49.637634 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc77w\" (UniqueName: \"kubernetes.io/projected/df2f4fa3-32c3-4f4a-a3c8-8ca1a520955e-kube-api-access-qc77w\") pod \"llmisvc-controller-manager-864bfd7bc9-5q7gw\" (UID: \"df2f4fa3-32c3-4f4a-a3c8-8ca1a520955e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5q7gw" Jun 05 15:15:50.130750 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:50.130700 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b5f3b03-ef67-446f-b811-a4b897b597fe-cert\") pod \"kserve-controller-manager-69fc866d76-6g76z\" (UID: \"1b5f3b03-ef67-446f-b811-a4b897b597fe\") " pod="opendatahub/kserve-controller-manager-69fc866d76-6g76z" Jun 05 15:15:50.130750 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:50.130762 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df2f4fa3-32c3-4f4a-a3c8-8ca1a520955e-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-5q7gw\" (UID: \"df2f4fa3-32c3-4f4a-a3c8-8ca1a520955e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5q7gw" Jun 05 15:15:50.133180 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:50.133156 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b5f3b03-ef67-446f-b811-a4b897b597fe-cert\") pod \"kserve-controller-manager-69fc866d76-6g76z\" (UID: \"1b5f3b03-ef67-446f-b811-a4b897b597fe\") " pod="opendatahub/kserve-controller-manager-69fc866d76-6g76z" Jun 05 15:15:50.133313 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:50.133294 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df2f4fa3-32c3-4f4a-a3c8-8ca1a520955e-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-5q7gw\" (UID: \"df2f4fa3-32c3-4f4a-a3c8-8ca1a520955e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5q7gw" Jun 05 15:15:50.358425 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:50.358388 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-6g76z" Jun 05 15:15:50.366586 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:50.366560 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5q7gw" Jun 05 15:15:50.501947 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:50.501924 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-6g76z"] Jun 05 15:15:50.504446 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:15:50.504419 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b5f3b03_ef67_446f_b811_a4b897b597fe.slice/crio-d57c335f08a2d5e2ec89692297cf4c55831f4e624139fbd90dae2fee1d583d09 WatchSource:0}: Error finding container d57c335f08a2d5e2ec89692297cf4c55831f4e624139fbd90dae2fee1d583d09: Status 404 returned error can't find the container with id d57c335f08a2d5e2ec89692297cf4c55831f4e624139fbd90dae2fee1d583d09 Jun 05 15:15:50.518392 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:50.518368 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-5q7gw"] Jun 05 15:15:50.520550 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:15:50.520519 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddf2f4fa3_32c3_4f4a_a3c8_8ca1a520955e.slice/crio-75e9f2a6a714eeff0ec2f5fb6f8bcfd89a590839086a5f6da40829a428718918 WatchSource:0}: Error finding container 75e9f2a6a714eeff0ec2f5fb6f8bcfd89a590839086a5f6da40829a428718918: Status 404 returned error can't find the container with id 75e9f2a6a714eeff0ec2f5fb6f8bcfd89a590839086a5f6da40829a428718918 Jun 05 15:15:51.296566 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:51.296521 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5q7gw" event={"ID":"df2f4fa3-32c3-4f4a-a3c8-8ca1a520955e","Type":"ContainerStarted","Data":"75e9f2a6a714eeff0ec2f5fb6f8bcfd89a590839086a5f6da40829a428718918"} Jun 05 15:15:51.298216 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:51.298178 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-6g76z" event={"ID":"1b5f3b03-ef67-446f-b811-a4b897b597fe","Type":"ContainerStarted","Data":"d57c335f08a2d5e2ec89692297cf4c55831f4e624139fbd90dae2fee1d583d09"} Jun 05 15:15:54.316259 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:54.316171 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5q7gw" event={"ID":"df2f4fa3-32c3-4f4a-a3c8-8ca1a520955e","Type":"ContainerStarted","Data":"5fdaea47edd812176042fc99ca8669958fe41f4f130cc7f1e3037ecb89836d26"} Jun 05 15:15:54.316259 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:54.316250 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5q7gw" Jun 05 15:15:54.317643 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:54.317618 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-6g76z" event={"ID":"1b5f3b03-ef67-446f-b811-a4b897b597fe","Type":"ContainerStarted","Data":"ad8703d91404e5029fde8d24e079f29f575a5733a2140e87b82d7f5bb85811bf"} Jun 05 15:15:54.317761 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:54.317737 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-6g76z" Jun 05 15:15:54.350370 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:54.350313 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5q7gw" podStartSLOduration=1.82277845 podStartE2EDuration="5.350295251s" totalImagesPullingTime="3.527516801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:15:54.348706104 +0000 UTC m=+468.244224205" watchObservedRunningTime="2026-06-05 15:15:54.350295251 +0000 UTC m=+468.245813398" Jun 05 15:15:54.378126 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:54.378059 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-6g76z" podStartSLOduration=1.838289683 podStartE2EDuration="5.378040599s" totalImagesPullingTime="3.539750916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:15:54.377065529 +0000 UTC m=+468.272583629" watchObservedRunningTime="2026-06-05 15:15:54.378040599 +0000 UTC m=+468.273558700" Jun 05 15:15:55.063203 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:55.063166 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an8rk9"] Jun 05 15:15:55.067738 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:55.067704 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an8rk9" Jun 05 15:15:55.073284 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:55.073254 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 15:15:55.074316 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:55.074296 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-q4kkf\"" Jun 05 15:15:55.074788 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:55.074766 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 15:15:55.085685 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:55.085659 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an8rk9"] Jun 05 15:15:55.174958 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:55.174891 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a22bf28a-f6e1-489b-9578-20aa10ab5347-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an8rk9\" (UID: \"a22bf28a-f6e1-489b-9578-20aa10ab5347\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an8rk9" Jun 05 15:15:55.175130 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:55.174981 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pcqq\" (UniqueName: \"kubernetes.io/projected/a22bf28a-f6e1-489b-9578-20aa10ab5347-kube-api-access-5pcqq\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an8rk9\" (UID: \"a22bf28a-f6e1-489b-9578-20aa10ab5347\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an8rk9" Jun 05 15:15:55.175130 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:55.175021 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a22bf28a-f6e1-489b-9578-20aa10ab5347-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an8rk9\" (UID: \"a22bf28a-f6e1-489b-9578-20aa10ab5347\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an8rk9" Jun 05 15:15:55.268062 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:55.268035 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-jwqvq" Jun 05 15:15:55.270097 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:55.270079 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-9h8wj" Jun 05 15:15:55.275485 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:55.275458 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a22bf28a-f6e1-489b-9578-20aa10ab5347-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an8rk9\" (UID: \"a22bf28a-f6e1-489b-9578-20aa10ab5347\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an8rk9" Jun 05 15:15:55.275603 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:55.275505 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pcqq\" (UniqueName: \"kubernetes.io/projected/a22bf28a-f6e1-489b-9578-20aa10ab5347-kube-api-access-5pcqq\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an8rk9\" (UID: \"a22bf28a-f6e1-489b-9578-20aa10ab5347\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an8rk9" Jun 05 15:15:55.275603 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:55.275540 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a22bf28a-f6e1-489b-9578-20aa10ab5347-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an8rk9\" (UID: \"a22bf28a-f6e1-489b-9578-20aa10ab5347\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an8rk9" Jun 05 15:15:55.275920 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:55.275879 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a22bf28a-f6e1-489b-9578-20aa10ab5347-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an8rk9\" (UID: \"a22bf28a-f6e1-489b-9578-20aa10ab5347\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an8rk9" Jun 05 15:15:55.275920 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:55.275893 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a22bf28a-f6e1-489b-9578-20aa10ab5347-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an8rk9\" (UID: \"a22bf28a-f6e1-489b-9578-20aa10ab5347\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an8rk9" Jun 05 15:15:55.315088 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:55.315016 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pcqq\" (UniqueName: \"kubernetes.io/projected/a22bf28a-f6e1-489b-9578-20aa10ab5347-kube-api-access-5pcqq\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an8rk9\" (UID: \"a22bf28a-f6e1-489b-9578-20aa10ab5347\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an8rk9" Jun 05 15:15:55.376705 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:55.376675 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an8rk9" Jun 05 15:15:55.611687 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:55.611505 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an8rk9"] Jun 05 15:15:55.614296 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:15:55.614268 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda22bf28a_f6e1_489b_9578_20aa10ab5347.slice/crio-1b0e40afa4a7743f88552b3a8342ebba5862f5ad600281166797a4abd4967c73 WatchSource:0}: Error finding container 1b0e40afa4a7743f88552b3a8342ebba5862f5ad600281166797a4abd4967c73: Status 404 returned error can't find the container with id 1b0e40afa4a7743f88552b3a8342ebba5862f5ad600281166797a4abd4967c73 Jun 05 15:15:56.328420 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:56.328385 2560 generic.go:356] "Generic (PLEG): container finished" podID="a22bf28a-f6e1-489b-9578-20aa10ab5347" containerID="31e981aa51db1df88141039eab59771b844abbab5ca725d6e3d28ef98b714538" exitCode=0 Jun 05 15:15:56.328559 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:56.328462 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an8rk9" event={"ID":"a22bf28a-f6e1-489b-9578-20aa10ab5347","Type":"ContainerDied","Data":"31e981aa51db1df88141039eab59771b844abbab5ca725d6e3d28ef98b714538"} Jun 05 15:15:56.328559 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:56.328508 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an8rk9" event={"ID":"a22bf28a-f6e1-489b-9578-20aa10ab5347","Type":"ContainerStarted","Data":"1b0e40afa4a7743f88552b3a8342ebba5862f5ad600281166797a4abd4967c73"} Jun 05 15:15:57.108428 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:57.108399 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-6wrgz"] Jun 05 15:15:57.111832 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:57.111812 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-6wrgz" Jun 05 15:15:57.114619 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:57.114593 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 05 15:15:57.114729 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:57.114622 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 05 15:15:57.114729 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:57.114641 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-jxdxk\"" Jun 05 15:15:57.130549 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:57.130460 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-6wrgz"] Jun 05 15:15:57.188922 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:57.188883 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/2514fcbc-6a6c-42fa-b596-9022d82456eb-operator-config\") pod \"servicemesh-operator3-57f65f65fb-6wrgz\" (UID: \"2514fcbc-6a6c-42fa-b596-9022d82456eb\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-6wrgz" Jun 05 15:15:57.189025 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:57.188953 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q5dv\" (UniqueName: \"kubernetes.io/projected/2514fcbc-6a6c-42fa-b596-9022d82456eb-kube-api-access-8q5dv\") pod \"servicemesh-operator3-57f65f65fb-6wrgz\" (UID: \"2514fcbc-6a6c-42fa-b596-9022d82456eb\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-6wrgz" Jun 05 15:15:57.289446 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:57.289413 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/2514fcbc-6a6c-42fa-b596-9022d82456eb-operator-config\") pod \"servicemesh-operator3-57f65f65fb-6wrgz\" (UID: \"2514fcbc-6a6c-42fa-b596-9022d82456eb\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-6wrgz" Jun 05 15:15:57.289595 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:57.289455 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q5dv\" (UniqueName: \"kubernetes.io/projected/2514fcbc-6a6c-42fa-b596-9022d82456eb-kube-api-access-8q5dv\") pod \"servicemesh-operator3-57f65f65fb-6wrgz\" (UID: \"2514fcbc-6a6c-42fa-b596-9022d82456eb\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-6wrgz" Jun 05 15:15:57.291860 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:57.291836 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/2514fcbc-6a6c-42fa-b596-9022d82456eb-operator-config\") pod \"servicemesh-operator3-57f65f65fb-6wrgz\" (UID: \"2514fcbc-6a6c-42fa-b596-9022d82456eb\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-6wrgz" Jun 05 15:15:57.314851 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:57.314824 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q5dv\" (UniqueName: \"kubernetes.io/projected/2514fcbc-6a6c-42fa-b596-9022d82456eb-kube-api-access-8q5dv\") pod \"servicemesh-operator3-57f65f65fb-6wrgz\" (UID: \"2514fcbc-6a6c-42fa-b596-9022d82456eb\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-6wrgz" Jun 05 15:15:57.335817 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:57.335790 2560 generic.go:356] "Generic (PLEG): container finished" podID="a22bf28a-f6e1-489b-9578-20aa10ab5347" containerID="09ae5d874fc161ef5ab7f8177038b7b666a3131b8092a33d2cc250b557527aa0" exitCode=0 Jun 05 15:15:57.335949 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:57.335855 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an8rk9" event={"ID":"a22bf28a-f6e1-489b-9578-20aa10ab5347","Type":"ContainerDied","Data":"09ae5d874fc161ef5ab7f8177038b7b666a3131b8092a33d2cc250b557527aa0"} Jun 05 15:15:57.421231 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:57.421207 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-6wrgz" Jun 05 15:15:57.581460 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:57.581429 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-6wrgz"] Jun 05 15:15:57.626784 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:15:57.626721 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2514fcbc_6a6c_42fa_b596_9022d82456eb.slice/crio-cd6c637c3d48727cc5df540f48926dbb103ee33d78355cb555d1ff8e47b792da WatchSource:0}: Error finding container cd6c637c3d48727cc5df540f48926dbb103ee33d78355cb555d1ff8e47b792da: Status 404 returned error can't find the container with id cd6c637c3d48727cc5df540f48926dbb103ee33d78355cb555d1ff8e47b792da Jun 05 15:15:58.343099 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:58.343066 2560 generic.go:356] "Generic (PLEG): container finished" podID="a22bf28a-f6e1-489b-9578-20aa10ab5347" containerID="e8d7027fe3badcd8158fa6fd11e980ef49543df44b203b47a9ea0f7bbbc25b70" exitCode=0 Jun 05 15:15:58.343512 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:58.343146 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an8rk9" event={"ID":"a22bf28a-f6e1-489b-9578-20aa10ab5347","Type":"ContainerDied","Data":"e8d7027fe3badcd8158fa6fd11e980ef49543df44b203b47a9ea0f7bbbc25b70"} Jun 05 15:15:58.344683 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:58.344661 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-6wrgz" event={"ID":"2514fcbc-6a6c-42fa-b596-9022d82456eb","Type":"ContainerStarted","Data":"cd6c637c3d48727cc5df540f48926dbb103ee33d78355cb555d1ff8e47b792da"} Jun 05 15:15:59.500896 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:59.500869 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an8rk9" Jun 05 15:15:59.609995 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:59.609897 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pcqq\" (UniqueName: \"kubernetes.io/projected/a22bf28a-f6e1-489b-9578-20aa10ab5347-kube-api-access-5pcqq\") pod \"a22bf28a-f6e1-489b-9578-20aa10ab5347\" (UID: \"a22bf28a-f6e1-489b-9578-20aa10ab5347\") " Jun 05 15:15:59.609995 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:59.609960 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a22bf28a-f6e1-489b-9578-20aa10ab5347-bundle\") pod \"a22bf28a-f6e1-489b-9578-20aa10ab5347\" (UID: \"a22bf28a-f6e1-489b-9578-20aa10ab5347\") " Jun 05 15:15:59.609995 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:59.609984 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a22bf28a-f6e1-489b-9578-20aa10ab5347-util\") pod \"a22bf28a-f6e1-489b-9578-20aa10ab5347\" (UID: \"a22bf28a-f6e1-489b-9578-20aa10ab5347\") " Jun 05 15:15:59.611161 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:59.611129 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a22bf28a-f6e1-489b-9578-20aa10ab5347-bundle" (OuterVolumeSpecName: "bundle") pod "a22bf28a-f6e1-489b-9578-20aa10ab5347" (UID: "a22bf28a-f6e1-489b-9578-20aa10ab5347"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:15:59.611997 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:59.611965 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a22bf28a-f6e1-489b-9578-20aa10ab5347-kube-api-access-5pcqq" (OuterVolumeSpecName: "kube-api-access-5pcqq") pod "a22bf28a-f6e1-489b-9578-20aa10ab5347" (UID: "a22bf28a-f6e1-489b-9578-20aa10ab5347"). InnerVolumeSpecName "kube-api-access-5pcqq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:15:59.615943 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:59.615838 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a22bf28a-f6e1-489b-9578-20aa10ab5347-util" (OuterVolumeSpecName: "util") pod "a22bf28a-f6e1-489b-9578-20aa10ab5347" (UID: "a22bf28a-f6e1-489b-9578-20aa10ab5347"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:15:59.711161 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:59.711122 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pcqq\" (UniqueName: \"kubernetes.io/projected/a22bf28a-f6e1-489b-9578-20aa10ab5347-kube-api-access-5pcqq\") on node \"ip-10-0-138-97.ec2.internal\" DevicePath \"\"" Jun 05 15:15:59.711161 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:59.711158 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a22bf28a-f6e1-489b-9578-20aa10ab5347-bundle\") on node \"ip-10-0-138-97.ec2.internal\" DevicePath \"\"" Jun 05 15:15:59.711379 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:15:59.711172 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a22bf28a-f6e1-489b-9578-20aa10ab5347-util\") on node \"ip-10-0-138-97.ec2.internal\" DevicePath \"\"" Jun 05 15:16:00.358181 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:00.358147 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an8rk9" Jun 05 15:16:00.358181 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:00.358155 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an8rk9" event={"ID":"a22bf28a-f6e1-489b-9578-20aa10ab5347","Type":"ContainerDied","Data":"1b0e40afa4a7743f88552b3a8342ebba5862f5ad600281166797a4abd4967c73"} Jun 05 15:16:00.358429 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:00.358213 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b0e40afa4a7743f88552b3a8342ebba5862f5ad600281166797a4abd4967c73" Jun 05 15:16:01.366184 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:01.366148 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-6wrgz" event={"ID":"2514fcbc-6a6c-42fa-b596-9022d82456eb","Type":"ContainerStarted","Data":"ff621760f7e969ae9f4a1a9ba3c02fc20c74b09cbc7377f55f63ddab0170062b"} Jun 05 15:16:01.366623 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:01.366283 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-6wrgz" Jun 05 15:16:01.406483 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:01.406422 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-6wrgz" podStartSLOduration=0.815537835 podStartE2EDuration="4.406399811s" totalImagesPullingTime="3.590861976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:16:01.404944776 +0000 UTC m=+475.300462877" watchObservedRunningTime="2026-06-05 15:16:01.406399811 +0000 UTC m=+475.301917924" Jun 05 15:16:07.621211 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:07.621176 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-b5fr5"] Jun 05 15:16:07.621682 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:07.621485 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a22bf28a-f6e1-489b-9578-20aa10ab5347" containerName="extract" Jun 05 15:16:07.621682 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:07.621495 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a22bf28a-f6e1-489b-9578-20aa10ab5347" containerName="extract" Jun 05 15:16:07.621682 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:07.621510 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a22bf28a-f6e1-489b-9578-20aa10ab5347" containerName="util" Jun 05 15:16:07.621682 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:07.621515 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a22bf28a-f6e1-489b-9578-20aa10ab5347" containerName="util" Jun 05 15:16:07.621682 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:07.621522 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a22bf28a-f6e1-489b-9578-20aa10ab5347" containerName="pull" Jun 05 15:16:07.621682 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:07.621528 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a22bf28a-f6e1-489b-9578-20aa10ab5347" containerName="pull" Jun 05 15:16:07.621682 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:07.621575 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a22bf28a-f6e1-489b-9578-20aa10ab5347" containerName="extract" Jun 05 15:16:07.625984 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:07.625925 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5fr5" Jun 05 15:16:07.628969 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:07.628944 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 05 15:16:07.629174 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:07.629156 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 05 15:16:07.629267 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:07.629214 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 05 15:16:07.629326 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:07.629303 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-sth57\"" Jun 05 15:16:07.629326 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:07.629322 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 05 15:16:07.639680 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:07.639649 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-b5fr5"] Jun 05 15:16:07.782997 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:07.782953 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/86da3f8c-bf90-4711-a726-7977d625bf92-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-b5fr5\" (UID: \"86da3f8c-bf90-4711-a726-7977d625bf92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5fr5" Jun 05 15:16:07.782997 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:07.782998 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/86da3f8c-bf90-4711-a726-7977d625bf92-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-b5fr5\" (UID: \"86da3f8c-bf90-4711-a726-7977d625bf92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5fr5" Jun 05 15:16:07.783263 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:07.783022 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86da3f8c-bf90-4711-a726-7977d625bf92-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-b5fr5\" (UID: \"86da3f8c-bf90-4711-a726-7977d625bf92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5fr5" Jun 05 15:16:07.783263 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:07.783158 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/86da3f8c-bf90-4711-a726-7977d625bf92-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-b5fr5\" (UID: \"86da3f8c-bf90-4711-a726-7977d625bf92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5fr5" Jun 05 15:16:07.783263 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:07.783197 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llwsp\" (UniqueName: \"kubernetes.io/projected/86da3f8c-bf90-4711-a726-7977d625bf92-kube-api-access-llwsp\") pod \"istiod-openshift-gateway-75c67f8887-b5fr5\" (UID: \"86da3f8c-bf90-4711-a726-7977d625bf92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5fr5" Jun 05 15:16:07.783402 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:07.783273 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/86da3f8c-bf90-4711-a726-7977d625bf92-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-b5fr5\" (UID: \"86da3f8c-bf90-4711-a726-7977d625bf92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5fr5" Jun 05 15:16:07.783402 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:07.783340 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/86da3f8c-bf90-4711-a726-7977d625bf92-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-b5fr5\" (UID: \"86da3f8c-bf90-4711-a726-7977d625bf92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5fr5" Jun 05 15:16:07.884526 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:07.884426 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/86da3f8c-bf90-4711-a726-7977d625bf92-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-b5fr5\" (UID: \"86da3f8c-bf90-4711-a726-7977d625bf92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5fr5" Jun 05 15:16:07.884526 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:07.884467 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llwsp\" (UniqueName: \"kubernetes.io/projected/86da3f8c-bf90-4711-a726-7977d625bf92-kube-api-access-llwsp\") pod \"istiod-openshift-gateway-75c67f8887-b5fr5\" (UID: \"86da3f8c-bf90-4711-a726-7977d625bf92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5fr5" Jun 05 15:16:07.884757 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:07.884542 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/86da3f8c-bf90-4711-a726-7977d625bf92-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-b5fr5\" (UID: \"86da3f8c-bf90-4711-a726-7977d625bf92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5fr5" Jun 05 15:16:07.884757 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:07.884575 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/86da3f8c-bf90-4711-a726-7977d625bf92-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-b5fr5\" (UID: \"86da3f8c-bf90-4711-a726-7977d625bf92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5fr5" Jun 05 15:16:07.884757 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:07.884617 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/86da3f8c-bf90-4711-a726-7977d625bf92-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-b5fr5\" (UID: \"86da3f8c-bf90-4711-a726-7977d625bf92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5fr5" Jun 05 15:16:07.884757 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:07.884648 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/86da3f8c-bf90-4711-a726-7977d625bf92-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-b5fr5\" (UID: \"86da3f8c-bf90-4711-a726-7977d625bf92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5fr5" Jun 05 15:16:07.884757 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:07.884674 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86da3f8c-bf90-4711-a726-7977d625bf92-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-b5fr5\" (UID: \"86da3f8c-bf90-4711-a726-7977d625bf92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5fr5" Jun 05 15:16:07.885673 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:07.885647 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/86da3f8c-bf90-4711-a726-7977d625bf92-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-b5fr5\" (UID: \"86da3f8c-bf90-4711-a726-7977d625bf92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5fr5" Jun 05 15:16:07.887085 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:07.887053 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/86da3f8c-bf90-4711-a726-7977d625bf92-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-b5fr5\" (UID: \"86da3f8c-bf90-4711-a726-7977d625bf92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5fr5" Jun 05 15:16:07.887211 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:07.887117 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/86da3f8c-bf90-4711-a726-7977d625bf92-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-b5fr5\" (UID: \"86da3f8c-bf90-4711-a726-7977d625bf92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5fr5" Jun 05 15:16:07.887390 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:07.887373 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/86da3f8c-bf90-4711-a726-7977d625bf92-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-b5fr5\" (UID: \"86da3f8c-bf90-4711-a726-7977d625bf92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5fr5" Jun 05 15:16:07.887430 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:07.887400 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/86da3f8c-bf90-4711-a726-7977d625bf92-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-b5fr5\" (UID: \"86da3f8c-bf90-4711-a726-7977d625bf92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5fr5" Jun 05 15:16:07.892865 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:07.892843 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86da3f8c-bf90-4711-a726-7977d625bf92-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-b5fr5\" (UID: \"86da3f8c-bf90-4711-a726-7977d625bf92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5fr5" Jun 05 15:16:07.892865 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:07.892854 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llwsp\" (UniqueName: \"kubernetes.io/projected/86da3f8c-bf90-4711-a726-7977d625bf92-kube-api-access-llwsp\") pod \"istiod-openshift-gateway-75c67f8887-b5fr5\" (UID: \"86da3f8c-bf90-4711-a726-7977d625bf92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5fr5" Jun 05 15:16:07.935576 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:07.935550 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5fr5" Jun 05 15:16:08.073994 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:08.073970 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-b5fr5"] Jun 05 15:16:08.075967 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:16:08.075939 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86da3f8c_bf90_4711_a726_7977d625bf92.slice/crio-3bdf9037509cc58582bf7c1081c061c1d671b3175752d19875227fad771d17d0 WatchSource:0}: Error finding container 3bdf9037509cc58582bf7c1081c061c1d671b3175752d19875227fad771d17d0: Status 404 returned error can't find the container with id 3bdf9037509cc58582bf7c1081c061c1d671b3175752d19875227fad771d17d0 Jun 05 15:16:08.405817 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:08.405779 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5fr5" event={"ID":"86da3f8c-bf90-4711-a726-7977d625bf92","Type":"ContainerStarted","Data":"3bdf9037509cc58582bf7c1081c061c1d671b3175752d19875227fad771d17d0"} Jun 05 15:16:12.373708 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:12.373673 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-6wrgz" Jun 05 15:16:12.818432 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:12.818391 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 15:16:12.818567 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:12.818468 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 15:16:13.434519 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:13.434406 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5fr5" event={"ID":"86da3f8c-bf90-4711-a726-7977d625bf92","Type":"ContainerStarted","Data":"418ee371a9f5b9f40367af871119ebdb232f393f59908af57ffe83e57ab5b138"} Jun 05 15:16:13.435004 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:13.434814 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5fr5" Jun 05 15:16:13.436417 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:13.436387 2560 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-b5fr5 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 05 15:16:13.436556 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:13.436448 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5fr5" podUID="86da3f8c-bf90-4711-a726-7977d625bf92" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 15:16:14.439462 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:14.439431 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5fr5" Jun 05 15:16:14.497045 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:14.496988 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5fr5" podStartSLOduration=2.757221576 podStartE2EDuration="7.49696816s" totalImagesPullingTime="4.739746584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:16:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:16:13.476960211 +0000 UTC m=+487.372478310" watchObservedRunningTime="2026-06-05 15:16:14.49696816 +0000 UTC m=+488.392486260" Jun 05 15:16:15.127673 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:15.127642 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-84b74885b5-g774x"] Jun 05 15:16:15.185464 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:15.185431 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-84b74885b5-g774x"] Jun 05 15:16:15.185625 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:15.185543 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-84b74885b5-g774x" Jun 05 15:16:15.190670 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:15.190649 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-5tfkc\"" Jun 05 15:16:15.191719 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:15.191701 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 05 15:16:15.351208 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:15.351167 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbf5k\" (UniqueName: \"kubernetes.io/projected/992deb59-4a05-4360-b362-3b37cc4e5f8e-kube-api-access-tbf5k\") pod \"dashboard-redirect-84b74885b5-g774x\" (UID: \"992deb59-4a05-4360-b362-3b37cc4e5f8e\") " pod="opendatahub/dashboard-redirect-84b74885b5-g774x" Jun 05 15:16:15.351360 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:15.351295 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/992deb59-4a05-4360-b362-3b37cc4e5f8e-redirect-config\") pod \"dashboard-redirect-84b74885b5-g774x\" (UID: \"992deb59-4a05-4360-b362-3b37cc4e5f8e\") " pod="opendatahub/dashboard-redirect-84b74885b5-g774x" Jun 05 15:16:15.451872 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:15.451840 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/992deb59-4a05-4360-b362-3b37cc4e5f8e-redirect-config\") pod \"dashboard-redirect-84b74885b5-g774x\" (UID: \"992deb59-4a05-4360-b362-3b37cc4e5f8e\") " pod="opendatahub/dashboard-redirect-84b74885b5-g774x" Jun 05 15:16:15.452232 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:15.451888 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbf5k\" (UniqueName: \"kubernetes.io/projected/992deb59-4a05-4360-b362-3b37cc4e5f8e-kube-api-access-tbf5k\") pod \"dashboard-redirect-84b74885b5-g774x\" (UID: \"992deb59-4a05-4360-b362-3b37cc4e5f8e\") " pod="opendatahub/dashboard-redirect-84b74885b5-g774x" Jun 05 15:16:15.452507 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:15.452486 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/992deb59-4a05-4360-b362-3b37cc4e5f8e-redirect-config\") pod \"dashboard-redirect-84b74885b5-g774x\" (UID: \"992deb59-4a05-4360-b362-3b37cc4e5f8e\") " pod="opendatahub/dashboard-redirect-84b74885b5-g774x" Jun 05 15:16:15.461120 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:15.461090 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbf5k\" (UniqueName: \"kubernetes.io/projected/992deb59-4a05-4360-b362-3b37cc4e5f8e-kube-api-access-tbf5k\") pod \"dashboard-redirect-84b74885b5-g774x\" (UID: \"992deb59-4a05-4360-b362-3b37cc4e5f8e\") " pod="opendatahub/dashboard-redirect-84b74885b5-g774x" Jun 05 15:16:15.495811 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:15.495784 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-84b74885b5-g774x" Jun 05 15:16:15.668691 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:15.668664 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-84b74885b5-g774x"] Jun 05 15:16:15.670495 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:16:15.670473 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod992deb59_4a05_4360_b362_3b37cc4e5f8e.slice/crio-1e7ff0a2838547655226f3f0485065035776dda8feb7201e9ee02b21b523b27f WatchSource:0}: Error finding container 1e7ff0a2838547655226f3f0485065035776dda8feb7201e9ee02b21b523b27f: Status 404 returned error can't find the container with id 1e7ff0a2838547655226f3f0485065035776dda8feb7201e9ee02b21b523b27f Jun 05 15:16:16.453132 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:16.453097 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-84b74885b5-g774x" event={"ID":"992deb59-4a05-4360-b362-3b37cc4e5f8e","Type":"ContainerStarted","Data":"1e7ff0a2838547655226f3f0485065035776dda8feb7201e9ee02b21b523b27f"} Jun 05 15:16:18.464011 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:18.463975 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-84b74885b5-g774x" event={"ID":"992deb59-4a05-4360-b362-3b37cc4e5f8e","Type":"ContainerStarted","Data":"01a113220e3c0591d8bf9cd16c833c1a5f0765a9a41f2554218dbe3a5196f568"} Jun 05 15:16:18.481630 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:18.481550 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-84b74885b5-g774x" podStartSLOduration=0.93518102 podStartE2EDuration="3.481537193s" totalImagesPullingTime="2.546356173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:16:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:16:18.480260004 +0000 UTC m=+492.375778120" watchObservedRunningTime="2026-06-05 15:16:18.481537193 +0000 UTC m=+492.377055293" Jun 05 15:16:25.323822 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:25.323789 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5q7gw" Jun 05 15:16:25.326720 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:16:25.326695 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-6g76z" Jun 05 15:17:20.143249 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:20.143216 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zp2q2"] Jun 05 15:17:20.146572 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:20.146547 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zp2q2" Jun 05 15:17:20.149376 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:20.149344 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 05 15:17:20.149520 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:20.149398 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 05 15:17:20.150569 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:20.150545 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 05 15:17:20.150654 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:20.150581 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-cqsqf\"" Jun 05 15:17:20.160247 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:20.160218 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zp2q2"] Jun 05 15:17:20.178764 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:20.178735 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47nrh\" (UniqueName: \"kubernetes.io/projected/85ad0caf-b5f6-4922-9fb3-45f7131d5ba4-kube-api-access-47nrh\") pod \"dns-operator-controller-manager-864dd78c4c-zp2q2\" (UID: \"85ad0caf-b5f6-4922-9fb3-45f7131d5ba4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zp2q2" Jun 05 15:17:20.279476 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:20.279437 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47nrh\" (UniqueName: \"kubernetes.io/projected/85ad0caf-b5f6-4922-9fb3-45f7131d5ba4-kube-api-access-47nrh\") pod \"dns-operator-controller-manager-864dd78c4c-zp2q2\" (UID: \"85ad0caf-b5f6-4922-9fb3-45f7131d5ba4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zp2q2" Jun 05 15:17:20.291208 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:20.291184 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47nrh\" (UniqueName: \"kubernetes.io/projected/85ad0caf-b5f6-4922-9fb3-45f7131d5ba4-kube-api-access-47nrh\") pod \"dns-operator-controller-manager-864dd78c4c-zp2q2\" (UID: \"85ad0caf-b5f6-4922-9fb3-45f7131d5ba4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zp2q2" Jun 05 15:17:20.457546 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:20.457519 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zp2q2" Jun 05 15:17:20.613460 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:20.613429 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zp2q2"] Jun 05 15:17:20.616721 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:17:20.616696 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85ad0caf_b5f6_4922_9fb3_45f7131d5ba4.slice/crio-a380aa3315ba24b46ea6c2ee3c1aa2f8cc388888821974a012f23061d09a081a WatchSource:0}: Error finding container a380aa3315ba24b46ea6c2ee3c1aa2f8cc388888821974a012f23061d09a081a: Status 404 returned error can't find the container with id a380aa3315ba24b46ea6c2ee3c1aa2f8cc388888821974a012f23061d09a081a Jun 05 15:17:20.757236 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:20.757149 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zp2q2" event={"ID":"85ad0caf-b5f6-4922-9fb3-45f7131d5ba4","Type":"ContainerStarted","Data":"a380aa3315ba24b46ea6c2ee3c1aa2f8cc388888821974a012f23061d09a081a"} Jun 05 15:17:23.773963 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:23.773924 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zp2q2" event={"ID":"85ad0caf-b5f6-4922-9fb3-45f7131d5ba4","Type":"ContainerStarted","Data":"057ebf41e83839c0c76029e612513b8004ac12753dde97c4a2929813e336c711"} Jun 05 15:17:23.774346 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:23.774044 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zp2q2" Jun 05 15:17:23.795914 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:23.795867 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zp2q2" podStartSLOduration=1.531905962 podStartE2EDuration="3.795853493s" totalImagesPullingTime="2.263947531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:17:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:17:23.793459945 +0000 UTC m=+557.688978056" watchObservedRunningTime="2026-06-05 15:17:23.795853493 +0000 UTC m=+557.691371593" Jun 05 15:17:27.544755 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:27.544721 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-hk2xk"] Jun 05 15:17:27.547942 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:27.547925 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hk2xk" Jun 05 15:17:27.550633 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:27.550608 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 05 15:17:27.550758 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:27.550731 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 05 15:17:27.550807 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:27.550781 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qjl2x\"" Jun 05 15:17:27.559122 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:27.559103 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-hk2xk"] Jun 05 15:17:27.637716 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:27.637687 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a36d096a-eb90-4297-9546-db64d3ff6f38-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-hk2xk\" (UID: \"a36d096a-eb90-4297-9546-db64d3ff6f38\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hk2xk" Jun 05 15:17:27.637863 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:27.637724 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a36d096a-eb90-4297-9546-db64d3ff6f38-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-hk2xk\" (UID: \"a36d096a-eb90-4297-9546-db64d3ff6f38\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hk2xk" Jun 05 15:17:27.637863 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:27.637745 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhgxf\" (UniqueName: \"kubernetes.io/projected/a36d096a-eb90-4297-9546-db64d3ff6f38-kube-api-access-qhgxf\") pod \"kuadrant-console-plugin-66b5774985-hk2xk\" (UID: \"a36d096a-eb90-4297-9546-db64d3ff6f38\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hk2xk" Jun 05 15:17:27.739233 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:27.739202 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a36d096a-eb90-4297-9546-db64d3ff6f38-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-hk2xk\" (UID: \"a36d096a-eb90-4297-9546-db64d3ff6f38\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hk2xk" Jun 05 15:17:27.739392 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:27.739241 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a36d096a-eb90-4297-9546-db64d3ff6f38-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-hk2xk\" (UID: \"a36d096a-eb90-4297-9546-db64d3ff6f38\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hk2xk" Jun 05 15:17:27.739392 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:27.739271 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhgxf\" (UniqueName: \"kubernetes.io/projected/a36d096a-eb90-4297-9546-db64d3ff6f38-kube-api-access-qhgxf\") pod \"kuadrant-console-plugin-66b5774985-hk2xk\" (UID: \"a36d096a-eb90-4297-9546-db64d3ff6f38\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hk2xk" Jun 05 15:17:27.739392 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:17:27.739371 2560 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 05 15:17:27.739564 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:17:27.739444 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a36d096a-eb90-4297-9546-db64d3ff6f38-plugin-serving-cert podName:a36d096a-eb90-4297-9546-db64d3ff6f38 nodeName:}" failed. No retries permitted until 2026-06-05 15:17:28.239423481 +0000 UTC m=+562.134941578 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/a36d096a-eb90-4297-9546-db64d3ff6f38-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-hk2xk" (UID: "a36d096a-eb90-4297-9546-db64d3ff6f38") : secret "plugin-serving-cert" not found Jun 05 15:17:27.739888 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:27.739868 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a36d096a-eb90-4297-9546-db64d3ff6f38-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-hk2xk\" (UID: \"a36d096a-eb90-4297-9546-db64d3ff6f38\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hk2xk" Jun 05 15:17:27.748051 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:27.748030 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhgxf\" (UniqueName: \"kubernetes.io/projected/a36d096a-eb90-4297-9546-db64d3ff6f38-kube-api-access-qhgxf\") pod \"kuadrant-console-plugin-66b5774985-hk2xk\" (UID: \"a36d096a-eb90-4297-9546-db64d3ff6f38\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hk2xk" Jun 05 15:17:28.200004 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.199969 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b9d8766bd-g5qjd"] Jun 05 15:17:28.203456 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.203433 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b9d8766bd-g5qjd" Jun 05 15:17:28.206051 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.206031 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 05 15:17:28.207723 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.207706 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 05 15:17:28.208772 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.208756 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 05 15:17:28.209156 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.209136 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qvwrz\"" Jun 05 15:17:28.209535 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.209517 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 05 15:17:28.209634 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.209518 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 05 15:17:28.209634 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.209521 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 05 15:17:28.209634 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.209575 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 05 15:17:28.213898 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.213883 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 05 15:17:28.219161 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.219141 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b9d8766bd-g5qjd"] Jun 05 15:17:28.241954 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.241924 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1af6ca4-3467-46a1-be9d-745e203b381b-console-config\") pod \"console-5b9d8766bd-g5qjd\" (UID: \"a1af6ca4-3467-46a1-be9d-745e203b381b\") " pod="openshift-console/console-5b9d8766bd-g5qjd" Jun 05 15:17:28.242068 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.241959 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1af6ca4-3467-46a1-be9d-745e203b381b-console-serving-cert\") pod \"console-5b9d8766bd-g5qjd\" (UID: \"a1af6ca4-3467-46a1-be9d-745e203b381b\") " pod="openshift-console/console-5b9d8766bd-g5qjd" Jun 05 15:17:28.242068 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.242009 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1af6ca4-3467-46a1-be9d-745e203b381b-console-oauth-config\") pod \"console-5b9d8766bd-g5qjd\" (UID: \"a1af6ca4-3467-46a1-be9d-745e203b381b\") " pod="openshift-console/console-5b9d8766bd-g5qjd" Jun 05 15:17:28.242068 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.242038 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a36d096a-eb90-4297-9546-db64d3ff6f38-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-hk2xk\" (UID: \"a36d096a-eb90-4297-9546-db64d3ff6f38\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hk2xk" Jun 05 15:17:28.242068 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.242063 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1af6ca4-3467-46a1-be9d-745e203b381b-service-ca\") pod \"console-5b9d8766bd-g5qjd\" (UID: \"a1af6ca4-3467-46a1-be9d-745e203b381b\") " pod="openshift-console/console-5b9d8766bd-g5qjd" Jun 05 15:17:28.242198 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.242086 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8rtp\" (UniqueName: \"kubernetes.io/projected/a1af6ca4-3467-46a1-be9d-745e203b381b-kube-api-access-f8rtp\") pod \"console-5b9d8766bd-g5qjd\" (UID: \"a1af6ca4-3467-46a1-be9d-745e203b381b\") " pod="openshift-console/console-5b9d8766bd-g5qjd" Jun 05 15:17:28.242198 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.242110 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1af6ca4-3467-46a1-be9d-745e203b381b-oauth-serving-cert\") pod \"console-5b9d8766bd-g5qjd\" (UID: \"a1af6ca4-3467-46a1-be9d-745e203b381b\") " pod="openshift-console/console-5b9d8766bd-g5qjd" Jun 05 15:17:28.242198 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.242128 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1af6ca4-3467-46a1-be9d-745e203b381b-trusted-ca-bundle\") pod \"console-5b9d8766bd-g5qjd\" (UID: \"a1af6ca4-3467-46a1-be9d-745e203b381b\") " pod="openshift-console/console-5b9d8766bd-g5qjd" Jun 05 15:17:28.244336 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.244319 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a36d096a-eb90-4297-9546-db64d3ff6f38-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-hk2xk\" (UID: \"a36d096a-eb90-4297-9546-db64d3ff6f38\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hk2xk" Jun 05 15:17:28.342615 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.342584 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1af6ca4-3467-46a1-be9d-745e203b381b-console-config\") pod \"console-5b9d8766bd-g5qjd\" (UID: \"a1af6ca4-3467-46a1-be9d-745e203b381b\") " pod="openshift-console/console-5b9d8766bd-g5qjd" Jun 05 15:17:28.342615 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.342616 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1af6ca4-3467-46a1-be9d-745e203b381b-console-serving-cert\") pod \"console-5b9d8766bd-g5qjd\" (UID: \"a1af6ca4-3467-46a1-be9d-745e203b381b\") " pod="openshift-console/console-5b9d8766bd-g5qjd" Jun 05 15:17:28.342795 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.342654 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1af6ca4-3467-46a1-be9d-745e203b381b-console-oauth-config\") pod \"console-5b9d8766bd-g5qjd\" (UID: \"a1af6ca4-3467-46a1-be9d-745e203b381b\") " pod="openshift-console/console-5b9d8766bd-g5qjd" Jun 05 15:17:28.342795 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.342763 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1af6ca4-3467-46a1-be9d-745e203b381b-service-ca\") pod \"console-5b9d8766bd-g5qjd\" (UID: \"a1af6ca4-3467-46a1-be9d-745e203b381b\") " pod="openshift-console/console-5b9d8766bd-g5qjd" Jun 05 15:17:28.342874 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.342795 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8rtp\" (UniqueName: \"kubernetes.io/projected/a1af6ca4-3467-46a1-be9d-745e203b381b-kube-api-access-f8rtp\") pod \"console-5b9d8766bd-g5qjd\" (UID: \"a1af6ca4-3467-46a1-be9d-745e203b381b\") " pod="openshift-console/console-5b9d8766bd-g5qjd" Jun 05 15:17:28.342874 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.342827 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1af6ca4-3467-46a1-be9d-745e203b381b-oauth-serving-cert\") pod \"console-5b9d8766bd-g5qjd\" (UID: \"a1af6ca4-3467-46a1-be9d-745e203b381b\") " pod="openshift-console/console-5b9d8766bd-g5qjd" Jun 05 15:17:28.342874 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.342852 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1af6ca4-3467-46a1-be9d-745e203b381b-trusted-ca-bundle\") pod \"console-5b9d8766bd-g5qjd\" (UID: \"a1af6ca4-3467-46a1-be9d-745e203b381b\") " pod="openshift-console/console-5b9d8766bd-g5qjd" Jun 05 15:17:28.343398 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.343370 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1af6ca4-3467-46a1-be9d-745e203b381b-console-config\") pod \"console-5b9d8766bd-g5qjd\" (UID: \"a1af6ca4-3467-46a1-be9d-745e203b381b\") " pod="openshift-console/console-5b9d8766bd-g5qjd" Jun 05 15:17:28.343507 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.343405 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1af6ca4-3467-46a1-be9d-745e203b381b-service-ca\") pod \"console-5b9d8766bd-g5qjd\" (UID: \"a1af6ca4-3467-46a1-be9d-745e203b381b\") " pod="openshift-console/console-5b9d8766bd-g5qjd" Jun 05 15:17:28.343507 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.343475 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1af6ca4-3467-46a1-be9d-745e203b381b-oauth-serving-cert\") pod \"console-5b9d8766bd-g5qjd\" (UID: \"a1af6ca4-3467-46a1-be9d-745e203b381b\") " pod="openshift-console/console-5b9d8766bd-g5qjd" Jun 05 15:17:28.343791 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.343770 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1af6ca4-3467-46a1-be9d-745e203b381b-trusted-ca-bundle\") pod \"console-5b9d8766bd-g5qjd\" (UID: \"a1af6ca4-3467-46a1-be9d-745e203b381b\") " pod="openshift-console/console-5b9d8766bd-g5qjd" Jun 05 15:17:28.345550 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.345529 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1af6ca4-3467-46a1-be9d-745e203b381b-console-serving-cert\") pod \"console-5b9d8766bd-g5qjd\" (UID: \"a1af6ca4-3467-46a1-be9d-745e203b381b\") " pod="openshift-console/console-5b9d8766bd-g5qjd" Jun 05 15:17:28.345635 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.345546 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1af6ca4-3467-46a1-be9d-745e203b381b-console-oauth-config\") pod \"console-5b9d8766bd-g5qjd\" (UID: \"a1af6ca4-3467-46a1-be9d-745e203b381b\") " pod="openshift-console/console-5b9d8766bd-g5qjd" Jun 05 15:17:28.354274 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.354252 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8rtp\" (UniqueName: \"kubernetes.io/projected/a1af6ca4-3467-46a1-be9d-745e203b381b-kube-api-access-f8rtp\") pod \"console-5b9d8766bd-g5qjd\" (UID: \"a1af6ca4-3467-46a1-be9d-745e203b381b\") " pod="openshift-console/console-5b9d8766bd-g5qjd" Jun 05 15:17:28.456837 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.456782 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hk2xk" Jun 05 15:17:28.513697 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.513655 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b9d8766bd-g5qjd" Jun 05 15:17:28.609202 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.609174 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-hk2xk"] Jun 05 15:17:28.612368 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:17:28.612332 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda36d096a_eb90_4297_9546_db64d3ff6f38.slice/crio-8f265fd8c2f5d22389bc3e37df2689063d4a7b84ee5b3d6e39bc50ccd11c0965 WatchSource:0}: Error finding container 8f265fd8c2f5d22389bc3e37df2689063d4a7b84ee5b3d6e39bc50ccd11c0965: Status 404 returned error can't find the container with id 8f265fd8c2f5d22389bc3e37df2689063d4a7b84ee5b3d6e39bc50ccd11c0965 Jun 05 15:17:28.666778 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.666755 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b9d8766bd-g5qjd"] Jun 05 15:17:28.669131 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:17:28.669105 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1af6ca4_3467_46a1_be9d_745e203b381b.slice/crio-4551c540514d4a660b36251864f8c0d816c29b0d5664e154fdb4c0e9d6f767d3 WatchSource:0}: Error finding container 4551c540514d4a660b36251864f8c0d816c29b0d5664e154fdb4c0e9d6f767d3: Status 404 returned error can't find the container with id 4551c540514d4a660b36251864f8c0d816c29b0d5664e154fdb4c0e9d6f767d3 Jun 05 15:17:28.803711 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.803670 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b9d8766bd-g5qjd" event={"ID":"a1af6ca4-3467-46a1-be9d-745e203b381b","Type":"ContainerStarted","Data":"836d82dea1dad87fa24ace6f1a2c379c5e0a9f2e069adf1b9a281d8cebe11c8f"} Jun 05 15:17:28.803887 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.803729 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b9d8766bd-g5qjd" event={"ID":"a1af6ca4-3467-46a1-be9d-745e203b381b","Type":"ContainerStarted","Data":"4551c540514d4a660b36251864f8c0d816c29b0d5664e154fdb4c0e9d6f767d3"} Jun 05 15:17:28.804954 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.804928 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hk2xk" event={"ID":"a36d096a-eb90-4297-9546-db64d3ff6f38","Type":"ContainerStarted","Data":"8f265fd8c2f5d22389bc3e37df2689063d4a7b84ee5b3d6e39bc50ccd11c0965"} Jun 05 15:17:28.841464 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:28.841419 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b9d8766bd-g5qjd" podStartSLOduration=0.841406054 podStartE2EDuration="841.406054ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:17:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:17:28.83813803 +0000 UTC m=+562.733656131" watchObservedRunningTime="2026-06-05 15:17:28.841406054 +0000 UTC m=+562.736924153" Jun 05 15:17:34.780736 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:34.780693 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zp2q2" Jun 05 15:17:38.513862 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:38.513828 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b9d8766bd-g5qjd" Jun 05 15:17:38.514244 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:38.513929 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b9d8766bd-g5qjd" Jun 05 15:17:38.518664 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:38.518644 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b9d8766bd-g5qjd" Jun 05 15:17:38.863384 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:38.863314 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b9d8766bd-g5qjd" Jun 05 15:17:53.942265 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:53.942224 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hk2xk" event={"ID":"a36d096a-eb90-4297-9546-db64d3ff6f38","Type":"ContainerStarted","Data":"30ed21e376b55c3dad516980a2989928490b0bd19f0e23959359b57ab7c1cf11"} Jun 05 15:17:53.959182 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:17:53.959127 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hk2xk" podStartSLOduration=2.412278029 podStartE2EDuration="26.9591112s" totalImagesPullingTime="24.546833171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:17:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:17:53.957271433 +0000 UTC m=+587.852789535" watchObservedRunningTime="2026-06-05 15:17:53.9591112 +0000 UTC m=+587.854629300" Jun 05 15:18:06.561693 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:06.561665 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7wnx_3e51389e-8fe0-48a4-b902-493bfa632cf8/ovn-acl-logging/0.log" Jun 05 15:18:06.566850 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:06.566828 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7wnx_3e51389e-8fe0-48a4-b902-493bfa632cf8/ovn-acl-logging/0.log" Jun 05 15:18:11.530439 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:11.530396 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lmx75"] Jun 05 15:18:11.533807 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:11.533786 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lmx75" Jun 05 15:18:11.537557 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:11.537539 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 05 15:18:11.546378 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:11.546357 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lmx75"] Jun 05 15:18:11.597756 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:11.597719 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfgzf\" (UniqueName: \"kubernetes.io/projected/c3187c68-7a0e-41a8-8d8b-55686a903d0b-kube-api-access-nfgzf\") pod \"limitador-limitador-64c94fd64f-lmx75\" (UID: \"c3187c68-7a0e-41a8-8d8b-55686a903d0b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lmx75" Jun 05 15:18:11.597952 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:11.597789 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c3187c68-7a0e-41a8-8d8b-55686a903d0b-config-file\") pod \"limitador-limitador-64c94fd64f-lmx75\" (UID: \"c3187c68-7a0e-41a8-8d8b-55686a903d0b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lmx75" Jun 05 15:18:11.616742 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:11.616712 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lmx75"] Jun 05 15:18:11.699053 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:11.699029 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c3187c68-7a0e-41a8-8d8b-55686a903d0b-config-file\") pod \"limitador-limitador-64c94fd64f-lmx75\" (UID: \"c3187c68-7a0e-41a8-8d8b-55686a903d0b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lmx75" Jun 05 15:18:11.699195 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:11.699126 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfgzf\" (UniqueName: \"kubernetes.io/projected/c3187c68-7a0e-41a8-8d8b-55686a903d0b-kube-api-access-nfgzf\") pod \"limitador-limitador-64c94fd64f-lmx75\" (UID: \"c3187c68-7a0e-41a8-8d8b-55686a903d0b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lmx75" Jun 05 15:18:11.699685 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:11.699664 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c3187c68-7a0e-41a8-8d8b-55686a903d0b-config-file\") pod \"limitador-limitador-64c94fd64f-lmx75\" (UID: \"c3187c68-7a0e-41a8-8d8b-55686a903d0b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lmx75" Jun 05 15:18:11.709223 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:11.709191 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfgzf\" (UniqueName: \"kubernetes.io/projected/c3187c68-7a0e-41a8-8d8b-55686a903d0b-kube-api-access-nfgzf\") pod \"limitador-limitador-64c94fd64f-lmx75\" (UID: \"c3187c68-7a0e-41a8-8d8b-55686a903d0b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lmx75" Jun 05 15:18:11.843924 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:11.843840 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lmx75" Jun 05 15:18:11.986202 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:11.986178 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lmx75"] Jun 05 15:18:11.988157 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:18:11.988133 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3187c68_7a0e_41a8_8d8b_55686a903d0b.slice/crio-7a38f3874d93866d11c37d64f9f3b3e19fd1853d00f6209510687e8bbfe0db41 WatchSource:0}: Error finding container 7a38f3874d93866d11c37d64f9f3b3e19fd1853d00f6209510687e8bbfe0db41: Status 404 returned error can't find the container with id 7a38f3874d93866d11c37d64f9f3b3e19fd1853d00f6209510687e8bbfe0db41 Jun 05 15:18:12.028958 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:12.028931 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lmx75" event={"ID":"c3187c68-7a0e-41a8-8d8b-55686a903d0b","Type":"ContainerStarted","Data":"7a38f3874d93866d11c37d64f9f3b3e19fd1853d00f6209510687e8bbfe0db41"} Jun 05 15:18:15.047718 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:15.047683 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lmx75" event={"ID":"c3187c68-7a0e-41a8-8d8b-55686a903d0b","Type":"ContainerStarted","Data":"60324a473a854f0ef550fb99e75608cb2bccb1e02254265eabf0d2129a7f54ac"} Jun 05 15:18:15.048120 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:15.047762 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-lmx75" Jun 05 15:18:15.068837 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:15.068790 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-lmx75" podStartSLOduration=1.520527274 podStartE2EDuration="4.068775025s" totalImagesPullingTime="2.548247751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:18:15.066257343 +0000 UTC m=+608.961775446" watchObservedRunningTime="2026-06-05 15:18:15.068775025 +0000 UTC m=+608.964293124" Jun 05 15:18:26.054614 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:26.054518 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-lmx75" Jun 05 15:18:28.181532 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:28.181499 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lmx75"] Jun 05 15:18:28.181929 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:28.181676 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-lmx75" podUID="c3187c68-7a0e-41a8-8d8b-55686a903d0b" containerName="limitador" containerID="cri-o://60324a473a854f0ef550fb99e75608cb2bccb1e02254265eabf0d2129a7f54ac" gracePeriod=30 Jun 05 15:18:28.777017 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:28.776992 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lmx75" Jun 05 15:18:28.839808 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:28.839780 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nfgzf\" (UniqueName: \"kubernetes.io/projected/c3187c68-7a0e-41a8-8d8b-55686a903d0b-kube-api-access-nfgzf\") pod \"c3187c68-7a0e-41a8-8d8b-55686a903d0b\" (UID: \"c3187c68-7a0e-41a8-8d8b-55686a903d0b\") " Jun 05 15:18:28.839965 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:28.839818 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c3187c68-7a0e-41a8-8d8b-55686a903d0b-config-file\") pod \"c3187c68-7a0e-41a8-8d8b-55686a903d0b\" (UID: \"c3187c68-7a0e-41a8-8d8b-55686a903d0b\") " Jun 05 15:18:28.840223 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:28.840203 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3187c68-7a0e-41a8-8d8b-55686a903d0b-config-file" (OuterVolumeSpecName: "config-file") pod "c3187c68-7a0e-41a8-8d8b-55686a903d0b" (UID: "c3187c68-7a0e-41a8-8d8b-55686a903d0b"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:18:28.841916 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:28.841885 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3187c68-7a0e-41a8-8d8b-55686a903d0b-kube-api-access-nfgzf" (OuterVolumeSpecName: "kube-api-access-nfgzf") pod "c3187c68-7a0e-41a8-8d8b-55686a903d0b" (UID: "c3187c68-7a0e-41a8-8d8b-55686a903d0b"). InnerVolumeSpecName "kube-api-access-nfgzf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:18:28.940872 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:28.940844 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfgzf\" (UniqueName: \"kubernetes.io/projected/c3187c68-7a0e-41a8-8d8b-55686a903d0b-kube-api-access-nfgzf\") on node \"ip-10-0-138-97.ec2.internal\" DevicePath \"\"" Jun 05 15:18:28.940872 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:28.940868 2560 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c3187c68-7a0e-41a8-8d8b-55686a903d0b-config-file\") on node \"ip-10-0-138-97.ec2.internal\" DevicePath \"\"" Jun 05 15:18:29.115631 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:29.115565 2560 generic.go:356] "Generic (PLEG): container finished" podID="c3187c68-7a0e-41a8-8d8b-55686a903d0b" containerID="60324a473a854f0ef550fb99e75608cb2bccb1e02254265eabf0d2129a7f54ac" exitCode=0 Jun 05 15:18:29.115631 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:29.115604 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lmx75" Jun 05 15:18:29.115631 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:29.115612 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lmx75" event={"ID":"c3187c68-7a0e-41a8-8d8b-55686a903d0b","Type":"ContainerDied","Data":"60324a473a854f0ef550fb99e75608cb2bccb1e02254265eabf0d2129a7f54ac"} Jun 05 15:18:29.115807 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:29.115656 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lmx75" event={"ID":"c3187c68-7a0e-41a8-8d8b-55686a903d0b","Type":"ContainerDied","Data":"7a38f3874d93866d11c37d64f9f3b3e19fd1853d00f6209510687e8bbfe0db41"} Jun 05 15:18:29.115807 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:29.115684 2560 scope.go:117] "RemoveContainer" containerID="60324a473a854f0ef550fb99e75608cb2bccb1e02254265eabf0d2129a7f54ac" Jun 05 15:18:29.124107 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:29.124086 2560 scope.go:117] "RemoveContainer" containerID="60324a473a854f0ef550fb99e75608cb2bccb1e02254265eabf0d2129a7f54ac" Jun 05 15:18:29.124332 ip-10-0-138-97 kubenswrapper[2560]: E0605 15:18:29.124314 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60324a473a854f0ef550fb99e75608cb2bccb1e02254265eabf0d2129a7f54ac\": container with ID starting with 60324a473a854f0ef550fb99e75608cb2bccb1e02254265eabf0d2129a7f54ac not found: ID does not exist" containerID="60324a473a854f0ef550fb99e75608cb2bccb1e02254265eabf0d2129a7f54ac" Jun 05 15:18:29.124376 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:29.124341 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60324a473a854f0ef550fb99e75608cb2bccb1e02254265eabf0d2129a7f54ac"} err="failed to get container status \"60324a473a854f0ef550fb99e75608cb2bccb1e02254265eabf0d2129a7f54ac\": rpc error: code = NotFound desc = could not find container \"60324a473a854f0ef550fb99e75608cb2bccb1e02254265eabf0d2129a7f54ac\": container with ID starting with 60324a473a854f0ef550fb99e75608cb2bccb1e02254265eabf0d2129a7f54ac not found: ID does not exist" Jun 05 15:18:29.137490 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:29.137469 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lmx75"] Jun 05 15:18:29.144956 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:29.144937 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lmx75"] Jun 05 15:18:30.596681 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:30.596648 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3187c68-7a0e-41a8-8d8b-55686a903d0b" path="/var/lib/kubelet/pods/c3187c68-7a0e-41a8-8d8b-55686a903d0b/volumes" Jun 05 15:18:32.689894 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:32.689860 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-llmxt"] Jun 05 15:18:32.690369 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:32.690348 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3187c68-7a0e-41a8-8d8b-55686a903d0b" containerName="limitador" Jun 05 15:18:32.690413 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:32.690375 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3187c68-7a0e-41a8-8d8b-55686a903d0b" containerName="limitador" Jun 05 15:18:32.690492 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:32.690480 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3187c68-7a0e-41a8-8d8b-55686a903d0b" containerName="limitador" Jun 05 15:18:32.695108 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:32.695088 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-llmxt" Jun 05 15:18:32.698047 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:32.698029 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 05 15:18:32.705490 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:32.705468 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-llmxt"] Jun 05 15:18:32.772878 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:32.772840 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/42b8a3e5-1e3f-4af0-a022-7ed03583abb5-data\") pod \"postgres-69fb4594cf-llmxt\" (UID: \"42b8a3e5-1e3f-4af0-a022-7ed03583abb5\") " pod="opendatahub/postgres-69fb4594cf-llmxt" Jun 05 15:18:32.773017 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:32.772897 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqk87\" (UniqueName: \"kubernetes.io/projected/42b8a3e5-1e3f-4af0-a022-7ed03583abb5-kube-api-access-sqk87\") pod \"postgres-69fb4594cf-llmxt\" (UID: \"42b8a3e5-1e3f-4af0-a022-7ed03583abb5\") " pod="opendatahub/postgres-69fb4594cf-llmxt" Jun 05 15:18:32.873644 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:32.873614 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/42b8a3e5-1e3f-4af0-a022-7ed03583abb5-data\") pod \"postgres-69fb4594cf-llmxt\" (UID: \"42b8a3e5-1e3f-4af0-a022-7ed03583abb5\") " pod="opendatahub/postgres-69fb4594cf-llmxt" Jun 05 15:18:32.873755 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:32.873663 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqk87\" (UniqueName: \"kubernetes.io/projected/42b8a3e5-1e3f-4af0-a022-7ed03583abb5-kube-api-access-sqk87\") pod \"postgres-69fb4594cf-llmxt\" (UID: \"42b8a3e5-1e3f-4af0-a022-7ed03583abb5\") " pod="opendatahub/postgres-69fb4594cf-llmxt" Jun 05 15:18:32.873992 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:32.873975 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/42b8a3e5-1e3f-4af0-a022-7ed03583abb5-data\") pod \"postgres-69fb4594cf-llmxt\" (UID: \"42b8a3e5-1e3f-4af0-a022-7ed03583abb5\") " pod="opendatahub/postgres-69fb4594cf-llmxt" Jun 05 15:18:32.883076 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:32.883056 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqk87\" (UniqueName: \"kubernetes.io/projected/42b8a3e5-1e3f-4af0-a022-7ed03583abb5-kube-api-access-sqk87\") pod \"postgres-69fb4594cf-llmxt\" (UID: \"42b8a3e5-1e3f-4af0-a022-7ed03583abb5\") " pod="opendatahub/postgres-69fb4594cf-llmxt" Jun 05 15:18:33.006601 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:33.006530 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-llmxt" Jun 05 15:18:33.139989 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:33.139819 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-llmxt"] Jun 05 15:18:33.142972 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:18:33.142943 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42b8a3e5_1e3f_4af0_a022_7ed03583abb5.slice/crio-ebb6a0429492cef831c734d089e0954d90daadda2828b0a4efbbb9d0e44bef91 WatchSource:0}: Error finding container ebb6a0429492cef831c734d089e0954d90daadda2828b0a4efbbb9d0e44bef91: Status 404 returned error can't find the container with id ebb6a0429492cef831c734d089e0954d90daadda2828b0a4efbbb9d0e44bef91 Jun 05 15:18:34.141776 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:34.141743 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-llmxt" event={"ID":"42b8a3e5-1e3f-4af0-a022-7ed03583abb5","Type":"ContainerStarted","Data":"ebb6a0429492cef831c734d089e0954d90daadda2828b0a4efbbb9d0e44bef91"} Jun 05 15:18:37.159595 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:37.159558 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-llmxt" event={"ID":"42b8a3e5-1e3f-4af0-a022-7ed03583abb5","Type":"ContainerStarted","Data":"1af5f55e678c75f87794bc0499c5a8efde768cfce50732ab0d5f825a1835c3c0"} Jun 05 15:18:37.160110 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:37.159659 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-llmxt" Jun 05 15:18:37.179410 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:37.179361 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-llmxt" podStartSLOduration=1.857826065 podStartE2EDuration="5.179348129s" totalImagesPullingTime="3.321522064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:18:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:18:37.177960036 +0000 UTC m=+631.073478134" watchObservedRunningTime="2026-06-05 15:18:37.179348129 +0000 UTC m=+631.074866277" Jun 05 15:18:43.199096 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:43.199058 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-llmxt" Jun 05 15:18:45.137326 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:45.136655 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702r6b2"] Jun 05 15:18:45.143366 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:45.143339 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702r6b2" Jun 05 15:18:45.147235 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:45.147205 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 15:18:45.147235 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:45.147215 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 15:18:45.147458 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:45.147426 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-q4kkf\"" Jun 05 15:18:45.148794 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:45.148767 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702r6b2"] Jun 05 15:18:45.279138 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:45.279108 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmf9t\" (UniqueName: \"kubernetes.io/projected/67df7922-6286-4026-bb1e-2ba5e778aef2-kube-api-access-lmf9t\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702r6b2\" (UID: \"67df7922-6286-4026-bb1e-2ba5e778aef2\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702r6b2" Jun 05 15:18:45.279256 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:45.279146 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67df7922-6286-4026-bb1e-2ba5e778aef2-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702r6b2\" (UID: \"67df7922-6286-4026-bb1e-2ba5e778aef2\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702r6b2" Jun 05 15:18:45.279299 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:45.279254 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67df7922-6286-4026-bb1e-2ba5e778aef2-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702r6b2\" (UID: \"67df7922-6286-4026-bb1e-2ba5e778aef2\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702r6b2" Jun 05 15:18:45.380309 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:45.380284 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmf9t\" (UniqueName: \"kubernetes.io/projected/67df7922-6286-4026-bb1e-2ba5e778aef2-kube-api-access-lmf9t\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702r6b2\" (UID: \"67df7922-6286-4026-bb1e-2ba5e778aef2\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702r6b2" Jun 05 15:18:45.380449 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:45.380314 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67df7922-6286-4026-bb1e-2ba5e778aef2-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702r6b2\" (UID: \"67df7922-6286-4026-bb1e-2ba5e778aef2\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702r6b2" Jun 05 15:18:45.380449 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:45.380361 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67df7922-6286-4026-bb1e-2ba5e778aef2-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702r6b2\" (UID: \"67df7922-6286-4026-bb1e-2ba5e778aef2\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702r6b2" Jun 05 15:18:45.380701 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:45.380685 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67df7922-6286-4026-bb1e-2ba5e778aef2-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702r6b2\" (UID: \"67df7922-6286-4026-bb1e-2ba5e778aef2\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702r6b2" Jun 05 15:18:45.380756 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:45.380715 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67df7922-6286-4026-bb1e-2ba5e778aef2-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702r6b2\" (UID: \"67df7922-6286-4026-bb1e-2ba5e778aef2\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702r6b2" Jun 05 15:18:45.390556 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:45.390498 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmf9t\" (UniqueName: \"kubernetes.io/projected/67df7922-6286-4026-bb1e-2ba5e778aef2-kube-api-access-lmf9t\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702r6b2\" (UID: \"67df7922-6286-4026-bb1e-2ba5e778aef2\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702r6b2" Jun 05 15:18:45.454311 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:45.454289 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702r6b2" Jun 05 15:18:45.580046 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:45.580015 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702r6b2"] Jun 05 15:18:45.582872 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:18:45.582842 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67df7922_6286_4026_bb1e_2ba5e778aef2.slice/crio-11e43da03139acd855ce12f5982216d4e156f43865ee738ed09dc552668df472 WatchSource:0}: Error finding container 11e43da03139acd855ce12f5982216d4e156f43865ee738ed09dc552668df472: Status 404 returned error can't find the container with id 11e43da03139acd855ce12f5982216d4e156f43865ee738ed09dc552668df472 Jun 05 15:18:46.208438 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:46.208408 2560 generic.go:356] "Generic (PLEG): container finished" podID="67df7922-6286-4026-bb1e-2ba5e778aef2" containerID="2a77ebaff9b4ad0dd57283e2ac583d0e7518af98272b435e3b0262d4200676fd" exitCode=0 Jun 05 15:18:46.208938 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:46.208460 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702r6b2" event={"ID":"67df7922-6286-4026-bb1e-2ba5e778aef2","Type":"ContainerDied","Data":"2a77ebaff9b4ad0dd57283e2ac583d0e7518af98272b435e3b0262d4200676fd"} Jun 05 15:18:46.208938 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:46.208505 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702r6b2" event={"ID":"67df7922-6286-4026-bb1e-2ba5e778aef2","Type":"ContainerStarted","Data":"11e43da03139acd855ce12f5982216d4e156f43865ee738ed09dc552668df472"} Jun 05 15:18:47.215346 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:47.215310 2560 generic.go:356] "Generic (PLEG): container finished" podID="67df7922-6286-4026-bb1e-2ba5e778aef2" containerID="c2b9b98d0f862b5f7de60effa80819fb9485f2dde6b426fa5f758929bdb88ab8" exitCode=0 Jun 05 15:18:47.215729 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:47.215375 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702r6b2" event={"ID":"67df7922-6286-4026-bb1e-2ba5e778aef2","Type":"ContainerDied","Data":"c2b9b98d0f862b5f7de60effa80819fb9485f2dde6b426fa5f758929bdb88ab8"} Jun 05 15:18:48.222268 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:48.222232 2560 generic.go:356] "Generic (PLEG): container finished" podID="67df7922-6286-4026-bb1e-2ba5e778aef2" containerID="a986f40254f342ff82249eee745ce4f88a04a9bb701a9340c1837cbbffda8e68" exitCode=0 Jun 05 15:18:48.222626 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:48.222309 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702r6b2" event={"ID":"67df7922-6286-4026-bb1e-2ba5e778aef2","Type":"ContainerDied","Data":"a986f40254f342ff82249eee745ce4f88a04a9bb701a9340c1837cbbffda8e68"} Jun 05 15:18:49.365614 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:49.365592 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702r6b2" Jun 05 15:18:49.516181 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:49.516101 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmf9t\" (UniqueName: \"kubernetes.io/projected/67df7922-6286-4026-bb1e-2ba5e778aef2-kube-api-access-lmf9t\") pod \"67df7922-6286-4026-bb1e-2ba5e778aef2\" (UID: \"67df7922-6286-4026-bb1e-2ba5e778aef2\") " Jun 05 15:18:49.516181 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:49.516168 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67df7922-6286-4026-bb1e-2ba5e778aef2-bundle\") pod \"67df7922-6286-4026-bb1e-2ba5e778aef2\" (UID: \"67df7922-6286-4026-bb1e-2ba5e778aef2\") " Jun 05 15:18:49.516374 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:49.516197 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67df7922-6286-4026-bb1e-2ba5e778aef2-util\") pod \"67df7922-6286-4026-bb1e-2ba5e778aef2\" (UID: \"67df7922-6286-4026-bb1e-2ba5e778aef2\") " Jun 05 15:18:49.516642 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:49.516613 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67df7922-6286-4026-bb1e-2ba5e778aef2-bundle" (OuterVolumeSpecName: "bundle") pod "67df7922-6286-4026-bb1e-2ba5e778aef2" (UID: "67df7922-6286-4026-bb1e-2ba5e778aef2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:18:49.518085 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:49.518051 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67df7922-6286-4026-bb1e-2ba5e778aef2-kube-api-access-lmf9t" (OuterVolumeSpecName: "kube-api-access-lmf9t") pod "67df7922-6286-4026-bb1e-2ba5e778aef2" (UID: "67df7922-6286-4026-bb1e-2ba5e778aef2"). InnerVolumeSpecName "kube-api-access-lmf9t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:18:49.521721 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:49.521689 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67df7922-6286-4026-bb1e-2ba5e778aef2-util" (OuterVolumeSpecName: "util") pod "67df7922-6286-4026-bb1e-2ba5e778aef2" (UID: "67df7922-6286-4026-bb1e-2ba5e778aef2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:18:49.616958 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:49.616935 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmf9t\" (UniqueName: \"kubernetes.io/projected/67df7922-6286-4026-bb1e-2ba5e778aef2-kube-api-access-lmf9t\") on node \"ip-10-0-138-97.ec2.internal\" DevicePath \"\"" Jun 05 15:18:49.616958 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:49.616955 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67df7922-6286-4026-bb1e-2ba5e778aef2-bundle\") on node \"ip-10-0-138-97.ec2.internal\" DevicePath \"\"" Jun 05 15:18:49.617080 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:49.616965 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67df7922-6286-4026-bb1e-2ba5e778aef2-util\") on node \"ip-10-0-138-97.ec2.internal\" DevicePath \"\"" Jun 05 15:18:50.235427 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:50.235388 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702r6b2" event={"ID":"67df7922-6286-4026-bb1e-2ba5e778aef2","Type":"ContainerDied","Data":"11e43da03139acd855ce12f5982216d4e156f43865ee738ed09dc552668df472"} Jun 05 15:18:50.235582 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:50.235435 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702r6b2" Jun 05 15:18:50.235582 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:50.235445 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11e43da03139acd855ce12f5982216d4e156f43865ee738ed09dc552668df472" Jun 05 15:18:53.486337 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:53.486306 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-qk52j"] Jun 05 15:18:53.486694 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:53.486616 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67df7922-6286-4026-bb1e-2ba5e778aef2" containerName="pull" Jun 05 15:18:53.486694 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:53.486626 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="67df7922-6286-4026-bb1e-2ba5e778aef2" containerName="pull" Jun 05 15:18:53.486694 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:53.486636 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67df7922-6286-4026-bb1e-2ba5e778aef2" containerName="extract" Jun 05 15:18:53.486694 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:53.486642 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="67df7922-6286-4026-bb1e-2ba5e778aef2" containerName="extract" Jun 05 15:18:53.486694 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:53.486649 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67df7922-6286-4026-bb1e-2ba5e778aef2" containerName="util" Jun 05 15:18:53.486694 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:53.486655 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="67df7922-6286-4026-bb1e-2ba5e778aef2" containerName="util" Jun 05 15:18:53.486880 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:53.486705 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="67df7922-6286-4026-bb1e-2ba5e778aef2" containerName="extract" Jun 05 15:18:53.489756 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:53.489735 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-dd84cbf46-qk52j" Jun 05 15:18:53.493149 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:53.493131 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 05 15:18:53.493149 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:53.493141 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-zwkf5\"" Jun 05 15:18:53.496183 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:53.496151 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 05 15:18:53.507004 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:53.506980 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-qk52j"] Jun 05 15:18:53.648807 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:53.648782 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49djk\" (UniqueName: \"kubernetes.io/projected/e7786700-5d40-460f-972d-21e13dc1103a-kube-api-access-49djk\") pod \"keycloak-operator-dd84cbf46-qk52j\" (UID: \"e7786700-5d40-460f-972d-21e13dc1103a\") " pod="keycloak-system/keycloak-operator-dd84cbf46-qk52j" Jun 05 15:18:53.750153 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:53.750089 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49djk\" (UniqueName: \"kubernetes.io/projected/e7786700-5d40-460f-972d-21e13dc1103a-kube-api-access-49djk\") pod \"keycloak-operator-dd84cbf46-qk52j\" (UID: \"e7786700-5d40-460f-972d-21e13dc1103a\") " pod="keycloak-system/keycloak-operator-dd84cbf46-qk52j" Jun 05 15:18:53.773647 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:53.773628 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49djk\" (UniqueName: \"kubernetes.io/projected/e7786700-5d40-460f-972d-21e13dc1103a-kube-api-access-49djk\") pod \"keycloak-operator-dd84cbf46-qk52j\" (UID: \"e7786700-5d40-460f-972d-21e13dc1103a\") " pod="keycloak-system/keycloak-operator-dd84cbf46-qk52j" Jun 05 15:18:53.798994 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:53.798974 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-dd84cbf46-qk52j" Jun 05 15:18:53.951638 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:53.951613 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-qk52j"] Jun 05 15:18:53.953413 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:18:53.953386 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7786700_5d40_460f_972d_21e13dc1103a.slice/crio-618d32375cd8ece99f034b40f404f7c5b6e4ac9c9dcf8008b0dbcad8482071d0 WatchSource:0}: Error finding container 618d32375cd8ece99f034b40f404f7c5b6e4ac9c9dcf8008b0dbcad8482071d0: Status 404 returned error can't find the container with id 618d32375cd8ece99f034b40f404f7c5b6e4ac9c9dcf8008b0dbcad8482071d0 Jun 05 15:18:54.257195 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:18:54.257162 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-dd84cbf46-qk52j" event={"ID":"e7786700-5d40-460f-972d-21e13dc1103a","Type":"ContainerStarted","Data":"618d32375cd8ece99f034b40f404f7c5b6e4ac9c9dcf8008b0dbcad8482071d0"} Jun 05 15:19:01.298579 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:19:01.298535 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-dd84cbf46-qk52j" event={"ID":"e7786700-5d40-460f-972d-21e13dc1103a","Type":"ContainerStarted","Data":"c9baf32380b4dbddaeb72952ad731826f1354943c25d1976323cafa28fb61c90"} Jun 05 15:19:01.333831 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:19:01.333781 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-dd84cbf46-qk52j" podStartSLOduration=2.044803617 podStartE2EDuration="8.333766036s" totalImagesPullingTime="6.288962419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:18:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:19:01.331149507 +0000 UTC m=+655.226667607" watchObservedRunningTime="2026-06-05 15:19:01.333766036 +0000 UTC m=+655.229284136" Jun 05 15:21:34.581713 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:34.581613 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-vz2mp"] Jun 05 15:21:34.585340 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:34.585309 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vz2mp" Jun 05 15:21:34.588247 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:34.588219 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 05 15:21:34.589330 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:34.589308 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 05 15:21:34.589446 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:34.589360 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-s2rbf\"" Jun 05 15:21:34.589446 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:34.589401 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 05 15:21:34.600203 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:34.600182 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-vz2mp"] Jun 05 15:21:34.747746 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:34.747716 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfnnq\" (UniqueName: \"kubernetes.io/projected/c19409aa-94c5-461a-8cfa-56b14c601660-kube-api-access-kfnnq\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vz2mp\" (UID: \"c19409aa-94c5-461a-8cfa-56b14c601660\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vz2mp" Jun 05 15:21:34.747886 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:34.747755 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c19409aa-94c5-461a-8cfa-56b14c601660-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vz2mp\" (UID: \"c19409aa-94c5-461a-8cfa-56b14c601660\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vz2mp" Jun 05 15:21:34.747886 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:34.747780 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c19409aa-94c5-461a-8cfa-56b14c601660-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vz2mp\" (UID: \"c19409aa-94c5-461a-8cfa-56b14c601660\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vz2mp" Jun 05 15:21:34.747886 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:34.747854 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c19409aa-94c5-461a-8cfa-56b14c601660-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vz2mp\" (UID: \"c19409aa-94c5-461a-8cfa-56b14c601660\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vz2mp" Jun 05 15:21:34.748043 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:34.747898 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c19409aa-94c5-461a-8cfa-56b14c601660-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vz2mp\" (UID: \"c19409aa-94c5-461a-8cfa-56b14c601660\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vz2mp" Jun 05 15:21:34.748043 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:34.748013 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c19409aa-94c5-461a-8cfa-56b14c601660-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vz2mp\" (UID: \"c19409aa-94c5-461a-8cfa-56b14c601660\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vz2mp" Jun 05 15:21:34.848660 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:34.848594 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c19409aa-94c5-461a-8cfa-56b14c601660-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vz2mp\" (UID: \"c19409aa-94c5-461a-8cfa-56b14c601660\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vz2mp" Jun 05 15:21:34.848660 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:34.848632 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfnnq\" (UniqueName: \"kubernetes.io/projected/c19409aa-94c5-461a-8cfa-56b14c601660-kube-api-access-kfnnq\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vz2mp\" (UID: \"c19409aa-94c5-461a-8cfa-56b14c601660\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vz2mp" Jun 05 15:21:34.848660 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:34.848654 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c19409aa-94c5-461a-8cfa-56b14c601660-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vz2mp\" (UID: \"c19409aa-94c5-461a-8cfa-56b14c601660\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vz2mp" Jun 05 15:21:34.848851 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:34.848674 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c19409aa-94c5-461a-8cfa-56b14c601660-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vz2mp\" (UID: \"c19409aa-94c5-461a-8cfa-56b14c601660\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vz2mp" Jun 05 15:21:34.848851 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:34.848705 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c19409aa-94c5-461a-8cfa-56b14c601660-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vz2mp\" (UID: \"c19409aa-94c5-461a-8cfa-56b14c601660\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vz2mp" Jun 05 15:21:34.848851 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:34.848730 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c19409aa-94c5-461a-8cfa-56b14c601660-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vz2mp\" (UID: \"c19409aa-94c5-461a-8cfa-56b14c601660\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vz2mp" Jun 05 15:21:34.849113 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:34.849096 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c19409aa-94c5-461a-8cfa-56b14c601660-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vz2mp\" (UID: \"c19409aa-94c5-461a-8cfa-56b14c601660\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vz2mp" Jun 05 15:21:34.849195 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:34.849166 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c19409aa-94c5-461a-8cfa-56b14c601660-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vz2mp\" (UID: \"c19409aa-94c5-461a-8cfa-56b14c601660\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vz2mp" Jun 05 15:21:34.849195 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:34.849187 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c19409aa-94c5-461a-8cfa-56b14c601660-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vz2mp\" (UID: \"c19409aa-94c5-461a-8cfa-56b14c601660\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vz2mp" Jun 05 15:21:34.850966 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:34.850944 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c19409aa-94c5-461a-8cfa-56b14c601660-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vz2mp\" (UID: \"c19409aa-94c5-461a-8cfa-56b14c601660\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vz2mp" Jun 05 15:21:34.851178 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:34.851161 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c19409aa-94c5-461a-8cfa-56b14c601660-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vz2mp\" (UID: \"c19409aa-94c5-461a-8cfa-56b14c601660\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vz2mp" Jun 05 15:21:34.859512 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:34.857653 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfnnq\" (UniqueName: \"kubernetes.io/projected/c19409aa-94c5-461a-8cfa-56b14c601660-kube-api-access-kfnnq\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vz2mp\" (UID: \"c19409aa-94c5-461a-8cfa-56b14c601660\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vz2mp" Jun 05 15:21:34.898052 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:34.898031 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vz2mp" Jun 05 15:21:35.033769 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:35.033743 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-vz2mp"] Jun 05 15:21:35.035372 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:21:35.035344 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc19409aa_94c5_461a_8cfa_56b14c601660.slice/crio-1a92522dfed06bfa1930478e1886d393f0febb81bc5349fc640dafd30c492df0 WatchSource:0}: Error finding container 1a92522dfed06bfa1930478e1886d393f0febb81bc5349fc640dafd30c492df0: Status 404 returned error can't find the container with id 1a92522dfed06bfa1930478e1886d393f0febb81bc5349fc640dafd30c492df0 Jun 05 15:21:35.037174 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:35.037155 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 15:21:35.050535 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:35.050500 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vz2mp" event={"ID":"c19409aa-94c5-461a-8cfa-56b14c601660","Type":"ContainerStarted","Data":"1a92522dfed06bfa1930478e1886d393f0febb81bc5349fc640dafd30c492df0"} Jun 05 15:21:39.073929 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:39.073878 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vz2mp" event={"ID":"c19409aa-94c5-461a-8cfa-56b14c601660","Type":"ContainerStarted","Data":"3dbadd28fac39a9d1b9e10fc21d8e90192291643cba34bbb3754fa25d6b74067"} Jun 05 15:21:41.085190 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:41.085154 2560 generic.go:356] "Generic (PLEG): container finished" podID="c19409aa-94c5-461a-8cfa-56b14c601660" containerID="3dbadd28fac39a9d1b9e10fc21d8e90192291643cba34bbb3754fa25d6b74067" exitCode=0 Jun 05 15:21:41.085586 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:41.085226 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vz2mp" event={"ID":"c19409aa-94c5-461a-8cfa-56b14c601660","Type":"ContainerDied","Data":"3dbadd28fac39a9d1b9e10fc21d8e90192291643cba34bbb3754fa25d6b74067"} Jun 05 15:21:43.097633 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:43.097598 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vz2mp" event={"ID":"c19409aa-94c5-461a-8cfa-56b14c601660","Type":"ContainerStarted","Data":"4a9ec5915c2e95b6969f904a494c6a4e67e3882db009374751c8465b7102c024"} Jun 05 15:21:43.120294 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:43.120245 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vz2mp" podStartSLOduration=2.722412154 podStartE2EDuration="9.120231242s" totalImagesPullingTime="4.332701369s" totalInitContainerRuntime="2.065117719s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:21:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:21:43.117535713 +0000 UTC m=+817.013053824" watchObservedRunningTime="2026-06-05 15:21:43.120231242 +0000 UTC m=+817.015749345" Jun 05 15:21:44.899090 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:44.899060 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vz2mp" Jun 05 15:21:44.899548 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:44.899146 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vz2mp" Jun 05 15:21:44.911337 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:44.911313 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vz2mp" Jun 05 15:21:45.118177 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:21:45.118153 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vz2mp" Jun 05 15:22:28.212576 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:22:28.212544 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-97h4j"] Jun 05 15:22:28.215928 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:22:28.215896 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-97h4j" Jun 05 15:22:28.219084 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:22:28.219064 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 05 15:22:28.220194 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:22:28.220173 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-97h4j"] Jun 05 15:22:28.372699 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:22:28.372672 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/664a50cc-a9e0-49ed-ac47-a030551a0b77-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-97h4j\" (UID: \"664a50cc-a9e0-49ed-ac47-a030551a0b77\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-97h4j" Jun 05 15:22:28.372870 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:22:28.372714 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/664a50cc-a9e0-49ed-ac47-a030551a0b77-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-97h4j\" (UID: \"664a50cc-a9e0-49ed-ac47-a030551a0b77\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-97h4j" Jun 05 15:22:28.372870 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:22:28.372735 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlgpl\" (UniqueName: \"kubernetes.io/projected/664a50cc-a9e0-49ed-ac47-a030551a0b77-kube-api-access-tlgpl\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-97h4j\" (UID: \"664a50cc-a9e0-49ed-ac47-a030551a0b77\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-97h4j" Jun 05 15:22:28.372870 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:22:28.372801 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/664a50cc-a9e0-49ed-ac47-a030551a0b77-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-97h4j\" (UID: \"664a50cc-a9e0-49ed-ac47-a030551a0b77\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-97h4j" Jun 05 15:22:28.372870 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:22:28.372854 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/664a50cc-a9e0-49ed-ac47-a030551a0b77-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-97h4j\" (UID: \"664a50cc-a9e0-49ed-ac47-a030551a0b77\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-97h4j" Jun 05 15:22:28.373031 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:22:28.372879 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/664a50cc-a9e0-49ed-ac47-a030551a0b77-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-97h4j\" (UID: \"664a50cc-a9e0-49ed-ac47-a030551a0b77\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-97h4j" Jun 05 15:22:28.473462 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:22:28.473374 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/664a50cc-a9e0-49ed-ac47-a030551a0b77-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-97h4j\" (UID: \"664a50cc-a9e0-49ed-ac47-a030551a0b77\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-97h4j" Jun 05 15:22:28.473462 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:22:28.473445 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/664a50cc-a9e0-49ed-ac47-a030551a0b77-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-97h4j\" (UID: \"664a50cc-a9e0-49ed-ac47-a030551a0b77\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-97h4j" Jun 05 15:22:28.473669 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:22:28.473480 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlgpl\" (UniqueName: \"kubernetes.io/projected/664a50cc-a9e0-49ed-ac47-a030551a0b77-kube-api-access-tlgpl\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-97h4j\" (UID: \"664a50cc-a9e0-49ed-ac47-a030551a0b77\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-97h4j" Jun 05 15:22:28.473669 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:22:28.473524 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/664a50cc-a9e0-49ed-ac47-a030551a0b77-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-97h4j\" (UID: \"664a50cc-a9e0-49ed-ac47-a030551a0b77\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-97h4j" Jun 05 15:22:28.473669 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:22:28.473554 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/664a50cc-a9e0-49ed-ac47-a030551a0b77-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-97h4j\" (UID: \"664a50cc-a9e0-49ed-ac47-a030551a0b77\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-97h4j" Jun 05 15:22:28.473669 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:22:28.473580 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/664a50cc-a9e0-49ed-ac47-a030551a0b77-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-97h4j\" (UID: \"664a50cc-a9e0-49ed-ac47-a030551a0b77\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-97h4j" Jun 05 15:22:28.473865 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:22:28.473759 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/664a50cc-a9e0-49ed-ac47-a030551a0b77-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-97h4j\" (UID: \"664a50cc-a9e0-49ed-ac47-a030551a0b77\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-97h4j" Jun 05 15:22:28.473865 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:22:28.473813 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/664a50cc-a9e0-49ed-ac47-a030551a0b77-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-97h4j\" (UID: \"664a50cc-a9e0-49ed-ac47-a030551a0b77\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-97h4j" Jun 05 15:22:28.473962 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:22:28.473946 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/664a50cc-a9e0-49ed-ac47-a030551a0b77-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-97h4j\" (UID: \"664a50cc-a9e0-49ed-ac47-a030551a0b77\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-97h4j" Jun 05 15:22:28.475680 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:22:28.475652 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/664a50cc-a9e0-49ed-ac47-a030551a0b77-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-97h4j\" (UID: \"664a50cc-a9e0-49ed-ac47-a030551a0b77\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-97h4j" Jun 05 15:22:28.476000 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:22:28.475981 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/664a50cc-a9e0-49ed-ac47-a030551a0b77-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-97h4j\" (UID: \"664a50cc-a9e0-49ed-ac47-a030551a0b77\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-97h4j" Jun 05 15:22:28.484795 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:22:28.484771 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlgpl\" (UniqueName: \"kubernetes.io/projected/664a50cc-a9e0-49ed-ac47-a030551a0b77-kube-api-access-tlgpl\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-97h4j\" (UID: \"664a50cc-a9e0-49ed-ac47-a030551a0b77\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-97h4j" Jun 05 15:22:28.526602 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:22:28.526580 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-97h4j" Jun 05 15:22:28.656097 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:22:28.656073 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-97h4j"] Jun 05 15:22:28.657879 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:22:28.657853 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod664a50cc_a9e0_49ed_ac47_a030551a0b77.slice/crio-65607346dcc9feb028ebfd0a6e8b28ac7279a1edbc96a35b940dfbc60650f507 WatchSource:0}: Error finding container 65607346dcc9feb028ebfd0a6e8b28ac7279a1edbc96a35b940dfbc60650f507: Status 404 returned error can't find the container with id 65607346dcc9feb028ebfd0a6e8b28ac7279a1edbc96a35b940dfbc60650f507 Jun 05 15:22:29.330728 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:22:29.330689 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-97h4j" event={"ID":"664a50cc-a9e0-49ed-ac47-a030551a0b77","Type":"ContainerStarted","Data":"cb3b581038717a8b138d5743a4fef7abc567132515ef5ea3727fcd3453b20e24"} Jun 05 15:22:29.330728 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:22:29.330731 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-97h4j" event={"ID":"664a50cc-a9e0-49ed-ac47-a030551a0b77","Type":"ContainerStarted","Data":"65607346dcc9feb028ebfd0a6e8b28ac7279a1edbc96a35b940dfbc60650f507"} Jun 05 15:23:06.597120 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:23:06.597096 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7wnx_3e51389e-8fe0-48a4-b902-493bfa632cf8/ovn-acl-logging/0.log" Jun 05 15:23:06.598642 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:23:06.598615 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7wnx_3e51389e-8fe0-48a4-b902-493bfa632cf8/ovn-acl-logging/0.log" Jun 05 15:24:15.866607 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:24:15.866516 2560 generic.go:356] "Generic (PLEG): container finished" podID="664a50cc-a9e0-49ed-ac47-a030551a0b77" containerID="cb3b581038717a8b138d5743a4fef7abc567132515ef5ea3727fcd3453b20e24" exitCode=0 Jun 05 15:24:15.866607 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:24:15.866592 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-97h4j" event={"ID":"664a50cc-a9e0-49ed-ac47-a030551a0b77","Type":"ContainerDied","Data":"cb3b581038717a8b138d5743a4fef7abc567132515ef5ea3727fcd3453b20e24"} Jun 05 15:24:16.873199 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:24:16.873164 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-97h4j" event={"ID":"664a50cc-a9e0-49ed-ac47-a030551a0b77","Type":"ContainerStarted","Data":"89089582ab5fbea26ad12f9ae6833b6f75e50c65ad82a8b04789c7593dcf3fb3"} Jun 05 15:24:16.893592 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:24:16.893543 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-97h4j" podStartSLOduration=2.422146702 podStartE2EDuration="1m48.893526593s" totalImagesPullingTime="220.014697ms" totalInitContainerRuntime="1m46.251365194s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:22:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:24:16.89245082 +0000 UTC m=+970.787968921" watchObservedRunningTime="2026-06-05 15:24:16.893526593 +0000 UTC m=+970.789044708" Jun 05 15:24:18.527084 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:24:18.527040 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-97h4j" Jun 05 15:24:18.527084 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:24:18.527090 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-97h4j" Jun 05 15:24:18.539299 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:24:18.539277 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-97h4j" Jun 05 15:24:18.897344 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:24:18.897269 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-97h4j" Jun 05 15:28:06.634788 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:28:06.634763 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7wnx_3e51389e-8fe0-48a4-b902-493bfa632cf8/ovn-acl-logging/0.log" Jun 05 15:28:06.635294 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:28:06.634835 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7wnx_3e51389e-8fe0-48a4-b902-493bfa632cf8/ovn-acl-logging/0.log" Jun 05 15:33:06.665342 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:33:06.665313 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7wnx_3e51389e-8fe0-48a4-b902-493bfa632cf8/ovn-acl-logging/0.log" Jun 05 15:33:06.667428 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:33:06.667404 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7wnx_3e51389e-8fe0-48a4-b902-493bfa632cf8/ovn-acl-logging/0.log" Jun 05 15:38:06.696900 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:38:06.696858 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7wnx_3e51389e-8fe0-48a4-b902-493bfa632cf8/ovn-acl-logging/0.log" Jun 05 15:38:06.707856 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:38:06.707834 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7wnx_3e51389e-8fe0-48a4-b902-493bfa632cf8/ovn-acl-logging/0.log" Jun 05 15:43:06.728705 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:43:06.728677 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7wnx_3e51389e-8fe0-48a4-b902-493bfa632cf8/ovn-acl-logging/0.log" Jun 05 15:43:06.745497 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:43:06.745476 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7wnx_3e51389e-8fe0-48a4-b902-493bfa632cf8/ovn-acl-logging/0.log" Jun 05 15:47:18.972421 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:18.972386 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-84b74885b5-g774x_992deb59-4a05-4360-b362-3b37cc4e5f8e/nginx/0.log" Jun 05 15:47:19.215626 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:19.215573 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-6g76z_1b5f3b03-ef67-446f-b811-a4b897b597fe/manager/0.log" Jun 05 15:47:19.332063 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:19.331974 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-5q7gw_df2f4fa3-32c3-4f4a-a3c8-8ca1a520955e/manager/0.log" Jun 05 15:47:19.889281 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:19.889252 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-9h8wj_1228a6af-7afe-438f-b6a3-344936281feb/server/0.log" Jun 05 15:47:20.003635 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:20.003606 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-jwqvq_fb5f14c7-9680-4b33-b570-fc7f58bb5918/manager/0.log" Jun 05 15:47:20.118401 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:20.118373 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-848c5d5886-48qpd_647844cb-e727-4c54-a5b4-de27e57410b4/copy-manifests/0.log" Jun 05 15:47:20.132260 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:20.132232 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-848c5d5886-48qpd_647844cb-e727-4c54-a5b4-de27e57410b4/manager/0.log" Jun 05 15:47:20.475590 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:20.475560 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-llmxt_42b8a3e5-1e3f-4af0-a022-7ed03583abb5/postgres/0.log" Jun 05 15:47:21.959080 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:21.959047 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-zp2q2_85ad0caf-b5f6-4922-9fb3-45f7131d5ba4/manager/0.log" Jun 05 15:47:22.060813 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:22.060786 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-hk2xk_a36d096a-eb90-4297-9546-db64d3ff6f38/kuadrant-console-plugin/0.log" Jun 05 15:47:22.968661 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:22.968634 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-b5fr5_86da3f8c-bf90-4711-a726-7977d625bf92/discovery/0.log" Jun 05 15:47:23.190280 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:23.190249 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7696d464b-w6wjn_6222b53f-0262-45fd-ada8-e159013c3080/kube-auth-proxy/0.log" Jun 05 15:47:24.112921 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:24.112886 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-vz2mp_c19409aa-94c5-461a-8cfa-56b14c601660/storage-initializer/0.log" Jun 05 15:47:24.120061 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:24.120041 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-vz2mp_c19409aa-94c5-461a-8cfa-56b14c601660/main/0.log" Jun 05 15:47:24.581827 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:24.581773 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-97h4j_664a50cc-a9e0-49ed-ac47-a030551a0b77/storage-initializer/0.log" Jun 05 15:47:24.589225 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:24.589206 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-97h4j_664a50cc-a9e0-49ed-ac47-a030551a0b77/main/0.log" Jun 05 15:47:31.718722 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:31.718692 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rmrn7_70a59546-d9b0-43b7-aa6c-72d294856aed/global-pull-secret-syncer/0.log" Jun 05 15:47:31.860258 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:31.860229 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-chbh5_bf33dc4e-b571-415e-817d-e1985a4f656a/konnectivity-agent/0.log" Jun 05 15:47:31.938169 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:31.938141 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-97.ec2.internal_662b71b6c5497bdd12105b5f3133c1f7/haproxy/0.log" Jun 05 15:47:35.171585 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:35.171552 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-6wrgz_2514fcbc-6a6c-42fa-b596-9022d82456eb/sail-operator/0.log" Jun 05 15:47:36.827747 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:36.827721 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-zp2q2_85ad0caf-b5f6-4922-9fb3-45f7131d5ba4/manager/0.log" Jun 05 15:47:36.854370 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:36.854349 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-hk2xk_a36d096a-eb90-4297-9546-db64d3ff6f38/kuadrant-console-plugin/0.log" Jun 05 15:47:39.296501 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:39.296475 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c9dst_3ecef66d-2f1a-4043-9d84-1b0dac9cb22e/node-exporter/0.log" Jun 05 15:47:39.324053 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:39.324029 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c9dst_3ecef66d-2f1a-4043-9d84-1b0dac9cb22e/kube-rbac-proxy/0.log" Jun 05 15:47:39.349546 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:39.349527 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c9dst_3ecef66d-2f1a-4043-9d84-1b0dac9cb22e/init-textfile/0.log" Jun 05 15:47:39.836835 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:39.836770 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78dc664dbc-k47v6_ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312/telemeter-client/0.log" Jun 05 15:47:39.863665 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:39.863643 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78dc664dbc-k47v6_ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312/reload/0.log" Jun 05 15:47:39.893616 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:39.893598 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78dc664dbc-k47v6_ba5ecd83-51b0-41f5-bbfa-a50ffc1f4312/kube-rbac-proxy/0.log" Jun 05 15:47:42.677065 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:42.677033 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5b9d8766bd-g5qjd_a1af6ca4-3467-46a1-be9d-745e203b381b/console/0.log" Jun 05 15:47:43.308506 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:43.308466 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wwjc4/perf-node-gather-daemonset-nrw2x"] Jun 05 15:47:43.312104 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:43.312081 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wwjc4/perf-node-gather-daemonset-nrw2x" Jun 05 15:47:43.315020 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:43.315000 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wwjc4\"/\"openshift-service-ca.crt\"" Jun 05 15:47:43.315114 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:43.315000 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wwjc4\"/\"default-dockercfg-nm5f2\"" Jun 05 15:47:43.316408 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:43.316383 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wwjc4\"/\"kube-root-ca.crt\"" Jun 05 15:47:43.321956 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:43.321933 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wwjc4/perf-node-gather-daemonset-nrw2x"] Jun 05 15:47:43.415613 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:43.415589 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aca56ea5-9fe9-47e2-9ae6-95dc1bfb34e9-podres\") pod \"perf-node-gather-daemonset-nrw2x\" (UID: \"aca56ea5-9fe9-47e2-9ae6-95dc1bfb34e9\") " pod="openshift-must-gather-wwjc4/perf-node-gather-daemonset-nrw2x" Jun 05 15:47:43.415713 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:43.415618 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ffvk\" (UniqueName: \"kubernetes.io/projected/aca56ea5-9fe9-47e2-9ae6-95dc1bfb34e9-kube-api-access-9ffvk\") pod \"perf-node-gather-daemonset-nrw2x\" (UID: \"aca56ea5-9fe9-47e2-9ae6-95dc1bfb34e9\") " pod="openshift-must-gather-wwjc4/perf-node-gather-daemonset-nrw2x" Jun 05 15:47:43.415713 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:43.415645 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aca56ea5-9fe9-47e2-9ae6-95dc1bfb34e9-proc\") pod \"perf-node-gather-daemonset-nrw2x\" (UID: \"aca56ea5-9fe9-47e2-9ae6-95dc1bfb34e9\") " pod="openshift-must-gather-wwjc4/perf-node-gather-daemonset-nrw2x" Jun 05 15:47:43.415789 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:43.415711 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aca56ea5-9fe9-47e2-9ae6-95dc1bfb34e9-lib-modules\") pod \"perf-node-gather-daemonset-nrw2x\" (UID: \"aca56ea5-9fe9-47e2-9ae6-95dc1bfb34e9\") " pod="openshift-must-gather-wwjc4/perf-node-gather-daemonset-nrw2x" Jun 05 15:47:43.415825 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:43.415782 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aca56ea5-9fe9-47e2-9ae6-95dc1bfb34e9-sys\") pod \"perf-node-gather-daemonset-nrw2x\" (UID: \"aca56ea5-9fe9-47e2-9ae6-95dc1bfb34e9\") " pod="openshift-must-gather-wwjc4/perf-node-gather-daemonset-nrw2x" Jun 05 15:47:43.516651 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:43.516623 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aca56ea5-9fe9-47e2-9ae6-95dc1bfb34e9-podres\") pod \"perf-node-gather-daemonset-nrw2x\" (UID: \"aca56ea5-9fe9-47e2-9ae6-95dc1bfb34e9\") " pod="openshift-must-gather-wwjc4/perf-node-gather-daemonset-nrw2x" Jun 05 15:47:43.516780 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:43.516654 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ffvk\" (UniqueName: \"kubernetes.io/projected/aca56ea5-9fe9-47e2-9ae6-95dc1bfb34e9-kube-api-access-9ffvk\") pod \"perf-node-gather-daemonset-nrw2x\" (UID: \"aca56ea5-9fe9-47e2-9ae6-95dc1bfb34e9\") " pod="openshift-must-gather-wwjc4/perf-node-gather-daemonset-nrw2x" Jun 05 15:47:43.516780 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:43.516694 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aca56ea5-9fe9-47e2-9ae6-95dc1bfb34e9-proc\") pod \"perf-node-gather-daemonset-nrw2x\" (UID: \"aca56ea5-9fe9-47e2-9ae6-95dc1bfb34e9\") " pod="openshift-must-gather-wwjc4/perf-node-gather-daemonset-nrw2x" Jun 05 15:47:43.516780 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:43.516733 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aca56ea5-9fe9-47e2-9ae6-95dc1bfb34e9-lib-modules\") pod \"perf-node-gather-daemonset-nrw2x\" (UID: \"aca56ea5-9fe9-47e2-9ae6-95dc1bfb34e9\") " pod="openshift-must-gather-wwjc4/perf-node-gather-daemonset-nrw2x" Jun 05 15:47:43.516780 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:43.516771 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aca56ea5-9fe9-47e2-9ae6-95dc1bfb34e9-sys\") pod \"perf-node-gather-daemonset-nrw2x\" (UID: \"aca56ea5-9fe9-47e2-9ae6-95dc1bfb34e9\") " pod="openshift-must-gather-wwjc4/perf-node-gather-daemonset-nrw2x" Jun 05 15:47:43.516997 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:43.516801 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aca56ea5-9fe9-47e2-9ae6-95dc1bfb34e9-podres\") pod \"perf-node-gather-daemonset-nrw2x\" (UID: \"aca56ea5-9fe9-47e2-9ae6-95dc1bfb34e9\") " pod="openshift-must-gather-wwjc4/perf-node-gather-daemonset-nrw2x" Jun 05 15:47:43.516997 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:43.516809 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aca56ea5-9fe9-47e2-9ae6-95dc1bfb34e9-proc\") pod \"perf-node-gather-daemonset-nrw2x\" (UID: \"aca56ea5-9fe9-47e2-9ae6-95dc1bfb34e9\") " pod="openshift-must-gather-wwjc4/perf-node-gather-daemonset-nrw2x" Jun 05 15:47:43.516997 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:43.516862 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aca56ea5-9fe9-47e2-9ae6-95dc1bfb34e9-sys\") pod \"perf-node-gather-daemonset-nrw2x\" (UID: \"aca56ea5-9fe9-47e2-9ae6-95dc1bfb34e9\") " pod="openshift-must-gather-wwjc4/perf-node-gather-daemonset-nrw2x" Jun 05 15:47:43.516997 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:43.516886 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aca56ea5-9fe9-47e2-9ae6-95dc1bfb34e9-lib-modules\") pod \"perf-node-gather-daemonset-nrw2x\" (UID: \"aca56ea5-9fe9-47e2-9ae6-95dc1bfb34e9\") " pod="openshift-must-gather-wwjc4/perf-node-gather-daemonset-nrw2x" Jun 05 15:47:43.524983 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:43.524963 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ffvk\" (UniqueName: \"kubernetes.io/projected/aca56ea5-9fe9-47e2-9ae6-95dc1bfb34e9-kube-api-access-9ffvk\") pod \"perf-node-gather-daemonset-nrw2x\" (UID: \"aca56ea5-9fe9-47e2-9ae6-95dc1bfb34e9\") " pod="openshift-must-gather-wwjc4/perf-node-gather-daemonset-nrw2x" Jun 05 15:47:43.623115 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:43.623064 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wwjc4/perf-node-gather-daemonset-nrw2x" Jun 05 15:47:43.756563 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:43.756538 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wwjc4/perf-node-gather-daemonset-nrw2x"] Jun 05 15:47:43.758266 ip-10-0-138-97 kubenswrapper[2560]: W0605 15:47:43.758239 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podaca56ea5_9fe9_47e2_9ae6_95dc1bfb34e9.slice/crio-1fa278058657268be4b9402c1652fbb69ca775d36d061b8ca658e2894a1753cc WatchSource:0}: Error finding container 1fa278058657268be4b9402c1652fbb69ca775d36d061b8ca658e2894a1753cc: Status 404 returned error can't find the container with id 1fa278058657268be4b9402c1652fbb69ca775d36d061b8ca658e2894a1753cc Jun 05 15:47:44.152269 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:44.152235 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wwjc4/perf-node-gather-daemonset-nrw2x" event={"ID":"aca56ea5-9fe9-47e2-9ae6-95dc1bfb34e9","Type":"ContainerStarted","Data":"834ae5bce9ad7acd9829be8cc5788b5b4de1eb5abb60600c9f27f70b3e92fa01"} Jun 05 15:47:44.152440 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:44.152282 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wwjc4/perf-node-gather-daemonset-nrw2x" event={"ID":"aca56ea5-9fe9-47e2-9ae6-95dc1bfb34e9","Type":"ContainerStarted","Data":"1fa278058657268be4b9402c1652fbb69ca775d36d061b8ca658e2894a1753cc"} Jun 05 15:47:44.152440 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:44.152361 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wwjc4/perf-node-gather-daemonset-nrw2x" Jun 05 15:47:44.170174 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:44.170133 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wwjc4/perf-node-gather-daemonset-nrw2x" podStartSLOduration=1.170121509 podStartE2EDuration="1.170121509s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:47:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:47:44.16876625 +0000 UTC m=+2378.064284350" watchObservedRunningTime="2026-06-05 15:47:44.170121509 +0000 UTC m=+2378.065639608" Jun 05 15:47:44.738351 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:44.738324 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8d5qm_c521bb9d-3aae-47f9-b597-6ef61f55b131/dns/0.log" Jun 05 15:47:44.766537 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:44.766512 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8d5qm_c521bb9d-3aae-47f9-b597-6ef61f55b131/kube-rbac-proxy/0.log" Jun 05 15:47:44.955307 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:44.955279 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-69xsz_9c7936f0-3a4d-4553-b67c-90eea6c1fcd6/dns-node-resolver/0.log" Jun 05 15:47:45.632736 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:45.632692 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-559cbfcb8d-2mtxn_ff186964-efd3-44ce-9132-b5d532084e36/registry/0.log" Jun 05 15:47:45.642733 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:45.642709 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-559cbfcb8d-2mtxn_ff186964-efd3-44ce-9132-b5d532084e36/registry/1.log" Jun 05 15:47:45.674680 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:45.674651 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2nrvs_cc603818-b45b-4274-b792-47b121c133a7/node-ca/0.log" Jun 05 15:47:46.824579 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:46.824550 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-b5fr5_86da3f8c-bf90-4711-a726-7977d625bf92/discovery/0.log" Jun 05 15:47:46.877718 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:46.877695 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7696d464b-w6wjn_6222b53f-0262-45fd-ada8-e159013c3080/kube-auth-proxy/0.log" Jun 05 15:47:47.789636 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:47.789607 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-g4qm9_0b540521-50dd-4407-9756-824f14cfeaaf/serve-healthcheck-canary/0.log" Jun 05 15:47:48.432559 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:48.432521 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-55qbh_84a1a20f-fa8f-4c65-8116-4c15a54c2b33/kube-rbac-proxy/0.log" Jun 05 15:47:48.455445 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:48.455418 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-55qbh_84a1a20f-fa8f-4c65-8116-4c15a54c2b33/exporter/0.log" Jun 05 15:47:48.478398 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:48.478378 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-55qbh_84a1a20f-fa8f-4c65-8116-4c15a54c2b33/extractor/0.log" Jun 05 15:47:50.168836 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:50.168809 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wwjc4/perf-node-gather-daemonset-nrw2x" Jun 05 15:47:50.902582 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:50.902548 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-84b74885b5-g774x_992deb59-4a05-4360-b362-3b37cc4e5f8e/nginx/0.log" Jun 05 15:47:50.979717 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:50.979685 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-6g76z_1b5f3b03-ef67-446f-b811-a4b897b597fe/manager/0.log" Jun 05 15:47:51.070736 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:51.070710 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-5q7gw_df2f4fa3-32c3-4f4a-a3c8-8ca1a520955e/manager/0.log" Jun 05 15:47:51.266329 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:51.266311 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-9h8wj_1228a6af-7afe-438f-b6a3-344936281feb/server/0.log" Jun 05 15:47:51.317757 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:51.317734 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-jwqvq_fb5f14c7-9680-4b33-b570-fc7f58bb5918/manager/0.log" Jun 05 15:47:51.413186 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:51.413165 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-848c5d5886-48qpd_647844cb-e727-4c54-a5b4-de27e57410b4/manager/0.log" Jun 05 15:47:51.437010 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:51.436988 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-848c5d5886-48qpd_647844cb-e727-4c54-a5b4-de27e57410b4/copy-manifests/0.log" Jun 05 15:47:51.586171 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:51.586120 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-llmxt_42b8a3e5-1e3f-4af0-a022-7ed03583abb5/postgres/0.log" Jun 05 15:47:53.437720 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:53.437697 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-ljlxq_ee599fce-5b54-471f-ae49-0eab34e63c8a/openshift-lws-operator/0.log" Jun 05 15:47:56.475604 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:56.475572 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-b5fr5_86da3f8c-bf90-4711-a726-7977d625bf92/discovery/0.log" Jun 05 15:47:56.507262 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:56.507236 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7696d464b-w6wjn_6222b53f-0262-45fd-ada8-e159013c3080/kube-auth-proxy/0.log" Jun 05 15:47:57.962797 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:57.962766 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-b5fr5_86da3f8c-bf90-4711-a726-7977d625bf92/discovery/0.log" Jun 05 15:47:57.996313 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:47:57.996291 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7696d464b-w6wjn_6222b53f-0262-45fd-ada8-e159013c3080/kube-auth-proxy/0.log" Jun 05 15:48:00.032048 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:48:00.032015 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-b5fr5_86da3f8c-bf90-4711-a726-7977d625bf92/discovery/0.log" Jun 05 15:48:00.059555 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:48:00.059533 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7696d464b-w6wjn_6222b53f-0262-45fd-ada8-e159013c3080/kube-auth-proxy/0.log" Jun 05 15:48:00.812393 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:48:00.812369 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jqpvb_2a40ce2e-4726-44e7-aea3-0278d610c96d/kube-multus-additional-cni-plugins/0.log" Jun 05 15:48:00.839367 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:48:00.839343 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jqpvb_2a40ce2e-4726-44e7-aea3-0278d610c96d/egress-router-binary-copy/0.log" Jun 05 15:48:00.866939 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:48:00.866893 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jqpvb_2a40ce2e-4726-44e7-aea3-0278d610c96d/cni-plugins/0.log" Jun 05 15:48:00.892535 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:48:00.892518 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jqpvb_2a40ce2e-4726-44e7-aea3-0278d610c96d/bond-cni-plugin/0.log" Jun 05 15:48:00.918969 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:48:00.918955 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jqpvb_2a40ce2e-4726-44e7-aea3-0278d610c96d/routeoverride-cni/0.log" Jun 05 15:48:00.950117 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:48:00.950099 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jqpvb_2a40ce2e-4726-44e7-aea3-0278d610c96d/whereabouts-cni-bincopy/0.log" Jun 05 15:48:00.974151 ip-10-0-138-97 kubenswrapper[2560]: I0605 15:48:00.974132 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jqpvb_2a40ce2e-4726-44e7-aea3-0278d610c96d/whereabouts-cni/0.log"