Jun 11 16:54:22.622172 ip-10-0-130-110 systemd[1]: Starting Kubernetes Kubelet... Jun 11 16:54:23.022774 ip-10-0-130-110 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:54:23.022774 ip-10-0-130-110 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 16:54:23.022774 ip-10-0-130-110 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:54:23.022774 ip-10-0-130-110 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 16:54:23.022774 ip-10-0-130-110 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:54:23.023726 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.023647 2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 16:54:23.030226 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030203 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:54:23.030226 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030222 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:54:23.030226 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030228 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:54:23.030226 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030232 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:54:23.030394 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030236 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:54:23.030394 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030241 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:54:23.030394 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030245 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:54:23.030394 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030249 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:54:23.030394 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030253 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:54:23.030394 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030257 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:54:23.030394 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030261 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:54:23.030394 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030265 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:54:23.030394 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030271 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:54:23.030394 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030276 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:54:23.030394 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030280 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:54:23.030394 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030284 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:54:23.030394 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030288 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:54:23.030394 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030292 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:54:23.030394 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030296 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:54:23.030394 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030301 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:54:23.030394 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030305 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:54:23.030394 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030308 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:54:23.030394 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030312 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:54:23.030394 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030316 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:54:23.030889 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030320 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:54:23.030889 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030325 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:54:23.030889 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030328 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:54:23.030889 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030331 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:54:23.030889 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030334 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:54:23.030889 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030336 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:54:23.030889 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030340 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:54:23.030889 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030342 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:54:23.030889 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030345 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:54:23.030889 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030348 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:54:23.030889 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030350 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:54:23.030889 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030353 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:54:23.030889 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030355 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:54:23.030889 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030358 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:54:23.030889 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030361 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:54:23.030889 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030365 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:54:23.030889 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030367 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:54:23.030889 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030370 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:54:23.030889 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030372 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:54:23.030889 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030375 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:54:23.031377 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030380 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:54:23.031377 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030384 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:54:23.031377 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030387 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:54:23.031377 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030391 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:54:23.031377 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030393 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:54:23.031377 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030397 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:54:23.031377 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030400 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:54:23.031377 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030403 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:54:23.031377 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030407 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:54:23.031377 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030411 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:54:23.031377 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030415 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:54:23.031377 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030418 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:54:23.031377 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030420 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:54:23.031377 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030424 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:54:23.031377 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030428 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:54:23.031377 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030431 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:54:23.031377 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030435 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:54:23.031377 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030437 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:54:23.031377 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030441 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:54:23.031834 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030443 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:54:23.031834 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030446 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:54:23.031834 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030450 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:54:23.031834 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030452 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:54:23.031834 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030455 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:54:23.031834 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030458 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:54:23.031834 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030461 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:54:23.031834 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030464 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:54:23.031834 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030467 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:54:23.031834 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030469 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:54:23.031834 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030472 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:54:23.031834 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030474 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:54:23.031834 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030477 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:54:23.031834 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030480 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:54:23.031834 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030482 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:54:23.031834 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030485 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:54:23.031834 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030487 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:54:23.031834 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030490 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:54:23.031834 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030493 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:54:23.031834 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030495 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:54:23.032318 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030498 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:54:23.032318 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030501 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:54:23.032318 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030503 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:54:23.032318 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030506 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:54:23.032318 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030508 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:54:23.032318 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030511 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:54:23.032318 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030513 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:54:23.032318 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030516 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:54:23.032318 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030518 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:54:23.032318 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030520 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:54:23.032318 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030523 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:54:23.032318 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030525 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:54:23.032318 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030528 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:54:23.032318 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030530 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:54:23.032318 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030533 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:54:23.032318 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.030535 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:54:23.032318 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031315 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:54:23.032318 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031323 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:54:23.032318 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031327 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:54:23.032318 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031331 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:54:23.032797 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031334 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:54:23.032797 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031337 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:54:23.032797 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031339 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:54:23.032797 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031342 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:54:23.032797 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031345 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:54:23.032797 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031347 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:54:23.032797 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031350 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:54:23.032797 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031354 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:54:23.032797 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031358 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:54:23.032797 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031361 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:54:23.032797 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031364 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:54:23.032797 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031367 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:54:23.032797 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031370 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:54:23.032797 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031373 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:54:23.032797 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031376 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:54:23.032797 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031379 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:54:23.032797 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031383 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:54:23.032797 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031386 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:54:23.032797 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031389 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:54:23.032797 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031392 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:54:23.033313 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031395 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:54:23.033313 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031398 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:54:23.033313 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031400 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:54:23.033313 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031403 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:54:23.033313 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031406 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:54:23.033313 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031408 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:54:23.033313 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031411 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:54:23.033313 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031414 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:54:23.033313 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031416 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:54:23.033313 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031419 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:54:23.033313 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031423 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:54:23.033313 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031426 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:54:23.033313 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031429 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:54:23.033313 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031431 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:54:23.033313 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031434 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:54:23.033313 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031436 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:54:23.033313 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031439 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:54:23.033313 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031442 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:54:23.033313 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031444 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:54:23.033313 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031447 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:54:23.033805 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031449 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:54:23.033805 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031452 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:54:23.033805 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031454 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:54:23.033805 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031457 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:54:23.033805 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031460 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:54:23.033805 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031462 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:54:23.033805 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031465 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:54:23.033805 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031468 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:54:23.033805 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031470 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:54:23.033805 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031472 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:54:23.033805 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031475 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:54:23.033805 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031477 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:54:23.033805 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031480 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:54:23.033805 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031482 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:54:23.033805 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031485 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:54:23.033805 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031487 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:54:23.033805 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031490 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:54:23.033805 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031492 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:54:23.033805 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031494 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:54:23.033805 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031497 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:54:23.034307 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031499 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:54:23.034307 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031502 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:54:23.034307 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031506 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:54:23.034307 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031510 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:54:23.034307 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031513 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:54:23.034307 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031516 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:54:23.034307 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031519 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:54:23.034307 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031521 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:54:23.034307 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031524 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:54:23.034307 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031526 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:54:23.034307 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031529 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:54:23.034307 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031531 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:54:23.034307 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031534 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:54:23.034307 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031537 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:54:23.034307 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031539 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:54:23.034307 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031542 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:54:23.034307 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031544 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:54:23.034307 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031547 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:54:23.034307 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031549 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:54:23.034775 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031553 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:54:23.034775 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031555 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:54:23.034775 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031558 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:54:23.034775 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031560 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:54:23.034775 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031563 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:54:23.034775 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031566 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:54:23.034775 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031569 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:54:23.034775 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031572 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:54:23.034775 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031575 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:54:23.034775 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031578 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:54:23.034775 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031580 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:54:23.034775 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031583 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:54:23.034775 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031587 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:54:23.034775 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031591 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:54:23.034775 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031594 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:54:23.034775 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031597 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:54:23.034775 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031973 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:54:23.034775 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031981 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:54:23.034775 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031984 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:54:23.035274 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031988 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:54:23.035274 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031991 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:54:23.035274 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031994 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:54:23.035274 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.031997 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:54:23.035274 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032000 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:54:23.035274 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032002 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:54:23.035274 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032005 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:54:23.035274 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032007 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:54:23.035274 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032010 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:54:23.035274 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032012 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:54:23.035274 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032015 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:54:23.035274 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032018 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:54:23.035274 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032020 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:54:23.035274 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032023 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:54:23.035274 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032026 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:54:23.035274 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032029 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:54:23.035274 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032031 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:54:23.035274 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032034 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:54:23.035274 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032036 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:54:23.035274 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032039 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:54:23.035750 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032041 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:54:23.035750 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032044 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:54:23.035750 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032046 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:54:23.035750 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032049 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:54:23.035750 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032052 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:54:23.035750 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032054 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:54:23.035750 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032057 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:54:23.035750 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032059 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:54:23.035750 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032062 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:54:23.035750 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032064 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:54:23.035750 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032068 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:54:23.035750 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032070 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:54:23.035750 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032073 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:54:23.035750 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032078 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:54:23.035750 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032081 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:54:23.035750 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032083 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:54:23.035750 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032086 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:54:23.035750 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032088 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:54:23.035750 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032091 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:54:23.035750 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032093 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:54:23.036255 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032096 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:54:23.036255 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032098 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:54:23.036255 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032101 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:54:23.036255 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032104 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:54:23.036255 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032106 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:54:23.036255 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032109 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:54:23.036255 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032112 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:54:23.036255 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032114 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:54:23.036255 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032117 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:54:23.036255 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032119 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:54:23.036255 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032122 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:54:23.036255 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032124 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:54:23.036255 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032127 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:54:23.036255 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032129 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:54:23.036255 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032132 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:54:23.036255 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032134 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:54:23.036255 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032137 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:54:23.036255 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032139 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:54:23.036255 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032143 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:54:23.036255 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032145 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:54:23.036859 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032148 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:54:23.036859 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032151 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:54:23.036859 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032155 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:54:23.036859 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032158 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:54:23.036859 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032160 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:54:23.036859 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032166 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:54:23.036859 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032169 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:54:23.036859 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032171 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:54:23.036859 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032174 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:54:23.036859 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032176 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:54:23.036859 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032179 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:54:23.036859 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032181 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:54:23.036859 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032184 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:54:23.036859 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032187 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:54:23.036859 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032189 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:54:23.036859 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032192 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:54:23.036859 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032194 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:54:23.036859 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032197 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:54:23.036859 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032199 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:54:23.037338 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032202 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:54:23.037338 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032205 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:54:23.037338 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032207 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:54:23.037338 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032209 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:54:23.037338 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032213 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:54:23.037338 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032215 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:54:23.037338 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032218 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:54:23.037338 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032220 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:54:23.037338 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032223 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:54:23.037338 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032227 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:54:23.037338 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032230 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:54:23.037338 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032233 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:54:23.037338 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032235 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:54:23.037338 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032237 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:54:23.037338 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032240 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:54:23.037338 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032242 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:54:23.037338 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032245 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:54:23.037338 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032320 2565 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 16:54:23.037338 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032332 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 16:54:23.037338 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032342 2565 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 16:54:23.037338 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032348 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 16:54:23.037870 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032354 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 16:54:23.037870 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032359 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 16:54:23.037870 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032363 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 16:54:23.037870 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032367 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 16:54:23.037870 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032370 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 16:54:23.037870 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032373 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 16:54:23.037870 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032376 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 16:54:23.037870 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032380 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 16:54:23.037870 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032383 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 16:54:23.037870 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032386 2565 flags.go:64] FLAG: --cgroup-root="" Jun 11 16:54:23.037870 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032389 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 16:54:23.037870 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032392 2565 flags.go:64] FLAG: --client-ca-file="" Jun 11 16:54:23.037870 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032395 2565 flags.go:64] FLAG: --cloud-provider="external" Jun 11 16:54:23.037870 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032398 2565 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 16:54:23.037870 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032402 2565 flags.go:64] FLAG: --cluster-domain="" Jun 11 16:54:23.037870 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032405 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 16:54:23.037870 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032408 2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 16:54:23.037870 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032411 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 16:54:23.037870 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032414 2565 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 16:54:23.037870 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032417 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 16:54:23.037870 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032422 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 16:54:23.037870 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032425 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 16:54:23.037870 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032428 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 16:54:23.038454 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032431 2565 flags.go:64] FLAG: --contention-profiling="false" Jun 11 16:54:23.038454 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032434 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 16:54:23.038454 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032437 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 16:54:23.038454 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032440 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 16:54:23.038454 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032443 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 16:54:23.038454 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032447 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 16:54:23.038454 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032452 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 16:54:23.038454 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032455 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 16:54:23.038454 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032458 2565 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 16:54:23.038454 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032460 2565 flags.go:64] FLAG: --enable-server="true" Jun 11 16:54:23.038454 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032463 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 16:54:23.038454 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032468 2565 flags.go:64] FLAG: --event-burst="100" Jun 11 16:54:23.038454 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032471 2565 flags.go:64] FLAG: --event-qps="50" Jun 11 16:54:23.038454 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032474 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 16:54:23.038454 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032477 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 16:54:23.038454 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032479 2565 flags.go:64] FLAG: --eviction-hard="" Jun 11 16:54:23.038454 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032483 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 16:54:23.038454 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032486 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 16:54:23.038454 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032489 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 16:54:23.038454 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032491 2565 flags.go:64] FLAG: --eviction-soft="" Jun 11 16:54:23.038454 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032494 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 16:54:23.038454 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032497 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 16:54:23.038454 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032501 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 16:54:23.038454 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032503 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 16:54:23.038454 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032506 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 16:54:23.039122 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032509 2565 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 16:54:23.039122 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032512 2565 flags.go:64] FLAG: --feature-gates="" Jun 11 16:54:23.039122 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032515 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 16:54:23.039122 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032518 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 16:54:23.039122 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032522 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 16:54:23.039122 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032525 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 16:54:23.039122 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032528 2565 flags.go:64] FLAG: --healthz-port="10248" Jun 11 16:54:23.039122 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032531 2565 flags.go:64] FLAG: --help="false" Jun 11 16:54:23.039122 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032534 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-130-110.ec2.internal" Jun 11 16:54:23.039122 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032537 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 16:54:23.039122 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032540 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 16:54:23.039122 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032543 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 16:54:23.039122 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032546 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 16:54:23.039122 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032550 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 16:54:23.039122 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032553 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 16:54:23.039122 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032556 2565 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 16:54:23.039122 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032559 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 16:54:23.039122 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032561 2565 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 16:54:23.039122 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032564 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 16:54:23.039122 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032567 2565 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 16:54:23.039122 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032570 2565 flags.go:64] FLAG: --kube-reserved="" Jun 11 16:54:23.039122 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032573 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 16:54:23.039122 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032576 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 16:54:23.039122 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032579 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 16:54:23.039705 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032581 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 16:54:23.039705 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032584 2565 flags.go:64] FLAG: --lock-file="" Jun 11 16:54:23.039705 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032587 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 16:54:23.039705 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032590 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 16:54:23.039705 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032592 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 16:54:23.039705 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032598 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 16:54:23.039705 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032601 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 16:54:23.039705 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032604 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 16:54:23.039705 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032606 2565 flags.go:64] FLAG: --logging-format="text" Jun 11 16:54:23.039705 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032609 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 16:54:23.039705 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032612 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 16:54:23.039705 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032615 2565 flags.go:64] FLAG: --manifest-url="" Jun 11 16:54:23.039705 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032620 2565 flags.go:64] FLAG: --manifest-url-header="" Jun 11 16:54:23.039705 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032624 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 16:54:23.039705 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032627 2565 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 16:54:23.039705 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032631 2565 flags.go:64] FLAG: --max-pods="110" Jun 11 16:54:23.039705 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032634 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 16:54:23.039705 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032637 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 16:54:23.039705 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032640 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 16:54:23.039705 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032643 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 16:54:23.039705 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032646 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 16:54:23.039705 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032650 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 16:54:23.039705 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032653 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 16:54:23.039705 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032660 2565 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 16:54:23.039705 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032663 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 16:54:23.040339 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032666 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 16:54:23.040339 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032670 2565 flags.go:64] FLAG: --pod-cidr="" Jun 11 16:54:23.040339 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032672 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 16:54:23.040339 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032677 2565 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 16:54:23.040339 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032680 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 16:54:23.040339 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032683 2565 flags.go:64] FLAG: --pods-per-core="0" Jun 11 16:54:23.040339 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032686 2565 flags.go:64] FLAG: --port="10250" Jun 11 16:54:23.040339 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032689 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 16:54:23.040339 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032691 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d33bf82c69390410" Jun 11 16:54:23.040339 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032694 2565 flags.go:64] FLAG: --qos-reserved="" Jun 11 16:54:23.040339 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032698 2565 flags.go:64] FLAG: --read-only-port="10255" Jun 11 16:54:23.040339 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032701 2565 flags.go:64] FLAG: --register-node="true" Jun 11 16:54:23.040339 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032703 2565 flags.go:64] FLAG: --register-with-taints="" Jun 11 16:54:23.040339 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032707 2565 flags.go:64] FLAG: --registry-burst="10" Jun 11 16:54:23.040339 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032710 2565 flags.go:64] FLAG: --registry-qps="5" Jun 11 16:54:23.040339 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032713 2565 flags.go:64] FLAG: --reserved-cpus="" Jun 11 16:54:23.040339 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032716 2565 flags.go:64] FLAG: --reserved-memory="" Jun 11 16:54:23.040339 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032719 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 16:54:23.040339 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032722 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 16:54:23.040339 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032725 2565 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 16:54:23.040339 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032729 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 16:54:23.040339 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032732 2565 flags.go:64] FLAG: --runonce="false" Jun 11 16:54:23.040339 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032735 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 16:54:23.040339 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032738 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 16:54:23.040339 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032741 2565 flags.go:64] FLAG: --seccomp-default="false" Jun 11 16:54:23.040973 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032744 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 16:54:23.040973 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032746 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 16:54:23.040973 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032750 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 16:54:23.040973 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032754 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 16:54:23.040973 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032757 2565 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 16:54:23.040973 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032759 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 16:54:23.040973 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032762 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 16:54:23.040973 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032765 2565 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 16:54:23.040973 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032768 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 16:54:23.040973 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032771 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 16:54:23.040973 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032774 2565 flags.go:64] FLAG: --system-cgroups="" Jun 11 16:54:23.040973 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032776 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 16:54:23.040973 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032781 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 16:54:23.040973 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032784 2565 flags.go:64] FLAG: --tls-cert-file="" Jun 11 16:54:23.040973 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032786 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 16:54:23.040973 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032803 2565 flags.go:64] FLAG: --tls-min-version="" Jun 11 16:54:23.040973 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032807 2565 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 16:54:23.040973 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032811 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 16:54:23.040973 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032814 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 16:54:23.040973 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032834 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 16:54:23.040973 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032838 2565 flags.go:64] FLAG: --v="2" Jun 11 16:54:23.040973 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032842 2565 flags.go:64] FLAG: --version="false" Jun 11 16:54:23.040973 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032847 2565 flags.go:64] FLAG: --vmodule="" Jun 11 16:54:23.040973 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032851 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 16:54:23.040973 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.032855 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 16:54:23.041587 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032972 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:54:23.041587 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032976 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:54:23.041587 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032981 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:54:23.041587 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032985 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:54:23.041587 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032988 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:54:23.041587 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032991 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:54:23.041587 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032993 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:54:23.041587 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032996 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:54:23.041587 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.032998 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:54:23.041587 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033001 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:54:23.041587 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033005 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:54:23.041587 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033008 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:54:23.041587 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033010 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:54:23.041587 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033013 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:54:23.041587 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033016 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:54:23.041587 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033018 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:54:23.041587 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033021 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:54:23.041587 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033023 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:54:23.041587 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033026 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:54:23.042148 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033029 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:54:23.042148 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033031 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:54:23.042148 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033034 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:54:23.042148 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033036 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:54:23.042148 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033039 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:54:23.042148 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033041 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:54:23.042148 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033044 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:54:23.042148 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033048 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:54:23.042148 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033052 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:54:23.042148 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033055 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:54:23.042148 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033057 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:54:23.042148 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033061 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:54:23.042148 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033063 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:54:23.042148 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033066 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:54:23.042148 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033068 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:54:23.042148 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033072 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:54:23.042148 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033075 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:54:23.042148 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033077 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:54:23.042148 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033090 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:54:23.042602 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033094 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:54:23.042602 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033097 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:54:23.042602 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033100 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:54:23.042602 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033103 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:54:23.042602 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033107 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:54:23.042602 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033110 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:54:23.042602 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033112 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:54:23.042602 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033115 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:54:23.042602 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033117 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:54:23.042602 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033120 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:54:23.042602 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033123 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:54:23.042602 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033126 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:54:23.042602 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033128 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:54:23.042602 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033131 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:54:23.042602 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033133 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:54:23.042602 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033136 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:54:23.042602 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033139 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:54:23.042602 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033141 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:54:23.042602 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033144 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:54:23.042602 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033146 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:54:23.043111 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033149 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:54:23.043111 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033151 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:54:23.043111 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033154 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:54:23.043111 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033156 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:54:23.043111 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033159 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:54:23.043111 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033162 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:54:23.043111 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033165 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:54:23.043111 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033167 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:54:23.043111 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033171 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:54:23.043111 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033174 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:54:23.043111 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033176 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:54:23.043111 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033179 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:54:23.043111 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033182 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:54:23.043111 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033184 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:54:23.043111 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033187 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:54:23.043111 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033189 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:54:23.043111 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033193 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:54:23.043111 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033196 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:54:23.043111 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033198 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:54:23.043111 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033201 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:54:23.043618 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033203 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:54:23.043618 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033206 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:54:23.043618 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033208 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:54:23.043618 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033211 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:54:23.043618 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033214 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:54:23.043618 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033216 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:54:23.043618 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033219 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:54:23.043618 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033221 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:54:23.043618 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033224 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:54:23.043618 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033226 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:54:23.043618 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033229 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:54:23.043618 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033232 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:54:23.043618 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033234 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:54:23.043618 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033237 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:54:23.043618 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033241 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:54:23.043618 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033244 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:54:23.043618 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033247 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:54:23.043618 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033249 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:54:23.043618 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033253 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:54:23.044100 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033255 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:54:23.044100 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.033259 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:54:23.044100 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.033815 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:54:23.044100 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.040708 2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 16:54:23.044100 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.040845 2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 16:54:23.044100 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.041968 2565 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 16:54:23.044100 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.041975 2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 16:54:23.044100 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042031 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:54:23.044100 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042035 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:54:23.044100 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042039 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:54:23.044100 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042042 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:54:23.044100 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042046 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:54:23.044100 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042048 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:54:23.044100 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042051 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:54:23.044100 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042054 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:54:23.044472 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042056 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:54:23.044472 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042059 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:54:23.044472 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042062 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:54:23.044472 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042064 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:54:23.044472 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042068 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:54:23.044472 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042070 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:54:23.044472 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042073 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:54:23.044472 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042075 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:54:23.044472 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042079 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:54:23.044472 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042081 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:54:23.044472 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042084 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:54:23.044472 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042087 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:54:23.044472 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042090 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:54:23.044472 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042093 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:54:23.044472 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042097 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:54:23.044472 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042100 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:54:23.044472 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042107 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:54:23.044472 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042111 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:54:23.044472 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042113 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:54:23.044472 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042116 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:54:23.044992 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042119 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:54:23.044992 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042122 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:54:23.044992 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042125 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:54:23.044992 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042128 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:54:23.044992 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042132 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:54:23.044992 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042135 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:54:23.044992 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042138 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:54:23.044992 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042142 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:54:23.044992 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042145 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:54:23.044992 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042147 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:54:23.044992 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042150 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:54:23.044992 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042153 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:54:23.044992 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042156 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:54:23.044992 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042159 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:54:23.044992 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042162 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:54:23.044992 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042164 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:54:23.044992 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042167 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:54:23.044992 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042170 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:54:23.044992 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042172 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:54:23.045550 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042175 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:54:23.045550 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042178 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:54:23.045550 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042180 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:54:23.045550 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042183 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:54:23.045550 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042185 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:54:23.045550 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042188 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:54:23.045550 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042191 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:54:23.045550 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042193 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:54:23.045550 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042196 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:54:23.045550 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042198 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:54:23.045550 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042202 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:54:23.045550 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042204 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:54:23.045550 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042207 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:54:23.045550 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042209 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:54:23.045550 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042212 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:54:23.045550 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042215 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:54:23.045550 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042217 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:54:23.045550 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042220 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:54:23.045550 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042223 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:54:23.045550 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042227 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:54:23.046200 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042231 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:54:23.046200 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042233 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:54:23.046200 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042236 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:54:23.046200 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042239 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:54:23.046200 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042241 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:54:23.046200 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042244 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:54:23.046200 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042247 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:54:23.046200 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042249 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:54:23.046200 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042252 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:54:23.046200 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042255 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:54:23.046200 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042257 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:54:23.046200 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042260 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:54:23.046200 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042262 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:54:23.046200 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042265 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:54:23.046200 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042267 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:54:23.046200 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042270 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:54:23.046200 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042272 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:54:23.046200 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042275 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:54:23.046200 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042277 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:54:23.046200 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042280 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:54:23.046714 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042283 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:54:23.046714 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042286 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:54:23.046714 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042288 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:54:23.046714 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042292 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:54:23.046714 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042295 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:54:23.046714 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042297 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:54:23.046714 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042300 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:54:23.046714 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042303 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:54:23.046714 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042306 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:54:23.046714 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042308 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:54:23.046714 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042311 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:54:23.046714 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042313 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:54:23.046714 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.042319 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:54:23.046714 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042457 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:54:23.046714 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042462 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:54:23.047102 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042465 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:54:23.047102 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042468 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:54:23.047102 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042471 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:54:23.047102 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042474 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:54:23.047102 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042477 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:54:23.047102 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042479 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:54:23.047102 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042482 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:54:23.047102 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042485 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:54:23.047102 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042488 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:54:23.047102 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042490 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:54:23.047102 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042493 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:54:23.047102 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042497 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:54:23.047102 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042501 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:54:23.047102 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042504 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:54:23.047102 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042506 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:54:23.047102 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042509 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:54:23.047102 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042511 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:54:23.047102 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042514 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:54:23.047102 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042517 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:54:23.047102 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042520 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:54:23.047592 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042523 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:54:23.047592 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042526 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:54:23.047592 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042528 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:54:23.047592 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042532 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:54:23.047592 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042550 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:54:23.047592 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042554 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:54:23.047592 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042557 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:54:23.047592 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042560 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:54:23.047592 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042563 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:54:23.047592 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042566 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:54:23.047592 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042568 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:54:23.047592 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042571 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:54:23.047592 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042574 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:54:23.047592 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042577 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:54:23.047592 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042579 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:54:23.047592 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042582 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:54:23.047592 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042585 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:54:23.047592 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042587 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:54:23.047592 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042590 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:54:23.047592 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042593 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:54:23.048103 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042595 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:54:23.048103 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042597 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:54:23.048103 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042600 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:54:23.048103 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042603 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:54:23.048103 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042606 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:54:23.048103 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042608 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:54:23.048103 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042611 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:54:23.048103 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042614 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:54:23.048103 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042617 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:54:23.048103 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042619 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:54:23.048103 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042622 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:54:23.048103 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042625 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:54:23.048103 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042627 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:54:23.048103 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042630 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:54:23.048103 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042633 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:54:23.048103 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042637 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:54:23.048103 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042639 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:54:23.048103 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042642 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:54:23.048103 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042644 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:54:23.048103 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042647 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:54:23.048572 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042649 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:54:23.048572 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042652 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:54:23.048572 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042654 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:54:23.048572 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042657 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:54:23.048572 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042659 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:54:23.048572 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042662 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:54:23.048572 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042664 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:54:23.048572 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042667 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:54:23.048572 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042669 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:54:23.048572 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042672 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:54:23.048572 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042674 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:54:23.048572 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042677 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:54:23.048572 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042679 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:54:23.048572 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042682 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:54:23.048572 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042684 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:54:23.048572 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042687 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:54:23.048572 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042691 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:54:23.048572 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042694 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:54:23.048572 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042697 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:54:23.049059 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042700 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:54:23.049059 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042702 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:54:23.049059 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042704 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:54:23.049059 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042707 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:54:23.049059 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042710 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:54:23.049059 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042712 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:54:23.049059 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042715 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:54:23.049059 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042718 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:54:23.049059 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042721 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:54:23.049059 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042724 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:54:23.049059 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042726 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:54:23.049059 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042729 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:54:23.049059 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042731 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:54:23.049059 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042734 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:54:23.049059 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042736 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:54:23.049059 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042739 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:54:23.049059 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042741 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:54:23.049059 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:23.042744 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:54:23.049506 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.042748 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:54:23.049506 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.042859 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 16:54:23.049506 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.044885 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 16:54:23.049506 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.046436 2565 server.go:1019] "Starting client certificate rotation" Jun 11 16:54:23.049506 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.046564 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 16:54:23.049506 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.046594 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 16:54:23.049712 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.049700 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 16:54:23.056543 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.056517 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 16:54:23.069212 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.069197 2565 log.go:25] "Validated CRI v1 runtime API" Jun 11 16:54:23.071743 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.071731 2565 log.go:25] "Validated CRI v1 image API" Jun 11 16:54:23.072581 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.072566 2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 16:54:23.074953 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.074935 2565 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7ff10616-b1c6-464c-9e26-a65c55f20ba6:/dev/nvme0n1p3 e0c96ea1-884d-4e94-8e39-0121c45dbfbc:/dev/nvme0n1p4] Jun 11 16:54:23.075023 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.074954 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 16:54:23.079101 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.079084 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 16:54:23.080430 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.080322 2565 manager.go:216] Machine: {Timestamp:2026-06-11 16:54:23.078998116 +0000 UTC m=+0.339253014 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100487 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27a96973da6997924786b3969f1fd3 SystemUUID:ec27a969-73da-6997-9247-86b3969f1fd3 BootID:cbbbf9ea-6365-4b0d-b208-59d0238c2390 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:99:ae:3c:20:69 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:99:ae:3c:20:69 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:77:62:34:f7:50 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 16:54:23.080430 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.080428 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 16:54:23.080545 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.080533 2565 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 16:54:23.083655 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.083633 2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 16:54:23.083785 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.083658 2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-110.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 16:54:23.084499 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.084489 2565 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 16:54:23.084531 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.084502 2565 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 16:54:23.084531 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.084509 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 16:54:23.085161 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.085150 2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 16:54:23.086262 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.086253 2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 16:54:23.089398 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.089387 2565 state_mem.go:36] "Initialized new in-memory state store" Jun 11 16:54:23.089651 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.089641 2565 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 16:54:23.089690 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.089676 2565 kubelet.go:486] "Attempting to sync node with API server" Jun 11 16:54:23.089690 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.089687 2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 16:54:23.089771 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.089705 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 16:54:23.089771 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.089723 2565 kubelet.go:398] "Adding apiserver pod source" Jun 11 16:54:23.089771 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.089733 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 16:54:23.090139 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.090122 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 16:54:23.090186 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.090162 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 16:54:23.092561 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.092541 2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 16:54:23.094061 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.094044 2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 16:54:23.094138 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.094084 2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 16:54:23.094867 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.094850 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 16:54:23.094939 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.094873 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 16:54:23.094939 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.094882 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 16:54:23.094939 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.094890 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 16:54:23.094939 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.094901 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 16:54:23.094939 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.094910 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 16:54:23.094939 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.094922 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 16:54:23.094939 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.094931 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 16:54:23.094939 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.094942 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 16:54:23.095181 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.094950 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 16:54:23.095181 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.094969 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 16:54:23.095181 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.094981 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 16:54:23.095831 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.095742 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 16:54:23.095831 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.095761 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 16:54:23.099170 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.099159 2565 server.go:1268] "Started kubelet" Jun 11 16:54:23.099366 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.099336 2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 16:54:23.099419 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.099393 2565 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 16:54:23.102067 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.101979 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 16:54:23.102301 ip-10-0-130-110 systemd[1]: Started Kubernetes Kubelet. Jun 11 16:54:23.102922 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.102898 2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 16:54:23.103869 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.103544 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-110.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 16:54:23.103869 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:23.103814 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-110.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 16:54:23.106146 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.106130 2565 server.go:310] "Adding debug handlers to kubelet server" Jun 11 16:54:23.110313 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:23.110287 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 16:54:23.110399 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:23.110325 2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 16:54:23.112064 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.112047 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 16:54:23.112120 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.112079 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 16:54:23.112191 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:23.112169 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-110.ec2.internal\" not found" Jun 11 16:54:23.112756 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.112741 2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 16:54:23.112756 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.112743 2565 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 16:54:23.112913 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.112761 2565 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 16:54:23.112913 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.112886 2565 reconstruct.go:97] "Volume reconstruction finished" Jun 11 16:54:23.112913 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.112894 2565 reconciler.go:29] "Reconciler: start to sync state" Jun 11 16:54:23.113135 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.113115 2565 factory.go:55] Registering systemd factory Jun 11 16:54:23.113135 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.113136 2565 factory.go:223] Registration of the systemd container factory successfully Jun 11 16:54:23.113358 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.113340 2565 factory.go:153] Registering CRI-O factory Jun 11 16:54:23.113478 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.113455 2565 factory.go:223] Registration of the crio container factory successfully Jun 11 16:54:23.113553 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.113527 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 16:54:23.113553 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.113549 2565 factory.go:103] Registering Raw factory Jun 11 16:54:23.113659 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.113565 2565 manager.go:1196] Started watching for new ooms in manager Jun 11 16:54:23.113991 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.113964 2565 manager.go:349] Starting recovery of all containers Jun 11 16:54:23.120443 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:23.120406 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 16:54:23.121522 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:23.120449 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-110.ec2.internal.18b8151c1c105976 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-110.ec2.internal,UID:ip-10-0-130-110.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-110.ec2.internal,},FirstTimestamp:2026-06-11 16:54:23.099132278 +0000 UTC m=+0.359387175,LastTimestamp:2026-06-11 16:54:23.099132278 +0000 UTC m=+0.359387175,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-110.ec2.internal,}" Jun 11 16:54:23.124139 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:23.124115 2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-110.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 16:54:23.124469 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.124456 2565 manager.go:354] Recovery completed Jun 11 16:54:23.129403 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.129387 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f87xz" Jun 11 16:54:23.129487 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.129477 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:54:23.131240 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.131227 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:54:23.131315 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.131255 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:54:23.131315 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.131267 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:54:23.131768 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.131755 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 16:54:23.131768 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.131768 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 16:54:23.131913 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.131787 2565 state_mem.go:36] "Initialized new in-memory state store" Jun 11 16:54:23.131913 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.131769 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:54:23.133043 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:23.132954 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-110.ec2.internal.18b8151c1dfa4a03 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-110.ec2.internal,UID:ip-10-0-130-110.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-110.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-110.ec2.internal,},FirstTimestamp:2026-06-11 16:54:23.131240963 +0000 UTC m=+0.391495863,LastTimestamp:2026-06-11 16:54:23.131240963 +0000 UTC m=+0.391495863,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-110.ec2.internal,}" Jun 11 16:54:23.133136 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.133082 2565 policy_none.go:49] "None policy: Start" Jun 11 16:54:23.133136 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.133096 2565 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 16:54:23.133136 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.133109 2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 16:54:23.133362 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.133350 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:54:23.133397 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.133371 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:54:23.133397 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.133380 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:54:23.134119 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.134107 2565 policy_none.go:47] "Start" Jun 11 16:54:23.139141 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.139107 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f87xz" Jun 11 16:54:23.140766 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:23.140710 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-110.ec2.internal.18b8151c1dfa9c42 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-110.ec2.internal,UID:ip-10-0-130-110.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-110.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-110.ec2.internal,},FirstTimestamp:2026-06-11 16:54:23.131262018 +0000 UTC m=+0.391516915,LastTimestamp:2026-06-11 16:54:23.131262018 +0000 UTC m=+0.391516915,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-110.ec2.internal,}" Jun 11 16:54:23.170411 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.170398 2565 manager.go:337] "Starting Device Plugin manager" Jun 11 16:54:23.187119 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:23.170427 2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 16:54:23.187119 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.170439 2565 server.go:87] "Starting device plugin registration server" Jun 11 16:54:23.187119 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.170728 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 16:54:23.187119 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.170739 2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 16:54:23.187119 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.170846 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 16:54:23.187119 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.170917 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 16:54:23.187119 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.170934 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 16:54:23.187119 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:23.171479 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 16:54:23.187119 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:23.171519 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-110.ec2.internal\" not found" Jun 11 16:54:23.187119 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.183105 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 16:54:23.187119 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.184233 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 16:54:23.187119 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.184276 2565 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 16:54:23.187119 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.184299 2565 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 16:54:23.187119 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:23.184336 2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 16:54:23.187119 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.186645 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:54:23.271185 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.271168 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:54:23.272058 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.272046 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:54:23.272136 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.272071 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:54:23.272136 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.272082 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:54:23.272136 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.272109 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-110.ec2.internal" Jun 11 16:54:23.281845 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.281772 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-110.ec2.internal" Jun 11 16:54:23.281845 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:23.281792 2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-110.ec2.internal\": node \"ip-10-0-130-110.ec2.internal\" not found" Jun 11 16:54:23.284804 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.284778 2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-110.ec2.internal"] Jun 11 16:54:23.284906 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.284850 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:54:23.286165 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.286140 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:54:23.286243 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.286171 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:54:23.286243 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.286187 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:54:23.287320 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.287308 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:54:23.287465 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.287451 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal" Jun 11 16:54:23.287507 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.287480 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:54:23.287945 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.287933 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:54:23.288006 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.287955 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:54:23.288006 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.287953 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:54:23.288006 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.287981 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:54:23.288006 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.287994 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:54:23.288185 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.287965 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:54:23.289992 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.289976 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-110.ec2.internal" Jun 11 16:54:23.290063 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.290001 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:54:23.290630 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.290611 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:54:23.290721 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.290648 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:54:23.290721 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.290663 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:54:23.308156 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:23.308138 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-110.ec2.internal\" not found" Jun 11 16:54:23.312377 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:23.312363 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-110.ec2.internal\" not found" node="ip-10-0-130-110.ec2.internal" Jun 11 16:54:23.313190 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.313172 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/71a28d62884cbcf3e78ebb5653db9e0a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal\" (UID: \"71a28d62884cbcf3e78ebb5653db9e0a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal" Jun 11 16:54:23.313274 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.313197 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71a28d62884cbcf3e78ebb5653db9e0a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal\" (UID: \"71a28d62884cbcf3e78ebb5653db9e0a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal" Jun 11 16:54:23.313274 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.313234 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/52b07f939a17d866fffc845ba62c423b-config\") pod \"kube-apiserver-proxy-ip-10-0-130-110.ec2.internal\" (UID: \"52b07f939a17d866fffc845ba62c423b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-110.ec2.internal" Jun 11 16:54:23.316710 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:23.316694 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-110.ec2.internal\" not found" node="ip-10-0-130-110.ec2.internal" Jun 11 16:54:23.408692 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:23.408664 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-110.ec2.internal\" not found" Jun 11 16:54:23.413403 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.413375 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/52b07f939a17d866fffc845ba62c423b-config\") pod \"kube-apiserver-proxy-ip-10-0-130-110.ec2.internal\" (UID: \"52b07f939a17d866fffc845ba62c423b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-110.ec2.internal" Jun 11 16:54:23.413494 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.413411 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/71a28d62884cbcf3e78ebb5653db9e0a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal\" (UID: \"71a28d62884cbcf3e78ebb5653db9e0a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal" Jun 11 16:54:23.413494 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.413430 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71a28d62884cbcf3e78ebb5653db9e0a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal\" (UID: \"71a28d62884cbcf3e78ebb5653db9e0a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal" Jun 11 16:54:23.413494 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.413484 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/52b07f939a17d866fffc845ba62c423b-config\") pod \"kube-apiserver-proxy-ip-10-0-130-110.ec2.internal\" (UID: \"52b07f939a17d866fffc845ba62c423b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-110.ec2.internal" Jun 11 16:54:23.413594 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.413486 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71a28d62884cbcf3e78ebb5653db9e0a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal\" (UID: \"71a28d62884cbcf3e78ebb5653db9e0a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal" Jun 11 16:54:23.413594 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.413487 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/71a28d62884cbcf3e78ebb5653db9e0a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal\" (UID: \"71a28d62884cbcf3e78ebb5653db9e0a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal" Jun 11 16:54:23.509263 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:23.509225 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-110.ec2.internal\" not found" Jun 11 16:54:23.610010 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:23.609938 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-110.ec2.internal\" not found" Jun 11 16:54:23.617384 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.617362 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal" Jun 11 16:54:23.621412 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:23.621397 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-110.ec2.internal" Jun 11 16:54:23.710737 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:23.710712 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-110.ec2.internal\" not found" Jun 11 16:54:23.811224 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:23.811194 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-110.ec2.internal\" not found" Jun 11 16:54:23.911736 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:23.911669 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-110.ec2.internal\" not found" Jun 11 16:54:24.012143 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:24.012116 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-110.ec2.internal\" not found" Jun 11 16:54:24.045505 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:24.045475 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 16:54:24.045944 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:24.045653 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 16:54:24.072462 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:24.072440 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:54:24.100116 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:24.100082 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71a28d62884cbcf3e78ebb5653db9e0a.slice/crio-359f21ea46b7bcf8d51c33da41134a86f81ac9b35e182c7174f4f7f00d443c93 WatchSource:0}: Error finding container 359f21ea46b7bcf8d51c33da41134a86f81ac9b35e182c7174f4f7f00d443c93: Status 404 returned error can't find the container with id 359f21ea46b7bcf8d51c33da41134a86f81ac9b35e182c7174f4f7f00d443c93 Jun 11 16:54:24.100572 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:24.100553 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52b07f939a17d866fffc845ba62c423b.slice/crio-1e8a619a84dfc8f2f82c9ab96b448fc21a99333cba7d34d3662527ba4d49ad71 WatchSource:0}: Error finding container 1e8a619a84dfc8f2f82c9ab96b448fc21a99333cba7d34d3662527ba4d49ad71: Status 404 returned error can't find the container with id 1e8a619a84dfc8f2f82c9ab96b448fc21a99333cba7d34d3662527ba4d49ad71 Jun 11 16:54:24.105180 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:24.105164 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:54:24.112273 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:24.112254 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-110.ec2.internal\" not found" Jun 11 16:54:24.141706 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:24.141674 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 16:49:23 +0000 UTC" deadline="2028-01-20 08:06:20.033474622 +0000 UTC" Jun 11 16:54:24.141706 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:24.141698 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14103h11m55.891779006s" Jun 11 16:54:24.188243 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:24.188155 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-110.ec2.internal" event={"ID":"52b07f939a17d866fffc845ba62c423b","Type":"ContainerStarted","Data":"1e8a619a84dfc8f2f82c9ab96b448fc21a99333cba7d34d3662527ba4d49ad71"} Jun 11 16:54:24.189197 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:24.189177 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal" event={"ID":"71a28d62884cbcf3e78ebb5653db9e0a","Type":"ContainerStarted","Data":"359f21ea46b7bcf8d51c33da41134a86f81ac9b35e182c7174f4f7f00d443c93"} Jun 11 16:54:24.213336 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:24.213314 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-110.ec2.internal\" not found" Jun 11 16:54:24.301621 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:24.301599 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:54:24.302666 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:24.302651 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:54:24.302719 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:24.302684 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:54:24.302719 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:24.302695 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:54:24.314123 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:24.314106 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-110.ec2.internal\" not found" Jun 11 16:54:24.360605 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:24.360586 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:54:24.414700 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:24.414676 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-110.ec2.internal\" not found" Jun 11 16:54:24.515251 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:24.515167 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-110.ec2.internal\" not found" Jun 11 16:54:24.616009 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:24.615971 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-110.ec2.internal\" not found" Jun 11 16:54:24.648315 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:24.648285 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:54:24.713283 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:24.713252 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal" Jun 11 16:54:24.727644 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:24.727622 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 16:54:24.729254 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:24.729231 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-110.ec2.internal" Jun 11 16:54:24.739764 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:24.739743 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 16:54:25.091083 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.091056 2565 apiserver.go:52] "Watching apiserver" Jun 11 16:54:25.097653 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.097625 2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 16:54:25.100550 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.100515 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhcjl","openshift-cluster-node-tuning-operator/tuned-psjzn","openshift-image-registry/node-ca-h4cjk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal","openshift-multus/multus-vvl2p","openshift-multus/network-metrics-daemon-pdg6r","openshift-network-diagnostics/network-check-target-nmsmp","kube-system/global-pull-secret-syncer-bmvr9","kube-system/konnectivity-agent-pqrvn","kube-system/kube-apiserver-proxy-ip-10-0-130-110.ec2.internal","openshift-dns/node-resolver-mb5bm","openshift-multus/multus-additional-cni-plugins-p2xx8","openshift-network-operator/iptables-alerter-rkd7l","openshift-ovn-kubernetes/ovnkube-node-c7hbj"] Jun 11 16:54:25.101916 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.101898 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rkd7l" Jun 11 16:54:25.102978 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.102958 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.104062 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.104044 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h4cjk" Jun 11 16:54:25.104845 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.104811 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wc74x\"" Jun 11 16:54:25.105169 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.105153 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:54:25.105278 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.105153 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 16:54:25.105339 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.105290 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6vlwf\"" Jun 11 16:54:25.105554 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.105535 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhcjl" Jun 11 16:54:25.105661 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.105629 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 16:54:25.105931 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.105915 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 16:54:25.106067 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.106025 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:54:25.106301 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.106285 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 16:54:25.106391 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.106290 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-z8gtt\"" Jun 11 16:54:25.106391 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.106312 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 16:54:25.106613 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.106596 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 16:54:25.106907 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.106887 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.108050 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.107901 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 16:54:25.108050 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.107916 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 16:54:25.108050 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.107951 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 16:54:25.108050 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:25.107965 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pdg6r" podUID="66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42" Jun 11 16:54:25.108276 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.108160 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 16:54:25.108276 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.108202 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mwqks\"" Jun 11 16:54:25.108961 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.108942 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 16:54:25.109271 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.109089 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmsmp" Jun 11 16:54:25.109271 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:25.109150 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmsmp" podUID="b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3" Jun 11 16:54:25.109271 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.109098 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 16:54:25.109271 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.109205 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 16:54:25.109271 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.109244 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-b6r7d\"" Jun 11 16:54:25.109271 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.109269 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 16:54:25.110143 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.110129 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bmvr9" Jun 11 16:54:25.110223 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:25.110199 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bmvr9" podUID="183fce84-80c4-4c1d-aa51-e962fdd8b887" Jun 11 16:54:25.111279 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.111252 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pqrvn" Jun 11 16:54:25.112328 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.112310 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 16:54:25.112964 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.112946 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.113985 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.113883 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 16:54:25.114092 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.114048 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mb5bm" Jun 11 16:54:25.117730 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.115953 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p2xx8" Jun 11 16:54:25.117730 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.116889 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 16:54:25.117730 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.117267 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jlvtv\"" Jun 11 16:54:25.117730 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.117350 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 16:54:25.117730 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.117530 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 16:54:25.118435 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.118404 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-djn5v\"" Jun 11 16:54:25.118525 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.118442 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 16:54:25.118525 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.118503 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zwj4g\"" Jun 11 16:54:25.118740 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.118629 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 16:54:25.118740 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.118660 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 16:54:25.118740 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.118681 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 16:54:25.118740 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.118693 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 16:54:25.119003 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.118629 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 16:54:25.119003 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.118853 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 16:54:25.119097 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.119014 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-z29md\"" Jun 11 16:54:25.119150 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.119094 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 16:54:25.122896 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.122874 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-host-run-ovn-kubernetes\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.122997 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.122910 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a30425b4-3b27-4ae1-af09-384473269d18-env-overrides\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.122997 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.122934 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a30425b4-3b27-4ae1-af09-384473269d18-ovnkube-script-lib\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.122997 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.122958 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/77e0f958-e3d1-4add-bd6f-86886fd95c20-registration-dir\") pod \"aws-ebs-csi-driver-node-dhcjl\" (UID: \"77e0f958-e3d1-4add-bd6f-86886fd95c20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhcjl" Jun 11 16:54:25.122997 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.122982 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx7zn\" (UniqueName: \"kubernetes.io/projected/77e0f958-e3d1-4add-bd6f-86886fd95c20-kube-api-access-xx7zn\") pod \"aws-ebs-csi-driver-node-dhcjl\" (UID: \"77e0f958-e3d1-4add-bd6f-86886fd95c20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhcjl" Jun 11 16:54:25.123203 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.123007 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-multus-conf-dir\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.123203 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.123066 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e2363293-30cf-42fa-9a2d-45c11e3e85f2-multus-daemon-config\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.123203 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.123102 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9shx5\" (UniqueName: \"kubernetes.io/projected/66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42-kube-api-access-9shx5\") pod \"network-metrics-daemon-pdg6r\" (UID: \"66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42\") " pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 16:54:25.123203 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.123131 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a30425b4-3b27-4ae1-af09-384473269d18-ovnkube-config\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.123203 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.123153 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c3f8f49-e339-44dd-bcd9-860b5904ab31-tmp\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.123203 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.123177 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-multus-socket-dir-parent\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.123203 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.123199 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-hostroot\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.123504 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.123221 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrhxv\" (UniqueName: \"kubernetes.io/projected/e2363293-30cf-42fa-9a2d-45c11e3e85f2-kube-api-access-wrhxv\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.123504 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.123252 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/286b1d27-5581-44ce-b5d6-309dad57b6c9-konnectivity-ca\") pod \"konnectivity-agent-pqrvn\" (UID: \"286b1d27-5581-44ce-b5d6-309dad57b6c9\") " pod="kube-system/konnectivity-agent-pqrvn" Jun 11 16:54:25.123504 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.123297 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-run-systemd\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.123504 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.123327 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-cnibin\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.123504 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.123351 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-host-var-lib-cni-multus\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.123504 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.123374 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-host-slash\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.123504 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.123397 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-etc-openvswitch\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.123504 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.123419 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-run-ovn\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.123504 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.123445 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0c3f8f49-e339-44dd-bcd9-860b5904ab31-etc-modprobe-d\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.123504 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.123481 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c3f8f49-e339-44dd-bcd9-860b5904ab31-sys\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.123940 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.123524 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt68c\" (UniqueName: \"kubernetes.io/projected/0c3f8f49-e339-44dd-bcd9-860b5904ab31-kube-api-access-wt68c\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.123940 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.123577 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-host-kubelet\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.123940 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.123613 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c3f8f49-e339-44dd-bcd9-860b5904ab31-etc-kubernetes\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.123940 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.123636 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0c3f8f49-e339-44dd-bcd9-860b5904ab31-run\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.123940 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.123650 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-os-release\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.123940 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.123671 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e2363293-30cf-42fa-9a2d-45c11e3e85f2-cni-binary-copy\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.123940 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.123692 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-host-var-lib-cni-bin\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.123940 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.123749 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5f24a441-bff5-4a1f-bff7-92b60f4a2394-serviceca\") pod \"node-ca-h4cjk\" (UID: \"5f24a441-bff5-4a1f-bff7-92b60f4a2394\") " pod="openshift-image-registry/node-ca-h4cjk" Jun 11 16:54:25.123940 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.123770 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-var-lib-openvswitch\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.123940 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.123799 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-multus-cni-dir\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.123940 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.123838 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0a87b53-941e-4917-b0a7-8459458b8b25-tmp-dir\") pod \"node-resolver-mb5bm\" (UID: \"b0a87b53-941e-4917-b0a7-8459458b8b25\") " pod="openshift-dns/node-resolver-mb5bm" Jun 11 16:54:25.123940 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.123860 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-run-openvswitch\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.123940 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.123921 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-log-socket\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.124490 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.123961 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/858bb5e3-e1bb-4958-a063-7acb2de52d1b-iptables-alerter-script\") pod \"iptables-alerter-rkd7l\" (UID: \"858bb5e3-e1bb-4958-a063-7acb2de52d1b\") " pod="openshift-network-operator/iptables-alerter-rkd7l" Jun 11 16:54:25.124490 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.123991 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0c3f8f49-e339-44dd-bcd9-860b5904ab31-etc-sysconfig\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.124490 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124022 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/77e0f958-e3d1-4add-bd6f-86886fd95c20-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dhcjl\" (UID: \"77e0f958-e3d1-4add-bd6f-86886fd95c20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhcjl" Jun 11 16:54:25.124490 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124044 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/77e0f958-e3d1-4add-bd6f-86886fd95c20-device-dir\") pod \"aws-ebs-csi-driver-node-dhcjl\" (UID: \"77e0f958-e3d1-4add-bd6f-86886fd95c20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhcjl" Jun 11 16:54:25.124490 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124059 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-system-cni-dir\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.124490 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124082 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-host-run-multus-certs\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.124490 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124104 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/183fce84-80c4-4c1d-aa51-e962fdd8b887-dbus\") pod \"global-pull-secret-syncer-bmvr9\" (UID: \"183fce84-80c4-4c1d-aa51-e962fdd8b887\") " pod="kube-system/global-pull-secret-syncer-bmvr9" Jun 11 16:54:25.124490 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124125 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-host-run-netns\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.124490 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124146 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-host-run-k8s-cni-cncf-io\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.124490 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124167 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-etc-kubernetes\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.124490 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124189 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h2c2\" (UniqueName: \"kubernetes.io/projected/5f24a441-bff5-4a1f-bff7-92b60f4a2394-kube-api-access-4h2c2\") pod \"node-ca-h4cjk\" (UID: \"5f24a441-bff5-4a1f-bff7-92b60f4a2394\") " pod="openshift-image-registry/node-ca-h4cjk" Jun 11 16:54:25.124490 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124210 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a30425b4-3b27-4ae1-af09-384473269d18-ovn-node-metrics-cert\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.124490 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124233 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/858bb5e3-e1bb-4958-a063-7acb2de52d1b-host-slash\") pod \"iptables-alerter-rkd7l\" (UID: \"858bb5e3-e1bb-4958-a063-7acb2de52d1b\") " pod="openshift-network-operator/iptables-alerter-rkd7l" Jun 11 16:54:25.124490 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124252 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0c3f8f49-e339-44dd-bcd9-860b5904ab31-etc-sysctl-conf\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.124490 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124270 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/183fce84-80c4-4c1d-aa51-e962fdd8b887-kubelet-config\") pod \"global-pull-secret-syncer-bmvr9\" (UID: \"183fce84-80c4-4c1d-aa51-e962fdd8b887\") " pod="kube-system/global-pull-secret-syncer-bmvr9" Jun 11 16:54:25.124490 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124293 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/183fce84-80c4-4c1d-aa51-e962fdd8b887-original-pull-secret\") pod \"global-pull-secret-syncer-bmvr9\" (UID: \"183fce84-80c4-4c1d-aa51-e962fdd8b887\") " pod="kube-system/global-pull-secret-syncer-bmvr9" Jun 11 16:54:25.125237 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124329 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0c3f8f49-e339-44dd-bcd9-860b5904ab31-etc-systemd\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.125237 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124351 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0c3f8f49-e339-44dd-bcd9-860b5904ab31-lib-modules\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.125237 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124376 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0c3f8f49-e339-44dd-bcd9-860b5904ab31-host\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.125237 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124397 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-node-log\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.125237 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124434 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-host-cni-netd\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.125237 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124483 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.125237 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124506 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c3f8f49-e339-44dd-bcd9-860b5904ab31-var-lib-kubelet\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.125237 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124529 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjldb\" (UniqueName: \"kubernetes.io/projected/b0a87b53-941e-4917-b0a7-8459458b8b25-kube-api-access-kjldb\") pod \"node-resolver-mb5bm\" (UID: \"b0a87b53-941e-4917-b0a7-8459458b8b25\") " pod="openshift-dns/node-resolver-mb5bm" Jun 11 16:54:25.125237 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124551 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42-metrics-certs\") pod \"network-metrics-daemon-pdg6r\" (UID: \"66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42\") " pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 16:54:25.125237 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124573 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/286b1d27-5581-44ce-b5d6-309dad57b6c9-agent-certs\") pod \"konnectivity-agent-pqrvn\" (UID: \"286b1d27-5581-44ce-b5d6-309dad57b6c9\") " pod="kube-system/konnectivity-agent-pqrvn" Jun 11 16:54:25.125237 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124595 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-host-cni-bin\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.125237 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124618 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0c3f8f49-e339-44dd-bcd9-860b5904ab31-etc-sysctl-d\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.125237 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124644 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/77e0f958-e3d1-4add-bd6f-86886fd95c20-etc-selinux\") pod \"aws-ebs-csi-driver-node-dhcjl\" (UID: \"77e0f958-e3d1-4add-bd6f-86886fd95c20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhcjl" Jun 11 16:54:25.125237 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124667 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-host-var-lib-kubelet\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.125237 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124688 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5f24a441-bff5-4a1f-bff7-92b60f4a2394-host\") pod \"node-ca-h4cjk\" (UID: \"5f24a441-bff5-4a1f-bff7-92b60f4a2394\") " pod="openshift-image-registry/node-ca-h4cjk" Jun 11 16:54:25.125237 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124709 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0c3f8f49-e339-44dd-bcd9-860b5904ab31-etc-tuned\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.126080 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124731 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/77e0f958-e3d1-4add-bd6f-86886fd95c20-socket-dir\") pod \"aws-ebs-csi-driver-node-dhcjl\" (UID: \"77e0f958-e3d1-4add-bd6f-86886fd95c20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhcjl" Jun 11 16:54:25.126080 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124754 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-host-run-netns\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.126080 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124778 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b0a87b53-941e-4917-b0a7-8459458b8b25-hosts-file\") pod \"node-resolver-mb5bm\" (UID: \"b0a87b53-941e-4917-b0a7-8459458b8b25\") " pod="openshift-dns/node-resolver-mb5bm" Jun 11 16:54:25.126080 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124814 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-systemd-units\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.126080 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124864 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp9tc\" (UniqueName: \"kubernetes.io/projected/858bb5e3-e1bb-4958-a063-7acb2de52d1b-kube-api-access-mp9tc\") pod \"iptables-alerter-rkd7l\" (UID: \"858bb5e3-e1bb-4958-a063-7acb2de52d1b\") " pod="openshift-network-operator/iptables-alerter-rkd7l" Jun 11 16:54:25.126080 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124888 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/77e0f958-e3d1-4add-bd6f-86886fd95c20-sys-fs\") pod \"aws-ebs-csi-driver-node-dhcjl\" (UID: \"77e0f958-e3d1-4add-bd6f-86886fd95c20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhcjl" Jun 11 16:54:25.126080 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124933 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57rpw\" (UniqueName: \"kubernetes.io/projected/b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3-kube-api-access-57rpw\") pod \"network-check-target-nmsmp\" (UID: \"b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3\") " pod="openshift-network-diagnostics/network-check-target-nmsmp" Jun 11 16:54:25.126080 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.124988 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx6hb\" (UniqueName: \"kubernetes.io/projected/a30425b4-3b27-4ae1-af09-384473269d18-kube-api-access-rx6hb\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.129917 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.129896 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 16:54:25.156799 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.156775 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hshqz" Jun 11 16:54:25.166696 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.166675 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hshqz" Jun 11 16:54:25.214235 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.214208 2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 16:54:25.225197 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225168 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7c6s\" (UniqueName: \"kubernetes.io/projected/09e3bd81-f153-41cb-90c4-37372e7ebadd-kube-api-access-k7c6s\") pod \"multus-additional-cni-plugins-p2xx8\" (UID: \"09e3bd81-f153-41cb-90c4-37372e7ebadd\") " pod="openshift-multus/multus-additional-cni-plugins-p2xx8" Jun 11 16:54:25.225352 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225205 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-node-log\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.225352 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225221 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-host-cni-netd\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.225352 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225236 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.225352 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225264 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c3f8f49-e339-44dd-bcd9-860b5904ab31-var-lib-kubelet\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.225352 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225287 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-node-log\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.225352 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225293 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-host-cni-netd\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.225352 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225301 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.225352 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225287 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjldb\" (UniqueName: \"kubernetes.io/projected/b0a87b53-941e-4917-b0a7-8459458b8b25-kube-api-access-kjldb\") pod \"node-resolver-mb5bm\" (UID: \"b0a87b53-941e-4917-b0a7-8459458b8b25\") " pod="openshift-dns/node-resolver-mb5bm" Jun 11 16:54:25.225352 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225352 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c3f8f49-e339-44dd-bcd9-860b5904ab31-var-lib-kubelet\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.225352 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225358 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42-metrics-certs\") pod \"network-metrics-daemon-pdg6r\" (UID: \"66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42\") " pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 16:54:25.225905 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225378 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/286b1d27-5581-44ce-b5d6-309dad57b6c9-agent-certs\") pod \"konnectivity-agent-pqrvn\" (UID: \"286b1d27-5581-44ce-b5d6-309dad57b6c9\") " pod="kube-system/konnectivity-agent-pqrvn" Jun 11 16:54:25.225905 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225396 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-host-cni-bin\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.225905 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:25.225441 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:54:25.225905 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225444 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0c3f8f49-e339-44dd-bcd9-860b5904ab31-etc-sysctl-d\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.225905 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:25.225511 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42-metrics-certs podName:66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42 nodeName:}" failed. No retries permitted until 2026-06-11 16:54:25.725490118 +0000 UTC m=+2.985745006 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42-metrics-certs") pod "network-metrics-daemon-pdg6r" (UID: "66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:54:25.225905 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225542 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0c3f8f49-e339-44dd-bcd9-860b5904ab31-etc-sysctl-d\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.225905 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225541 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/77e0f958-e3d1-4add-bd6f-86886fd95c20-etc-selinux\") pod \"aws-ebs-csi-driver-node-dhcjl\" (UID: \"77e0f958-e3d1-4add-bd6f-86886fd95c20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhcjl" Jun 11 16:54:25.225905 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225507 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-host-cni-bin\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.225905 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225570 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-host-var-lib-kubelet\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.225905 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225592 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5f24a441-bff5-4a1f-bff7-92b60f4a2394-host\") pod \"node-ca-h4cjk\" (UID: \"5f24a441-bff5-4a1f-bff7-92b60f4a2394\") " pod="openshift-image-registry/node-ca-h4cjk" Jun 11 16:54:25.225905 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225609 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09e3bd81-f153-41cb-90c4-37372e7ebadd-system-cni-dir\") pod \"multus-additional-cni-plugins-p2xx8\" (UID: \"09e3bd81-f153-41cb-90c4-37372e7ebadd\") " pod="openshift-multus/multus-additional-cni-plugins-p2xx8" Jun 11 16:54:25.225905 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225618 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-host-var-lib-kubelet\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.225905 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225626 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0c3f8f49-e339-44dd-bcd9-860b5904ab31-etc-tuned\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.225905 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225628 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/77e0f958-e3d1-4add-bd6f-86886fd95c20-etc-selinux\") pod \"aws-ebs-csi-driver-node-dhcjl\" (UID: \"77e0f958-e3d1-4add-bd6f-86886fd95c20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhcjl" Jun 11 16:54:25.225905 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225658 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/77e0f958-e3d1-4add-bd6f-86886fd95c20-socket-dir\") pod \"aws-ebs-csi-driver-node-dhcjl\" (UID: \"77e0f958-e3d1-4add-bd6f-86886fd95c20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhcjl" Jun 11 16:54:25.225905 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225661 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5f24a441-bff5-4a1f-bff7-92b60f4a2394-host\") pod \"node-ca-h4cjk\" (UID: \"5f24a441-bff5-4a1f-bff7-92b60f4a2394\") " pod="openshift-image-registry/node-ca-h4cjk" Jun 11 16:54:25.225905 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225690 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-host-run-netns\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.226678 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225722 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b0a87b53-941e-4917-b0a7-8459458b8b25-hosts-file\") pod \"node-resolver-mb5bm\" (UID: \"b0a87b53-941e-4917-b0a7-8459458b8b25\") " pod="openshift-dns/node-resolver-mb5bm" Jun 11 16:54:25.226678 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225749 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/77e0f958-e3d1-4add-bd6f-86886fd95c20-socket-dir\") pod \"aws-ebs-csi-driver-node-dhcjl\" (UID: \"77e0f958-e3d1-4add-bd6f-86886fd95c20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhcjl" Jun 11 16:54:25.226678 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225750 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/09e3bd81-f153-41cb-90c4-37372e7ebadd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p2xx8\" (UID: \"09e3bd81-f153-41cb-90c4-37372e7ebadd\") " pod="openshift-multus/multus-additional-cni-plugins-p2xx8" Jun 11 16:54:25.226678 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225758 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-host-run-netns\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.226678 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225778 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-systemd-units\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.226678 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225799 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp9tc\" (UniqueName: \"kubernetes.io/projected/858bb5e3-e1bb-4958-a063-7acb2de52d1b-kube-api-access-mp9tc\") pod \"iptables-alerter-rkd7l\" (UID: \"858bb5e3-e1bb-4958-a063-7acb2de52d1b\") " pod="openshift-network-operator/iptables-alerter-rkd7l" Jun 11 16:54:25.226678 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225810 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-systemd-units\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.226678 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225838 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/77e0f958-e3d1-4add-bd6f-86886fd95c20-sys-fs\") pod \"aws-ebs-csi-driver-node-dhcjl\" (UID: \"77e0f958-e3d1-4add-bd6f-86886fd95c20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhcjl" Jun 11 16:54:25.226678 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225860 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57rpw\" (UniqueName: \"kubernetes.io/projected/b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3-kube-api-access-57rpw\") pod \"network-check-target-nmsmp\" (UID: \"b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3\") " pod="openshift-network-diagnostics/network-check-target-nmsmp" Jun 11 16:54:25.226678 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225878 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/77e0f958-e3d1-4add-bd6f-86886fd95c20-sys-fs\") pod \"aws-ebs-csi-driver-node-dhcjl\" (UID: \"77e0f958-e3d1-4add-bd6f-86886fd95c20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhcjl" Jun 11 16:54:25.226678 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225881 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx6hb\" (UniqueName: \"kubernetes.io/projected/a30425b4-3b27-4ae1-af09-384473269d18-kube-api-access-rx6hb\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.226678 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225911 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-host-run-ovn-kubernetes\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.226678 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225935 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a30425b4-3b27-4ae1-af09-384473269d18-env-overrides\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.226678 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225959 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a30425b4-3b27-4ae1-af09-384473269d18-ovnkube-script-lib\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.226678 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225802 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b0a87b53-941e-4917-b0a7-8459458b8b25-hosts-file\") pod \"node-resolver-mb5bm\" (UID: \"b0a87b53-941e-4917-b0a7-8459458b8b25\") " pod="openshift-dns/node-resolver-mb5bm" Jun 11 16:54:25.226678 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.226135 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 16:54:25.226678 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.226234 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-host-run-ovn-kubernetes\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.227402 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.226377 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/77e0f958-e3d1-4add-bd6f-86886fd95c20-registration-dir\") pod \"aws-ebs-csi-driver-node-dhcjl\" (UID: \"77e0f958-e3d1-4add-bd6f-86886fd95c20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhcjl" Jun 11 16:54:25.227402 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.225980 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/77e0f958-e3d1-4add-bd6f-86886fd95c20-registration-dir\") pod \"aws-ebs-csi-driver-node-dhcjl\" (UID: \"77e0f958-e3d1-4add-bd6f-86886fd95c20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhcjl" Jun 11 16:54:25.227402 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.226468 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx7zn\" (UniqueName: \"kubernetes.io/projected/77e0f958-e3d1-4add-bd6f-86886fd95c20-kube-api-access-xx7zn\") pod \"aws-ebs-csi-driver-node-dhcjl\" (UID: \"77e0f958-e3d1-4add-bd6f-86886fd95c20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhcjl" Jun 11 16:54:25.227402 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.226513 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-multus-conf-dir\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.227402 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.226538 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e2363293-30cf-42fa-9a2d-45c11e3e85f2-multus-daemon-config\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.227402 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.226561 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9shx5\" (UniqueName: \"kubernetes.io/projected/66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42-kube-api-access-9shx5\") pod \"network-metrics-daemon-pdg6r\" (UID: \"66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42\") " pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 16:54:25.227402 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.226585 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a30425b4-3b27-4ae1-af09-384473269d18-ovnkube-config\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.227402 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.226607 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c3f8f49-e339-44dd-bcd9-860b5904ab31-tmp\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.227402 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.226676 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-multus-socket-dir-parent\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.227402 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.226711 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-hostroot\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.227402 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.226763 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrhxv\" (UniqueName: \"kubernetes.io/projected/e2363293-30cf-42fa-9a2d-45c11e3e85f2-kube-api-access-wrhxv\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.227402 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.226787 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/286b1d27-5581-44ce-b5d6-309dad57b6c9-konnectivity-ca\") pod \"konnectivity-agent-pqrvn\" (UID: \"286b1d27-5581-44ce-b5d6-309dad57b6c9\") " pod="kube-system/konnectivity-agent-pqrvn" Jun 11 16:54:25.227402 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.226799 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a30425b4-3b27-4ae1-af09-384473269d18-env-overrides\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.227402 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.226809 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-run-systemd\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.227402 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.226847 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-cnibin\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.227402 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.226869 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-host-var-lib-cni-multus\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.227402 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.226911 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/09e3bd81-f153-41cb-90c4-37372e7ebadd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p2xx8\" (UID: \"09e3bd81-f153-41cb-90c4-37372e7ebadd\") " pod="openshift-multus/multus-additional-cni-plugins-p2xx8" Jun 11 16:54:25.228236 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.226916 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a30425b4-3b27-4ae1-af09-384473269d18-ovnkube-script-lib\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.228236 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.226920 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-multus-socket-dir-parent\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.228236 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.226935 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-host-slash\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.228236 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.226972 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-etc-openvswitch\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.228236 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.226954 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-multus-conf-dir\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.228236 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.226996 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-run-ovn\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.228236 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.227019 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0c3f8f49-e339-44dd-bcd9-860b5904ab31-etc-modprobe-d\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.228236 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.227043 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-hostroot\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.228236 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.227068 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c3f8f49-e339-44dd-bcd9-860b5904ab31-sys\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.228236 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.227109 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt68c\" (UniqueName: \"kubernetes.io/projected/0c3f8f49-e339-44dd-bcd9-860b5904ab31-kube-api-access-wt68c\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.228236 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.227194 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/09e3bd81-f153-41cb-90c4-37372e7ebadd-cnibin\") pod \"multus-additional-cni-plugins-p2xx8\" (UID: \"09e3bd81-f153-41cb-90c4-37372e7ebadd\") " pod="openshift-multus/multus-additional-cni-plugins-p2xx8" Jun 11 16:54:25.228236 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.227254 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-host-kubelet\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.228236 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.227279 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c3f8f49-e339-44dd-bcd9-860b5904ab31-etc-kubernetes\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.228236 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.227300 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0c3f8f49-e339-44dd-bcd9-860b5904ab31-run\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.228948 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.228338 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e2363293-30cf-42fa-9a2d-45c11e3e85f2-multus-daemon-config\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.228948 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.228644 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/286b1d27-5581-44ce-b5d6-309dad57b6c9-konnectivity-ca\") pod \"konnectivity-agent-pqrvn\" (UID: \"286b1d27-5581-44ce-b5d6-309dad57b6c9\") " pod="kube-system/konnectivity-agent-pqrvn" Jun 11 16:54:25.228948 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.228843 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-os-release\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.228948 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.228885 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e2363293-30cf-42fa-9a2d-45c11e3e85f2-cni-binary-copy\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.228948 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.228912 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-host-var-lib-cni-bin\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.228948 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.228943 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5f24a441-bff5-4a1f-bff7-92b60f4a2394-serviceca\") pod \"node-ca-h4cjk\" (UID: \"5f24a441-bff5-4a1f-bff7-92b60f4a2394\") " pod="openshift-image-registry/node-ca-h4cjk" Jun 11 16:54:25.229257 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.228973 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-var-lib-openvswitch\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.229257 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.229009 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-multus-cni-dir\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.229257 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.229040 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0a87b53-941e-4917-b0a7-8459458b8b25-tmp-dir\") pod \"node-resolver-mb5bm\" (UID: \"b0a87b53-941e-4917-b0a7-8459458b8b25\") " pod="openshift-dns/node-resolver-mb5bm" Jun 11 16:54:25.229257 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.229083 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/09e3bd81-f153-41cb-90c4-37372e7ebadd-os-release\") pod \"multus-additional-cni-plugins-p2xx8\" (UID: \"09e3bd81-f153-41cb-90c4-37372e7ebadd\") " pod="openshift-multus/multus-additional-cni-plugins-p2xx8" Jun 11 16:54:25.229257 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.229113 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-run-openvswitch\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.229257 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.229143 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-log-socket\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.229257 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.229173 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/858bb5e3-e1bb-4958-a063-7acb2de52d1b-iptables-alerter-script\") pod \"iptables-alerter-rkd7l\" (UID: \"858bb5e3-e1bb-4958-a063-7acb2de52d1b\") " pod="openshift-network-operator/iptables-alerter-rkd7l" Jun 11 16:54:25.229257 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.229205 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0c3f8f49-e339-44dd-bcd9-860b5904ab31-etc-sysconfig\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.229257 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.229237 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/77e0f958-e3d1-4add-bd6f-86886fd95c20-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dhcjl\" (UID: \"77e0f958-e3d1-4add-bd6f-86886fd95c20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhcjl" Jun 11 16:54:25.229667 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.229262 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/77e0f958-e3d1-4add-bd6f-86886fd95c20-device-dir\") pod \"aws-ebs-csi-driver-node-dhcjl\" (UID: \"77e0f958-e3d1-4add-bd6f-86886fd95c20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhcjl" Jun 11 16:54:25.229667 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.229292 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-system-cni-dir\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.229667 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.229329 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-host-run-multus-certs\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.229667 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.229371 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/183fce84-80c4-4c1d-aa51-e962fdd8b887-dbus\") pod \"global-pull-secret-syncer-bmvr9\" (UID: \"183fce84-80c4-4c1d-aa51-e962fdd8b887\") " pod="kube-system/global-pull-secret-syncer-bmvr9" Jun 11 16:54:25.229667 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.229402 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-host-run-netns\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.229667 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.229428 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-host-run-k8s-cni-cncf-io\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.229667 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.229462 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-etc-kubernetes\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.229667 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.229491 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h2c2\" (UniqueName: \"kubernetes.io/projected/5f24a441-bff5-4a1f-bff7-92b60f4a2394-kube-api-access-4h2c2\") pod \"node-ca-h4cjk\" (UID: \"5f24a441-bff5-4a1f-bff7-92b60f4a2394\") " pod="openshift-image-registry/node-ca-h4cjk" Jun 11 16:54:25.229667 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.229523 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/09e3bd81-f153-41cb-90c4-37372e7ebadd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p2xx8\" (UID: \"09e3bd81-f153-41cb-90c4-37372e7ebadd\") " pod="openshift-multus/multus-additional-cni-plugins-p2xx8" Jun 11 16:54:25.229667 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.229550 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a30425b4-3b27-4ae1-af09-384473269d18-ovn-node-metrics-cert\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.229667 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.229580 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/858bb5e3-e1bb-4958-a063-7acb2de52d1b-host-slash\") pod \"iptables-alerter-rkd7l\" (UID: \"858bb5e3-e1bb-4958-a063-7acb2de52d1b\") " pod="openshift-network-operator/iptables-alerter-rkd7l" Jun 11 16:54:25.229667 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.229608 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0c3f8f49-e339-44dd-bcd9-860b5904ab31-etc-sysctl-conf\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.229667 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.229639 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/183fce84-80c4-4c1d-aa51-e962fdd8b887-kubelet-config\") pod \"global-pull-secret-syncer-bmvr9\" (UID: \"183fce84-80c4-4c1d-aa51-e962fdd8b887\") " pod="kube-system/global-pull-secret-syncer-bmvr9" Jun 11 16:54:25.229667 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.229669 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/183fce84-80c4-4c1d-aa51-e962fdd8b887-original-pull-secret\") pod \"global-pull-secret-syncer-bmvr9\" (UID: \"183fce84-80c4-4c1d-aa51-e962fdd8b887\") " pod="kube-system/global-pull-secret-syncer-bmvr9" Jun 11 16:54:25.230300 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.229695 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0c3f8f49-e339-44dd-bcd9-860b5904ab31-etc-systemd\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.230300 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.229723 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0c3f8f49-e339-44dd-bcd9-860b5904ab31-lib-modules\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.230300 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.229752 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0c3f8f49-e339-44dd-bcd9-860b5904ab31-host\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.230300 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.229815 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0c3f8f49-e339-44dd-bcd9-860b5904ab31-host\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.230300 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.229814 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-run-systemd\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.230300 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.229912 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-host-var-lib-cni-bin\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.230300 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.229956 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/09e3bd81-f153-41cb-90c4-37372e7ebadd-cni-binary-copy\") pod \"multus-additional-cni-plugins-p2xx8\" (UID: \"09e3bd81-f153-41cb-90c4-37372e7ebadd\") " pod="openshift-multus/multus-additional-cni-plugins-p2xx8" Jun 11 16:54:25.230300 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.230107 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c3f8f49-e339-44dd-bcd9-860b5904ab31-tmp\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.230670 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.230305 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5f24a441-bff5-4a1f-bff7-92b60f4a2394-serviceca\") pod \"node-ca-h4cjk\" (UID: \"5f24a441-bff5-4a1f-bff7-92b60f4a2394\") " pod="openshift-image-registry/node-ca-h4cjk" Jun 11 16:54:25.230670 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.230340 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0c3f8f49-e339-44dd-bcd9-860b5904ab31-etc-modprobe-d\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.230670 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.230327 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/286b1d27-5581-44ce-b5d6-309dad57b6c9-agent-certs\") pod \"konnectivity-agent-pqrvn\" (UID: \"286b1d27-5581-44ce-b5d6-309dad57b6c9\") " pod="kube-system/konnectivity-agent-pqrvn" Jun 11 16:54:25.230670 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.230381 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-var-lib-openvswitch\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.230670 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.230403 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-host-var-lib-cni-multus\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.230670 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.230475 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-host-slash\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.230670 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.230500 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-multus-cni-dir\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.230670 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.230516 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e2363293-30cf-42fa-9a2d-45c11e3e85f2-cni-binary-copy\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.230670 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.230539 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-etc-openvswitch\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.230670 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.230567 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c3f8f49-e339-44dd-bcd9-860b5904ab31-sys\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.231191 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.230691 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-etc-kubernetes\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.231191 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.230721 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0c3f8f49-e339-44dd-bcd9-860b5904ab31-etc-sysconfig\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.231191 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.230760 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/183fce84-80c4-4c1d-aa51-e962fdd8b887-kubelet-config\") pod \"global-pull-secret-syncer-bmvr9\" (UID: \"183fce84-80c4-4c1d-aa51-e962fdd8b887\") " pod="kube-system/global-pull-secret-syncer-bmvr9" Jun 11 16:54:25.231191 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.230802 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/77e0f958-e3d1-4add-bd6f-86886fd95c20-device-dir\") pod \"aws-ebs-csi-driver-node-dhcjl\" (UID: \"77e0f958-e3d1-4add-bd6f-86886fd95c20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhcjl" Jun 11 16:54:25.231191 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.230879 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-system-cni-dir\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.231191 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.230903 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0c3f8f49-e339-44dd-bcd9-860b5904ab31-etc-sysctl-conf\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.231191 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.230992 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/183fce84-80c4-4c1d-aa51-e962fdd8b887-dbus\") pod \"global-pull-secret-syncer-bmvr9\" (UID: \"183fce84-80c4-4c1d-aa51-e962fdd8b887\") " pod="kube-system/global-pull-secret-syncer-bmvr9" Jun 11 16:54:25.231191 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.231009 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0c3f8f49-e339-44dd-bcd9-860b5904ab31-etc-systemd\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.231191 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.231074 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-cnibin\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.231191 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.231094 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-log-socket\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.231191 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.231125 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c3f8f49-e339-44dd-bcd9-860b5904ab31-etc-kubernetes\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.231191 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.231177 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-run-ovn\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.231787 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.231381 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0a87b53-941e-4917-b0a7-8459458b8b25-tmp-dir\") pod \"node-resolver-mb5bm\" (UID: \"b0a87b53-941e-4917-b0a7-8459458b8b25\") " pod="openshift-dns/node-resolver-mb5bm" Jun 11 16:54:25.231787 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:25.231443 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:54:25.231787 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.231489 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0c3f8f49-e339-44dd-bcd9-860b5904ab31-run\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.231787 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:25.231501 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/183fce84-80c4-4c1d-aa51-e962fdd8b887-original-pull-secret podName:183fce84-80c4-4c1d-aa51-e962fdd8b887 nodeName:}" failed. No retries permitted until 2026-06-11 16:54:25.731484136 +0000 UTC m=+2.991739041 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/183fce84-80c4-4c1d-aa51-e962fdd8b887-original-pull-secret") pod "global-pull-secret-syncer-bmvr9" (UID: "183fce84-80c4-4c1d-aa51-e962fdd8b887") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:54:25.231787 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.231553 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/858bb5e3-e1bb-4958-a063-7acb2de52d1b-host-slash\") pod \"iptables-alerter-rkd7l\" (UID: \"858bb5e3-e1bb-4958-a063-7acb2de52d1b\") " pod="openshift-network-operator/iptables-alerter-rkd7l" Jun 11 16:54:25.231787 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.231592 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-host-run-multus-certs\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.231787 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.231646 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-host-run-netns\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.231787 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.231675 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a30425b4-3b27-4ae1-af09-384473269d18-ovnkube-config\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.231787 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.231735 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/77e0f958-e3d1-4add-bd6f-86886fd95c20-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dhcjl\" (UID: \"77e0f958-e3d1-4add-bd6f-86886fd95c20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhcjl" Jun 11 16:54:25.232247 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.231802 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-host-run-k8s-cni-cncf-io\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.232247 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.231977 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0c3f8f49-e339-44dd-bcd9-860b5904ab31-lib-modules\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.232247 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.232053 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/858bb5e3-e1bb-4958-a063-7acb2de52d1b-iptables-alerter-script\") pod \"iptables-alerter-rkd7l\" (UID: \"858bb5e3-e1bb-4958-a063-7acb2de52d1b\") " pod="openshift-network-operator/iptables-alerter-rkd7l" Jun 11 16:54:25.232247 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.232161 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-host-kubelet\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.232443 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.232286 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0c3f8f49-e339-44dd-bcd9-860b5904ab31-etc-tuned\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.232443 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.232394 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e2363293-30cf-42fa-9a2d-45c11e3e85f2-os-release\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.234123 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.233888 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a30425b4-3b27-4ae1-af09-384473269d18-run-openvswitch\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.234123 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.233963 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a30425b4-3b27-4ae1-af09-384473269d18-ovn-node-metrics-cert\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.236275 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:25.236254 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:54:25.236393 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:25.236282 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:54:25.236393 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:25.236296 2565 projected.go:196] Error preparing data for projected volume kube-api-access-57rpw for pod openshift-network-diagnostics/network-check-target-nmsmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:54:25.236393 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:25.236365 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3-kube-api-access-57rpw podName:b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3 nodeName:}" failed. No retries permitted until 2026-06-11 16:54:25.736347897 +0000 UTC m=+2.996602803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-57rpw" (UniqueName: "kubernetes.io/projected/b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3-kube-api-access-57rpw") pod "network-check-target-nmsmp" (UID: "b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:54:25.237006 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.236920 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjldb\" (UniqueName: \"kubernetes.io/projected/b0a87b53-941e-4917-b0a7-8459458b8b25-kube-api-access-kjldb\") pod \"node-resolver-mb5bm\" (UID: \"b0a87b53-941e-4917-b0a7-8459458b8b25\") " pod="openshift-dns/node-resolver-mb5bm" Jun 11 16:54:25.238051 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.238015 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9shx5\" (UniqueName: \"kubernetes.io/projected/66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42-kube-api-access-9shx5\") pod \"network-metrics-daemon-pdg6r\" (UID: \"66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42\") " pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 16:54:25.238504 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.238483 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx6hb\" (UniqueName: \"kubernetes.io/projected/a30425b4-3b27-4ae1-af09-384473269d18-kube-api-access-rx6hb\") pod \"ovnkube-node-c7hbj\" (UID: \"a30425b4-3b27-4ae1-af09-384473269d18\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.238632 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.238615 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp9tc\" (UniqueName: \"kubernetes.io/projected/858bb5e3-e1bb-4958-a063-7acb2de52d1b-kube-api-access-mp9tc\") pod \"iptables-alerter-rkd7l\" (UID: \"858bb5e3-e1bb-4958-a063-7acb2de52d1b\") " pod="openshift-network-operator/iptables-alerter-rkd7l" Jun 11 16:54:25.242103 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.242063 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx7zn\" (UniqueName: \"kubernetes.io/projected/77e0f958-e3d1-4add-bd6f-86886fd95c20-kube-api-access-xx7zn\") pod \"aws-ebs-csi-driver-node-dhcjl\" (UID: \"77e0f958-e3d1-4add-bd6f-86886fd95c20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhcjl" Jun 11 16:54:25.243106 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.243084 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt68c\" (UniqueName: \"kubernetes.io/projected/0c3f8f49-e339-44dd-bcd9-860b5904ab31-kube-api-access-wt68c\") pod \"tuned-psjzn\" (UID: \"0c3f8f49-e339-44dd-bcd9-860b5904ab31\") " pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.243552 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.243532 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h2c2\" (UniqueName: \"kubernetes.io/projected/5f24a441-bff5-4a1f-bff7-92b60f4a2394-kube-api-access-4h2c2\") pod \"node-ca-h4cjk\" (UID: \"5f24a441-bff5-4a1f-bff7-92b60f4a2394\") " pod="openshift-image-registry/node-ca-h4cjk" Jun 11 16:54:25.244146 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.244122 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrhxv\" (UniqueName: \"kubernetes.io/projected/e2363293-30cf-42fa-9a2d-45c11e3e85f2-kube-api-access-wrhxv\") pod \"multus-vvl2p\" (UID: \"e2363293-30cf-42fa-9a2d-45c11e3e85f2\") " pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.331079 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.331043 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/09e3bd81-f153-41cb-90c4-37372e7ebadd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p2xx8\" (UID: \"09e3bd81-f153-41cb-90c4-37372e7ebadd\") " pod="openshift-multus/multus-additional-cni-plugins-p2xx8" Jun 11 16:54:25.331253 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.331105 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/09e3bd81-f153-41cb-90c4-37372e7ebadd-cni-binary-copy\") pod \"multus-additional-cni-plugins-p2xx8\" (UID: \"09e3bd81-f153-41cb-90c4-37372e7ebadd\") " pod="openshift-multus/multus-additional-cni-plugins-p2xx8" Jun 11 16:54:25.331253 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.331130 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7c6s\" (UniqueName: \"kubernetes.io/projected/09e3bd81-f153-41cb-90c4-37372e7ebadd-kube-api-access-k7c6s\") pod \"multus-additional-cni-plugins-p2xx8\" (UID: \"09e3bd81-f153-41cb-90c4-37372e7ebadd\") " pod="openshift-multus/multus-additional-cni-plugins-p2xx8" Jun 11 16:54:25.331253 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.331173 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09e3bd81-f153-41cb-90c4-37372e7ebadd-system-cni-dir\") pod \"multus-additional-cni-plugins-p2xx8\" (UID: \"09e3bd81-f153-41cb-90c4-37372e7ebadd\") " pod="openshift-multus/multus-additional-cni-plugins-p2xx8" Jun 11 16:54:25.331253 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.331198 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/09e3bd81-f153-41cb-90c4-37372e7ebadd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p2xx8\" (UID: \"09e3bd81-f153-41cb-90c4-37372e7ebadd\") " pod="openshift-multus/multus-additional-cni-plugins-p2xx8" Jun 11 16:54:25.331253 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.331246 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/09e3bd81-f153-41cb-90c4-37372e7ebadd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p2xx8\" (UID: \"09e3bd81-f153-41cb-90c4-37372e7ebadd\") " pod="openshift-multus/multus-additional-cni-plugins-p2xx8" Jun 11 16:54:25.331503 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.331273 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/09e3bd81-f153-41cb-90c4-37372e7ebadd-cnibin\") pod \"multus-additional-cni-plugins-p2xx8\" (UID: \"09e3bd81-f153-41cb-90c4-37372e7ebadd\") " pod="openshift-multus/multus-additional-cni-plugins-p2xx8" Jun 11 16:54:25.331503 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.331301 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/09e3bd81-f153-41cb-90c4-37372e7ebadd-os-release\") pod \"multus-additional-cni-plugins-p2xx8\" (UID: \"09e3bd81-f153-41cb-90c4-37372e7ebadd\") " pod="openshift-multus/multus-additional-cni-plugins-p2xx8" Jun 11 16:54:25.331503 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.331306 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09e3bd81-f153-41cb-90c4-37372e7ebadd-system-cni-dir\") pod \"multus-additional-cni-plugins-p2xx8\" (UID: \"09e3bd81-f153-41cb-90c4-37372e7ebadd\") " pod="openshift-multus/multus-additional-cni-plugins-p2xx8" Jun 11 16:54:25.331503 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.331373 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/09e3bd81-f153-41cb-90c4-37372e7ebadd-cnibin\") pod \"multus-additional-cni-plugins-p2xx8\" (UID: \"09e3bd81-f153-41cb-90c4-37372e7ebadd\") " pod="openshift-multus/multus-additional-cni-plugins-p2xx8" Jun 11 16:54:25.331503 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.331383 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/09e3bd81-f153-41cb-90c4-37372e7ebadd-os-release\") pod \"multus-additional-cni-plugins-p2xx8\" (UID: \"09e3bd81-f153-41cb-90c4-37372e7ebadd\") " pod="openshift-multus/multus-additional-cni-plugins-p2xx8" Jun 11 16:54:25.331503 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.331410 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/09e3bd81-f153-41cb-90c4-37372e7ebadd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p2xx8\" (UID: \"09e3bd81-f153-41cb-90c4-37372e7ebadd\") " pod="openshift-multus/multus-additional-cni-plugins-p2xx8" Jun 11 16:54:25.331786 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.331726 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/09e3bd81-f153-41cb-90c4-37372e7ebadd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p2xx8\" (UID: \"09e3bd81-f153-41cb-90c4-37372e7ebadd\") " pod="openshift-multus/multus-additional-cni-plugins-p2xx8" Jun 11 16:54:25.331904 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.331886 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/09e3bd81-f153-41cb-90c4-37372e7ebadd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p2xx8\" (UID: \"09e3bd81-f153-41cb-90c4-37372e7ebadd\") " pod="openshift-multus/multus-additional-cni-plugins-p2xx8" Jun 11 16:54:25.331955 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.331926 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/09e3bd81-f153-41cb-90c4-37372e7ebadd-cni-binary-copy\") pod \"multus-additional-cni-plugins-p2xx8\" (UID: \"09e3bd81-f153-41cb-90c4-37372e7ebadd\") " pod="openshift-multus/multus-additional-cni-plugins-p2xx8" Jun 11 16:54:25.340657 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.340633 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7c6s\" (UniqueName: \"kubernetes.io/projected/09e3bd81-f153-41cb-90c4-37372e7ebadd-kube-api-access-k7c6s\") pod \"multus-additional-cni-plugins-p2xx8\" (UID: \"09e3bd81-f153-41cb-90c4-37372e7ebadd\") " pod="openshift-multus/multus-additional-cni-plugins-p2xx8" Jun 11 16:54:25.416249 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.416156 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rkd7l" Jun 11 16:54:25.422785 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.422761 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-psjzn" Jun 11 16:54:25.430361 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.430338 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h4cjk" Jun 11 16:54:25.437124 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.437103 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhcjl" Jun 11 16:54:25.443788 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.443770 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vvl2p" Jun 11 16:54:25.451392 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.451374 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pqrvn" Jun 11 16:54:25.458967 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.458952 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:25.465625 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.465607 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mb5bm" Jun 11 16:54:25.472151 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.472136 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p2xx8" Jun 11 16:54:25.498268 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.498245 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:54:25.734194 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.734118 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/183fce84-80c4-4c1d-aa51-e962fdd8b887-original-pull-secret\") pod \"global-pull-secret-syncer-bmvr9\" (UID: \"183fce84-80c4-4c1d-aa51-e962fdd8b887\") " pod="kube-system/global-pull-secret-syncer-bmvr9" Jun 11 16:54:25.734194 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.734160 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42-metrics-certs\") pod \"network-metrics-daemon-pdg6r\" (UID: \"66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42\") " pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 16:54:25.734371 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:25.734273 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:54:25.734371 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:25.734332 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/183fce84-80c4-4c1d-aa51-e962fdd8b887-original-pull-secret podName:183fce84-80c4-4c1d-aa51-e962fdd8b887 nodeName:}" failed. No retries permitted until 2026-06-11 16:54:26.7343178 +0000 UTC m=+3.994572689 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/183fce84-80c4-4c1d-aa51-e962fdd8b887-original-pull-secret") pod "global-pull-secret-syncer-bmvr9" (UID: "183fce84-80c4-4c1d-aa51-e962fdd8b887") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:54:25.734472 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:25.734273 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:54:25.734472 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:25.734449 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42-metrics-certs podName:66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42 nodeName:}" failed. No retries permitted until 2026-06-11 16:54:26.734424855 +0000 UTC m=+3.994679756 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42-metrics-certs") pod "network-metrics-daemon-pdg6r" (UID: "66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:54:25.835419 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:25.835387 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57rpw\" (UniqueName: \"kubernetes.io/projected/b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3-kube-api-access-57rpw\") pod \"network-check-target-nmsmp\" (UID: \"b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3\") " pod="openshift-network-diagnostics/network-check-target-nmsmp" Jun 11 16:54:25.835591 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:25.835569 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:54:25.835679 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:25.835600 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:54:25.837115 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:25.836444 2565 projected.go:196] Error preparing data for projected volume kube-api-access-57rpw for pod openshift-network-diagnostics/network-check-target-nmsmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:54:25.837115 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:25.836535 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3-kube-api-access-57rpw podName:b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3 nodeName:}" failed. No retries permitted until 2026-06-11 16:54:26.836514928 +0000 UTC m=+4.096769825 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-57rpw" (UniqueName: "kubernetes.io/projected/b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3-kube-api-access-57rpw") pod "network-check-target-nmsmp" (UID: "b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:54:25.865736 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:25.865446 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09e3bd81_f153_41cb_90c4_37372e7ebadd.slice/crio-0e1f44a4146a18e6041ec2c1470463c0bd27b23cf055f9589b8685b48d7fd475 WatchSource:0}: Error finding container 0e1f44a4146a18e6041ec2c1470463c0bd27b23cf055f9589b8685b48d7fd475: Status 404 returned error can't find the container with id 0e1f44a4146a18e6041ec2c1470463c0bd27b23cf055f9589b8685b48d7fd475 Jun 11 16:54:25.867414 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:25.867381 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2363293_30cf_42fa_9a2d_45c11e3e85f2.slice/crio-52bbf61e07b356a10b76a02d2d9409b30f3349bdd558c9d7dfaf0b78cde82c63 WatchSource:0}: Error finding container 52bbf61e07b356a10b76a02d2d9409b30f3349bdd558c9d7dfaf0b78cde82c63: Status 404 returned error can't find the container with id 52bbf61e07b356a10b76a02d2d9409b30f3349bdd558c9d7dfaf0b78cde82c63 Jun 11 16:54:25.868065 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:25.868043 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c3f8f49_e339_44dd_bcd9_860b5904ab31.slice/crio-b799df76e795ae1939b2985fe9385f2eae6b60aa2f5543f18f7ba1677918c6dd WatchSource:0}: Error finding container b799df76e795ae1939b2985fe9385f2eae6b60aa2f5543f18f7ba1677918c6dd: Status 404 returned error can't find the container with id b799df76e795ae1939b2985fe9385f2eae6b60aa2f5543f18f7ba1677918c6dd Jun 11 16:54:25.868994 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:25.868917 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0a87b53_941e_4917_b0a7_8459458b8b25.slice/crio-7e435c38bd382bc44cd1759651cae12aae34315181c3f974ed411cc95b1d1870 WatchSource:0}: Error finding container 7e435c38bd382bc44cd1759651cae12aae34315181c3f974ed411cc95b1d1870: Status 404 returned error can't find the container with id 7e435c38bd382bc44cd1759651cae12aae34315181c3f974ed411cc95b1d1870 Jun 11 16:54:25.871303 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:25.871284 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda30425b4_3b27_4ae1_af09_384473269d18.slice/crio-3e50792dea3856b9158d7c1077aa8b4597b2386327bf9b0a0a1f07c6adc3d329 WatchSource:0}: Error finding container 3e50792dea3856b9158d7c1077aa8b4597b2386327bf9b0a0a1f07c6adc3d329: Status 404 returned error can't find the container with id 3e50792dea3856b9158d7c1077aa8b4597b2386327bf9b0a0a1f07c6adc3d329 Jun 11 16:54:25.872787 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:25.872710 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f24a441_bff5_4a1f_bff7_92b60f4a2394.slice/crio-7d0c02dc1d9d6b90d140cc0490efd13f65f9919410dedd8323ebbd92d8b56d85 WatchSource:0}: Error finding container 7d0c02dc1d9d6b90d140cc0490efd13f65f9919410dedd8323ebbd92d8b56d85: Status 404 returned error can't find the container with id 7d0c02dc1d9d6b90d140cc0490efd13f65f9919410dedd8323ebbd92d8b56d85 Jun 11 16:54:25.874476 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:25.874456 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod858bb5e3_e1bb_4958_a063_7acb2de52d1b.slice/crio-743630c283aa342d027b86de8281f29e4c70858091b71fd9ae5a2e09964b4c38 WatchSource:0}: Error finding container 743630c283aa342d027b86de8281f29e4c70858091b71fd9ae5a2e09964b4c38: Status 404 returned error can't find the container with id 743630c283aa342d027b86de8281f29e4c70858091b71fd9ae5a2e09964b4c38 Jun 11 16:54:25.875607 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:25.875586 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77e0f958_e3d1_4add_bd6f_86886fd95c20.slice/crio-457322abf4740bc0369d37ddf39ddb2ea97af6128a95ad24ed73ccf9e19e424a WatchSource:0}: Error finding container 457322abf4740bc0369d37ddf39ddb2ea97af6128a95ad24ed73ccf9e19e424a: Status 404 returned error can't find the container with id 457322abf4740bc0369d37ddf39ddb2ea97af6128a95ad24ed73ccf9e19e424a Jun 11 16:54:25.877127 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:25.877055 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod286b1d27_5581_44ce_b5d6_309dad57b6c9.slice/crio-e6ee1f76d6fe16b0351a91a048c277b4ad53f8d9967ffa69639ca4fd3dc02896 WatchSource:0}: Error finding container e6ee1f76d6fe16b0351a91a048c277b4ad53f8d9967ffa69639ca4fd3dc02896: Status 404 returned error can't find the container with id e6ee1f76d6fe16b0351a91a048c277b4ad53f8d9967ffa69639ca4fd3dc02896 Jun 11 16:54:26.168707 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:26.168659 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 16:49:25 +0000 UTC" deadline="2027-12-14 18:18:21.690383912 +0000 UTC" Jun 11 16:54:26.168707 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:26.168701 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13225h23m55.521684809s" Jun 11 16:54:26.185074 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:26.185045 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmsmp" Jun 11 16:54:26.185174 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:26.185155 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmsmp" podUID="b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3" Jun 11 16:54:26.193815 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:26.193788 2565 generic.go:356] "Generic (PLEG): container finished" podID="71a28d62884cbcf3e78ebb5653db9e0a" containerID="9576734c9d9c8dfa836945cc833d7aba0f314ef1561a4992575513494df2715a" exitCode=0 Jun 11 16:54:26.193918 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:26.193838 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal" event={"ID":"71a28d62884cbcf3e78ebb5653db9e0a","Type":"ContainerDied","Data":"9576734c9d9c8dfa836945cc833d7aba0f314ef1561a4992575513494df2715a"} Jun 11 16:54:26.195029 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:26.194998 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rkd7l" event={"ID":"858bb5e3-e1bb-4958-a063-7acb2de52d1b","Type":"ContainerStarted","Data":"743630c283aa342d027b86de8281f29e4c70858091b71fd9ae5a2e09964b4c38"} Jun 11 16:54:26.196389 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:26.196341 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h4cjk" event={"ID":"5f24a441-bff5-4a1f-bff7-92b60f4a2394","Type":"ContainerStarted","Data":"7d0c02dc1d9d6b90d140cc0490efd13f65f9919410dedd8323ebbd92d8b56d85"} Jun 11 16:54:26.197785 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:26.197723 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" event={"ID":"a30425b4-3b27-4ae1-af09-384473269d18","Type":"ContainerStarted","Data":"3e50792dea3856b9158d7c1077aa8b4597b2386327bf9b0a0a1f07c6adc3d329"} Jun 11 16:54:26.198917 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:26.198885 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mb5bm" event={"ID":"b0a87b53-941e-4917-b0a7-8459458b8b25","Type":"ContainerStarted","Data":"7e435c38bd382bc44cd1759651cae12aae34315181c3f974ed411cc95b1d1870"} Jun 11 16:54:26.199959 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:26.199934 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-psjzn" event={"ID":"0c3f8f49-e339-44dd-bcd9-860b5904ab31","Type":"ContainerStarted","Data":"b799df76e795ae1939b2985fe9385f2eae6b60aa2f5543f18f7ba1677918c6dd"} Jun 11 16:54:26.201696 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:26.201646 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-110.ec2.internal" event={"ID":"52b07f939a17d866fffc845ba62c423b","Type":"ContainerStarted","Data":"793ea2fe831809b283a87978e7f63f01dfabae7e4b3075472d8e757fd0b72104"} Jun 11 16:54:26.203194 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:26.203102 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pqrvn" event={"ID":"286b1d27-5581-44ce-b5d6-309dad57b6c9","Type":"ContainerStarted","Data":"e6ee1f76d6fe16b0351a91a048c277b4ad53f8d9967ffa69639ca4fd3dc02896"} Jun 11 16:54:26.204387 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:26.204364 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhcjl" event={"ID":"77e0f958-e3d1-4add-bd6f-86886fd95c20","Type":"ContainerStarted","Data":"457322abf4740bc0369d37ddf39ddb2ea97af6128a95ad24ed73ccf9e19e424a"} Jun 11 16:54:26.205802 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:26.205766 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vvl2p" event={"ID":"e2363293-30cf-42fa-9a2d-45c11e3e85f2","Type":"ContainerStarted","Data":"52bbf61e07b356a10b76a02d2d9409b30f3349bdd558c9d7dfaf0b78cde82c63"} Jun 11 16:54:26.207417 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:26.207388 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p2xx8" event={"ID":"09e3bd81-f153-41cb-90c4-37372e7ebadd","Type":"ContainerStarted","Data":"0e1f44a4146a18e6041ec2c1470463c0bd27b23cf055f9589b8685b48d7fd475"} Jun 11 16:54:26.226099 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:26.226041 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-110.ec2.internal" podStartSLOduration=2.226023975 podStartE2EDuration="2.226023975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:54:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:54:26.225380238 +0000 UTC m=+3.485635142" watchObservedRunningTime="2026-06-11 16:54:26.226023975 +0000 UTC m=+3.486278882" Jun 11 16:54:26.743196 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:26.743112 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/183fce84-80c4-4c1d-aa51-e962fdd8b887-original-pull-secret\") pod \"global-pull-secret-syncer-bmvr9\" (UID: \"183fce84-80c4-4c1d-aa51-e962fdd8b887\") " pod="kube-system/global-pull-secret-syncer-bmvr9" Jun 11 16:54:26.743196 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:26.743166 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42-metrics-certs\") pod \"network-metrics-daemon-pdg6r\" (UID: \"66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42\") " pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 16:54:26.743404 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:26.743275 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:54:26.743404 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:26.743337 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42-metrics-certs podName:66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42 nodeName:}" failed. No retries permitted until 2026-06-11 16:54:28.743317799 +0000 UTC m=+6.003572685 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42-metrics-certs") pod "network-metrics-daemon-pdg6r" (UID: "66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:54:26.743404 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:26.743275 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:54:26.743567 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:26.743411 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/183fce84-80c4-4c1d-aa51-e962fdd8b887-original-pull-secret podName:183fce84-80c4-4c1d-aa51-e962fdd8b887 nodeName:}" failed. No retries permitted until 2026-06-11 16:54:28.743392345 +0000 UTC m=+6.003647244 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/183fce84-80c4-4c1d-aa51-e962fdd8b887-original-pull-secret") pod "global-pull-secret-syncer-bmvr9" (UID: "183fce84-80c4-4c1d-aa51-e962fdd8b887") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:54:26.843941 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:26.843905 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57rpw\" (UniqueName: \"kubernetes.io/projected/b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3-kube-api-access-57rpw\") pod \"network-check-target-nmsmp\" (UID: \"b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3\") " pod="openshift-network-diagnostics/network-check-target-nmsmp" Jun 11 16:54:26.844115 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:26.844069 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:54:26.844115 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:26.844093 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:54:26.844115 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:26.844105 2565 projected.go:196] Error preparing data for projected volume kube-api-access-57rpw for pod openshift-network-diagnostics/network-check-target-nmsmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:54:26.844264 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:26.844159 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3-kube-api-access-57rpw podName:b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3 nodeName:}" failed. No retries permitted until 2026-06-11 16:54:28.844141768 +0000 UTC m=+6.104396672 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-57rpw" (UniqueName: "kubernetes.io/projected/b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3-kube-api-access-57rpw") pod "network-check-target-nmsmp" (UID: "b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:54:27.168921 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:27.168813 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 16:49:25 +0000 UTC" deadline="2028-02-15 08:39:56.558015323 +0000 UTC" Jun 11 16:54:27.168921 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:27.168874 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14727h45m29.389146204s" Jun 11 16:54:27.187626 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:27.187599 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 16:54:27.187768 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:27.187741 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pdg6r" podUID="66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42" Jun 11 16:54:27.188152 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:27.188132 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bmvr9" Jun 11 16:54:27.188252 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:27.188232 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bmvr9" podUID="183fce84-80c4-4c1d-aa51-e962fdd8b887" Jun 11 16:54:27.234032 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:27.233994 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal" event={"ID":"71a28d62884cbcf3e78ebb5653db9e0a","Type":"ContainerStarted","Data":"cb876683e339e330aa7ab1104be47dbbd065f9eb88e3fd1f0ca7e558c8e89e79"} Jun 11 16:54:28.184685 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:28.184655 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmsmp" Jun 11 16:54:28.185167 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:28.184778 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmsmp" podUID="b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3" Jun 11 16:54:28.758237 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:28.758196 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42-metrics-certs\") pod \"network-metrics-daemon-pdg6r\" (UID: \"66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42\") " pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 16:54:28.758403 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:28.758312 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/183fce84-80c4-4c1d-aa51-e962fdd8b887-original-pull-secret\") pod \"global-pull-secret-syncer-bmvr9\" (UID: \"183fce84-80c4-4c1d-aa51-e962fdd8b887\") " pod="kube-system/global-pull-secret-syncer-bmvr9" Jun 11 16:54:28.758464 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:28.758384 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:54:28.758464 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:28.758416 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:54:28.758570 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:28.758479 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42-metrics-certs podName:66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42 nodeName:}" failed. No retries permitted until 2026-06-11 16:54:32.758458045 +0000 UTC m=+10.018712942 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42-metrics-certs") pod "network-metrics-daemon-pdg6r" (UID: "66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:54:28.758570 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:28.758501 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/183fce84-80c4-4c1d-aa51-e962fdd8b887-original-pull-secret podName:183fce84-80c4-4c1d-aa51-e962fdd8b887 nodeName:}" failed. No retries permitted until 2026-06-11 16:54:32.758490934 +0000 UTC m=+10.018745821 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/183fce84-80c4-4c1d-aa51-e962fdd8b887-original-pull-secret") pod "global-pull-secret-syncer-bmvr9" (UID: "183fce84-80c4-4c1d-aa51-e962fdd8b887") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:54:28.859282 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:28.859244 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57rpw\" (UniqueName: \"kubernetes.io/projected/b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3-kube-api-access-57rpw\") pod \"network-check-target-nmsmp\" (UID: \"b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3\") " pod="openshift-network-diagnostics/network-check-target-nmsmp" Jun 11 16:54:28.859470 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:28.859434 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:54:28.859470 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:28.859457 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:54:28.859470 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:28.859470 2565 projected.go:196] Error preparing data for projected volume kube-api-access-57rpw for pod openshift-network-diagnostics/network-check-target-nmsmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:54:28.859635 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:28.859529 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3-kube-api-access-57rpw podName:b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3 nodeName:}" failed. No retries permitted until 2026-06-11 16:54:32.859509993 +0000 UTC m=+10.119764890 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-57rpw" (UniqueName: "kubernetes.io/projected/b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3-kube-api-access-57rpw") pod "network-check-target-nmsmp" (UID: "b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:54:29.185458 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:29.184920 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 16:54:29.185458 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:29.185067 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pdg6r" podUID="66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42" Jun 11 16:54:29.186223 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:29.186077 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bmvr9" Jun 11 16:54:29.186223 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:29.186186 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bmvr9" podUID="183fce84-80c4-4c1d-aa51-e962fdd8b887" Jun 11 16:54:30.184842 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:30.184784 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmsmp" Jun 11 16:54:30.185017 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:30.184949 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmsmp" podUID="b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3" Jun 11 16:54:31.185656 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:31.185590 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 16:54:31.186100 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:31.185732 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pdg6r" podUID="66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42" Jun 11 16:54:31.186100 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:31.185929 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bmvr9" Jun 11 16:54:31.186100 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:31.186044 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bmvr9" podUID="183fce84-80c4-4c1d-aa51-e962fdd8b887" Jun 11 16:54:32.185052 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:32.184984 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmsmp" Jun 11 16:54:32.185224 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:32.185132 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmsmp" podUID="b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3" Jun 11 16:54:32.789047 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:32.788998 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/183fce84-80c4-4c1d-aa51-e962fdd8b887-original-pull-secret\") pod \"global-pull-secret-syncer-bmvr9\" (UID: \"183fce84-80c4-4c1d-aa51-e962fdd8b887\") " pod="kube-system/global-pull-secret-syncer-bmvr9" Jun 11 16:54:32.789047 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:32.789050 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42-metrics-certs\") pod \"network-metrics-daemon-pdg6r\" (UID: \"66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42\") " pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 16:54:32.789557 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:32.789222 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:54:32.789557 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:32.789285 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42-metrics-certs podName:66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42 nodeName:}" failed. No retries permitted until 2026-06-11 16:54:40.789265779 +0000 UTC m=+18.049520664 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42-metrics-certs") pod "network-metrics-daemon-pdg6r" (UID: "66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:54:32.789716 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:32.789689 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:54:32.789854 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:32.789758 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/183fce84-80c4-4c1d-aa51-e962fdd8b887-original-pull-secret podName:183fce84-80c4-4c1d-aa51-e962fdd8b887 nodeName:}" failed. No retries permitted until 2026-06-11 16:54:40.789737784 +0000 UTC m=+18.049992670 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/183fce84-80c4-4c1d-aa51-e962fdd8b887-original-pull-secret") pod "global-pull-secret-syncer-bmvr9" (UID: "183fce84-80c4-4c1d-aa51-e962fdd8b887") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:54:32.889721 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:32.889519 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57rpw\" (UniqueName: \"kubernetes.io/projected/b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3-kube-api-access-57rpw\") pod \"network-check-target-nmsmp\" (UID: \"b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3\") " pod="openshift-network-diagnostics/network-check-target-nmsmp" Jun 11 16:54:32.889908 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:32.889734 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:54:32.889908 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:32.889753 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:54:32.889908 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:32.889764 2565 projected.go:196] Error preparing data for projected volume kube-api-access-57rpw for pod openshift-network-diagnostics/network-check-target-nmsmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:54:32.889908 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:32.889850 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3-kube-api-access-57rpw podName:b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3 nodeName:}" failed. No retries permitted until 2026-06-11 16:54:40.889804574 +0000 UTC m=+18.150059472 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-57rpw" (UniqueName: "kubernetes.io/projected/b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3-kube-api-access-57rpw") pod "network-check-target-nmsmp" (UID: "b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:54:33.186481 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:33.186393 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bmvr9" Jun 11 16:54:33.186637 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:33.186592 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bmvr9" podUID="183fce84-80c4-4c1d-aa51-e962fdd8b887" Jun 11 16:54:33.186703 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:33.186681 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 16:54:33.186860 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:33.186837 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pdg6r" podUID="66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42" Jun 11 16:54:34.184969 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:34.184893 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmsmp" Jun 11 16:54:34.185435 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:34.185025 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmsmp" podUID="b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3" Jun 11 16:54:35.185067 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:35.185023 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 16:54:35.185527 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:35.185180 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pdg6r" podUID="66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42" Jun 11 16:54:35.185527 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:35.185243 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bmvr9" Jun 11 16:54:35.185527 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:35.185359 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bmvr9" podUID="183fce84-80c4-4c1d-aa51-e962fdd8b887" Jun 11 16:54:36.184897 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:36.184858 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmsmp" Jun 11 16:54:36.185082 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:36.184993 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmsmp" podUID="b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3" Jun 11 16:54:37.184896 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:37.184858 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 16:54:37.184896 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:37.184892 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bmvr9" Jun 11 16:54:37.185539 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:37.185008 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pdg6r" podUID="66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42" Jun 11 16:54:37.185539 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:37.185131 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bmvr9" podUID="183fce84-80c4-4c1d-aa51-e962fdd8b887" Jun 11 16:54:38.184767 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:38.184740 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmsmp" Jun 11 16:54:38.184960 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:38.184869 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmsmp" podUID="b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3" Jun 11 16:54:39.185019 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:39.184980 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 16:54:39.185488 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:39.185034 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bmvr9" Jun 11 16:54:39.185488 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:39.185129 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pdg6r" podUID="66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42" Jun 11 16:54:39.185488 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:39.185261 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bmvr9" podUID="183fce84-80c4-4c1d-aa51-e962fdd8b887" Jun 11 16:54:40.184738 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:40.184505 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmsmp" Jun 11 16:54:40.185036 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:40.184856 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmsmp" podUID="b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3" Jun 11 16:54:40.847283 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:40.847243 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/183fce84-80c4-4c1d-aa51-e962fdd8b887-original-pull-secret\") pod \"global-pull-secret-syncer-bmvr9\" (UID: \"183fce84-80c4-4c1d-aa51-e962fdd8b887\") " pod="kube-system/global-pull-secret-syncer-bmvr9" Jun 11 16:54:40.847471 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:40.847295 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42-metrics-certs\") pod \"network-metrics-daemon-pdg6r\" (UID: \"66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42\") " pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 16:54:40.847471 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:40.847403 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:54:40.847471 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:40.847413 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:54:40.847635 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:40.847475 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42-metrics-certs podName:66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42 nodeName:}" failed. No retries permitted until 2026-06-11 16:54:56.847454074 +0000 UTC m=+34.107708958 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42-metrics-certs") pod "network-metrics-daemon-pdg6r" (UID: "66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:54:40.847635 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:40.847491 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/183fce84-80c4-4c1d-aa51-e962fdd8b887-original-pull-secret podName:183fce84-80c4-4c1d-aa51-e962fdd8b887 nodeName:}" failed. No retries permitted until 2026-06-11 16:54:56.8474828 +0000 UTC m=+34.107737684 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/183fce84-80c4-4c1d-aa51-e962fdd8b887-original-pull-secret") pod "global-pull-secret-syncer-bmvr9" (UID: "183fce84-80c4-4c1d-aa51-e962fdd8b887") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:54:40.948398 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:40.948348 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57rpw\" (UniqueName: \"kubernetes.io/projected/b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3-kube-api-access-57rpw\") pod \"network-check-target-nmsmp\" (UID: \"b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3\") " pod="openshift-network-diagnostics/network-check-target-nmsmp" Jun 11 16:54:40.948558 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:40.948518 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:54:40.948558 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:40.948544 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:54:40.948558 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:40.948557 2565 projected.go:196] Error preparing data for projected volume kube-api-access-57rpw for pod openshift-network-diagnostics/network-check-target-nmsmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:54:40.948681 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:40.948625 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3-kube-api-access-57rpw podName:b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3 nodeName:}" failed. No retries permitted until 2026-06-11 16:54:56.94860626 +0000 UTC m=+34.208861145 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-57rpw" (UniqueName: "kubernetes.io/projected/b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3-kube-api-access-57rpw") pod "network-check-target-nmsmp" (UID: "b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:54:41.184625 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:41.184529 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bmvr9" Jun 11 16:54:41.184804 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:41.184686 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 16:54:41.184891 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:41.184682 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bmvr9" podUID="183fce84-80c4-4c1d-aa51-e962fdd8b887" Jun 11 16:54:41.184891 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:41.184838 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pdg6r" podUID="66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42" Jun 11 16:54:42.184829 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:42.184717 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmsmp" Jun 11 16:54:42.185221 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:42.184849 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmsmp" podUID="b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3" Jun 11 16:54:43.185528 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:43.185448 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 16:54:43.185982 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:43.185576 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pdg6r" podUID="66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42" Jun 11 16:54:43.185982 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:43.185593 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bmvr9" Jun 11 16:54:43.185982 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:43.185718 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bmvr9" podUID="183fce84-80c4-4c1d-aa51-e962fdd8b887" Jun 11 16:54:44.184806 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:44.184773 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmsmp" Jun 11 16:54:44.184919 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:44.184885 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmsmp" podUID="b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3" Jun 11 16:54:45.184765 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:45.184724 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bmvr9" Jun 11 16:54:45.184765 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:45.184750 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 16:54:45.185548 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:45.184864 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bmvr9" podUID="183fce84-80c4-4c1d-aa51-e962fdd8b887" Jun 11 16:54:45.185548 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:45.184977 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pdg6r" podUID="66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42" Jun 11 16:54:45.274636 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:45.274566 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mb5bm" event={"ID":"b0a87b53-941e-4917-b0a7-8459458b8b25","Type":"ContainerStarted","Data":"919e897f17a58f73f16259dd2a039091c131e45a6c5f1d09ca8de3d02c0d65bf"} Jun 11 16:54:45.276056 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:45.276033 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-psjzn" event={"ID":"0c3f8f49-e339-44dd-bcd9-860b5904ab31","Type":"ContainerStarted","Data":"1a9c4bc1d26f5be1b67b13a7dc786593ce2bf096258aa2ba184be769a0320288"} Jun 11 16:54:45.277337 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:45.277309 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pqrvn" event={"ID":"286b1d27-5581-44ce-b5d6-309dad57b6c9","Type":"ContainerStarted","Data":"8d10bf5f04fbcd075f1e3cf8714b8609e327a484d0ff62c3b4041c93741404b4"} Jun 11 16:54:45.278731 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:45.278708 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhcjl" event={"ID":"77e0f958-e3d1-4add-bd6f-86886fd95c20","Type":"ContainerStarted","Data":"c7066588c48698ce3df9fa28586edddb9a8a0e9e1c138117c3e898953c9bba57"} Jun 11 16:54:45.279945 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:45.279926 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vvl2p" event={"ID":"e2363293-30cf-42fa-9a2d-45c11e3e85f2","Type":"ContainerStarted","Data":"8a8382c561249a079cbc5bfa647287eff21435cfeee9c8950ed0e6af0f555324"} Jun 11 16:54:45.281301 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:45.281277 2565 generic.go:356] "Generic (PLEG): container finished" podID="09e3bd81-f153-41cb-90c4-37372e7ebadd" containerID="8fada863db2ff818a92977a50713efb306a54229386f3a8366f30643b2e200d1" exitCode=0 Jun 11 16:54:45.281416 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:45.281343 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p2xx8" event={"ID":"09e3bd81-f153-41cb-90c4-37372e7ebadd","Type":"ContainerDied","Data":"8fada863db2ff818a92977a50713efb306a54229386f3a8366f30643b2e200d1"} Jun 11 16:54:45.284535 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:45.284510 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h4cjk" event={"ID":"5f24a441-bff5-4a1f-bff7-92b60f4a2394","Type":"ContainerStarted","Data":"ba567d00c07ded94cf462307a4a9821b5ee7ca33f585bef991e37fcae3b19e53"} Jun 11 16:54:45.288385 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:45.288368 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7hbj_a30425b4-3b27-4ae1-af09-384473269d18/ovn-acl-logging/0.log" Jun 11 16:54:45.288690 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:45.288673 2565 generic.go:356] "Generic (PLEG): container finished" podID="a30425b4-3b27-4ae1-af09-384473269d18" containerID="5211e1500eff1f5876b5e3a99d0aeedbd9a83b95f0a16187d446873d8545956b" exitCode=1 Jun 11 16:54:45.288739 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:45.288699 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" event={"ID":"a30425b4-3b27-4ae1-af09-384473269d18","Type":"ContainerStarted","Data":"4c72e494cdae12ef8a25b053dda0fce6b0ee196ab88d60440bb4962bbb62715c"} Jun 11 16:54:45.288775 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:45.288741 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" event={"ID":"a30425b4-3b27-4ae1-af09-384473269d18","Type":"ContainerStarted","Data":"887907ded1eeeade10b83ec40db37919e39511c8ed1d0b8e6cab7bb76299a796"} Jun 11 16:54:45.288839 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:45.288773 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" event={"ID":"a30425b4-3b27-4ae1-af09-384473269d18","Type":"ContainerStarted","Data":"a8902d12f87a3636710c55fc3209c234a28482addb2ce9063747918f9bf73215"} Jun 11 16:54:45.288839 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:45.288801 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" event={"ID":"a30425b4-3b27-4ae1-af09-384473269d18","Type":"ContainerStarted","Data":"b641c91427dacde414f25d103c020a45c890b1fbb68a165617c515f21e56eb2c"} Jun 11 16:54:45.288902 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:45.288852 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" event={"ID":"a30425b4-3b27-4ae1-af09-384473269d18","Type":"ContainerDied","Data":"5211e1500eff1f5876b5e3a99d0aeedbd9a83b95f0a16187d446873d8545956b"} Jun 11 16:54:45.288902 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:45.288882 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" event={"ID":"a30425b4-3b27-4ae1-af09-384473269d18","Type":"ContainerStarted","Data":"cac6ab5b76d6ade2fdf70aa17f95dd229506cd131173b404fd928e36c55670ac"} Jun 11 16:54:45.294476 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:45.294431 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mb5bm" podStartSLOduration=3.859444215 podStartE2EDuration="22.294416827s" totalImagesPullingTime="18.434972612s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:54:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:54:45.293681692 +0000 UTC m=+22.553936597" watchObservedRunningTime="2026-06-11 16:54:45.294416827 +0000 UTC m=+22.554671734" Jun 11 16:54:45.295191 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:45.295154 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal" podStartSLOduration=21.295141922 podStartE2EDuration="21.295141922s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:54:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:54:27.254698383 +0000 UTC m=+4.514953290" watchObservedRunningTime="2026-06-11 16:54:45.295141922 +0000 UTC m=+22.555396840" Jun 11 16:54:45.337434 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:45.337395 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-psjzn" podStartSLOduration=3.897941049 podStartE2EDuration="22.337382002s" totalImagesPullingTime="18.439440953s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:54:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:54:45.336842088 +0000 UTC m=+22.597096985" watchObservedRunningTime="2026-06-11 16:54:45.337382002 +0000 UTC m=+22.597636931" Jun 11 16:54:45.352638 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:45.352604 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-h4cjk" podStartSLOduration=3.921422455 podStartE2EDuration="22.352592178s" totalImagesPullingTime="18.431169723s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:54:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:54:45.352413811 +0000 UTC m=+22.612668716" watchObservedRunningTime="2026-06-11 16:54:45.352592178 +0000 UTC m=+22.612847084" Jun 11 16:54:45.405314 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:45.405271 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vvl2p" podStartSLOduration=3.93870957 podStartE2EDuration="22.405256761s" totalImagesPullingTime="18.466547191s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:54:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:54:45.382339269 +0000 UTC m=+22.642594175" watchObservedRunningTime="2026-06-11 16:54:45.405256761 +0000 UTC m=+22.665511667" Jun 11 16:54:45.796484 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:45.796462 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 16:54:46.185290 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:46.185031 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmsmp" Jun 11 16:54:46.185772 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:46.185003 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T16:54:45.796480121Z","UUID":"bf55affc-150c-4c78-a826-008a20916e66","Handler":null,"Name":"","Endpoint":""} Jun 11 16:54:46.185772 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:46.185371 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmsmp" podUID="b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3" Jun 11 16:54:46.186712 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:46.186685 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 16:54:46.186844 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:46.186729 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 16:54:46.293229 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:46.293191 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhcjl" event={"ID":"77e0f958-e3d1-4add-bd6f-86886fd95c20","Type":"ContainerStarted","Data":"48aab2ed85f79fb1e48fadda8516347596976d4757c1c99eae3a2619b1e311f3"} Jun 11 16:54:46.295101 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:46.295066 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rkd7l" event={"ID":"858bb5e3-e1bb-4958-a063-7acb2de52d1b","Type":"ContainerStarted","Data":"b8115514141e5bd5493ed42da64519752925162c42879d7bc5d3fa7f438193d7"} Jun 11 16:54:46.315235 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:46.315172 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pqrvn" podStartSLOduration=9.554440718 podStartE2EDuration="23.315152412s" totalImagesPullingTime="13.760711694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:54:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:54:45.405059479 +0000 UTC m=+22.665314366" watchObservedRunningTime="2026-06-11 16:54:46.315152412 +0000 UTC m=+23.575407318" Jun 11 16:54:47.184871 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:47.184845 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 16:54:47.185012 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:47.184981 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pdg6r" podUID="66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42" Jun 11 16:54:47.185136 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:47.185052 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bmvr9" Jun 11 16:54:47.185201 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:47.185164 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bmvr9" podUID="183fce84-80c4-4c1d-aa51-e962fdd8b887" Jun 11 16:54:47.301048 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:47.301016 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7hbj_a30425b4-3b27-4ae1-af09-384473269d18/ovn-acl-logging/0.log" Jun 11 16:54:47.301522 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:47.301495 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" event={"ID":"a30425b4-3b27-4ae1-af09-384473269d18","Type":"ContainerStarted","Data":"e12ae413eed4d3abfa534c22d5f277a4642081df35ecff1948376016c6e44e17"} Jun 11 16:54:47.303872 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:47.303846 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhcjl" event={"ID":"77e0f958-e3d1-4add-bd6f-86886fd95c20","Type":"ContainerStarted","Data":"5edde12d7f53d1fe5760f0b0a0b70fac36b0bb023dfc8a70b5a4baf6101daa58"} Jun 11 16:54:47.335808 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:47.335763 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rkd7l" podStartSLOduration=5.906218689 podStartE2EDuration="24.335749017s" totalImagesPullingTime="18.429530328s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:54:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:54:46.314790611 +0000 UTC m=+23.575045542" watchObservedRunningTime="2026-06-11 16:54:47.335749017 +0000 UTC m=+24.596003922" Jun 11 16:54:48.184704 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:48.184668 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmsmp" Jun 11 16:54:48.184868 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:48.184784 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmsmp" podUID="b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3" Jun 11 16:54:49.185116 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:49.185081 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bmvr9" Jun 11 16:54:49.185519 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:49.185082 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 16:54:49.185519 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:49.185206 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bmvr9" podUID="183fce84-80c4-4c1d-aa51-e962fdd8b887" Jun 11 16:54:49.185519 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:49.185333 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pdg6r" podUID="66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42" Jun 11 16:54:49.567963 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:49.567752 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pqrvn" Jun 11 16:54:49.568316 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:49.568297 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pqrvn" Jun 11 16:54:49.589204 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:49.589159 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dhcjl" podStartSLOduration=6.155721404 podStartE2EDuration="26.5891445s" totalImagesPullingTime="20.433423096s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:54:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:54:47.33607534 +0000 UTC m=+24.596330246" watchObservedRunningTime="2026-06-11 16:54:49.5891445 +0000 UTC m=+26.849399407" Jun 11 16:54:50.184590 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:50.184556 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmsmp" Jun 11 16:54:50.184862 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:50.184649 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmsmp" podUID="b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3" Jun 11 16:54:50.313708 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:50.313682 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7hbj_a30425b4-3b27-4ae1-af09-384473269d18/ovn-acl-logging/0.log" Jun 11 16:54:50.314095 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:50.314070 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" event={"ID":"a30425b4-3b27-4ae1-af09-384473269d18","Type":"ContainerStarted","Data":"4625bf0fbf46355d0cc0d9dfbfed34547c36b23edb6b8ab0566e34a1f5e1d5db"} Jun 11 16:54:50.314379 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:50.314358 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:50.314510 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:50.314496 2565 scope.go:117] "RemoveContainer" containerID="5211e1500eff1f5876b5e3a99d0aeedbd9a83b95f0a16187d446873d8545956b" Jun 11 16:54:50.316132 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:50.316108 2565 generic.go:356] "Generic (PLEG): container finished" podID="09e3bd81-f153-41cb-90c4-37372e7ebadd" containerID="8c429d04ac9f664f7a0417e59660221006e71a32ec0fe6561013941c31077b7a" exitCode=0 Jun 11 16:54:50.316252 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:50.316147 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p2xx8" event={"ID":"09e3bd81-f153-41cb-90c4-37372e7ebadd","Type":"ContainerDied","Data":"8c429d04ac9f664f7a0417e59660221006e71a32ec0fe6561013941c31077b7a"} Jun 11 16:54:50.316391 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:50.316375 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pqrvn" Jun 11 16:54:50.317007 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:50.316902 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pqrvn" Jun 11 16:54:50.330988 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:50.330969 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:51.185107 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:51.185077 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 16:54:51.185309 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:51.185077 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bmvr9" Jun 11 16:54:51.185309 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:51.185208 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pdg6r" podUID="66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42" Jun 11 16:54:51.185309 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:51.185250 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bmvr9" podUID="183fce84-80c4-4c1d-aa51-e962fdd8b887" Jun 11 16:54:51.320280 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:51.320251 2565 generic.go:356] "Generic (PLEG): container finished" podID="09e3bd81-f153-41cb-90c4-37372e7ebadd" containerID="eb24ef2e23b8ef2ebca90d05493da6d3a97fe4b1e15146e1778944b5397d5f5f" exitCode=0 Jun 11 16:54:51.320883 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:51.320324 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p2xx8" event={"ID":"09e3bd81-f153-41cb-90c4-37372e7ebadd","Type":"ContainerDied","Data":"eb24ef2e23b8ef2ebca90d05493da6d3a97fe4b1e15146e1778944b5397d5f5f"} Jun 11 16:54:51.324053 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:51.324036 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7hbj_a30425b4-3b27-4ae1-af09-384473269d18/ovn-acl-logging/0.log" Jun 11 16:54:51.324401 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:51.324376 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" event={"ID":"a30425b4-3b27-4ae1-af09-384473269d18","Type":"ContainerStarted","Data":"25d19e658515acc96494ed7291ddb98af784d6549a8d0cf76882bd5c2bb72402"} Jun 11 16:54:51.324764 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:51.324739 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:51.324870 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:51.324862 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:51.338339 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:51.338314 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:54:51.378898 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:51.378855 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" podStartSLOduration=9.892396006 podStartE2EDuration="28.378843126s" totalImagesPullingTime="18.48644712s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:54:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:54:51.378584732 +0000 UTC m=+28.638839661" watchObservedRunningTime="2026-06-11 16:54:51.378843126 +0000 UTC m=+28.639098029" Jun 11 16:54:51.688934 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:51.688856 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nmsmp"] Jun 11 16:54:51.689096 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:51.688988 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmsmp" Jun 11 16:54:51.689162 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:51.689099 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmsmp" podUID="b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3" Jun 11 16:54:51.697950 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:51.697919 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bmvr9"] Jun 11 16:54:51.698093 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:51.698023 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bmvr9" Jun 11 16:54:51.698153 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:51.698111 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bmvr9" podUID="183fce84-80c4-4c1d-aa51-e962fdd8b887" Jun 11 16:54:51.715886 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:51.715858 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pdg6r"] Jun 11 16:54:51.716028 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:51.715961 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 16:54:51.716087 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:51.716056 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pdg6r" podUID="66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42" Jun 11 16:54:52.329409 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:52.329374 2565 generic.go:356] "Generic (PLEG): container finished" podID="09e3bd81-f153-41cb-90c4-37372e7ebadd" containerID="6b0035f62cfe4adfa0c2230d981b59f209572632b86817a3f0f1b699e9dfeab2" exitCode=0 Jun 11 16:54:52.329950 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:52.329456 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p2xx8" event={"ID":"09e3bd81-f153-41cb-90c4-37372e7ebadd","Type":"ContainerDied","Data":"6b0035f62cfe4adfa0c2230d981b59f209572632b86817a3f0f1b699e9dfeab2"} Jun 11 16:54:53.186085 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:53.186053 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 16:54:53.186277 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:53.186158 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bmvr9" Jun 11 16:54:53.186277 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:53.186218 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pdg6r" podUID="66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42" Jun 11 16:54:53.186277 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:53.186235 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bmvr9" podUID="183fce84-80c4-4c1d-aa51-e962fdd8b887" Jun 11 16:54:53.186277 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:53.186231 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmsmp" Jun 11 16:54:53.186499 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:53.186346 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmsmp" podUID="b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3" Jun 11 16:54:55.185112 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:55.184849 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bmvr9" Jun 11 16:54:55.185614 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:55.184892 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 16:54:55.185614 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:55.185227 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bmvr9" podUID="183fce84-80c4-4c1d-aa51-e962fdd8b887" Jun 11 16:54:55.185614 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:55.184920 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmsmp" Jun 11 16:54:55.185614 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:55.185323 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pdg6r" podUID="66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42" Jun 11 16:54:55.185614 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:55.185366 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmsmp" podUID="b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3" Jun 11 16:54:56.873506 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:56.873483 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/183fce84-80c4-4c1d-aa51-e962fdd8b887-original-pull-secret\") pod \"global-pull-secret-syncer-bmvr9\" (UID: \"183fce84-80c4-4c1d-aa51-e962fdd8b887\") " pod="kube-system/global-pull-secret-syncer-bmvr9" Jun 11 16:54:56.873853 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:56.873517 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42-metrics-certs\") pod \"network-metrics-daemon-pdg6r\" (UID: \"66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42\") " pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 16:54:56.873853 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:56.873603 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:54:56.873853 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:56.873623 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:54:56.873853 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:56.873657 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42-metrics-certs podName:66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42 nodeName:}" failed. No retries permitted until 2026-06-11 16:55:28.873637349 +0000 UTC m=+66.133892233 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42-metrics-certs") pod "network-metrics-daemon-pdg6r" (UID: "66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:54:56.873853 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:56.873672 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/183fce84-80c4-4c1d-aa51-e962fdd8b887-original-pull-secret podName:183fce84-80c4-4c1d-aa51-e962fdd8b887 nodeName:}" failed. No retries permitted until 2026-06-11 16:55:28.873665311 +0000 UTC m=+66.133920195 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/183fce84-80c4-4c1d-aa51-e962fdd8b887-original-pull-secret") pod "global-pull-secret-syncer-bmvr9" (UID: "183fce84-80c4-4c1d-aa51-e962fdd8b887") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:54:56.974139 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:56.974106 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57rpw\" (UniqueName: \"kubernetes.io/projected/b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3-kube-api-access-57rpw\") pod \"network-check-target-nmsmp\" (UID: \"b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3\") " pod="openshift-network-diagnostics/network-check-target-nmsmp" Jun 11 16:54:56.974298 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:56.974236 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:54:56.974298 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:56.974249 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:54:56.974298 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:56.974258 2565 projected.go:196] Error preparing data for projected volume kube-api-access-57rpw for pod openshift-network-diagnostics/network-check-target-nmsmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:54:56.974410 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:56.974305 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3-kube-api-access-57rpw podName:b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3 nodeName:}" failed. No retries permitted until 2026-06-11 16:55:28.974291659 +0000 UTC m=+66.234546542 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-57rpw" (UniqueName: "kubernetes.io/projected/b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3-kube-api-access-57rpw") pod "network-check-target-nmsmp" (UID: "b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:54:57.184716 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:57.184691 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 16:54:57.184859 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:57.184696 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmsmp" Jun 11 16:54:57.184859 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:57.184803 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pdg6r" podUID="66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42" Jun 11 16:54:57.184967 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:57.184696 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bmvr9" Jun 11 16:54:57.184967 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:57.184886 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmsmp" podUID="b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3" Jun 11 16:54:57.184967 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:57.184940 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bmvr9" podUID="183fce84-80c4-4c1d-aa51-e962fdd8b887" Jun 11 16:54:57.344224 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:57.344191 2565 generic.go:356] "Generic (PLEG): container finished" podID="09e3bd81-f153-41cb-90c4-37372e7ebadd" containerID="3c182ce28b926b415be6cda793e322fce20fcb28680260aa3cd07ef1b10bd326" exitCode=0 Jun 11 16:54:57.344377 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:57.344247 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p2xx8" event={"ID":"09e3bd81-f153-41cb-90c4-37372e7ebadd","Type":"ContainerDied","Data":"3c182ce28b926b415be6cda793e322fce20fcb28680260aa3cd07ef1b10bd326"} Jun 11 16:54:58.349069 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.349037 2565 generic.go:356] "Generic (PLEG): container finished" podID="09e3bd81-f153-41cb-90c4-37372e7ebadd" containerID="7c84bb24621136e74aa333be4f02d2e6331458b446e81aaeebc9bc816fe61875" exitCode=0 Jun 11 16:54:58.349475 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.349093 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p2xx8" event={"ID":"09e3bd81-f153-41cb-90c4-37372e7ebadd","Type":"ContainerDied","Data":"7c84bb24621136e74aa333be4f02d2e6331458b446e81aaeebc9bc816fe61875"} Jun 11 16:54:58.545616 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.545587 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeReady" Jun 11 16:54:58.545735 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.545695 2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 16:54:58.589233 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.589198 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-6skv7"] Jun 11 16:54:58.612165 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.612005 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7985894f89-cr2f7"] Jun 11 16:54:58.612384 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.612327 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6skv7" Jun 11 16:54:58.615954 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.615933 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 11 16:54:58.616222 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.616173 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 11 16:54:58.616309 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.616235 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-nnm6x\"" Jun 11 16:54:58.639947 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.639928 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8459d4785b-m9qxj"] Jun 11 16:54:58.640065 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.640049 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:54:58.643974 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.643954 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 16:54:58.644233 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.644211 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 16:54:58.644426 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.644410 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 16:54:58.644989 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.644971 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-x475h\"" Jun 11 16:54:58.654276 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.654255 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 16:54:58.658022 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.657956 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67dc78565d-dbhz6"] Jun 11 16:54:58.658022 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.658018 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8459d4785b-m9qxj" Jun 11 16:54:58.661983 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.661965 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-8q86r\"" Jun 11 16:54:58.662165 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.662143 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 16:54:58.662260 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.662191 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 11 16:54:58.662260 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.662147 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 16:54:58.662551 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.662534 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 16:54:58.677990 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.677966 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8799cfb8-xjd52"] Jun 11 16:54:58.678114 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.678099 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67dc78565d-dbhz6" Jun 11 16:54:58.680898 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.680882 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 11 16:54:58.681004 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.680963 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 11 16:54:58.681004 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.680987 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 11 16:54:58.681198 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.681185 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 11 16:54:58.700082 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.700061 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-6skv7"] Jun 11 16:54:58.700161 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.700086 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8459d4785b-m9qxj"] Jun 11 16:54:58.700161 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.700097 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8799cfb8-xjd52"] Jun 11 16:54:58.700161 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.700108 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67dc78565d-dbhz6"] Jun 11 16:54:58.700161 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.700120 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7985894f89-cr2f7"] Jun 11 16:54:58.700161 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.700134 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-x4w9j"] Jun 11 16:54:58.700161 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.700154 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8799cfb8-xjd52" Jun 11 16:54:58.702576 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.702557 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 11 16:54:58.722301 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.722284 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qxl9m"] Jun 11 16:54:58.722396 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.722383 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x4w9j" Jun 11 16:54:58.725208 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.725190 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 16:54:58.725208 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.725206 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-x9gb4\"" Jun 11 16:54:58.726056 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.726044 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 16:54:58.740318 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.740298 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x4w9j"] Jun 11 16:54:58.740395 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.740327 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qxl9m"] Jun 11 16:54:58.740440 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.740400 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qxl9m" Jun 11 16:54:58.742896 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.742880 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vd977\"" Jun 11 16:54:58.743105 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.743091 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 16:54:58.743105 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.743102 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 16:54:58.743409 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.743395 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 16:54:58.786708 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.786683 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/45c2cd36-79dd-429b-a48a-69e118b687e8-image-registry-private-configuration\") pod \"image-registry-7985894f89-cr2f7\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:54:58.786816 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.786716 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3924fcbb-d795-45ab-96f9-7cae5e426aa6-klusterlet-config\") pod \"klusterlet-addon-workmgr-d8799cfb8-xjd52\" (UID: \"3924fcbb-d795-45ab-96f9-7cae5e426aa6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8799cfb8-xjd52" Jun 11 16:54:58.786816 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.786756 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2d7567f4-2d0c-4979-b2fe-a59eae95b974-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-6skv7\" (UID: \"2d7567f4-2d0c-4979-b2fe-a59eae95b974\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6skv7" Jun 11 16:54:58.786816 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.786779 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/efcfb572-9a35-45e3-8959-1f3b3e1f60ef-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8459d4785b-m9qxj\" (UID: \"efcfb572-9a35-45e3-8959-1f3b3e1f60ef\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8459d4785b-m9qxj" Jun 11 16:54:58.786816 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.786813 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/26ec855b-2b23-483d-bd71-ae6b2e21ad12-hub\") pod \"cluster-proxy-proxy-agent-67dc78565d-dbhz6\" (UID: \"26ec855b-2b23-483d-bd71-ae6b2e21ad12\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67dc78565d-dbhz6" Jun 11 16:54:58.787008 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.786868 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-tls\") pod \"image-registry-7985894f89-cr2f7\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:54:58.787008 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.786915 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/45c2cd36-79dd-429b-a48a-69e118b687e8-trusted-ca\") pod \"image-registry-7985894f89-cr2f7\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:54:58.787008 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.786938 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-certificates\") pod \"image-registry-7985894f89-cr2f7\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:54:58.787008 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.786958 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8cpd\" (UniqueName: \"kubernetes.io/projected/efcfb572-9a35-45e3-8959-1f3b3e1f60ef-kube-api-access-f8cpd\") pod \"managed-serviceaccount-addon-agent-8459d4785b-m9qxj\" (UID: \"efcfb572-9a35-45e3-8959-1f3b3e1f60ef\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8459d4785b-m9qxj" Jun 11 16:54:58.787008 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.786977 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/26ec855b-2b23-483d-bd71-ae6b2e21ad12-additional-service-ca\") pod \"cluster-proxy-proxy-agent-67dc78565d-dbhz6\" (UID: \"26ec855b-2b23-483d-bd71-ae6b2e21ad12\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67dc78565d-dbhz6" Jun 11 16:54:58.787234 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.787013 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/26ec855b-2b23-483d-bd71-ae6b2e21ad12-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-67dc78565d-dbhz6\" (UID: \"26ec855b-2b23-483d-bd71-ae6b2e21ad12\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67dc78565d-dbhz6" Jun 11 16:54:58.787234 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.787042 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3924fcbb-d795-45ab-96f9-7cae5e426aa6-tmp\") pod \"klusterlet-addon-workmgr-d8799cfb8-xjd52\" (UID: \"3924fcbb-d795-45ab-96f9-7cae5e426aa6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8799cfb8-xjd52" Jun 11 16:54:58.787234 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.787080 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/26ec855b-2b23-483d-bd71-ae6b2e21ad12-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-67dc78565d-dbhz6\" (UID: \"26ec855b-2b23-483d-bd71-ae6b2e21ad12\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67dc78565d-dbhz6" Jun 11 16:54:58.787234 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.787098 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/45c2cd36-79dd-429b-a48a-69e118b687e8-installation-pull-secrets\") pod \"image-registry-7985894f89-cr2f7\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:54:58.787234 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.787114 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d7567f4-2d0c-4979-b2fe-a59eae95b974-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-6skv7\" (UID: \"2d7567f4-2d0c-4979-b2fe-a59eae95b974\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6skv7" Jun 11 16:54:58.787234 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.787129 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh6j6\" (UniqueName: \"kubernetes.io/projected/3924fcbb-d795-45ab-96f9-7cae5e426aa6-kube-api-access-lh6j6\") pod \"klusterlet-addon-workmgr-d8799cfb8-xjd52\" (UID: \"3924fcbb-d795-45ab-96f9-7cae5e426aa6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8799cfb8-xjd52" Jun 11 16:54:58.787234 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.787152 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/26ec855b-2b23-483d-bd71-ae6b2e21ad12-ca\") pod \"cluster-proxy-proxy-agent-67dc78565d-dbhz6\" (UID: \"26ec855b-2b23-483d-bd71-ae6b2e21ad12\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67dc78565d-dbhz6" Jun 11 16:54:58.787234 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.787166 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwpf8\" (UniqueName: \"kubernetes.io/projected/26ec855b-2b23-483d-bd71-ae6b2e21ad12-kube-api-access-vwpf8\") pod \"cluster-proxy-proxy-agent-67dc78565d-dbhz6\" (UID: \"26ec855b-2b23-483d-bd71-ae6b2e21ad12\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67dc78565d-dbhz6" Jun 11 16:54:58.787234 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.787198 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/45c2cd36-79dd-429b-a48a-69e118b687e8-ca-trust-extracted\") pod \"image-registry-7985894f89-cr2f7\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:54:58.787234 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.787225 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-bound-sa-token\") pod \"image-registry-7985894f89-cr2f7\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:54:58.787537 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.787263 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr966\" (UniqueName: \"kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-kube-api-access-xr966\") pod \"image-registry-7985894f89-cr2f7\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:54:58.832545 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.832517 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqrvn_286b1d27-5581-44ce-b5d6-309dad57b6c9/konnectivity-agent/0.log" limit=1024 Jun 11 16:54:58.888468 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.888418 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/efcfb572-9a35-45e3-8959-1f3b3e1f60ef-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8459d4785b-m9qxj\" (UID: \"efcfb572-9a35-45e3-8959-1f3b3e1f60ef\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8459d4785b-m9qxj" Jun 11 16:54:58.888468 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.888448 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-config-volume\") pod \"dns-default-x4w9j\" (UID: \"e56370ed-2f52-42f7-aa1f-ec213d8d14a1\") " pod="openshift-dns/dns-default-x4w9j" Jun 11 16:54:58.888586 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.888470 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-tmp-dir\") pod \"dns-default-x4w9j\" (UID: \"e56370ed-2f52-42f7-aa1f-ec213d8d14a1\") " pod="openshift-dns/dns-default-x4w9j" Jun 11 16:54:58.888586 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.888574 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/26ec855b-2b23-483d-bd71-ae6b2e21ad12-hub\") pod \"cluster-proxy-proxy-agent-67dc78565d-dbhz6\" (UID: \"26ec855b-2b23-483d-bd71-ae6b2e21ad12\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67dc78565d-dbhz6" Jun 11 16:54:58.888657 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.888593 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-tls\") pod \"image-registry-7985894f89-cr2f7\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:54:58.888657 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.888612 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/45c2cd36-79dd-429b-a48a-69e118b687e8-trusted-ca\") pod \"image-registry-7985894f89-cr2f7\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:54:58.888657 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.888628 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-metrics-tls\") pod \"dns-default-x4w9j\" (UID: \"e56370ed-2f52-42f7-aa1f-ec213d8d14a1\") " pod="openshift-dns/dns-default-x4w9j" Jun 11 16:54:58.888799 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.888654 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8cpd\" (UniqueName: \"kubernetes.io/projected/efcfb572-9a35-45e3-8959-1f3b3e1f60ef-kube-api-access-f8cpd\") pod \"managed-serviceaccount-addon-agent-8459d4785b-m9qxj\" (UID: \"efcfb572-9a35-45e3-8959-1f3b3e1f60ef\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8459d4785b-m9qxj" Jun 11 16:54:58.888799 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:58.888718 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:54:58.888799 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:58.888733 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7985894f89-cr2f7: secret "image-registry-tls" not found Jun 11 16:54:58.888799 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:58.888792 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-tls podName:45c2cd36-79dd-429b-a48a-69e118b687e8 nodeName:}" failed. No retries permitted until 2026-06-11 16:54:59.388774093 +0000 UTC m=+36.649028997 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-tls") pod "image-registry-7985894f89-cr2f7" (UID: "45c2cd36-79dd-429b-a48a-69e118b687e8") : secret "image-registry-tls" not found Jun 11 16:54:58.889052 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.888713 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/26ec855b-2b23-483d-bd71-ae6b2e21ad12-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-67dc78565d-dbhz6\" (UID: \"26ec855b-2b23-483d-bd71-ae6b2e21ad12\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67dc78565d-dbhz6" Jun 11 16:54:58.889052 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.888877 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26915d24-6b82-41d7-9d72-e4846076e9da-cert\") pod \"ingress-canary-qxl9m\" (UID: \"26915d24-6b82-41d7-9d72-e4846076e9da\") " pod="openshift-ingress-canary/ingress-canary-qxl9m" Jun 11 16:54:58.889052 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.888926 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/26ec855b-2b23-483d-bd71-ae6b2e21ad12-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-67dc78565d-dbhz6\" (UID: \"26ec855b-2b23-483d-bd71-ae6b2e21ad12\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67dc78565d-dbhz6" Jun 11 16:54:58.889052 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.888997 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh6j6\" (UniqueName: \"kubernetes.io/projected/3924fcbb-d795-45ab-96f9-7cae5e426aa6-kube-api-access-lh6j6\") pod \"klusterlet-addon-workmgr-d8799cfb8-xjd52\" (UID: \"3924fcbb-d795-45ab-96f9-7cae5e426aa6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8799cfb8-xjd52" Jun 11 16:54:58.889052 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.889044 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/45c2cd36-79dd-429b-a48a-69e118b687e8-ca-trust-extracted\") pod \"image-registry-7985894f89-cr2f7\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:54:58.889292 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.889095 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x8w5\" (UniqueName: \"kubernetes.io/projected/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-kube-api-access-5x8w5\") pod \"dns-default-x4w9j\" (UID: \"e56370ed-2f52-42f7-aa1f-ec213d8d14a1\") " pod="openshift-dns/dns-default-x4w9j" Jun 11 16:54:58.889292 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.889127 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/45c2cd36-79dd-429b-a48a-69e118b687e8-image-registry-private-configuration\") pod \"image-registry-7985894f89-cr2f7\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:54:58.889292 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.889152 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdzqx\" (UniqueName: \"kubernetes.io/projected/26915d24-6b82-41d7-9d72-e4846076e9da-kube-api-access-vdzqx\") pod \"ingress-canary-qxl9m\" (UID: \"26915d24-6b82-41d7-9d72-e4846076e9da\") " pod="openshift-ingress-canary/ingress-canary-qxl9m" Jun 11 16:54:58.889292 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.889178 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3924fcbb-d795-45ab-96f9-7cae5e426aa6-klusterlet-config\") pod \"klusterlet-addon-workmgr-d8799cfb8-xjd52\" (UID: \"3924fcbb-d795-45ab-96f9-7cae5e426aa6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8799cfb8-xjd52" Jun 11 16:54:58.889292 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.889213 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2d7567f4-2d0c-4979-b2fe-a59eae95b974-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-6skv7\" (UID: \"2d7567f4-2d0c-4979-b2fe-a59eae95b974\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6skv7" Jun 11 16:54:58.889292 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.889240 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-bound-sa-token\") pod \"image-registry-7985894f89-cr2f7\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:54:58.889292 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.889267 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr966\" (UniqueName: \"kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-kube-api-access-xr966\") pod \"image-registry-7985894f89-cr2f7\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:54:58.889637 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.889308 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-certificates\") pod \"image-registry-7985894f89-cr2f7\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:54:58.889637 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.889338 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/26ec855b-2b23-483d-bd71-ae6b2e21ad12-additional-service-ca\") pod \"cluster-proxy-proxy-agent-67dc78565d-dbhz6\" (UID: \"26ec855b-2b23-483d-bd71-ae6b2e21ad12\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67dc78565d-dbhz6" Jun 11 16:54:58.889637 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.889363 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3924fcbb-d795-45ab-96f9-7cae5e426aa6-tmp\") pod \"klusterlet-addon-workmgr-d8799cfb8-xjd52\" (UID: \"3924fcbb-d795-45ab-96f9-7cae5e426aa6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8799cfb8-xjd52" Jun 11 16:54:58.889637 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.889397 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/45c2cd36-79dd-429b-a48a-69e118b687e8-ca-trust-extracted\") pod \"image-registry-7985894f89-cr2f7\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:54:58.889637 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.889400 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/45c2cd36-79dd-429b-a48a-69e118b687e8-installation-pull-secrets\") pod \"image-registry-7985894f89-cr2f7\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:54:58.889637 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.889448 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d7567f4-2d0c-4979-b2fe-a59eae95b974-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-6skv7\" (UID: \"2d7567f4-2d0c-4979-b2fe-a59eae95b974\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6skv7" Jun 11 16:54:58.889637 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.889486 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/26ec855b-2b23-483d-bd71-ae6b2e21ad12-ca\") pod \"cluster-proxy-proxy-agent-67dc78565d-dbhz6\" (UID: \"26ec855b-2b23-483d-bd71-ae6b2e21ad12\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67dc78565d-dbhz6" Jun 11 16:54:58.889637 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.889510 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwpf8\" (UniqueName: \"kubernetes.io/projected/26ec855b-2b23-483d-bd71-ae6b2e21ad12-kube-api-access-vwpf8\") pod \"cluster-proxy-proxy-agent-67dc78565d-dbhz6\" (UID: \"26ec855b-2b23-483d-bd71-ae6b2e21ad12\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67dc78565d-dbhz6" Jun 11 16:54:58.890033 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.889637 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/45c2cd36-79dd-429b-a48a-69e118b687e8-trusted-ca\") pod \"image-registry-7985894f89-cr2f7\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:54:58.890033 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:58.889848 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 16:54:58.890033 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:58.889896 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7567f4-2d0c-4979-b2fe-a59eae95b974-networking-console-plugin-cert podName:2d7567f4-2d0c-4979-b2fe-a59eae95b974 nodeName:}" failed. No retries permitted until 2026-06-11 16:54:59.389881172 +0000 UTC m=+36.650136073 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2d7567f4-2d0c-4979-b2fe-a59eae95b974-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-6skv7" (UID: "2d7567f4-2d0c-4979-b2fe-a59eae95b974") : secret "networking-console-plugin-cert" not found Jun 11 16:54:58.890311 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.890292 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2d7567f4-2d0c-4979-b2fe-a59eae95b974-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-6skv7\" (UID: \"2d7567f4-2d0c-4979-b2fe-a59eae95b974\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6skv7" Jun 11 16:54:58.890904 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.890883 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-certificates\") pod \"image-registry-7985894f89-cr2f7\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:54:58.891238 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.890953 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3924fcbb-d795-45ab-96f9-7cae5e426aa6-tmp\") pod \"klusterlet-addon-workmgr-d8799cfb8-xjd52\" (UID: \"3924fcbb-d795-45ab-96f9-7cae5e426aa6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8799cfb8-xjd52" Jun 11 16:54:58.891644 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.891542 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/26ec855b-2b23-483d-bd71-ae6b2e21ad12-additional-service-ca\") pod \"cluster-proxy-proxy-agent-67dc78565d-dbhz6\" (UID: \"26ec855b-2b23-483d-bd71-ae6b2e21ad12\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67dc78565d-dbhz6" Jun 11 16:54:58.894035 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.894014 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/45c2cd36-79dd-429b-a48a-69e118b687e8-installation-pull-secrets\") pod \"image-registry-7985894f89-cr2f7\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:54:58.894125 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.894045 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/45c2cd36-79dd-429b-a48a-69e118b687e8-image-registry-private-configuration\") pod \"image-registry-7985894f89-cr2f7\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:54:58.894125 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.894083 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/26ec855b-2b23-483d-bd71-ae6b2e21ad12-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-67dc78565d-dbhz6\" (UID: \"26ec855b-2b23-483d-bd71-ae6b2e21ad12\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67dc78565d-dbhz6" Jun 11 16:54:58.894235 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.894193 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3924fcbb-d795-45ab-96f9-7cae5e426aa6-klusterlet-config\") pod \"klusterlet-addon-workmgr-d8799cfb8-xjd52\" (UID: \"3924fcbb-d795-45ab-96f9-7cae5e426aa6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8799cfb8-xjd52" Jun 11 16:54:58.894543 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.894520 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/26ec855b-2b23-483d-bd71-ae6b2e21ad12-hub\") pod \"cluster-proxy-proxy-agent-67dc78565d-dbhz6\" (UID: \"26ec855b-2b23-483d-bd71-ae6b2e21ad12\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67dc78565d-dbhz6" Jun 11 16:54:58.894627 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.894528 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/26ec855b-2b23-483d-bd71-ae6b2e21ad12-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-67dc78565d-dbhz6\" (UID: \"26ec855b-2b23-483d-bd71-ae6b2e21ad12\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67dc78565d-dbhz6" Jun 11 16:54:58.894694 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.894678 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/26ec855b-2b23-483d-bd71-ae6b2e21ad12-ca\") pod \"cluster-proxy-proxy-agent-67dc78565d-dbhz6\" (UID: \"26ec855b-2b23-483d-bd71-ae6b2e21ad12\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67dc78565d-dbhz6" Jun 11 16:54:58.894733 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.894702 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/efcfb572-9a35-45e3-8959-1f3b3e1f60ef-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8459d4785b-m9qxj\" (UID: \"efcfb572-9a35-45e3-8959-1f3b3e1f60ef\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8459d4785b-m9qxj" Jun 11 16:54:58.899938 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.899919 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8cpd\" (UniqueName: \"kubernetes.io/projected/efcfb572-9a35-45e3-8959-1f3b3e1f60ef-kube-api-access-f8cpd\") pod \"managed-serviceaccount-addon-agent-8459d4785b-m9qxj\" (UID: \"efcfb572-9a35-45e3-8959-1f3b3e1f60ef\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8459d4785b-m9qxj" Jun 11 16:54:58.903248 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.903225 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwpf8\" (UniqueName: \"kubernetes.io/projected/26ec855b-2b23-483d-bd71-ae6b2e21ad12-kube-api-access-vwpf8\") pod \"cluster-proxy-proxy-agent-67dc78565d-dbhz6\" (UID: \"26ec855b-2b23-483d-bd71-ae6b2e21ad12\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67dc78565d-dbhz6" Jun 11 16:54:58.903809 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.903792 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh6j6\" (UniqueName: \"kubernetes.io/projected/3924fcbb-d795-45ab-96f9-7cae5e426aa6-kube-api-access-lh6j6\") pod \"klusterlet-addon-workmgr-d8799cfb8-xjd52\" (UID: \"3924fcbb-d795-45ab-96f9-7cae5e426aa6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8799cfb8-xjd52" Jun 11 16:54:58.904316 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.904295 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-bound-sa-token\") pod \"image-registry-7985894f89-cr2f7\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:54:58.904419 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.904409 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr966\" (UniqueName: \"kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-kube-api-access-xr966\") pod \"image-registry-7985894f89-cr2f7\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:54:58.925458 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.925424 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqrvn_286b1d27-5581-44ce-b5d6-309dad57b6c9/konnectivity-agent/0.log" limit=1024 Jun 11 16:54:58.981364 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.981345 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8459d4785b-m9qxj" Jun 11 16:54:58.987507 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.987486 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67dc78565d-dbhz6" Jun 11 16:54:58.990735 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.990715 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdzqx\" (UniqueName: \"kubernetes.io/projected/26915d24-6b82-41d7-9d72-e4846076e9da-kube-api-access-vdzqx\") pod \"ingress-canary-qxl9m\" (UID: \"26915d24-6b82-41d7-9d72-e4846076e9da\") " pod="openshift-ingress-canary/ingress-canary-qxl9m" Jun 11 16:54:58.990807 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.990792 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-config-volume\") pod \"dns-default-x4w9j\" (UID: \"e56370ed-2f52-42f7-aa1f-ec213d8d14a1\") " pod="openshift-dns/dns-default-x4w9j" Jun 11 16:54:58.990859 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.990838 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-tmp-dir\") pod \"dns-default-x4w9j\" (UID: \"e56370ed-2f52-42f7-aa1f-ec213d8d14a1\") " pod="openshift-dns/dns-default-x4w9j" Jun 11 16:54:58.990914 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.990897 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-metrics-tls\") pod \"dns-default-x4w9j\" (UID: \"e56370ed-2f52-42f7-aa1f-ec213d8d14a1\") " pod="openshift-dns/dns-default-x4w9j" Jun 11 16:54:58.990949 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.990932 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26915d24-6b82-41d7-9d72-e4846076e9da-cert\") pod \"ingress-canary-qxl9m\" (UID: \"26915d24-6b82-41d7-9d72-e4846076e9da\") " pod="openshift-ingress-canary/ingress-canary-qxl9m" Jun 11 16:54:58.990988 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.990966 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x8w5\" (UniqueName: \"kubernetes.io/projected/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-kube-api-access-5x8w5\") pod \"dns-default-x4w9j\" (UID: \"e56370ed-2f52-42f7-aa1f-ec213d8d14a1\") " pod="openshift-dns/dns-default-x4w9j" Jun 11 16:54:58.991080 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:58.991059 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:54:58.991133 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.991115 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-tmp-dir\") pod \"dns-default-x4w9j\" (UID: \"e56370ed-2f52-42f7-aa1f-ec213d8d14a1\") " pod="openshift-dns/dns-default-x4w9j" Jun 11 16:54:58.991133 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:58.991123 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-metrics-tls podName:e56370ed-2f52-42f7-aa1f-ec213d8d14a1 nodeName:}" failed. No retries permitted until 2026-06-11 16:54:59.491106422 +0000 UTC m=+36.751361306 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-metrics-tls") pod "dns-default-x4w9j" (UID: "e56370ed-2f52-42f7-aa1f-ec213d8d14a1") : secret "dns-default-metrics-tls" not found Jun 11 16:54:58.991474 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.991454 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-config-volume\") pod \"dns-default-x4w9j\" (UID: \"e56370ed-2f52-42f7-aa1f-ec213d8d14a1\") " pod="openshift-dns/dns-default-x4w9j" Jun 11 16:54:58.993275 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:58.993255 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26915d24-6b82-41d7-9d72-e4846076e9da-cert\") pod \"ingress-canary-qxl9m\" (UID: \"26915d24-6b82-41d7-9d72-e4846076e9da\") " pod="openshift-ingress-canary/ingress-canary-qxl9m" Jun 11 16:54:59.000771 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:59.000755 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x8w5\" (UniqueName: \"kubernetes.io/projected/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-kube-api-access-5x8w5\") pod \"dns-default-x4w9j\" (UID: \"e56370ed-2f52-42f7-aa1f-ec213d8d14a1\") " pod="openshift-dns/dns-default-x4w9j" Jun 11 16:54:59.000915 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:59.000900 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdzqx\" (UniqueName: \"kubernetes.io/projected/26915d24-6b82-41d7-9d72-e4846076e9da-kube-api-access-vdzqx\") pod \"ingress-canary-qxl9m\" (UID: \"26915d24-6b82-41d7-9d72-e4846076e9da\") " pod="openshift-ingress-canary/ingress-canary-qxl9m" Jun 11 16:54:59.018748 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:59.018727 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8799cfb8-xjd52" Jun 11 16:54:59.048990 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:59.048949 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qxl9m" Jun 11 16:54:59.186788 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:59.186146 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmsmp" Jun 11 16:54:59.186926 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:59.186795 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 16:54:59.186926 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:59.186801 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bmvr9" Jun 11 16:54:59.192614 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:59.192574 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 16:54:59.192951 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:59.192891 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 16:54:59.193610 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:59.193590 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 16:54:59.193685 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:59.193656 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mzdmg\"" Jun 11 16:54:59.193779 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:59.193590 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pxj6x\"" Jun 11 16:54:59.193852 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:59.193839 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 16:54:59.273661 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:59.273635 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67dc78565d-dbhz6"] Jun 11 16:54:59.276988 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:59.276964 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26ec855b_2b23_483d_bd71_ae6b2e21ad12.slice/crio-ad84a748b300a1afa1393211a04e634065c7e64c0d2fd7338c80646cd1b197ab WatchSource:0}: Error finding container ad84a748b300a1afa1393211a04e634065c7e64c0d2fd7338c80646cd1b197ab: Status 404 returned error can't find the container with id ad84a748b300a1afa1393211a04e634065c7e64c0d2fd7338c80646cd1b197ab Jun 11 16:54:59.281593 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:59.281431 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8459d4785b-m9qxj"] Jun 11 16:54:59.282187 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:59.282098 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qxl9m"] Jun 11 16:54:59.283383 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:59.283353 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26915d24_6b82_41d7_9d72_e4846076e9da.slice/crio-5e687118e918ca6d493ab87467ee152648a8ef01a252bb5f328fd25e26a3bf0d WatchSource:0}: Error finding container 5e687118e918ca6d493ab87467ee152648a8ef01a252bb5f328fd25e26a3bf0d: Status 404 returned error can't find the container with id 5e687118e918ca6d493ab87467ee152648a8ef01a252bb5f328fd25e26a3bf0d Jun 11 16:54:59.283851 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:59.283830 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podefcfb572_9a35_45e3_8959_1f3b3e1f60ef.slice/crio-d69446981eb9a9c047ff727dde7d5d38130c429678d4850118e656b6ef52072a WatchSource:0}: Error finding container d69446981eb9a9c047ff727dde7d5d38130c429678d4850118e656b6ef52072a: Status 404 returned error can't find the container with id d69446981eb9a9c047ff727dde7d5d38130c429678d4850118e656b6ef52072a Jun 11 16:54:59.310364 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:59.310343 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8799cfb8-xjd52"] Jun 11 16:54:59.315317 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:54:59.315295 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3924fcbb_d795_45ab_96f9_7cae5e426aa6.slice/crio-340cbee65c68c077fa4ced12533f3d358e5b725a7e7729a204208a0fd1fc69fd WatchSource:0}: Error finding container 340cbee65c68c077fa4ced12533f3d358e5b725a7e7729a204208a0fd1fc69fd: Status 404 returned error can't find the container with id 340cbee65c68c077fa4ced12533f3d358e5b725a7e7729a204208a0fd1fc69fd Jun 11 16:54:59.353700 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:59.353671 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p2xx8" event={"ID":"09e3bd81-f153-41cb-90c4-37372e7ebadd","Type":"ContainerStarted","Data":"d6938becfe7d4a2825fda1502212a9cb9f7f1d14f89619f577f61aca48716ebc"} Jun 11 16:54:59.354692 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:59.354669 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qxl9m" event={"ID":"26915d24-6b82-41d7-9d72-e4846076e9da","Type":"ContainerStarted","Data":"5e687118e918ca6d493ab87467ee152648a8ef01a252bb5f328fd25e26a3bf0d"} Jun 11 16:54:59.355603 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:59.355585 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8799cfb8-xjd52" event={"ID":"3924fcbb-d795-45ab-96f9-7cae5e426aa6","Type":"ContainerStarted","Data":"340cbee65c68c077fa4ced12533f3d358e5b725a7e7729a204208a0fd1fc69fd"} Jun 11 16:54:59.356536 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:59.356518 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67dc78565d-dbhz6" event={"ID":"26ec855b-2b23-483d-bd71-ae6b2e21ad12","Type":"ContainerStarted","Data":"ad84a748b300a1afa1393211a04e634065c7e64c0d2fd7338c80646cd1b197ab"} Jun 11 16:54:59.357450 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:59.357432 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8459d4785b-m9qxj" event={"ID":"efcfb572-9a35-45e3-8959-1f3b3e1f60ef","Type":"ContainerStarted","Data":"d69446981eb9a9c047ff727dde7d5d38130c429678d4850118e656b6ef52072a"} Jun 11 16:54:59.394909 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:59.394886 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-tls\") pod \"image-registry-7985894f89-cr2f7\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:54:59.394993 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:59.394970 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d7567f4-2d0c-4979-b2fe-a59eae95b974-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-6skv7\" (UID: \"2d7567f4-2d0c-4979-b2fe-a59eae95b974\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6skv7" Jun 11 16:54:59.395042 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:59.395021 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:54:59.395042 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:59.395038 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7985894f89-cr2f7: secret "image-registry-tls" not found Jun 11 16:54:59.395108 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:59.395058 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 16:54:59.395108 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:59.395088 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-tls podName:45c2cd36-79dd-429b-a48a-69e118b687e8 nodeName:}" failed. No retries permitted until 2026-06-11 16:55:00.395071922 +0000 UTC m=+37.655326807 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-tls") pod "image-registry-7985894f89-cr2f7" (UID: "45c2cd36-79dd-429b-a48a-69e118b687e8") : secret "image-registry-tls" not found Jun 11 16:54:59.395108 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:59.395102 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7567f4-2d0c-4979-b2fe-a59eae95b974-networking-console-plugin-cert podName:2d7567f4-2d0c-4979-b2fe-a59eae95b974 nodeName:}" failed. No retries permitted until 2026-06-11 16:55:00.395095926 +0000 UTC m=+37.655350809 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2d7567f4-2d0c-4979-b2fe-a59eae95b974-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-6skv7" (UID: "2d7567f4-2d0c-4979-b2fe-a59eae95b974") : secret "networking-console-plugin-cert" not found Jun 11 16:54:59.495777 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:59.495713 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-metrics-tls\") pod \"dns-default-x4w9j\" (UID: \"e56370ed-2f52-42f7-aa1f-ec213d8d14a1\") " pod="openshift-dns/dns-default-x4w9j" Jun 11 16:54:59.495892 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:59.495862 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:54:59.495947 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:54:59.495920 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-metrics-tls podName:e56370ed-2f52-42f7-aa1f-ec213d8d14a1 nodeName:}" failed. No retries permitted until 2026-06-11 16:55:00.495902474 +0000 UTC m=+37.756157364 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-metrics-tls") pod "dns-default-x4w9j" (UID: "e56370ed-2f52-42f7-aa1f-ec213d8d14a1") : secret "dns-default-metrics-tls" not found Jun 11 16:54:59.655147 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:59.655106 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqrvn_286b1d27-5581-44ce-b5d6-309dad57b6c9/konnectivity-agent/0.log" limit=1024 Jun 11 16:54:59.758766 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:54:59.758678 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqrvn_286b1d27-5581-44ce-b5d6-309dad57b6c9/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:00.402797 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:00.402758 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d7567f4-2d0c-4979-b2fe-a59eae95b974-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-6skv7\" (UID: \"2d7567f4-2d0c-4979-b2fe-a59eae95b974\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6skv7" Jun 11 16:55:00.403306 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:00.402900 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-tls\") pod \"image-registry-7985894f89-cr2f7\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:55:00.403306 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:55:00.403099 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:55:00.403306 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:55:00.403114 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7985894f89-cr2f7: secret "image-registry-tls" not found Jun 11 16:55:00.403306 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:55:00.403172 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-tls podName:45c2cd36-79dd-429b-a48a-69e118b687e8 nodeName:}" failed. No retries permitted until 2026-06-11 16:55:02.403152449 +0000 UTC m=+39.663407338 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-tls") pod "image-registry-7985894f89-cr2f7" (UID: "45c2cd36-79dd-429b-a48a-69e118b687e8") : secret "image-registry-tls" not found Jun 11 16:55:00.403661 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:55:00.403585 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 16:55:00.403661 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:55:00.403635 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7567f4-2d0c-4979-b2fe-a59eae95b974-networking-console-plugin-cert podName:2d7567f4-2d0c-4979-b2fe-a59eae95b974 nodeName:}" failed. No retries permitted until 2026-06-11 16:55:02.40361798 +0000 UTC m=+39.663872871 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2d7567f4-2d0c-4979-b2fe-a59eae95b974-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-6skv7" (UID: "2d7567f4-2d0c-4979-b2fe-a59eae95b974") : secret "networking-console-plugin-cert" not found Jun 11 16:55:00.503938 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:00.503901 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-metrics-tls\") pod \"dns-default-x4w9j\" (UID: \"e56370ed-2f52-42f7-aa1f-ec213d8d14a1\") " pod="openshift-dns/dns-default-x4w9j" Jun 11 16:55:00.505202 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:55:00.505073 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:55:00.505202 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:55:00.505170 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-metrics-tls podName:e56370ed-2f52-42f7-aa1f-ec213d8d14a1 nodeName:}" failed. No retries permitted until 2026-06-11 16:55:02.505149699 +0000 UTC m=+39.765404589 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-metrics-tls") pod "dns-default-x4w9j" (UID: "e56370ed-2f52-42f7-aa1f-ec213d8d14a1") : secret "dns-default-metrics-tls" not found Jun 11 16:55:00.964317 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:00.964213 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqrvn_286b1d27-5581-44ce-b5d6-309dad57b6c9/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:01.067931 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:01.067878 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqrvn_286b1d27-5581-44ce-b5d6-309dad57b6c9/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:02.420889 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:02.420837 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d7567f4-2d0c-4979-b2fe-a59eae95b974-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-6skv7\" (UID: \"2d7567f4-2d0c-4979-b2fe-a59eae95b974\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6skv7" Jun 11 16:55:02.421335 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:02.420928 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-tls\") pod \"image-registry-7985894f89-cr2f7\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:55:02.421335 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:55:02.420949 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 16:55:02.421335 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:55:02.421038 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7567f4-2d0c-4979-b2fe-a59eae95b974-networking-console-plugin-cert podName:2d7567f4-2d0c-4979-b2fe-a59eae95b974 nodeName:}" failed. No retries permitted until 2026-06-11 16:55:06.421006078 +0000 UTC m=+43.681260977 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2d7567f4-2d0c-4979-b2fe-a59eae95b974-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-6skv7" (UID: "2d7567f4-2d0c-4979-b2fe-a59eae95b974") : secret "networking-console-plugin-cert" not found Jun 11 16:55:02.421335 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:55:02.421086 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:55:02.421335 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:55:02.421101 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7985894f89-cr2f7: secret "image-registry-tls" not found Jun 11 16:55:02.421335 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:55:02.421149 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-tls podName:45c2cd36-79dd-429b-a48a-69e118b687e8 nodeName:}" failed. No retries permitted until 2026-06-11 16:55:06.421133102 +0000 UTC m=+43.681387987 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-tls") pod "image-registry-7985894f89-cr2f7" (UID: "45c2cd36-79dd-429b-a48a-69e118b687e8") : secret "image-registry-tls" not found Jun 11 16:55:02.522389 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:02.522353 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-metrics-tls\") pod \"dns-default-x4w9j\" (UID: \"e56370ed-2f52-42f7-aa1f-ec213d8d14a1\") " pod="openshift-dns/dns-default-x4w9j" Jun 11 16:55:02.522582 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:55:02.522557 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:55:02.522647 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:55:02.522624 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-metrics-tls podName:e56370ed-2f52-42f7-aa1f-ec213d8d14a1 nodeName:}" failed. No retries permitted until 2026-06-11 16:55:06.522604056 +0000 UTC m=+43.782858941 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-metrics-tls") pod "dns-default-x4w9j" (UID: "e56370ed-2f52-42f7-aa1f-ec213d8d14a1") : secret "dns-default-metrics-tls" not found Jun 11 16:55:06.455355 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:06.455167 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d7567f4-2d0c-4979-b2fe-a59eae95b974-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-6skv7\" (UID: \"2d7567f4-2d0c-4979-b2fe-a59eae95b974\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6skv7" Jun 11 16:55:06.455739 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:06.455378 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-tls\") pod \"image-registry-7985894f89-cr2f7\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:55:06.455739 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:55:06.455315 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 16:55:06.455739 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:55:06.455473 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7567f4-2d0c-4979-b2fe-a59eae95b974-networking-console-plugin-cert podName:2d7567f4-2d0c-4979-b2fe-a59eae95b974 nodeName:}" failed. No retries permitted until 2026-06-11 16:55:14.455457713 +0000 UTC m=+51.715712597 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2d7567f4-2d0c-4979-b2fe-a59eae95b974-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-6skv7" (UID: "2d7567f4-2d0c-4979-b2fe-a59eae95b974") : secret "networking-console-plugin-cert" not found Jun 11 16:55:06.455739 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:55:06.455477 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:55:06.455739 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:55:06.455489 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7985894f89-cr2f7: secret "image-registry-tls" not found Jun 11 16:55:06.455739 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:55:06.455529 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-tls podName:45c2cd36-79dd-429b-a48a-69e118b687e8 nodeName:}" failed. No retries permitted until 2026-06-11 16:55:14.455515312 +0000 UTC m=+51.715770195 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-tls") pod "image-registry-7985894f89-cr2f7" (UID: "45c2cd36-79dd-429b-a48a-69e118b687e8") : secret "image-registry-tls" not found Jun 11 16:55:06.556692 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:06.556658 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-metrics-tls\") pod \"dns-default-x4w9j\" (UID: \"e56370ed-2f52-42f7-aa1f-ec213d8d14a1\") " pod="openshift-dns/dns-default-x4w9j" Jun 11 16:55:06.556874 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:55:06.556786 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:55:06.556874 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:55:06.556853 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-metrics-tls podName:e56370ed-2f52-42f7-aa1f-ec213d8d14a1 nodeName:}" failed. No retries permitted until 2026-06-11 16:55:14.556838946 +0000 UTC m=+51.817093829 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-metrics-tls") pod "dns-default-x4w9j" (UID: "e56370ed-2f52-42f7-aa1f-ec213d8d14a1") : secret "dns-default-metrics-tls" not found Jun 11 16:55:08.392908 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:08.392865 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8799cfb8-xjd52" event={"ID":"3924fcbb-d795-45ab-96f9-7cae5e426aa6","Type":"ContainerStarted","Data":"30d7be0d29bb901ffd2acb0c1427bf08a1611d20a9394aa00f5336ee64d83d3e"} Jun 11 16:55:08.393364 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:08.392971 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8799cfb8-xjd52" Jun 11 16:55:08.394862 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:08.394839 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8799cfb8-xjd52" Jun 11 16:55:08.395230 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:08.395209 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67dc78565d-dbhz6" event={"ID":"26ec855b-2b23-483d-bd71-ae6b2e21ad12","Type":"ContainerStarted","Data":"66340725a56e2608a657b20a2cdcc05c098fbaab5e11687b5ed36feb098decf4"} Jun 11 16:55:08.395323 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:08.395247 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67dc78565d-dbhz6" event={"ID":"26ec855b-2b23-483d-bd71-ae6b2e21ad12","Type":"ContainerStarted","Data":"10efc64cbdcc7ea024b76f0461b01a3efbceae7d383ebd7808f71d600d83c308"} Jun 11 16:55:08.395323 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:08.395265 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67dc78565d-dbhz6" event={"ID":"26ec855b-2b23-483d-bd71-ae6b2e21ad12","Type":"ContainerStarted","Data":"9e273d37582f916bf1a959be7b3583cf676ae5c17793bf55593c10d199bba7e7"} Jun 11 16:55:08.396603 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:08.396577 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8459d4785b-m9qxj" event={"ID":"efcfb572-9a35-45e3-8959-1f3b3e1f60ef","Type":"ContainerStarted","Data":"b98eb6fafec35068ce78c3ced17fcc4374a457a9f224dd20ac285dbe214596c4"} Jun 11 16:55:08.397872 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:08.397854 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qxl9m" event={"ID":"26915d24-6b82-41d7-9d72-e4846076e9da","Type":"ContainerStarted","Data":"94869716bd092d53a37ae830f4f2e853b3a5eec31967418ce78d1391ea4d561b"} Jun 11 16:55:08.426206 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:08.426165 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8799cfb8-xjd52" podStartSLOduration=36.464468139 podStartE2EDuration="44.426152634s" totalImagesPullingTime="7.961684495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:54:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:55:08.425757707 +0000 UTC m=+45.686012612" watchObservedRunningTime="2026-06-11 16:55:08.426152634 +0000 UTC m=+45.686407541" Jun 11 16:55:08.426295 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:08.426277 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-p2xx8" podStartSLOduration=17.220559289 podStartE2EDuration="45.426272402s" totalImagesPullingTime="28.205713113s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:54:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:54:59.39752006 +0000 UTC m=+36.657774965" watchObservedRunningTime="2026-06-11 16:55:08.426272402 +0000 UTC m=+45.686527359" Jun 11 16:55:08.458783 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:08.458741 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8459d4785b-m9qxj" podStartSLOduration=36.47028003 podStartE2EDuration="44.458726324s" totalImagesPullingTime="7.988446294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:54:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:55:08.458457854 +0000 UTC m=+45.718712760" watchObservedRunningTime="2026-06-11 16:55:08.458726324 +0000 UTC m=+45.718981224" Jun 11 16:55:08.507219 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:08.507174 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67dc78565d-dbhz6" podStartSLOduration=36.521726828 podStartE2EDuration="44.507162648s" totalImagesPullingTime="7.98543582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:54:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:55:08.506084927 +0000 UTC m=+45.766339874" watchObservedRunningTime="2026-06-11 16:55:08.507162648 +0000 UTC m=+45.767417566" Jun 11 16:55:08.552903 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:08.552857 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qxl9m" podStartSLOduration=2.580107344 podStartE2EDuration="10.552842527s" totalImagesPullingTime="7.972735183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:54:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:55:08.551539012 +0000 UTC m=+45.811793928" watchObservedRunningTime="2026-06-11 16:55:08.552842527 +0000 UTC m=+45.813097429" Jun 11 16:55:14.513688 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:14.513652 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-tls\") pod \"image-registry-7985894f89-cr2f7\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:55:14.514079 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:14.513737 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d7567f4-2d0c-4979-b2fe-a59eae95b974-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-6skv7\" (UID: \"2d7567f4-2d0c-4979-b2fe-a59eae95b974\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6skv7" Jun 11 16:55:14.514079 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:55:14.513791 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:55:14.514079 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:55:14.513811 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7985894f89-cr2f7: secret "image-registry-tls" not found Jun 11 16:55:14.514079 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:55:14.513864 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 16:55:14.514079 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:55:14.513879 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-tls podName:45c2cd36-79dd-429b-a48a-69e118b687e8 nodeName:}" failed. No retries permitted until 2026-06-11 16:55:30.513862092 +0000 UTC m=+67.774116980 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-tls") pod "image-registry-7985894f89-cr2f7" (UID: "45c2cd36-79dd-429b-a48a-69e118b687e8") : secret "image-registry-tls" not found Jun 11 16:55:14.514079 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:55:14.513904 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7567f4-2d0c-4979-b2fe-a59eae95b974-networking-console-plugin-cert podName:2d7567f4-2d0c-4979-b2fe-a59eae95b974 nodeName:}" failed. No retries permitted until 2026-06-11 16:55:30.51389253 +0000 UTC m=+67.774147415 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2d7567f4-2d0c-4979-b2fe-a59eae95b974-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-6skv7" (UID: "2d7567f4-2d0c-4979-b2fe-a59eae95b974") : secret "networking-console-plugin-cert" not found Jun 11 16:55:14.614468 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:14.614437 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-metrics-tls\") pod \"dns-default-x4w9j\" (UID: \"e56370ed-2f52-42f7-aa1f-ec213d8d14a1\") " pod="openshift-dns/dns-default-x4w9j" Jun 11 16:55:14.614616 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:55:14.614573 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:55:14.614654 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:55:14.614627 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-metrics-tls podName:e56370ed-2f52-42f7-aa1f-ec213d8d14a1 nodeName:}" failed. No retries permitted until 2026-06-11 16:55:30.614613023 +0000 UTC m=+67.874867908 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-metrics-tls") pod "dns-default-x4w9j" (UID: "e56370ed-2f52-42f7-aa1f-ec213d8d14a1") : secret "dns-default-metrics-tls" not found Jun 11 16:55:23.343044 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:23.343019 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c7hbj" Jun 11 16:55:28.922494 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:28.922457 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42-metrics-certs\") pod \"network-metrics-daemon-pdg6r\" (UID: \"66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42\") " pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 16:55:28.922909 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:28.922523 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/183fce84-80c4-4c1d-aa51-e962fdd8b887-original-pull-secret\") pod \"global-pull-secret-syncer-bmvr9\" (UID: \"183fce84-80c4-4c1d-aa51-e962fdd8b887\") " pod="kube-system/global-pull-secret-syncer-bmvr9" Jun 11 16:55:28.925374 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:28.925352 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 16:55:28.925949 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:28.925934 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 16:55:28.932875 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:55:28.932860 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 16:55:28.932954 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:55:28.932914 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42-metrics-certs podName:66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42 nodeName:}" failed. No retries permitted until 2026-06-11 16:56:32.932898198 +0000 UTC m=+130.193153087 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42-metrics-certs") pod "network-metrics-daemon-pdg6r" (UID: "66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42") : secret "metrics-daemon-secret" not found Jun 11 16:55:28.935572 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:28.935552 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/183fce84-80c4-4c1d-aa51-e962fdd8b887-original-pull-secret\") pod \"global-pull-secret-syncer-bmvr9\" (UID: \"183fce84-80c4-4c1d-aa51-e962fdd8b887\") " pod="kube-system/global-pull-secret-syncer-bmvr9" Jun 11 16:55:29.023788 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:29.023762 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57rpw\" (UniqueName: \"kubernetes.io/projected/b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3-kube-api-access-57rpw\") pod \"network-check-target-nmsmp\" (UID: \"b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3\") " pod="openshift-network-diagnostics/network-check-target-nmsmp" Jun 11 16:55:29.026597 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:29.026581 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 16:55:29.037157 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:29.037136 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 16:55:29.047387 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:29.047369 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57rpw\" (UniqueName: \"kubernetes.io/projected/b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3-kube-api-access-57rpw\") pod \"network-check-target-nmsmp\" (UID: \"b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3\") " pod="openshift-network-diagnostics/network-check-target-nmsmp" Jun 11 16:55:29.207996 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:29.207930 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mzdmg\"" Jun 11 16:55:29.211906 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:29.211892 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bmvr9" Jun 11 16:55:29.215640 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:29.215625 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmsmp" Jun 11 16:55:29.341045 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:29.341006 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bmvr9"] Jun 11 16:55:29.343639 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:55:29.343613 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod183fce84_80c4_4c1d_aa51_e962fdd8b887.slice/crio-5a14cf2003ed5a674628c6e01705337c1d636ba4136af6a37d222ba54db3851e WatchSource:0}: Error finding container 5a14cf2003ed5a674628c6e01705337c1d636ba4136af6a37d222ba54db3851e: Status 404 returned error can't find the container with id 5a14cf2003ed5a674628c6e01705337c1d636ba4136af6a37d222ba54db3851e Jun 11 16:55:29.365062 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:29.364945 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nmsmp"] Jun 11 16:55:29.367200 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:55:29.367169 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5358833_f0d1_4f0d_94dc_6ef3c9cfbdd3.slice/crio-333bd3e5497d274b2ab00243d2f4fe3682b6551d6756f8214c19bc4b90057deb WatchSource:0}: Error finding container 333bd3e5497d274b2ab00243d2f4fe3682b6551d6756f8214c19bc4b90057deb: Status 404 returned error can't find the container with id 333bd3e5497d274b2ab00243d2f4fe3682b6551d6756f8214c19bc4b90057deb Jun 11 16:55:29.465541 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:29.465445 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nmsmp" event={"ID":"b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3","Type":"ContainerStarted","Data":"333bd3e5497d274b2ab00243d2f4fe3682b6551d6756f8214c19bc4b90057deb"} Jun 11 16:55:29.466484 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:29.466462 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bmvr9" event={"ID":"183fce84-80c4-4c1d-aa51-e962fdd8b887","Type":"ContainerStarted","Data":"5a14cf2003ed5a674628c6e01705337c1d636ba4136af6a37d222ba54db3851e"} Jun 11 16:55:30.536096 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:30.536060 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d7567f4-2d0c-4979-b2fe-a59eae95b974-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-6skv7\" (UID: \"2d7567f4-2d0c-4979-b2fe-a59eae95b974\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6skv7" Jun 11 16:55:30.536470 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:30.536104 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-tls\") pod \"image-registry-7985894f89-cr2f7\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:55:30.536470 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:55:30.536203 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:55:30.536470 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:55:30.536203 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 16:55:30.536470 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:55:30.536273 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7567f4-2d0c-4979-b2fe-a59eae95b974-networking-console-plugin-cert podName:2d7567f4-2d0c-4979-b2fe-a59eae95b974 nodeName:}" failed. No retries permitted until 2026-06-11 16:56:02.53625634 +0000 UTC m=+99.796511224 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2d7567f4-2d0c-4979-b2fe-a59eae95b974-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-6skv7" (UID: "2d7567f4-2d0c-4979-b2fe-a59eae95b974") : secret "networking-console-plugin-cert" not found Jun 11 16:55:30.536470 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:55:30.536214 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7985894f89-cr2f7: secret "image-registry-tls" not found Jun 11 16:55:30.536470 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:55:30.536347 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-tls podName:45c2cd36-79dd-429b-a48a-69e118b687e8 nodeName:}" failed. No retries permitted until 2026-06-11 16:56:02.536334291 +0000 UTC m=+99.796589193 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-tls") pod "image-registry-7985894f89-cr2f7" (UID: "45c2cd36-79dd-429b-a48a-69e118b687e8") : secret "image-registry-tls" not found Jun 11 16:55:30.636869 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:30.636807 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-metrics-tls\") pod \"dns-default-x4w9j\" (UID: \"e56370ed-2f52-42f7-aa1f-ec213d8d14a1\") " pod="openshift-dns/dns-default-x4w9j" Jun 11 16:55:30.637061 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:55:30.637007 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:55:30.637127 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:55:30.637077 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-metrics-tls podName:e56370ed-2f52-42f7-aa1f-ec213d8d14a1 nodeName:}" failed. No retries permitted until 2026-06-11 16:56:02.637057773 +0000 UTC m=+99.897312666 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-metrics-tls") pod "dns-default-x4w9j" (UID: "e56370ed-2f52-42f7-aa1f-ec213d8d14a1") : secret "dns-default-metrics-tls" not found Jun 11 16:55:33.481731 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:33.481687 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nmsmp" event={"ID":"b5358833-f0d1-4f0d-94dc-6ef3c9cfbdd3","Type":"ContainerStarted","Data":"fa0e03c565fd2943764ef9616fbed0fb7655da32b1b0b96ea3e4be2a4fbd5c14"} Jun 11 16:55:33.482229 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:33.481815 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nmsmp" Jun 11 16:55:33.499533 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:33.499479 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nmsmp" podStartSLOduration=67.204930243 podStartE2EDuration="1m10.499459727s" totalImagesPullingTime="3.294529484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:54:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:55:33.498913671 +0000 UTC m=+70.759168578" watchObservedRunningTime="2026-06-11 16:55:33.499459727 +0000 UTC m=+70.759714612" Jun 11 16:55:34.486562 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:34.486474 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bmvr9" event={"ID":"183fce84-80c4-4c1d-aa51-e962fdd8b887","Type":"ContainerStarted","Data":"65db084dfd7118d69ca244b479be0d9e7d9345cf8da12fea9fa1c03f5033264a"} Jun 11 16:55:34.502543 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:55:34.502493 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bmvr9" podStartSLOduration=66.765522957 podStartE2EDuration="1m11.502476572s" totalImagesPullingTime="4.736953615s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:54:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:55:34.501144976 +0000 UTC m=+71.761399886" watchObservedRunningTime="2026-06-11 16:55:34.502476572 +0000 UTC m=+71.762731479" Jun 11 16:56:02.576969 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:56:02.576934 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d7567f4-2d0c-4979-b2fe-a59eae95b974-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-6skv7\" (UID: \"2d7567f4-2d0c-4979-b2fe-a59eae95b974\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6skv7" Jun 11 16:56:02.577390 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:56:02.576977 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-tls\") pod \"image-registry-7985894f89-cr2f7\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:56:02.577390 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:56:02.577076 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:56:02.577390 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:56:02.577077 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 16:56:02.577390 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:56:02.577155 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7567f4-2d0c-4979-b2fe-a59eae95b974-networking-console-plugin-cert podName:2d7567f4-2d0c-4979-b2fe-a59eae95b974 nodeName:}" failed. No retries permitted until 2026-06-11 16:57:06.577139097 +0000 UTC m=+163.837393981 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2d7567f4-2d0c-4979-b2fe-a59eae95b974-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-6skv7" (UID: "2d7567f4-2d0c-4979-b2fe-a59eae95b974") : secret "networking-console-plugin-cert" not found Jun 11 16:56:02.577390 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:56:02.577095 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7985894f89-cr2f7: secret "image-registry-tls" not found Jun 11 16:56:02.577390 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:56:02.577214 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-tls podName:45c2cd36-79dd-429b-a48a-69e118b687e8 nodeName:}" failed. No retries permitted until 2026-06-11 16:57:06.577201777 +0000 UTC m=+163.837456661 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-tls") pod "image-registry-7985894f89-cr2f7" (UID: "45c2cd36-79dd-429b-a48a-69e118b687e8") : secret "image-registry-tls" not found Jun 11 16:56:02.677853 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:56:02.677806 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-metrics-tls\") pod \"dns-default-x4w9j\" (UID: \"e56370ed-2f52-42f7-aa1f-ec213d8d14a1\") " pod="openshift-dns/dns-default-x4w9j" Jun 11 16:56:02.677984 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:56:02.677942 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:56:02.678020 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:56:02.678006 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-metrics-tls podName:e56370ed-2f52-42f7-aa1f-ec213d8d14a1 nodeName:}" failed. No retries permitted until 2026-06-11 16:57:06.677987449 +0000 UTC m=+163.938242344 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-metrics-tls") pod "dns-default-x4w9j" (UID: "e56370ed-2f52-42f7-aa1f-ec213d8d14a1") : secret "dns-default-metrics-tls" not found Jun 11 16:56:04.488834 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:56:04.488788 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nmsmp" Jun 11 16:56:32.998096 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:56:32.998049 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42-metrics-certs\") pod \"network-metrics-daemon-pdg6r\" (UID: \"66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42\") " pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 16:56:32.998579 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:56:32.998196 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 16:56:32.998579 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:56:32.998271 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42-metrics-certs podName:66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42 nodeName:}" failed. No retries permitted until 2026-06-11 16:58:34.998254487 +0000 UTC m=+252.258509371 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42-metrics-certs") pod "network-metrics-daemon-pdg6r" (UID: "66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42") : secret "metrics-daemon-secret" not found Jun 11 16:57:01.623555 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:57:01.623497 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6skv7" podUID="2d7567f4-2d0c-4979-b2fe-a59eae95b974" Jun 11 16:57:01.648714 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:57:01.648683 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7985894f89-cr2f7" podUID="45c2cd36-79dd-429b-a48a-69e118b687e8" Jun 11 16:57:01.729992 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:57:01.729962 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-x4w9j" podUID="e56370ed-2f52-42f7-aa1f-ec213d8d14a1" Jun 11 16:57:01.734113 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:57:01.734084 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x4w9j" Jun 11 16:57:01.734233 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:57:01.734084 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6skv7" Jun 11 16:57:01.734293 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:57:01.734092 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:57:02.218167 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:57:02.218114 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-pdg6r" podUID="66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42" Jun 11 16:57:06.635193 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:57:06.635104 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d7567f4-2d0c-4979-b2fe-a59eae95b974-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-6skv7\" (UID: \"2d7567f4-2d0c-4979-b2fe-a59eae95b974\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6skv7" Jun 11 16:57:06.635193 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:57:06.635151 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-tls\") pod \"image-registry-7985894f89-cr2f7\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:57:06.635735 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:57:06.635252 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:57:06.635735 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:57:06.635252 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 16:57:06.635735 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:57:06.635331 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7567f4-2d0c-4979-b2fe-a59eae95b974-networking-console-plugin-cert podName:2d7567f4-2d0c-4979-b2fe-a59eae95b974 nodeName:}" failed. No retries permitted until 2026-06-11 16:59:08.635310767 +0000 UTC m=+285.895565665 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2d7567f4-2d0c-4979-b2fe-a59eae95b974-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-6skv7" (UID: "2d7567f4-2d0c-4979-b2fe-a59eae95b974") : secret "networking-console-plugin-cert" not found Jun 11 16:57:06.635735 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:57:06.635264 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7985894f89-cr2f7: secret "image-registry-tls" not found Jun 11 16:57:06.635735 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:57:06.635397 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-tls podName:45c2cd36-79dd-429b-a48a-69e118b687e8 nodeName:}" failed. No retries permitted until 2026-06-11 16:59:08.635384746 +0000 UTC m=+285.895639630 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-tls") pod "image-registry-7985894f89-cr2f7" (UID: "45c2cd36-79dd-429b-a48a-69e118b687e8") : secret "image-registry-tls" not found Jun 11 16:57:06.736235 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:57:06.736191 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-metrics-tls\") pod \"dns-default-x4w9j\" (UID: \"e56370ed-2f52-42f7-aa1f-ec213d8d14a1\") " pod="openshift-dns/dns-default-x4w9j" Jun 11 16:57:06.736402 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:57:06.736331 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:57:06.736402 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:57:06.736386 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-metrics-tls podName:e56370ed-2f52-42f7-aa1f-ec213d8d14a1 nodeName:}" failed. No retries permitted until 2026-06-11 16:59:08.736370907 +0000 UTC m=+285.996625791 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-metrics-tls") pod "dns-default-x4w9j" (UID: "e56370ed-2f52-42f7-aa1f-ec213d8d14a1") : secret "dns-default-metrics-tls" not found Jun 11 16:57:07.752590 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:57:07.752513 2565 generic.go:356] "Generic (PLEG): container finished" podID="3924fcbb-d795-45ab-96f9-7cae5e426aa6" containerID="30d7be0d29bb901ffd2acb0c1427bf08a1611d20a9394aa00f5336ee64d83d3e" exitCode=1 Jun 11 16:57:07.753028 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:57:07.752587 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8799cfb8-xjd52" event={"ID":"3924fcbb-d795-45ab-96f9-7cae5e426aa6","Type":"ContainerDied","Data":"30d7be0d29bb901ffd2acb0c1427bf08a1611d20a9394aa00f5336ee64d83d3e"} Jun 11 16:57:07.753028 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:57:07.752934 2565 scope.go:117] "RemoveContainer" containerID="30d7be0d29bb901ffd2acb0c1427bf08a1611d20a9394aa00f5336ee64d83d3e" Jun 11 16:57:07.754133 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:57:07.754075 2565 generic.go:356] "Generic (PLEG): container finished" podID="efcfb572-9a35-45e3-8959-1f3b3e1f60ef" containerID="b98eb6fafec35068ce78c3ced17fcc4374a457a9f224dd20ac285dbe214596c4" exitCode=255 Jun 11 16:57:07.754133 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:57:07.754122 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8459d4785b-m9qxj" event={"ID":"efcfb572-9a35-45e3-8959-1f3b3e1f60ef","Type":"ContainerDied","Data":"b98eb6fafec35068ce78c3ced17fcc4374a457a9f224dd20ac285dbe214596c4"} Jun 11 16:57:07.754411 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:57:07.754392 2565 scope.go:117] "RemoveContainer" containerID="b98eb6fafec35068ce78c3ced17fcc4374a457a9f224dd20ac285dbe214596c4" Jun 11 16:57:08.393070 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:57:08.393039 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8799cfb8-xjd52" Jun 11 16:57:08.759265 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:57:08.759186 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8799cfb8-xjd52" event={"ID":"3924fcbb-d795-45ab-96f9-7cae5e426aa6","Type":"ContainerStarted","Data":"d2aa787e4a28c5ca85388108be82ceba509316410fe9432428480d2aa7f843fd"} Jun 11 16:57:08.759741 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:57:08.759364 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8799cfb8-xjd52" Jun 11 16:57:08.760004 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:57:08.759987 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8799cfb8-xjd52" Jun 11 16:57:08.761028 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:57:08.761004 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8459d4785b-m9qxj" event={"ID":"efcfb572-9a35-45e3-8959-1f3b3e1f60ef","Type":"ContainerStarted","Data":"2120139caeb31cbc28d825cb3a34fe915c6941a7d5a8a531aee90f25f1274674"} Jun 11 16:57:16.184712 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:57:16.184676 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 16:58:35.072702 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:58:35.072665 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42-metrics-certs\") pod \"network-metrics-daemon-pdg6r\" (UID: \"66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42\") " pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 16:58:35.073190 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:58:35.072785 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 16:58:35.073190 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:58:35.072859 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42-metrics-certs podName:66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42 nodeName:}" failed. No retries permitted until 2026-06-11 17:00:37.072844734 +0000 UTC m=+374.333099618 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42-metrics-certs") pod "network-metrics-daemon-pdg6r" (UID: "66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42") : secret "metrics-daemon-secret" not found Jun 11 16:58:38.456789 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:58:38.456760 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mb5bm_b0a87b53-941e-4917-b0a7-8459458b8b25/dns-node-resolver/0.log" Jun 11 16:58:39.660485 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:58:39.660453 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h4cjk_5f24a441-bff5-4a1f-bff7-92b60f4a2394/node-ca/0.log" Jun 11 16:58:40.258831 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:58:40.258800 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qxl9m_26915d24-6b82-41d7-9d72-e4846076e9da/serve-healthcheck-canary/0.log" Jun 11 16:59:01.957061 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:01.957026 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fc8kc"] Jun 11 16:59:01.960006 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:01.959990 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fc8kc" Jun 11 16:59:01.963251 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:01.963229 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 16:59:01.963486 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:01.963467 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 16:59:01.964069 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:01.964050 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 16:59:01.964416 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:01.964399 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bjndh\"" Jun 11 16:59:01.964495 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:01.964436 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 16:59:01.983265 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:01.983244 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fc8kc"] Jun 11 16:59:02.074277 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:02.074241 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b7f52e2-5d32-4c18-9483-549621c0a42e-data-volume\") pod \"insights-runtime-extractor-fc8kc\" (UID: \"6b7f52e2-5d32-4c18-9483-549621c0a42e\") " pod="openshift-insights/insights-runtime-extractor-fc8kc" Jun 11 16:59:02.074453 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:02.074291 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b7f52e2-5d32-4c18-9483-549621c0a42e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fc8kc\" (UID: \"6b7f52e2-5d32-4c18-9483-549621c0a42e\") " pod="openshift-insights/insights-runtime-extractor-fc8kc" Jun 11 16:59:02.074453 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:02.074340 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6b7f52e2-5d32-4c18-9483-549621c0a42e-crio-socket\") pod \"insights-runtime-extractor-fc8kc\" (UID: \"6b7f52e2-5d32-4c18-9483-549621c0a42e\") " pod="openshift-insights/insights-runtime-extractor-fc8kc" Jun 11 16:59:02.074453 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:02.074388 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b7f52e2-5d32-4c18-9483-549621c0a42e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fc8kc\" (UID: \"6b7f52e2-5d32-4c18-9483-549621c0a42e\") " pod="openshift-insights/insights-runtime-extractor-fc8kc" Jun 11 16:59:02.074566 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:02.074451 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlfv8\" (UniqueName: \"kubernetes.io/projected/6b7f52e2-5d32-4c18-9483-549621c0a42e-kube-api-access-mlfv8\") pod \"insights-runtime-extractor-fc8kc\" (UID: \"6b7f52e2-5d32-4c18-9483-549621c0a42e\") " pod="openshift-insights/insights-runtime-extractor-fc8kc" Jun 11 16:59:02.175000 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:02.174964 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b7f52e2-5d32-4c18-9483-549621c0a42e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fc8kc\" (UID: \"6b7f52e2-5d32-4c18-9483-549621c0a42e\") " pod="openshift-insights/insights-runtime-extractor-fc8kc" Jun 11 16:59:02.175170 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:02.175026 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlfv8\" (UniqueName: \"kubernetes.io/projected/6b7f52e2-5d32-4c18-9483-549621c0a42e-kube-api-access-mlfv8\") pod \"insights-runtime-extractor-fc8kc\" (UID: \"6b7f52e2-5d32-4c18-9483-549621c0a42e\") " pod="openshift-insights/insights-runtime-extractor-fc8kc" Jun 11 16:59:02.175170 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:02.175084 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b7f52e2-5d32-4c18-9483-549621c0a42e-data-volume\") pod \"insights-runtime-extractor-fc8kc\" (UID: \"6b7f52e2-5d32-4c18-9483-549621c0a42e\") " pod="openshift-insights/insights-runtime-extractor-fc8kc" Jun 11 16:59:02.175170 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:02.175138 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b7f52e2-5d32-4c18-9483-549621c0a42e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fc8kc\" (UID: \"6b7f52e2-5d32-4c18-9483-549621c0a42e\") " pod="openshift-insights/insights-runtime-extractor-fc8kc" Jun 11 16:59:02.175291 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:02.175164 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6b7f52e2-5d32-4c18-9483-549621c0a42e-crio-socket\") pod \"insights-runtime-extractor-fc8kc\" (UID: \"6b7f52e2-5d32-4c18-9483-549621c0a42e\") " pod="openshift-insights/insights-runtime-extractor-fc8kc" Jun 11 16:59:02.175291 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:02.175257 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6b7f52e2-5d32-4c18-9483-549621c0a42e-crio-socket\") pod \"insights-runtime-extractor-fc8kc\" (UID: \"6b7f52e2-5d32-4c18-9483-549621c0a42e\") " pod="openshift-insights/insights-runtime-extractor-fc8kc" Jun 11 16:59:02.175448 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:02.175425 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b7f52e2-5d32-4c18-9483-549621c0a42e-data-volume\") pod \"insights-runtime-extractor-fc8kc\" (UID: \"6b7f52e2-5d32-4c18-9483-549621c0a42e\") " pod="openshift-insights/insights-runtime-extractor-fc8kc" Jun 11 16:59:02.175574 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:02.175556 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b7f52e2-5d32-4c18-9483-549621c0a42e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fc8kc\" (UID: \"6b7f52e2-5d32-4c18-9483-549621c0a42e\") " pod="openshift-insights/insights-runtime-extractor-fc8kc" Jun 11 16:59:02.177486 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:02.177455 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b7f52e2-5d32-4c18-9483-549621c0a42e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fc8kc\" (UID: \"6b7f52e2-5d32-4c18-9483-549621c0a42e\") " pod="openshift-insights/insights-runtime-extractor-fc8kc" Jun 11 16:59:02.185830 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:02.185801 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlfv8\" (UniqueName: \"kubernetes.io/projected/6b7f52e2-5d32-4c18-9483-549621c0a42e-kube-api-access-mlfv8\") pod \"insights-runtime-extractor-fc8kc\" (UID: \"6b7f52e2-5d32-4c18-9483-549621c0a42e\") " pod="openshift-insights/insights-runtime-extractor-fc8kc" Jun 11 16:59:02.268619 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:02.268541 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fc8kc" Jun 11 16:59:02.411793 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:02.411761 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fc8kc"] Jun 11 16:59:02.414635 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:59:02.414608 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b7f52e2_5d32_4c18_9483_549621c0a42e.slice/crio-4e3f38235d47bac33733063b74541ffcbc37bfad54e0d15e803f22a17d44c2f8 WatchSource:0}: Error finding container 4e3f38235d47bac33733063b74541ffcbc37bfad54e0d15e803f22a17d44c2f8: Status 404 returned error can't find the container with id 4e3f38235d47bac33733063b74541ffcbc37bfad54e0d15e803f22a17d44c2f8 Jun 11 16:59:03.088300 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:03.088273 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fc8kc" event={"ID":"6b7f52e2-5d32-4c18-9483-549621c0a42e","Type":"ContainerStarted","Data":"ef5b87761fc8bee3471469d9b6664551adc97efe6fafcc0f8d1d431cfa1846fb"} Jun 11 16:59:03.088603 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:03.088337 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fc8kc" event={"ID":"6b7f52e2-5d32-4c18-9483-549621c0a42e","Type":"ContainerStarted","Data":"225ab94546f5a5367371541fbf8216ec870e54bf57fa13fdaf8ec1709a338ba3"} Jun 11 16:59:03.088603 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:03.088370 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fc8kc" event={"ID":"6b7f52e2-5d32-4c18-9483-549621c0a42e","Type":"ContainerStarted","Data":"4e3f38235d47bac33733063b74541ffcbc37bfad54e0d15e803f22a17d44c2f8"} Jun 11 16:59:04.734738 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:59:04.734693 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6skv7" podUID="2d7567f4-2d0c-4979-b2fe-a59eae95b974" Jun 11 16:59:04.734738 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:59:04.734693 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-x4w9j" podUID="e56370ed-2f52-42f7-aa1f-ec213d8d14a1" Jun 11 16:59:04.735169 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:59:04.734708 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7985894f89-cr2f7" podUID="45c2cd36-79dd-429b-a48a-69e118b687e8" Jun 11 16:59:05.097249 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:05.097217 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:59:05.097249 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:05.097236 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fc8kc" event={"ID":"6b7f52e2-5d32-4c18-9483-549621c0a42e","Type":"ContainerStarted","Data":"c10b6aded7f4e02c78ccae72d4d8a60e75b6142421f4fb3e6e38b54e9bcc90e4"} Jun 11 16:59:05.097512 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:05.097226 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6skv7" Jun 11 16:59:05.097512 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:05.097442 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x4w9j" Jun 11 16:59:05.115912 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:05.115872 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fc8kc" podStartSLOduration=2.093404068 podStartE2EDuration="4.115860375s" totalImagesPullingTime="2.022456307s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:59:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:59:05.11509688 +0000 UTC m=+282.375351785" watchObservedRunningTime="2026-06-11 16:59:05.115860375 +0000 UTC m=+282.376115280" Jun 11 16:59:08.108425 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:08.108344 2565 generic.go:356] "Generic (PLEG): container finished" podID="efcfb572-9a35-45e3-8959-1f3b3e1f60ef" containerID="2120139caeb31cbc28d825cb3a34fe915c6941a7d5a8a531aee90f25f1274674" exitCode=255 Jun 11 16:59:08.108890 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:08.108418 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8459d4785b-m9qxj" event={"ID":"efcfb572-9a35-45e3-8959-1f3b3e1f60ef","Type":"ContainerDied","Data":"2120139caeb31cbc28d825cb3a34fe915c6941a7d5a8a531aee90f25f1274674"} Jun 11 16:59:08.108890 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:08.108474 2565 scope.go:117] "RemoveContainer" containerID="b98eb6fafec35068ce78c3ced17fcc4374a457a9f224dd20ac285dbe214596c4" Jun 11 16:59:08.108890 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:08.108766 2565 scope.go:117] "RemoveContainer" containerID="2120139caeb31cbc28d825cb3a34fe915c6941a7d5a8a531aee90f25f1274674" Jun 11 16:59:08.109052 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:59:08.108984 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-8459d4785b-m9qxj_open-cluster-management-agent-addon(efcfb572-9a35-45e3-8959-1f3b3e1f60ef)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8459d4785b-m9qxj" podUID="efcfb572-9a35-45e3-8959-1f3b3e1f60ef" Jun 11 16:59:08.110204 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:08.110185 2565 generic.go:356] "Generic (PLEG): container finished" podID="3924fcbb-d795-45ab-96f9-7cae5e426aa6" containerID="d2aa787e4a28c5ca85388108be82ceba509316410fe9432428480d2aa7f843fd" exitCode=1 Jun 11 16:59:08.110316 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:08.110219 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8799cfb8-xjd52" event={"ID":"3924fcbb-d795-45ab-96f9-7cae5e426aa6","Type":"ContainerDied","Data":"d2aa787e4a28c5ca85388108be82ceba509316410fe9432428480d2aa7f843fd"} Jun 11 16:59:08.110522 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:08.110509 2565 scope.go:117] "RemoveContainer" containerID="d2aa787e4a28c5ca85388108be82ceba509316410fe9432428480d2aa7f843fd" Jun 11 16:59:08.110675 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:59:08.110657 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-d8799cfb8-xjd52_open-cluster-management-agent-addon(3924fcbb-d795-45ab-96f9-7cae5e426aa6)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8799cfb8-xjd52" podUID="3924fcbb-d795-45ab-96f9-7cae5e426aa6" Jun 11 16:59:08.118591 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:08.118575 2565 scope.go:117] "RemoveContainer" containerID="30d7be0d29bb901ffd2acb0c1427bf08a1611d20a9394aa00f5336ee64d83d3e" Jun 11 16:59:08.723218 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:08.723183 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d7567f4-2d0c-4979-b2fe-a59eae95b974-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-6skv7\" (UID: \"2d7567f4-2d0c-4979-b2fe-a59eae95b974\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6skv7" Jun 11 16:59:08.723429 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:08.723243 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-tls\") pod \"image-registry-7985894f89-cr2f7\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:59:08.725612 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:08.725578 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d7567f4-2d0c-4979-b2fe-a59eae95b974-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-6skv7\" (UID: \"2d7567f4-2d0c-4979-b2fe-a59eae95b974\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6skv7" Jun 11 16:59:08.725612 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:08.725601 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-tls\") pod \"image-registry-7985894f89-cr2f7\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:59:08.759507 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:08.759470 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8799cfb8-xjd52" Jun 11 16:59:08.823970 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:08.823944 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-metrics-tls\") pod \"dns-default-x4w9j\" (UID: \"e56370ed-2f52-42f7-aa1f-ec213d8d14a1\") " pod="openshift-dns/dns-default-x4w9j" Jun 11 16:59:08.826161 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:08.826138 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e56370ed-2f52-42f7-aa1f-ec213d8d14a1-metrics-tls\") pod \"dns-default-x4w9j\" (UID: \"e56370ed-2f52-42f7-aa1f-ec213d8d14a1\") " pod="openshift-dns/dns-default-x4w9j" Jun 11 16:59:08.982123 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:08.982035 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8459d4785b-m9qxj" Jun 11 16:59:09.001324 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:09.001297 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-nnm6x\"" Jun 11 16:59:09.001473 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:09.001298 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-x475h\"" Jun 11 16:59:09.001473 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:09.001298 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-x9gb4\"" Jun 11 16:59:09.008536 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:09.008516 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x4w9j" Jun 11 16:59:09.008606 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:09.008538 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6skv7" Jun 11 16:59:09.008647 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:09.008526 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:59:09.018859 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:09.018839 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8799cfb8-xjd52" Jun 11 16:59:09.115721 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:09.115702 2565 scope.go:117] "RemoveContainer" containerID="2120139caeb31cbc28d825cb3a34fe915c6941a7d5a8a531aee90f25f1274674" Jun 11 16:59:09.116085 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:59:09.115851 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-8459d4785b-m9qxj_open-cluster-management-agent-addon(efcfb572-9a35-45e3-8959-1f3b3e1f60ef)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8459d4785b-m9qxj" podUID="efcfb572-9a35-45e3-8959-1f3b3e1f60ef" Jun 11 16:59:09.117761 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:09.117737 2565 scope.go:117] "RemoveContainer" containerID="d2aa787e4a28c5ca85388108be82ceba509316410fe9432428480d2aa7f843fd" Jun 11 16:59:09.118085 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:59:09.117933 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-d8799cfb8-xjd52_open-cluster-management-agent-addon(3924fcbb-d795-45ab-96f9-7cae5e426aa6)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8799cfb8-xjd52" podUID="3924fcbb-d795-45ab-96f9-7cae5e426aa6" Jun 11 16:59:09.153366 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:09.153331 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x4w9j"] Jun 11 16:59:09.156081 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:59:09.156053 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode56370ed_2f52_42f7_aa1f_ec213d8d14a1.slice/crio-f8ad606bbaf8402f1a5fda1612e394164ead9230f4be8696a750bac87ff35ba0 WatchSource:0}: Error finding container f8ad606bbaf8402f1a5fda1612e394164ead9230f4be8696a750bac87ff35ba0: Status 404 returned error can't find the container with id f8ad606bbaf8402f1a5fda1612e394164ead9230f4be8696a750bac87ff35ba0 Jun 11 16:59:09.377945 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:09.377908 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-6skv7"] Jun 11 16:59:09.380474 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:09.380456 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7985894f89-cr2f7"] Jun 11 16:59:09.382156 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:59:09.382129 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d7567f4_2d0c_4979_b2fe_a59eae95b974.slice/crio-6530011b28ea74ed6aa30cbb94652b28861188903094e12a1e0f9102de56d3b5 WatchSource:0}: Error finding container 6530011b28ea74ed6aa30cbb94652b28861188903094e12a1e0f9102de56d3b5: Status 404 returned error can't find the container with id 6530011b28ea74ed6aa30cbb94652b28861188903094e12a1e0f9102de56d3b5 Jun 11 16:59:09.383643 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:59:09.383620 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45c2cd36_79dd_429b_a48a_69e118b687e8.slice/crio-296f70fddc2981caf620f5999caecb745dd9415cdaf6db21e37f8963f65dbea4 WatchSource:0}: Error finding container 296f70fddc2981caf620f5999caecb745dd9415cdaf6db21e37f8963f65dbea4: Status 404 returned error can't find the container with id 296f70fddc2981caf620f5999caecb745dd9415cdaf6db21e37f8963f65dbea4 Jun 11 16:59:10.125024 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:10.124987 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7985894f89-cr2f7" event={"ID":"45c2cd36-79dd-429b-a48a-69e118b687e8","Type":"ContainerStarted","Data":"e0eebc38d96ba13b6ca683fa85a56928f2e51813a058c5b8205ea18fa06f2a24"} Jun 11 16:59:10.125524 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:10.125049 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7985894f89-cr2f7" event={"ID":"45c2cd36-79dd-429b-a48a-69e118b687e8","Type":"ContainerStarted","Data":"296f70fddc2981caf620f5999caecb745dd9415cdaf6db21e37f8963f65dbea4"} Jun 11 16:59:10.125524 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:10.125172 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:59:10.126506 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:10.126471 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6skv7" event={"ID":"2d7567f4-2d0c-4979-b2fe-a59eae95b974","Type":"ContainerStarted","Data":"6530011b28ea74ed6aa30cbb94652b28861188903094e12a1e0f9102de56d3b5"} Jun 11 16:59:10.127874 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:10.127848 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x4w9j" event={"ID":"e56370ed-2f52-42f7-aa1f-ec213d8d14a1","Type":"ContainerStarted","Data":"f8ad606bbaf8402f1a5fda1612e394164ead9230f4be8696a750bac87ff35ba0"} Jun 11 16:59:10.128161 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:10.128139 2565 scope.go:117] "RemoveContainer" containerID="d2aa787e4a28c5ca85388108be82ceba509316410fe9432428480d2aa7f843fd" Jun 11 16:59:10.128368 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:59:10.128345 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-d8799cfb8-xjd52_open-cluster-management-agent-addon(3924fcbb-d795-45ab-96f9-7cae5e426aa6)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8799cfb8-xjd52" podUID="3924fcbb-d795-45ab-96f9-7cae5e426aa6" Jun 11 16:59:10.154012 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:10.153960 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7985894f89-cr2f7" podStartSLOduration=287.153940003 podStartE2EDuration="4m47.153940003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:54:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:59:10.15181332 +0000 UTC m=+287.412068238" watchObservedRunningTime="2026-06-11 16:59:10.153940003 +0000 UTC m=+287.414194894" Jun 11 16:59:12.135897 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:12.135856 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6skv7" event={"ID":"2d7567f4-2d0c-4979-b2fe-a59eae95b974","Type":"ContainerStarted","Data":"f6e180ad53760dd41a489f7219c3c1adc9f0411c65454e3545bc607075e342f7"} Jun 11 16:59:12.137535 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:12.137510 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x4w9j" event={"ID":"e56370ed-2f52-42f7-aa1f-ec213d8d14a1","Type":"ContainerStarted","Data":"0e166ad85bfb389d5dd6a826e58924a8289c13bd7f310c09f06831714c0dce02"} Jun 11 16:59:12.137654 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:12.137550 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x4w9j" event={"ID":"e56370ed-2f52-42f7-aa1f-ec213d8d14a1","Type":"ContainerStarted","Data":"5edc7e6b3e894a0fe304d341490d0737adb3d88581bb339ca5d467fe349a2034"} Jun 11 16:59:12.137654 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:12.137572 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-x4w9j" Jun 11 16:59:12.153137 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:12.153088 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6skv7" podStartSLOduration=286.46781169 podStartE2EDuration="4m48.153073463s" totalImagesPullingTime="1.685261773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:54:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:59:12.152410699 +0000 UTC m=+289.412665605" watchObservedRunningTime="2026-06-11 16:59:12.153073463 +0000 UTC m=+289.413328369" Jun 11 16:59:12.182519 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:12.182470 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-x4w9j" podStartSLOduration=252.270829524 podStartE2EDuration="4m14.182453499s" totalImagesPullingTime="1.911623975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:54:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:59:12.180996107 +0000 UTC m=+289.441251015" watchObservedRunningTime="2026-06-11 16:59:12.182453499 +0000 UTC m=+289.442708404" Jun 11 16:59:14.255403 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:14.255365 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4slfc"] Jun 11 16:59:14.258591 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:14.258569 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4slfc" Jun 11 16:59:14.260715 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:14.260666 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 16:59:14.260838 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:14.260755 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 16:59:14.261029 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:14.261014 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 16:59:14.261548 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:14.261531 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qvx74\"" Jun 11 16:59:14.261616 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:14.261558 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 16:59:14.261616 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:14.261607 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 16:59:14.261719 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:14.261558 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 16:59:14.363257 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:14.363226 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7f1f613d-1774-4b6b-8734-470d28645519-root\") pod \"node-exporter-4slfc\" (UID: \"7f1f613d-1774-4b6b-8734-470d28645519\") " pod="openshift-monitoring/node-exporter-4slfc" Jun 11 16:59:14.363257 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:14.363259 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7f1f613d-1774-4b6b-8734-470d28645519-node-exporter-textfile\") pod \"node-exporter-4slfc\" (UID: \"7f1f613d-1774-4b6b-8734-470d28645519\") " pod="openshift-monitoring/node-exporter-4slfc" Jun 11 16:59:14.363467 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:14.363278 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f1f613d-1774-4b6b-8734-470d28645519-metrics-client-ca\") pod \"node-exporter-4slfc\" (UID: \"7f1f613d-1774-4b6b-8734-470d28645519\") " pod="openshift-monitoring/node-exporter-4slfc" Jun 11 16:59:14.363467 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:14.363299 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt62z\" (UniqueName: \"kubernetes.io/projected/7f1f613d-1774-4b6b-8734-470d28645519-kube-api-access-kt62z\") pod \"node-exporter-4slfc\" (UID: \"7f1f613d-1774-4b6b-8734-470d28645519\") " pod="openshift-monitoring/node-exporter-4slfc" Jun 11 16:59:14.363467 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:14.363335 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7f1f613d-1774-4b6b-8734-470d28645519-node-exporter-tls\") pod \"node-exporter-4slfc\" (UID: \"7f1f613d-1774-4b6b-8734-470d28645519\") " pod="openshift-monitoring/node-exporter-4slfc" Jun 11 16:59:14.363467 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:14.363376 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f1f613d-1774-4b6b-8734-470d28645519-sys\") pod \"node-exporter-4slfc\" (UID: \"7f1f613d-1774-4b6b-8734-470d28645519\") " pod="openshift-monitoring/node-exporter-4slfc" Jun 11 16:59:14.363467 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:14.363454 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7f1f613d-1774-4b6b-8734-470d28645519-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4slfc\" (UID: \"7f1f613d-1774-4b6b-8734-470d28645519\") " pod="openshift-monitoring/node-exporter-4slfc" Jun 11 16:59:14.363668 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:14.363484 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7f1f613d-1774-4b6b-8734-470d28645519-node-exporter-accelerators-collector-config\") pod \"node-exporter-4slfc\" (UID: \"7f1f613d-1774-4b6b-8734-470d28645519\") " pod="openshift-monitoring/node-exporter-4slfc" Jun 11 16:59:14.363668 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:14.363514 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7f1f613d-1774-4b6b-8734-470d28645519-node-exporter-wtmp\") pod \"node-exporter-4slfc\" (UID: \"7f1f613d-1774-4b6b-8734-470d28645519\") " pod="openshift-monitoring/node-exporter-4slfc" Jun 11 16:59:14.464751 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:14.464696 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7f1f613d-1774-4b6b-8734-470d28645519-node-exporter-wtmp\") pod \"node-exporter-4slfc\" (UID: \"7f1f613d-1774-4b6b-8734-470d28645519\") " pod="openshift-monitoring/node-exporter-4slfc" Jun 11 16:59:14.464751 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:14.464758 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7f1f613d-1774-4b6b-8734-470d28645519-root\") pod \"node-exporter-4slfc\" (UID: \"7f1f613d-1774-4b6b-8734-470d28645519\") " pod="openshift-monitoring/node-exporter-4slfc" Jun 11 16:59:14.465003 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:14.464788 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7f1f613d-1774-4b6b-8734-470d28645519-node-exporter-textfile\") pod \"node-exporter-4slfc\" (UID: \"7f1f613d-1774-4b6b-8734-470d28645519\") " pod="openshift-monitoring/node-exporter-4slfc" Jun 11 16:59:14.465003 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:14.464810 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f1f613d-1774-4b6b-8734-470d28645519-metrics-client-ca\") pod \"node-exporter-4slfc\" (UID: \"7f1f613d-1774-4b6b-8734-470d28645519\") " pod="openshift-monitoring/node-exporter-4slfc" Jun 11 16:59:14.465003 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:14.464844 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt62z\" (UniqueName: \"kubernetes.io/projected/7f1f613d-1774-4b6b-8734-470d28645519-kube-api-access-kt62z\") pod \"node-exporter-4slfc\" (UID: \"7f1f613d-1774-4b6b-8734-470d28645519\") " pod="openshift-monitoring/node-exporter-4slfc" Jun 11 16:59:14.465003 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:14.464875 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7f1f613d-1774-4b6b-8734-470d28645519-node-exporter-tls\") pod \"node-exporter-4slfc\" (UID: \"7f1f613d-1774-4b6b-8734-470d28645519\") " pod="openshift-monitoring/node-exporter-4slfc" Jun 11 16:59:14.465003 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:14.464887 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7f1f613d-1774-4b6b-8734-470d28645519-root\") pod \"node-exporter-4slfc\" (UID: \"7f1f613d-1774-4b6b-8734-470d28645519\") " pod="openshift-monitoring/node-exporter-4slfc" Jun 11 16:59:14.465003 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:14.464895 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7f1f613d-1774-4b6b-8734-470d28645519-node-exporter-wtmp\") pod \"node-exporter-4slfc\" (UID: \"7f1f613d-1774-4b6b-8734-470d28645519\") " pod="openshift-monitoring/node-exporter-4slfc" Jun 11 16:59:14.465003 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:59:14.464965 2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 16:59:14.465003 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:14.464997 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f1f613d-1774-4b6b-8734-470d28645519-sys\") pod \"node-exporter-4slfc\" (UID: \"7f1f613d-1774-4b6b-8734-470d28645519\") " pod="openshift-monitoring/node-exporter-4slfc" Jun 11 16:59:14.465347 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:59:14.465021 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f1f613d-1774-4b6b-8734-470d28645519-node-exporter-tls podName:7f1f613d-1774-4b6b-8734-470d28645519 nodeName:}" failed. No retries permitted until 2026-06-11 16:59:14.965001311 +0000 UTC m=+292.225256202 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7f1f613d-1774-4b6b-8734-470d28645519-node-exporter-tls") pod "node-exporter-4slfc" (UID: "7f1f613d-1774-4b6b-8734-470d28645519") : secret "node-exporter-tls" not found Jun 11 16:59:14.465347 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:14.465032 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f1f613d-1774-4b6b-8734-470d28645519-sys\") pod \"node-exporter-4slfc\" (UID: \"7f1f613d-1774-4b6b-8734-470d28645519\") " pod="openshift-monitoring/node-exporter-4slfc" Jun 11 16:59:14.465347 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:14.465076 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7f1f613d-1774-4b6b-8734-470d28645519-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4slfc\" (UID: \"7f1f613d-1774-4b6b-8734-470d28645519\") " pod="openshift-monitoring/node-exporter-4slfc" Jun 11 16:59:14.465347 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:14.465095 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7f1f613d-1774-4b6b-8734-470d28645519-node-exporter-accelerators-collector-config\") pod \"node-exporter-4slfc\" (UID: \"7f1f613d-1774-4b6b-8734-470d28645519\") " pod="openshift-monitoring/node-exporter-4slfc" Jun 11 16:59:14.465347 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:14.465205 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7f1f613d-1774-4b6b-8734-470d28645519-node-exporter-textfile\") pod \"node-exporter-4slfc\" (UID: \"7f1f613d-1774-4b6b-8734-470d28645519\") " pod="openshift-monitoring/node-exporter-4slfc" Jun 11 16:59:14.465505 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:14.465461 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f1f613d-1774-4b6b-8734-470d28645519-metrics-client-ca\") pod \"node-exporter-4slfc\" (UID: \"7f1f613d-1774-4b6b-8734-470d28645519\") " pod="openshift-monitoring/node-exporter-4slfc" Jun 11 16:59:14.465600 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:14.465583 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7f1f613d-1774-4b6b-8734-470d28645519-node-exporter-accelerators-collector-config\") pod \"node-exporter-4slfc\" (UID: \"7f1f613d-1774-4b6b-8734-470d28645519\") " pod="openshift-monitoring/node-exporter-4slfc" Jun 11 16:59:14.467349 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:14.467327 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7f1f613d-1774-4b6b-8734-470d28645519-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4slfc\" (UID: \"7f1f613d-1774-4b6b-8734-470d28645519\") " pod="openshift-monitoring/node-exporter-4slfc" Jun 11 16:59:14.479640 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:14.479614 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt62z\" (UniqueName: \"kubernetes.io/projected/7f1f613d-1774-4b6b-8734-470d28645519-kube-api-access-kt62z\") pod \"node-exporter-4slfc\" (UID: \"7f1f613d-1774-4b6b-8734-470d28645519\") " pod="openshift-monitoring/node-exporter-4slfc" Jun 11 16:59:14.968437 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:14.968396 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7f1f613d-1774-4b6b-8734-470d28645519-node-exporter-tls\") pod \"node-exporter-4slfc\" (UID: \"7f1f613d-1774-4b6b-8734-470d28645519\") " pod="openshift-monitoring/node-exporter-4slfc" Jun 11 16:59:14.970630 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:14.970600 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7f1f613d-1774-4b6b-8734-470d28645519-node-exporter-tls\") pod \"node-exporter-4slfc\" (UID: \"7f1f613d-1774-4b6b-8734-470d28645519\") " pod="openshift-monitoring/node-exporter-4slfc" Jun 11 16:59:15.167619 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:15.167574 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4slfc" Jun 11 16:59:15.178768 ip-10-0-130-110 kubenswrapper[2565]: W0611 16:59:15.178740 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f1f613d_1774_4b6b_8734_470d28645519.slice/crio-7fd80e02265a2236a47ed87361497edf6eafb2a5b30107bea6fdc69bfdbc5b07 WatchSource:0}: Error finding container 7fd80e02265a2236a47ed87361497edf6eafb2a5b30107bea6fdc69bfdbc5b07: Status 404 returned error can't find the container with id 7fd80e02265a2236a47ed87361497edf6eafb2a5b30107bea6fdc69bfdbc5b07 Jun 11 16:59:16.153165 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:16.153123 2565 generic.go:356] "Generic (PLEG): container finished" podID="7f1f613d-1774-4b6b-8734-470d28645519" containerID="9fe15291d04184970fc55a5d2569b728eb69c8d2df85865e6c84417304e33eba" exitCode=0 Jun 11 16:59:16.153531 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:16.153202 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4slfc" event={"ID":"7f1f613d-1774-4b6b-8734-470d28645519","Type":"ContainerDied","Data":"9fe15291d04184970fc55a5d2569b728eb69c8d2df85865e6c84417304e33eba"} Jun 11 16:59:16.153531 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:16.153282 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4slfc" event={"ID":"7f1f613d-1774-4b6b-8734-470d28645519","Type":"ContainerStarted","Data":"7fd80e02265a2236a47ed87361497edf6eafb2a5b30107bea6fdc69bfdbc5b07"} Jun 11 16:59:17.159224 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:17.159186 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4slfc" event={"ID":"7f1f613d-1774-4b6b-8734-470d28645519","Type":"ContainerStarted","Data":"d10e59a90c002c21d4ab2e5911cf8953ce51bf71ddc83c3bb87377532738bbd0"} Jun 11 16:59:17.159642 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:17.159235 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4slfc" event={"ID":"7f1f613d-1774-4b6b-8734-470d28645519","Type":"ContainerStarted","Data":"a6b0b89f05008b7c472809058d0ddb89a416478a0a5dae924d1fd665f76dcc5f"} Jun 11 16:59:17.195492 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:17.195437 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4slfc" podStartSLOduration=2.365598791 podStartE2EDuration="3.195422255s" totalImagesPullingTime="766.273988ms" totalInitContainerRuntime="63.549476ms" isStatefulPod=true podCreationTimestamp="2026-06-11 16:59:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:59:17.194569995 +0000 UTC m=+294.454824901" watchObservedRunningTime="2026-06-11 16:59:17.195422255 +0000 UTC m=+294.455677162" Jun 11 16:59:19.185144 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:59:19.185111 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-pdg6r" podUID="66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42" Jun 11 16:59:21.185670 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:21.185645 2565 scope.go:117] "RemoveContainer" containerID="d2aa787e4a28c5ca85388108be82ceba509316410fe9432428480d2aa7f843fd" Jun 11 16:59:22.143497 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:22.143468 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-x4w9j" Jun 11 16:59:22.178043 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:22.178008 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8799cfb8-xjd52" event={"ID":"3924fcbb-d795-45ab-96f9-7cae5e426aa6","Type":"ContainerStarted","Data":"c000e5c0523d66f675c70896364bf18f6c1eb12f99078b6576c8c6004d103499"} Jun 11 16:59:22.178336 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:22.178318 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8799cfb8-xjd52" Jun 11 16:59:22.179497 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:22.179477 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d8799cfb8-xjd52" Jun 11 16:59:23.134515 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:23.134490 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7hbj_a30425b4-3b27-4ae1-af09-384473269d18/ovn-acl-logging/0.log" Jun 11 16:59:23.135699 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:23.135678 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7hbj_a30425b4-3b27-4ae1-af09-384473269d18/ovn-acl-logging/0.log" Jun 11 16:59:23.141220 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:23.141203 2565 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 16:59:24.185243 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:24.185214 2565 scope.go:117] "RemoveContainer" containerID="2120139caeb31cbc28d825cb3a34fe915c6941a7d5a8a531aee90f25f1274674" Jun 11 16:59:24.326949 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:24.326918 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7985894f89-cr2f7"] Jun 11 16:59:24.331579 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:24.331542 2565 patch_prober.go:28] interesting pod/image-registry-7985894f89-cr2f7 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 16:59:24.331708 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:24.331603 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7985894f89-cr2f7" podUID="45c2cd36-79dd-429b-a48a-69e118b687e8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 16:59:25.189815 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:25.189785 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8459d4785b-m9qxj" event={"ID":"efcfb572-9a35-45e3-8959-1f3b3e1f60ef","Type":"ContainerStarted","Data":"d0efc77a32fa0549dc0a33e39ca67ddef4c761346e8669e7855d54205a527081"} Jun 11 16:59:30.185362 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:30.185319 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 16:59:34.332040 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:34.332012 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:59:49.346837 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:49.346767 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7985894f89-cr2f7" podUID="45c2cd36-79dd-429b-a48a-69e118b687e8" containerName="registry" containerID="cri-o://e0eebc38d96ba13b6ca683fa85a56928f2e51813a058c5b8205ea18fa06f2a24" gracePeriod=30 Jun 11 16:59:49.595588 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:49.595565 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:59:49.732861 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:49.732765 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-bound-sa-token\") pod \"45c2cd36-79dd-429b-a48a-69e118b687e8\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " Jun 11 16:59:49.732861 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:49.732803 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/45c2cd36-79dd-429b-a48a-69e118b687e8-installation-pull-secrets\") pod \"45c2cd36-79dd-429b-a48a-69e118b687e8\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " Jun 11 16:59:49.732861 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:49.732840 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/45c2cd36-79dd-429b-a48a-69e118b687e8-ca-trust-extracted\") pod \"45c2cd36-79dd-429b-a48a-69e118b687e8\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " Jun 11 16:59:49.733125 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:49.732880 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-tls\") pod \"45c2cd36-79dd-429b-a48a-69e118b687e8\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " Jun 11 16:59:49.733125 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:49.732898 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/45c2cd36-79dd-429b-a48a-69e118b687e8-image-registry-private-configuration\") pod \"45c2cd36-79dd-429b-a48a-69e118b687e8\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " Jun 11 16:59:49.733125 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:49.732922 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/45c2cd36-79dd-429b-a48a-69e118b687e8-trusted-ca\") pod \"45c2cd36-79dd-429b-a48a-69e118b687e8\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " Jun 11 16:59:49.733125 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:49.732945 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-certificates\") pod \"45c2cd36-79dd-429b-a48a-69e118b687e8\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " Jun 11 16:59:49.733125 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:49.732976 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xr966\" (UniqueName: \"kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-kube-api-access-xr966\") pod \"45c2cd36-79dd-429b-a48a-69e118b687e8\" (UID: \"45c2cd36-79dd-429b-a48a-69e118b687e8\") " Jun 11 16:59:49.733531 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:49.733469 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45c2cd36-79dd-429b-a48a-69e118b687e8-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "45c2cd36-79dd-429b-a48a-69e118b687e8" (UID: "45c2cd36-79dd-429b-a48a-69e118b687e8"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:59:49.734166 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:49.733767 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "45c2cd36-79dd-429b-a48a-69e118b687e8" (UID: "45c2cd36-79dd-429b-a48a-69e118b687e8"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:59:49.735568 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:49.735516 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45c2cd36-79dd-429b-a48a-69e118b687e8-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "45c2cd36-79dd-429b-a48a-69e118b687e8" (UID: "45c2cd36-79dd-429b-a48a-69e118b687e8"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:59:49.735666 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:49.735582 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "45c2cd36-79dd-429b-a48a-69e118b687e8" (UID: "45c2cd36-79dd-429b-a48a-69e118b687e8"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:59:49.735666 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:49.735599 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "45c2cd36-79dd-429b-a48a-69e118b687e8" (UID: "45c2cd36-79dd-429b-a48a-69e118b687e8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:59:49.735666 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:49.735606 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45c2cd36-79dd-429b-a48a-69e118b687e8-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "45c2cd36-79dd-429b-a48a-69e118b687e8" (UID: "45c2cd36-79dd-429b-a48a-69e118b687e8"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:59:49.735805 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:49.735787 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-kube-api-access-xr966" (OuterVolumeSpecName: "kube-api-access-xr966") pod "45c2cd36-79dd-429b-a48a-69e118b687e8" (UID: "45c2cd36-79dd-429b-a48a-69e118b687e8"). InnerVolumeSpecName "kube-api-access-xr966". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:59:49.741899 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:49.741866 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45c2cd36-79dd-429b-a48a-69e118b687e8-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "45c2cd36-79dd-429b-a48a-69e118b687e8" (UID: "45c2cd36-79dd-429b-a48a-69e118b687e8"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:59:49.834346 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:49.834311 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-tls\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\"" Jun 11 16:59:49.834346 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:49.834338 2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/45c2cd36-79dd-429b-a48a-69e118b687e8-image-registry-private-configuration\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\"" Jun 11 16:59:49.834346 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:49.834348 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/45c2cd36-79dd-429b-a48a-69e118b687e8-trusted-ca\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\"" Jun 11 16:59:49.834567 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:49.834360 2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/45c2cd36-79dd-429b-a48a-69e118b687e8-registry-certificates\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\"" Jun 11 16:59:49.834567 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:49.834370 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xr966\" (UniqueName: \"kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-kube-api-access-xr966\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\"" Jun 11 16:59:49.834567 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:49.834379 2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45c2cd36-79dd-429b-a48a-69e118b687e8-bound-sa-token\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\"" Jun 11 16:59:49.834567 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:49.834387 2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/45c2cd36-79dd-429b-a48a-69e118b687e8-installation-pull-secrets\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\"" Jun 11 16:59:49.834567 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:49.834396 2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/45c2cd36-79dd-429b-a48a-69e118b687e8-ca-trust-extracted\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\"" Jun 11 16:59:50.268609 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:50.268572 2565 generic.go:356] "Generic (PLEG): container finished" podID="45c2cd36-79dd-429b-a48a-69e118b687e8" containerID="e0eebc38d96ba13b6ca683fa85a56928f2e51813a058c5b8205ea18fa06f2a24" exitCode=0 Jun 11 16:59:50.268609 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:50.268612 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7985894f89-cr2f7" Jun 11 16:59:50.268964 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:50.268612 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7985894f89-cr2f7" event={"ID":"45c2cd36-79dd-429b-a48a-69e118b687e8","Type":"ContainerDied","Data":"e0eebc38d96ba13b6ca683fa85a56928f2e51813a058c5b8205ea18fa06f2a24"} Jun 11 16:59:50.268964 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:50.268749 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7985894f89-cr2f7" event={"ID":"45c2cd36-79dd-429b-a48a-69e118b687e8","Type":"ContainerDied","Data":"296f70fddc2981caf620f5999caecb745dd9415cdaf6db21e37f8963f65dbea4"} Jun 11 16:59:50.268964 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:50.268776 2565 scope.go:117] "RemoveContainer" containerID="e0eebc38d96ba13b6ca683fa85a56928f2e51813a058c5b8205ea18fa06f2a24" Jun 11 16:59:50.277274 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:50.277260 2565 scope.go:117] "RemoveContainer" containerID="e0eebc38d96ba13b6ca683fa85a56928f2e51813a058c5b8205ea18fa06f2a24" Jun 11 16:59:50.277544 ip-10-0-130-110 kubenswrapper[2565]: E0611 16:59:50.277521 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0eebc38d96ba13b6ca683fa85a56928f2e51813a058c5b8205ea18fa06f2a24\": container with ID starting with e0eebc38d96ba13b6ca683fa85a56928f2e51813a058c5b8205ea18fa06f2a24 not found: ID does not exist" containerID="e0eebc38d96ba13b6ca683fa85a56928f2e51813a058c5b8205ea18fa06f2a24" Jun 11 16:59:50.277611 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:50.277555 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0eebc38d96ba13b6ca683fa85a56928f2e51813a058c5b8205ea18fa06f2a24"} err="failed to get container status \"e0eebc38d96ba13b6ca683fa85a56928f2e51813a058c5b8205ea18fa06f2a24\": rpc error: code = NotFound desc = could not find container \"e0eebc38d96ba13b6ca683fa85a56928f2e51813a058c5b8205ea18fa06f2a24\": container with ID starting with e0eebc38d96ba13b6ca683fa85a56928f2e51813a058c5b8205ea18fa06f2a24 not found: ID does not exist" Jun 11 16:59:50.295507 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:50.295482 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7985894f89-cr2f7"] Jun 11 16:59:50.302104 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:50.302085 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7985894f89-cr2f7"] Jun 11 16:59:51.190145 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:51.190107 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45c2cd36-79dd-429b-a48a-69e118b687e8" path="/var/lib/kubelet/pods/45c2cd36-79dd-429b-a48a-69e118b687e8/volumes" Jun 11 16:59:57.250346 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:57.250310 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qxl9m_26915d24-6b82-41d7-9d72-e4846076e9da/serve-healthcheck-canary/0.log" Jun 11 16:59:58.989221 ip-10-0-130-110 kubenswrapper[2565]: I0611 16:59:58.989186 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67dc78565d-dbhz6" podUID="26ec855b-2b23-483d-bd71-ae6b2e21ad12" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 17:00:08.989220 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:00:08.989125 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67dc78565d-dbhz6" podUID="26ec855b-2b23-483d-bd71-ae6b2e21ad12" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 17:00:18.988488 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:00:18.988450 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67dc78565d-dbhz6" podUID="26ec855b-2b23-483d-bd71-ae6b2e21ad12" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 17:00:18.988896 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:00:18.988517 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67dc78565d-dbhz6" Jun 11 17:00:18.989015 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:00:18.988998 2565 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"66340725a56e2608a657b20a2cdcc05c098fbaab5e11687b5ed36feb098decf4"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67dc78565d-dbhz6" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 11 17:00:18.989052 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:00:18.989036 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67dc78565d-dbhz6" podUID="26ec855b-2b23-483d-bd71-ae6b2e21ad12" containerName="service-proxy" containerID="cri-o://66340725a56e2608a657b20a2cdcc05c098fbaab5e11687b5ed36feb098decf4" gracePeriod=30 Jun 11 17:00:19.362080 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:00:19.362045 2565 generic.go:356] "Generic (PLEG): container finished" podID="26ec855b-2b23-483d-bd71-ae6b2e21ad12" containerID="66340725a56e2608a657b20a2cdcc05c098fbaab5e11687b5ed36feb098decf4" exitCode=2 Jun 11 17:00:19.362296 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:00:19.362104 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67dc78565d-dbhz6" event={"ID":"26ec855b-2b23-483d-bd71-ae6b2e21ad12","Type":"ContainerDied","Data":"66340725a56e2608a657b20a2cdcc05c098fbaab5e11687b5ed36feb098decf4"} Jun 11 17:00:19.362296 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:00:19.362146 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67dc78565d-dbhz6" event={"ID":"26ec855b-2b23-483d-bd71-ae6b2e21ad12","Type":"ContainerStarted","Data":"006c14748f96fdf5764ec206652e34fceb2922f2ee7a03b4450735115c5b8826"} Jun 11 17:00:37.166890 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:00:37.166841 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42-metrics-certs\") pod \"network-metrics-daemon-pdg6r\" (UID: \"66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42\") " pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 17:00:37.169089 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:00:37.169061 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42-metrics-certs\") pod \"network-metrics-daemon-pdg6r\" (UID: \"66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42\") " pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 17:00:37.388542 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:00:37.388516 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pxj6x\"" Jun 11 17:00:37.396736 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:00:37.396719 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdg6r" Jun 11 17:00:37.519596 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:00:37.519578 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pdg6r"] Jun 11 17:00:37.521981 ip-10-0-130-110 kubenswrapper[2565]: W0611 17:00:37.521950 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66b28b26_15e3_4cd2_9a1c_1a23dbd5bb42.slice/crio-3c744ff5de1fc056f7d22191543a0a258fab0a36c983cfd0e5e6dca609ace15a WatchSource:0}: Error finding container 3c744ff5de1fc056f7d22191543a0a258fab0a36c983cfd0e5e6dca609ace15a: Status 404 returned error can't find the container with id 3c744ff5de1fc056f7d22191543a0a258fab0a36c983cfd0e5e6dca609ace15a Jun 11 17:00:37.523998 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:00:37.523984 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 17:00:38.426315 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:00:38.426280 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pdg6r" event={"ID":"66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42","Type":"ContainerStarted","Data":"3c744ff5de1fc056f7d22191543a0a258fab0a36c983cfd0e5e6dca609ace15a"} Jun 11 17:00:39.430908 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:00:39.430870 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pdg6r" event={"ID":"66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42","Type":"ContainerStarted","Data":"5903702907d0041f31cc0fabad6f64a34742e059e4616bd595d371a7feead1cc"} Jun 11 17:00:39.431303 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:00:39.430934 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pdg6r" event={"ID":"66b28b26-15e3-4cd2-9a1c-1a23dbd5bb42","Type":"ContainerStarted","Data":"a86196e22d6ea79f167c56925487b6b1a3adeca58d84ecdf448a94518d4416c8"} Jun 11 17:00:39.449738 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:00:39.449688 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pdg6r" podStartSLOduration=375.587025078 podStartE2EDuration="6m16.449672966s" totalImagesPullingTime="862.647888ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:54:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:00:39.448573562 +0000 UTC m=+376.708828468" watchObservedRunningTime="2026-06-11 17:00:39.449672966 +0000 UTC m=+376.709927914" Jun 11 17:04:03.383225 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:03.383192 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nmfkv"] Jun 11 17:04:03.383664 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:03.383405 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45c2cd36-79dd-429b-a48a-69e118b687e8" containerName="registry" Jun 11 17:04:03.383664 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:03.383416 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="45c2cd36-79dd-429b-a48a-69e118b687e8" containerName="registry" Jun 11 17:04:03.383664 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:03.383468 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="45c2cd36-79dd-429b-a48a-69e118b687e8" containerName="registry" Jun 11 17:04:03.386009 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:03.385994 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nmfkv" Jun 11 17:04:03.388269 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:03.388233 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-cq6p2\"" Jun 11 17:04:03.388269 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:03.388250 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 17:04:03.388909 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:03.388891 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 17:04:03.395331 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:03.395313 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nmfkv"] Jun 11 17:04:03.448783 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:03.448752 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2ffc2c0-7768-46f2-b0a7-3c8e7dd34a05-tmp\") pod \"openshift-lws-operator-fd8ccff4c-nmfkv\" (UID: \"f2ffc2c0-7768-46f2-b0a7-3c8e7dd34a05\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nmfkv" Jun 11 17:04:03.448954 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:03.448804 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrm6q\" (UniqueName: \"kubernetes.io/projected/f2ffc2c0-7768-46f2-b0a7-3c8e7dd34a05-kube-api-access-nrm6q\") pod \"openshift-lws-operator-fd8ccff4c-nmfkv\" (UID: \"f2ffc2c0-7768-46f2-b0a7-3c8e7dd34a05\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nmfkv" Jun 11 17:04:03.549575 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:03.549546 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrm6q\" (UniqueName: \"kubernetes.io/projected/f2ffc2c0-7768-46f2-b0a7-3c8e7dd34a05-kube-api-access-nrm6q\") pod \"openshift-lws-operator-fd8ccff4c-nmfkv\" (UID: \"f2ffc2c0-7768-46f2-b0a7-3c8e7dd34a05\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nmfkv" Jun 11 17:04:03.549751 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:03.549588 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2ffc2c0-7768-46f2-b0a7-3c8e7dd34a05-tmp\") pod \"openshift-lws-operator-fd8ccff4c-nmfkv\" (UID: \"f2ffc2c0-7768-46f2-b0a7-3c8e7dd34a05\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nmfkv" Jun 11 17:04:03.549936 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:03.549919 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2ffc2c0-7768-46f2-b0a7-3c8e7dd34a05-tmp\") pod \"openshift-lws-operator-fd8ccff4c-nmfkv\" (UID: \"f2ffc2c0-7768-46f2-b0a7-3c8e7dd34a05\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nmfkv" Jun 11 17:04:03.558073 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:03.558049 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrm6q\" (UniqueName: \"kubernetes.io/projected/f2ffc2c0-7768-46f2-b0a7-3c8e7dd34a05-kube-api-access-nrm6q\") pod \"openshift-lws-operator-fd8ccff4c-nmfkv\" (UID: \"f2ffc2c0-7768-46f2-b0a7-3c8e7dd34a05\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nmfkv" Jun 11 17:04:03.695124 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:03.695036 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nmfkv" Jun 11 17:04:03.817565 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:03.817533 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nmfkv"] Jun 11 17:04:03.820325 ip-10-0-130-110 kubenswrapper[2565]: W0611 17:04:03.820300 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf2ffc2c0_7768_46f2_b0a7_3c8e7dd34a05.slice/crio-d0e813c7ecd013b0e4bf6b9de7362391ba165eb051f0de2de09a13e51c7516a9 WatchSource:0}: Error finding container d0e813c7ecd013b0e4bf6b9de7362391ba165eb051f0de2de09a13e51c7516a9: Status 404 returned error can't find the container with id d0e813c7ecd013b0e4bf6b9de7362391ba165eb051f0de2de09a13e51c7516a9 Jun 11 17:04:04.080276 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:04.080241 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nmfkv" event={"ID":"f2ffc2c0-7768-46f2-b0a7-3c8e7dd34a05","Type":"ContainerStarted","Data":"d0e813c7ecd013b0e4bf6b9de7362391ba165eb051f0de2de09a13e51c7516a9"} Jun 11 17:04:07.094999 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:07.094958 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nmfkv" event={"ID":"f2ffc2c0-7768-46f2-b0a7-3c8e7dd34a05","Type":"ContainerStarted","Data":"50a0cb7f9670f762b355e6c543a3decf22de4fe8980c4bc76e1a1e78bd063415"} Jun 11 17:04:07.115912 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:07.115865 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nmfkv" podStartSLOduration=1.532854859 podStartE2EDuration="4.115849248s" totalImagesPullingTime="2.582994389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:04:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:04:07.113736848 +0000 UTC m=+584.373991752" watchObservedRunningTime="2026-06-11 17:04:07.115849248 +0000 UTC m=+584.376104151" Jun 11 17:04:22.292813 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:22.292778 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-zlj6k"] Jun 11 17:04:22.295512 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:22.295491 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-zlj6k" Jun 11 17:04:22.299369 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:22.299322 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 17:04:22.299369 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:22.299329 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6sbj9\"" Jun 11 17:04:22.299575 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:22.299559 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 17:04:22.299655 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:22.299639 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 17:04:22.299703 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:22.299641 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 17:04:22.330857 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:22.330813 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-zlj6k"] Jun 11 17:04:22.377876 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:22.377850 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf2f24e7-50fb-4fd0-849f-f9cee3637dca-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dbfc5486d-zlj6k\" (UID: \"bf2f24e7-50fb-4fd0-849f-f9cee3637dca\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-zlj6k" Jun 11 17:04:22.378045 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:22.377885 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf2f24e7-50fb-4fd0-849f-f9cee3637dca-tmp\") pod \"opendatahub-operator-controller-manager-7dbfc5486d-zlj6k\" (UID: \"bf2f24e7-50fb-4fd0-849f-f9cee3637dca\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-zlj6k" Jun 11 17:04:22.378045 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:22.377907 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bf2f24e7-50fb-4fd0-849f-f9cee3637dca-manifests\") pod \"opendatahub-operator-controller-manager-7dbfc5486d-zlj6k\" (UID: \"bf2f24e7-50fb-4fd0-849f-f9cee3637dca\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-zlj6k" Jun 11 17:04:22.378045 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:22.377933 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbhbw\" (UniqueName: \"kubernetes.io/projected/bf2f24e7-50fb-4fd0-849f-f9cee3637dca-kube-api-access-tbhbw\") pod \"opendatahub-operator-controller-manager-7dbfc5486d-zlj6k\" (UID: \"bf2f24e7-50fb-4fd0-849f-f9cee3637dca\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-zlj6k" Jun 11 17:04:22.378045 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:22.378019 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bf2f24e7-50fb-4fd0-849f-f9cee3637dca-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dbfc5486d-zlj6k\" (UID: \"bf2f24e7-50fb-4fd0-849f-f9cee3637dca\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-zlj6k" Jun 11 17:04:22.478598 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:22.478557 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf2f24e7-50fb-4fd0-849f-f9cee3637dca-tmp\") pod \"opendatahub-operator-controller-manager-7dbfc5486d-zlj6k\" (UID: \"bf2f24e7-50fb-4fd0-849f-f9cee3637dca\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-zlj6k" Jun 11 17:04:22.478738 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:22.478604 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bf2f24e7-50fb-4fd0-849f-f9cee3637dca-manifests\") pod \"opendatahub-operator-controller-manager-7dbfc5486d-zlj6k\" (UID: \"bf2f24e7-50fb-4fd0-849f-f9cee3637dca\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-zlj6k" Jun 11 17:04:22.478738 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:22.478637 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbhbw\" (UniqueName: \"kubernetes.io/projected/bf2f24e7-50fb-4fd0-849f-f9cee3637dca-kube-api-access-tbhbw\") pod \"opendatahub-operator-controller-manager-7dbfc5486d-zlj6k\" (UID: \"bf2f24e7-50fb-4fd0-849f-f9cee3637dca\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-zlj6k" Jun 11 17:04:22.478738 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:22.478662 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bf2f24e7-50fb-4fd0-849f-f9cee3637dca-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dbfc5486d-zlj6k\" (UID: \"bf2f24e7-50fb-4fd0-849f-f9cee3637dca\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-zlj6k" Jun 11 17:04:22.478738 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:22.478682 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf2f24e7-50fb-4fd0-849f-f9cee3637dca-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dbfc5486d-zlj6k\" (UID: \"bf2f24e7-50fb-4fd0-849f-f9cee3637dca\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-zlj6k" Jun 11 17:04:22.479116 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:22.479087 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bf2f24e7-50fb-4fd0-849f-f9cee3637dca-manifests\") pod \"opendatahub-operator-controller-manager-7dbfc5486d-zlj6k\" (UID: \"bf2f24e7-50fb-4fd0-849f-f9cee3637dca\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-zlj6k" Jun 11 17:04:22.480877 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:22.480855 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf2f24e7-50fb-4fd0-849f-f9cee3637dca-tmp\") pod \"opendatahub-operator-controller-manager-7dbfc5486d-zlj6k\" (UID: \"bf2f24e7-50fb-4fd0-849f-f9cee3637dca\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-zlj6k" Jun 11 17:04:22.481144 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:22.481125 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bf2f24e7-50fb-4fd0-849f-f9cee3637dca-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dbfc5486d-zlj6k\" (UID: \"bf2f24e7-50fb-4fd0-849f-f9cee3637dca\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-zlj6k" Jun 11 17:04:22.481254 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:22.481235 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf2f24e7-50fb-4fd0-849f-f9cee3637dca-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dbfc5486d-zlj6k\" (UID: \"bf2f24e7-50fb-4fd0-849f-f9cee3637dca\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-zlj6k" Jun 11 17:04:22.487840 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:22.487803 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbhbw\" (UniqueName: \"kubernetes.io/projected/bf2f24e7-50fb-4fd0-849f-f9cee3637dca-kube-api-access-tbhbw\") pod \"opendatahub-operator-controller-manager-7dbfc5486d-zlj6k\" (UID: \"bf2f24e7-50fb-4fd0-849f-f9cee3637dca\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-zlj6k" Jun 11 17:04:22.605495 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:22.605460 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-zlj6k" Jun 11 17:04:22.744895 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:22.744870 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-zlj6k"] Jun 11 17:04:22.747183 ip-10-0-130-110 kubenswrapper[2565]: W0611 17:04:22.747153 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf2f24e7_50fb_4fd0_849f_f9cee3637dca.slice/crio-e5f6f8568e4980cfab76e8a8dfea468f94b224aa4777e59c29a89079da2252af WatchSource:0}: Error finding container e5f6f8568e4980cfab76e8a8dfea468f94b224aa4777e59c29a89079da2252af: Status 404 returned error can't find the container with id e5f6f8568e4980cfab76e8a8dfea468f94b224aa4777e59c29a89079da2252af Jun 11 17:04:23.146725 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:23.146689 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-zlj6k" event={"ID":"bf2f24e7-50fb-4fd0-849f-f9cee3637dca","Type":"ContainerStarted","Data":"e5f6f8568e4980cfab76e8a8dfea468f94b224aa4777e59c29a89079da2252af"} Jun 11 17:04:23.154486 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:23.154451 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7hbj_a30425b4-3b27-4ae1-af09-384473269d18/ovn-acl-logging/0.log" Jun 11 17:04:23.156313 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:23.156288 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7hbj_a30425b4-3b27-4ae1-af09-384473269d18/ovn-acl-logging/0.log" Jun 11 17:04:26.158690 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:26.158656 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-zlj6k" event={"ID":"bf2f24e7-50fb-4fd0-849f-f9cee3637dca","Type":"ContainerStarted","Data":"9f757dd557be4262a4e7fe5c47f4be3393640fb00ec520594c76e4229d68d350"} Jun 11 17:04:27.163977 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:27.163946 2565 generic.go:356] "Generic (PLEG): container finished" podID="bf2f24e7-50fb-4fd0-849f-f9cee3637dca" containerID="9f757dd557be4262a4e7fe5c47f4be3393640fb00ec520594c76e4229d68d350" exitCode=0 Jun 11 17:04:27.164354 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:27.164016 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-zlj6k" event={"ID":"bf2f24e7-50fb-4fd0-849f-f9cee3637dca","Type":"ContainerDied","Data":"9f757dd557be4262a4e7fe5c47f4be3393640fb00ec520594c76e4229d68d350"} Jun 11 17:04:28.169349 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:28.169312 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-zlj6k" event={"ID":"bf2f24e7-50fb-4fd0-849f-f9cee3637dca","Type":"ContainerStarted","Data":"e36f0958215b568f10e58f01a14bcb6603f5121ec1f789a4d124db95674f2e74"} Jun 11 17:04:28.169850 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:28.169385 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-zlj6k" Jun 11 17:04:28.194684 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:28.194634 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-zlj6k" podStartSLOduration=1.666828252 podStartE2EDuration="6.194617862s" totalImagesPullingTime="3.576411957s" totalInitContainerRuntime="951.377653ms" isStatefulPod=false podCreationTimestamp="2026-06-11 17:04:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:04:28.193223029 +0000 UTC m=+605.453477923" watchObservedRunningTime="2026-06-11 17:04:28.194617862 +0000 UTC m=+605.454872827" Jun 11 17:04:39.175583 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:39.175499 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-zlj6k" Jun 11 17:04:42.378812 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:42.378777 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-hwtcf"] Jun 11 17:04:42.386240 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:42.386214 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-hwtcf" Jun 11 17:04:42.390047 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:42.390027 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-9jsvn\"" Jun 11 17:04:42.390297 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:42.390277 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 11 17:04:42.403541 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:42.403508 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-hwtcf"] Jun 11 17:04:42.524620 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:42.524585 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2cd6b12-2658-45e0-a432-cd9f705aa11c-cert\") pod \"odh-model-controller-6dc94f689f-hwtcf\" (UID: \"c2cd6b12-2658-45e0-a432-cd9f705aa11c\") " pod="opendatahub/odh-model-controller-6dc94f689f-hwtcf" Jun 11 17:04:42.524620 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:42.524620 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mc8d\" (UniqueName: \"kubernetes.io/projected/c2cd6b12-2658-45e0-a432-cd9f705aa11c-kube-api-access-2mc8d\") pod \"odh-model-controller-6dc94f689f-hwtcf\" (UID: \"c2cd6b12-2658-45e0-a432-cd9f705aa11c\") " pod="opendatahub/odh-model-controller-6dc94f689f-hwtcf" Jun 11 17:04:42.625978 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:42.625940 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2cd6b12-2658-45e0-a432-cd9f705aa11c-cert\") pod \"odh-model-controller-6dc94f689f-hwtcf\" (UID: \"c2cd6b12-2658-45e0-a432-cd9f705aa11c\") " pod="opendatahub/odh-model-controller-6dc94f689f-hwtcf" Jun 11 17:04:42.625978 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:42.625981 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mc8d\" (UniqueName: \"kubernetes.io/projected/c2cd6b12-2658-45e0-a432-cd9f705aa11c-kube-api-access-2mc8d\") pod \"odh-model-controller-6dc94f689f-hwtcf\" (UID: \"c2cd6b12-2658-45e0-a432-cd9f705aa11c\") " pod="opendatahub/odh-model-controller-6dc94f689f-hwtcf" Jun 11 17:04:42.626192 ip-10-0-130-110 kubenswrapper[2565]: E0611 17:04:42.626095 2565 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 11 17:04:42.626192 ip-10-0-130-110 kubenswrapper[2565]: E0611 17:04:42.626176 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2cd6b12-2658-45e0-a432-cd9f705aa11c-cert podName:c2cd6b12-2658-45e0-a432-cd9f705aa11c nodeName:}" failed. No retries permitted until 2026-06-11 17:04:43.126155923 +0000 UTC m=+620.386410811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c2cd6b12-2658-45e0-a432-cd9f705aa11c-cert") pod "odh-model-controller-6dc94f689f-hwtcf" (UID: "c2cd6b12-2658-45e0-a432-cd9f705aa11c") : secret "odh-model-controller-webhook-cert" not found Jun 11 17:04:42.642236 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:42.642163 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mc8d\" (UniqueName: \"kubernetes.io/projected/c2cd6b12-2658-45e0-a432-cd9f705aa11c-kube-api-access-2mc8d\") pod \"odh-model-controller-6dc94f689f-hwtcf\" (UID: \"c2cd6b12-2658-45e0-a432-cd9f705aa11c\") " pod="opendatahub/odh-model-controller-6dc94f689f-hwtcf" Jun 11 17:04:43.130860 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:43.130805 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2cd6b12-2658-45e0-a432-cd9f705aa11c-cert\") pod \"odh-model-controller-6dc94f689f-hwtcf\" (UID: \"c2cd6b12-2658-45e0-a432-cd9f705aa11c\") " pod="opendatahub/odh-model-controller-6dc94f689f-hwtcf" Jun 11 17:04:43.133186 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:43.133160 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2cd6b12-2658-45e0-a432-cd9f705aa11c-cert\") pod \"odh-model-controller-6dc94f689f-hwtcf\" (UID: \"c2cd6b12-2658-45e0-a432-cd9f705aa11c\") " pod="opendatahub/odh-model-controller-6dc94f689f-hwtcf" Jun 11 17:04:43.295415 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:43.295389 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-hwtcf" Jun 11 17:04:43.430834 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:43.430742 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-hwtcf"] Jun 11 17:04:43.434070 ip-10-0-130-110 kubenswrapper[2565]: W0611 17:04:43.434026 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2cd6b12_2658_45e0_a432_cd9f705aa11c.slice/crio-20f72cff0cc8090a0fe419faccd344713ffefd1e356280a013228a4c3001880a WatchSource:0}: Error finding container 20f72cff0cc8090a0fe419faccd344713ffefd1e356280a013228a4c3001880a: Status 404 returned error can't find the container with id 20f72cff0cc8090a0fe419faccd344713ffefd1e356280a013228a4c3001880a Jun 11 17:04:44.224201 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:44.224152 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-hwtcf" event={"ID":"c2cd6b12-2658-45e0-a432-cd9f705aa11c","Type":"ContainerStarted","Data":"20f72cff0cc8090a0fe419faccd344713ffefd1e356280a013228a4c3001880a"} Jun 11 17:04:47.237973 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:47.237929 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-hwtcf" event={"ID":"c2cd6b12-2658-45e0-a432-cd9f705aa11c","Type":"ContainerStarted","Data":"d64d3109c3762e0885030a8c438be98fc3c70eb46a1a7cba21ea83fa51aaa330"} Jun 11 17:04:47.238377 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:47.238051 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-hwtcf" Jun 11 17:04:47.256464 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:47.256368 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-hwtcf" podStartSLOduration=1.6982397200000001 podStartE2EDuration="5.256353262s" totalImagesPullingTime="3.558113542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:04:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:04:47.255488472 +0000 UTC m=+624.515743399" watchObservedRunningTime="2026-06-11 17:04:47.256353262 +0000 UTC m=+624.516608183" Jun 11 17:04:53.272617 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:53.272583 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5968bff7d8-pm9xh"] Jun 11 17:04:53.274729 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:53.274713 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5968bff7d8-pm9xh" Jun 11 17:04:53.279187 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:53.279165 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 17:04:53.279337 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:53.279220 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 17:04:53.281859 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:53.281837 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 17:04:53.281982 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:53.281846 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 17:04:53.308444 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:53.308413 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5968bff7d8-pm9xh"] Jun 11 17:04:53.415736 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:53.415694 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b482be0e-6df3-4947-b806-6b653d23dc71-tls-certs\") pod \"kube-auth-proxy-5968bff7d8-pm9xh\" (UID: \"b482be0e-6df3-4947-b806-6b653d23dc71\") " pod="openshift-ingress/kube-auth-proxy-5968bff7d8-pm9xh" Jun 11 17:04:53.415923 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:53.415773 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnfgq\" (UniqueName: \"kubernetes.io/projected/b482be0e-6df3-4947-b806-6b653d23dc71-kube-api-access-wnfgq\") pod \"kube-auth-proxy-5968bff7d8-pm9xh\" (UID: \"b482be0e-6df3-4947-b806-6b653d23dc71\") " pod="openshift-ingress/kube-auth-proxy-5968bff7d8-pm9xh" Jun 11 17:04:53.415923 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:53.415878 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b482be0e-6df3-4947-b806-6b653d23dc71-tmp\") pod \"kube-auth-proxy-5968bff7d8-pm9xh\" (UID: \"b482be0e-6df3-4947-b806-6b653d23dc71\") " pod="openshift-ingress/kube-auth-proxy-5968bff7d8-pm9xh" Jun 11 17:04:53.517189 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:53.517149 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b482be0e-6df3-4947-b806-6b653d23dc71-tls-certs\") pod \"kube-auth-proxy-5968bff7d8-pm9xh\" (UID: \"b482be0e-6df3-4947-b806-6b653d23dc71\") " pod="openshift-ingress/kube-auth-proxy-5968bff7d8-pm9xh" Jun 11 17:04:53.517388 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:53.517214 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnfgq\" (UniqueName: \"kubernetes.io/projected/b482be0e-6df3-4947-b806-6b653d23dc71-kube-api-access-wnfgq\") pod \"kube-auth-proxy-5968bff7d8-pm9xh\" (UID: \"b482be0e-6df3-4947-b806-6b653d23dc71\") " pod="openshift-ingress/kube-auth-proxy-5968bff7d8-pm9xh" Jun 11 17:04:53.517388 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:53.517253 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b482be0e-6df3-4947-b806-6b653d23dc71-tmp\") pod \"kube-auth-proxy-5968bff7d8-pm9xh\" (UID: \"b482be0e-6df3-4947-b806-6b653d23dc71\") " pod="openshift-ingress/kube-auth-proxy-5968bff7d8-pm9xh" Jun 11 17:04:53.517388 ip-10-0-130-110 kubenswrapper[2565]: E0611 17:04:53.517342 2565 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 11 17:04:53.517506 ip-10-0-130-110 kubenswrapper[2565]: E0611 17:04:53.517425 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b482be0e-6df3-4947-b806-6b653d23dc71-tls-certs podName:b482be0e-6df3-4947-b806-6b653d23dc71 nodeName:}" failed. No retries permitted until 2026-06-11 17:04:54.017401018 +0000 UTC m=+631.277655913 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/b482be0e-6df3-4947-b806-6b653d23dc71-tls-certs") pod "kube-auth-proxy-5968bff7d8-pm9xh" (UID: "b482be0e-6df3-4947-b806-6b653d23dc71") : secret "kube-auth-proxy-tls" not found Jun 11 17:04:53.519558 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:53.519532 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b482be0e-6df3-4947-b806-6b653d23dc71-tmp\") pod \"kube-auth-proxy-5968bff7d8-pm9xh\" (UID: \"b482be0e-6df3-4947-b806-6b653d23dc71\") " pod="openshift-ingress/kube-auth-proxy-5968bff7d8-pm9xh" Jun 11 17:04:53.532215 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:53.532154 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnfgq\" (UniqueName: \"kubernetes.io/projected/b482be0e-6df3-4947-b806-6b653d23dc71-kube-api-access-wnfgq\") pod \"kube-auth-proxy-5968bff7d8-pm9xh\" (UID: \"b482be0e-6df3-4947-b806-6b653d23dc71\") " pod="openshift-ingress/kube-auth-proxy-5968bff7d8-pm9xh" Jun 11 17:04:53.990418 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:53.990381 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-jwqpb"] Jun 11 17:04:53.992590 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:53.992572 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-jwqpb" Jun 11 17:04:53.995775 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:53.995758 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 11 17:04:53.995987 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:53.995975 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-whvgm\"" Jun 11 17:04:54.008411 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:54.008390 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-8r2wk"] Jun 11 17:04:54.010653 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:54.010638 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8r2wk" Jun 11 17:04:54.013442 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:54.013427 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-9dl28\"" Jun 11 17:04:54.014038 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:54.014020 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 11 17:04:54.015662 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:54.015642 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-jwqpb"] Jun 11 17:04:54.021631 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:54.021610 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b482be0e-6df3-4947-b806-6b653d23dc71-tls-certs\") pod \"kube-auth-proxy-5968bff7d8-pm9xh\" (UID: \"b482be0e-6df3-4947-b806-6b653d23dc71\") " pod="openshift-ingress/kube-auth-proxy-5968bff7d8-pm9xh" Jun 11 17:04:54.024076 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:54.024050 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b482be0e-6df3-4947-b806-6b653d23dc71-tls-certs\") pod \"kube-auth-proxy-5968bff7d8-pm9xh\" (UID: \"b482be0e-6df3-4947-b806-6b653d23dc71\") " pod="openshift-ingress/kube-auth-proxy-5968bff7d8-pm9xh" Jun 11 17:04:54.035986 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:54.035961 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-8r2wk"] Jun 11 17:04:54.122664 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:54.122625 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g5cg\" (UniqueName: \"kubernetes.io/projected/9335727b-3eec-4b79-9b6b-981cb67cbe2e-kube-api-access-9g5cg\") pod \"llmisvc-controller-manager-864bfd7bc9-8r2wk\" (UID: \"9335727b-3eec-4b79-9b6b-981cb67cbe2e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8r2wk" Jun 11 17:04:54.122920 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:54.122681 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5k52\" (UniqueName: \"kubernetes.io/projected/5873dfb7-b042-465a-a480-ed0aaa195ca7-kube-api-access-g5k52\") pod \"kserve-controller-manager-69fc866d76-jwqpb\" (UID: \"5873dfb7-b042-465a-a480-ed0aaa195ca7\") " pod="opendatahub/kserve-controller-manager-69fc866d76-jwqpb" Jun 11 17:04:54.122920 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:54.122779 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5873dfb7-b042-465a-a480-ed0aaa195ca7-cert\") pod \"kserve-controller-manager-69fc866d76-jwqpb\" (UID: \"5873dfb7-b042-465a-a480-ed0aaa195ca7\") " pod="opendatahub/kserve-controller-manager-69fc866d76-jwqpb" Jun 11 17:04:54.122920 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:54.122854 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9335727b-3eec-4b79-9b6b-981cb67cbe2e-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-8r2wk\" (UID: \"9335727b-3eec-4b79-9b6b-981cb67cbe2e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8r2wk" Jun 11 17:04:54.184767 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:54.184725 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5968bff7d8-pm9xh" Jun 11 17:04:54.224061 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:54.224025 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g5cg\" (UniqueName: \"kubernetes.io/projected/9335727b-3eec-4b79-9b6b-981cb67cbe2e-kube-api-access-9g5cg\") pod \"llmisvc-controller-manager-864bfd7bc9-8r2wk\" (UID: \"9335727b-3eec-4b79-9b6b-981cb67cbe2e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8r2wk" Jun 11 17:04:54.224259 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:54.224071 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5k52\" (UniqueName: \"kubernetes.io/projected/5873dfb7-b042-465a-a480-ed0aaa195ca7-kube-api-access-g5k52\") pod \"kserve-controller-manager-69fc866d76-jwqpb\" (UID: \"5873dfb7-b042-465a-a480-ed0aaa195ca7\") " pod="opendatahub/kserve-controller-manager-69fc866d76-jwqpb" Jun 11 17:04:54.224259 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:54.224119 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5873dfb7-b042-465a-a480-ed0aaa195ca7-cert\") pod \"kserve-controller-manager-69fc866d76-jwqpb\" (UID: \"5873dfb7-b042-465a-a480-ed0aaa195ca7\") " pod="opendatahub/kserve-controller-manager-69fc866d76-jwqpb" Jun 11 17:04:54.224259 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:54.224152 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9335727b-3eec-4b79-9b6b-981cb67cbe2e-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-8r2wk\" (UID: \"9335727b-3eec-4b79-9b6b-981cb67cbe2e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8r2wk" Jun 11 17:04:54.224425 ip-10-0-130-110 kubenswrapper[2565]: E0611 17:04:54.224260 2565 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 11 17:04:54.224425 ip-10-0-130-110 kubenswrapper[2565]: E0611 17:04:54.224329 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9335727b-3eec-4b79-9b6b-981cb67cbe2e-cert podName:9335727b-3eec-4b79-9b6b-981cb67cbe2e nodeName:}" failed. No retries permitted until 2026-06-11 17:04:54.724308357 +0000 UTC m=+631.984563248 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9335727b-3eec-4b79-9b6b-981cb67cbe2e-cert") pod "llmisvc-controller-manager-864bfd7bc9-8r2wk" (UID: "9335727b-3eec-4b79-9b6b-981cb67cbe2e") : secret "llmisvc-webhook-server-cert" not found Jun 11 17:04:54.226609 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:54.226580 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5873dfb7-b042-465a-a480-ed0aaa195ca7-cert\") pod \"kserve-controller-manager-69fc866d76-jwqpb\" (UID: \"5873dfb7-b042-465a-a480-ed0aaa195ca7\") " pod="opendatahub/kserve-controller-manager-69fc866d76-jwqpb" Jun 11 17:04:54.234975 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:54.234952 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5k52\" (UniqueName: \"kubernetes.io/projected/5873dfb7-b042-465a-a480-ed0aaa195ca7-kube-api-access-g5k52\") pod \"kserve-controller-manager-69fc866d76-jwqpb\" (UID: \"5873dfb7-b042-465a-a480-ed0aaa195ca7\") " pod="opendatahub/kserve-controller-manager-69fc866d76-jwqpb" Jun 11 17:04:54.235521 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:54.235494 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g5cg\" (UniqueName: \"kubernetes.io/projected/9335727b-3eec-4b79-9b6b-981cb67cbe2e-kube-api-access-9g5cg\") pod \"llmisvc-controller-manager-864bfd7bc9-8r2wk\" (UID: \"9335727b-3eec-4b79-9b6b-981cb67cbe2e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8r2wk" Jun 11 17:04:54.303219 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:54.303180 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-jwqpb" Jun 11 17:04:54.345375 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:54.345346 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5968bff7d8-pm9xh"] Jun 11 17:04:54.347260 ip-10-0-130-110 kubenswrapper[2565]: W0611 17:04:54.347232 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb482be0e_6df3_4947_b806_6b653d23dc71.slice/crio-a0cfadee55d436734e73f59c62dd41f093e3131a5014a3f55aaa3857ac618679 WatchSource:0}: Error finding container a0cfadee55d436734e73f59c62dd41f093e3131a5014a3f55aaa3857ac618679: Status 404 returned error can't find the container with id a0cfadee55d436734e73f59c62dd41f093e3131a5014a3f55aaa3857ac618679 Jun 11 17:04:54.461908 ip-10-0-130-110 kubenswrapper[2565]: W0611 17:04:54.461868 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5873dfb7_b042_465a_a480_ed0aaa195ca7.slice/crio-d2d655d48dcdbaeb77749d9cb113e7099ebbbe658301f768c845a5d99377ad0b WatchSource:0}: Error finding container d2d655d48dcdbaeb77749d9cb113e7099ebbbe658301f768c845a5d99377ad0b: Status 404 returned error can't find the container with id d2d655d48dcdbaeb77749d9cb113e7099ebbbe658301f768c845a5d99377ad0b Jun 11 17:04:54.477383 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:54.477358 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-jwqpb"] Jun 11 17:04:54.728873 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:54.728809 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9335727b-3eec-4b79-9b6b-981cb67cbe2e-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-8r2wk\" (UID: \"9335727b-3eec-4b79-9b6b-981cb67cbe2e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8r2wk" Jun 11 17:04:54.731369 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:54.731338 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9335727b-3eec-4b79-9b6b-981cb67cbe2e-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-8r2wk\" (UID: \"9335727b-3eec-4b79-9b6b-981cb67cbe2e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8r2wk" Jun 11 17:04:54.920481 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:54.920445 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8r2wk" Jun 11 17:04:55.085132 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:55.085103 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-8r2wk"] Jun 11 17:04:55.088324 ip-10-0-130-110 kubenswrapper[2565]: W0611 17:04:55.088279 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9335727b_3eec_4b79_9b6b_981cb67cbe2e.slice/crio-2ece9ca862d163ea2ed36f29cd013c80dc72e2282562550776565a746cb3a732 WatchSource:0}: Error finding container 2ece9ca862d163ea2ed36f29cd013c80dc72e2282562550776565a746cb3a732: Status 404 returned error can't find the container with id 2ece9ca862d163ea2ed36f29cd013c80dc72e2282562550776565a746cb3a732 Jun 11 17:04:55.286952 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:55.286846 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5968bff7d8-pm9xh" event={"ID":"b482be0e-6df3-4947-b806-6b653d23dc71","Type":"ContainerStarted","Data":"a0cfadee55d436734e73f59c62dd41f093e3131a5014a3f55aaa3857ac618679"} Jun 11 17:04:55.289699 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:55.289650 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8r2wk" event={"ID":"9335727b-3eec-4b79-9b6b-981cb67cbe2e","Type":"ContainerStarted","Data":"2ece9ca862d163ea2ed36f29cd013c80dc72e2282562550776565a746cb3a732"} Jun 11 17:04:55.294613 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:55.294570 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-jwqpb" event={"ID":"5873dfb7-b042-465a-a480-ed0aaa195ca7","Type":"ContainerStarted","Data":"d2d655d48dcdbaeb77749d9cb113e7099ebbbe658301f768c845a5d99377ad0b"} Jun 11 17:04:58.244276 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:58.244244 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-hwtcf" Jun 11 17:04:59.316287 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:59.316244 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5968bff7d8-pm9xh" event={"ID":"b482be0e-6df3-4947-b806-6b653d23dc71","Type":"ContainerStarted","Data":"d45246d46303a24a30a511c2a8bb7e602e3e8275d7f73ff7c7c2bd4de98c06f7"} Jun 11 17:04:59.317970 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:59.317937 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-jwqpb" event={"ID":"5873dfb7-b042-465a-a480-ed0aaa195ca7","Type":"ContainerStarted","Data":"f2cf695683177e5e028132c24a859a2fa49c4069e385679edd3e6951a7fb6dab"} Jun 11 17:04:59.318115 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:59.317997 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-jwqpb" Jun 11 17:04:59.336863 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:59.336794 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5968bff7d8-pm9xh" podStartSLOduration=2.371358579 podStartE2EDuration="6.336772128s" totalImagesPullingTime="3.965413549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:04:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:04:59.335666176 +0000 UTC m=+636.595921082" watchObservedRunningTime="2026-06-11 17:04:59.336772128 +0000 UTC m=+636.597027035" Jun 11 17:04:59.353186 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:04:59.353128 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-jwqpb" podStartSLOduration=2.459988978 podStartE2EDuration="6.353106611s" totalImagesPullingTime="3.893117633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:04:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:04:59.351861988 +0000 UTC m=+636.612116895" watchObservedRunningTime="2026-06-11 17:04:59.353106611 +0000 UTC m=+636.613361518" Jun 11 17:05:00.323951 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:00.323916 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8r2wk" event={"ID":"9335727b-3eec-4b79-9b6b-981cb67cbe2e","Type":"ContainerStarted","Data":"f708e2c2edf2cf0029f6c24eb87358a1bf3708afdb67e1166b290396509afc1d"} Jun 11 17:05:00.324354 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:00.324018 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8r2wk" Jun 11 17:05:00.349736 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:00.349679 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8r2wk" podStartSLOduration=2.905364827 podStartE2EDuration="7.349657723s" totalImagesPullingTime="4.444292896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:04:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:05:00.34625678 +0000 UTC m=+637.606511695" watchObservedRunningTime="2026-06-11 17:05:00.349657723 +0000 UTC m=+637.609912636" Jun 11 17:05:10.151914 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:10.151881 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-n9rw7"] Jun 11 17:05:10.154451 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:10.154430 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-n9rw7" Jun 11 17:05:10.163811 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:10.163783 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-l4z5w\"" Jun 11 17:05:10.163935 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:10.163878 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 11 17:05:10.164430 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:10.164405 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 11 17:05:10.181754 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:10.181726 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-n9rw7"] Jun 11 17:05:10.237308 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:10.237273 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7c77f5f568-q7psn"] Jun 11 17:05:10.239669 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:10.239650 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7c77f5f568-q7psn" Jun 11 17:05:10.242187 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:10.242168 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-z2pt9\"" Jun 11 17:05:10.242317 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:10.242231 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 17:05:10.256161 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:10.256132 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7c77f5f568-q7psn"] Jun 11 17:05:10.257355 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:10.257331 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46ps7\" (UniqueName: \"kubernetes.io/projected/b1e8b720-d4a0-4956-8f4d-1935af408fe2-kube-api-access-46ps7\") pod \"servicemesh-operator3-57f65f65fb-n9rw7\" (UID: \"b1e8b720-d4a0-4956-8f4d-1935af408fe2\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-n9rw7" Jun 11 17:05:10.257468 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:10.257365 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/b1e8b720-d4a0-4956-8f4d-1935af408fe2-operator-config\") pod \"servicemesh-operator3-57f65f65fb-n9rw7\" (UID: \"b1e8b720-d4a0-4956-8f4d-1935af408fe2\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-n9rw7" Jun 11 17:05:10.358111 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:10.358079 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d11b5098-6e68-4b4e-8a3d-14e6af5d5f1c-redirect-config\") pod \"dashboard-redirect-7c77f5f568-q7psn\" (UID: \"d11b5098-6e68-4b4e-8a3d-14e6af5d5f1c\") " pod="opendatahub/dashboard-redirect-7c77f5f568-q7psn" Jun 11 17:05:10.358276 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:10.358115 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gh67\" (UniqueName: \"kubernetes.io/projected/d11b5098-6e68-4b4e-8a3d-14e6af5d5f1c-kube-api-access-6gh67\") pod \"dashboard-redirect-7c77f5f568-q7psn\" (UID: \"d11b5098-6e68-4b4e-8a3d-14e6af5d5f1c\") " pod="opendatahub/dashboard-redirect-7c77f5f568-q7psn" Jun 11 17:05:10.358276 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:10.358179 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46ps7\" (UniqueName: \"kubernetes.io/projected/b1e8b720-d4a0-4956-8f4d-1935af408fe2-kube-api-access-46ps7\") pod \"servicemesh-operator3-57f65f65fb-n9rw7\" (UID: \"b1e8b720-d4a0-4956-8f4d-1935af408fe2\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-n9rw7" Jun 11 17:05:10.358276 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:10.358206 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/b1e8b720-d4a0-4956-8f4d-1935af408fe2-operator-config\") pod \"servicemesh-operator3-57f65f65fb-n9rw7\" (UID: \"b1e8b720-d4a0-4956-8f4d-1935af408fe2\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-n9rw7" Jun 11 17:05:10.360756 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:10.360724 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/b1e8b720-d4a0-4956-8f4d-1935af408fe2-operator-config\") pod \"servicemesh-operator3-57f65f65fb-n9rw7\" (UID: \"b1e8b720-d4a0-4956-8f4d-1935af408fe2\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-n9rw7" Jun 11 17:05:10.369672 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:10.369649 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46ps7\" (UniqueName: \"kubernetes.io/projected/b1e8b720-d4a0-4956-8f4d-1935af408fe2-kube-api-access-46ps7\") pod \"servicemesh-operator3-57f65f65fb-n9rw7\" (UID: \"b1e8b720-d4a0-4956-8f4d-1935af408fe2\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-n9rw7" Jun 11 17:05:10.459638 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:10.459541 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d11b5098-6e68-4b4e-8a3d-14e6af5d5f1c-redirect-config\") pod \"dashboard-redirect-7c77f5f568-q7psn\" (UID: \"d11b5098-6e68-4b4e-8a3d-14e6af5d5f1c\") " pod="opendatahub/dashboard-redirect-7c77f5f568-q7psn" Jun 11 17:05:10.459638 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:10.459585 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gh67\" (UniqueName: \"kubernetes.io/projected/d11b5098-6e68-4b4e-8a3d-14e6af5d5f1c-kube-api-access-6gh67\") pod \"dashboard-redirect-7c77f5f568-q7psn\" (UID: \"d11b5098-6e68-4b4e-8a3d-14e6af5d5f1c\") " pod="opendatahub/dashboard-redirect-7c77f5f568-q7psn" Jun 11 17:05:10.460260 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:10.460239 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d11b5098-6e68-4b4e-8a3d-14e6af5d5f1c-redirect-config\") pod \"dashboard-redirect-7c77f5f568-q7psn\" (UID: \"d11b5098-6e68-4b4e-8a3d-14e6af5d5f1c\") " pod="opendatahub/dashboard-redirect-7c77f5f568-q7psn" Jun 11 17:05:10.463494 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:10.463475 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-n9rw7" Jun 11 17:05:10.470341 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:10.470322 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gh67\" (UniqueName: \"kubernetes.io/projected/d11b5098-6e68-4b4e-8a3d-14e6af5d5f1c-kube-api-access-6gh67\") pod \"dashboard-redirect-7c77f5f568-q7psn\" (UID: \"d11b5098-6e68-4b4e-8a3d-14e6af5d5f1c\") " pod="opendatahub/dashboard-redirect-7c77f5f568-q7psn" Jun 11 17:05:10.550211 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:10.550123 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7c77f5f568-q7psn" Jun 11 17:05:10.610802 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:10.610687 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-n9rw7"] Jun 11 17:05:10.614803 ip-10-0-130-110 kubenswrapper[2565]: W0611 17:05:10.614775 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1e8b720_d4a0_4956_8f4d_1935af408fe2.slice/crio-7038b8db72e8f7f95514b83eb4f3d894a4498eef992b6f96fb293308a40d8fcd WatchSource:0}: Error finding container 7038b8db72e8f7f95514b83eb4f3d894a4498eef992b6f96fb293308a40d8fcd: Status 404 returned error can't find the container with id 7038b8db72e8f7f95514b83eb4f3d894a4498eef992b6f96fb293308a40d8fcd Jun 11 17:05:10.695783 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:10.695747 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7c77f5f568-q7psn"] Jun 11 17:05:10.698527 ip-10-0-130-110 kubenswrapper[2565]: W0611 17:05:10.698506 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd11b5098_6e68_4b4e_8a3d_14e6af5d5f1c.slice/crio-c16217e42db445e12443b6e1da32bef536646331d34f44a1af76a0b481c64088 WatchSource:0}: Error finding container c16217e42db445e12443b6e1da32bef536646331d34f44a1af76a0b481c64088: Status 404 returned error can't find the container with id c16217e42db445e12443b6e1da32bef536646331d34f44a1af76a0b481c64088 Jun 11 17:05:11.372269 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:11.372205 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-n9rw7" event={"ID":"b1e8b720-d4a0-4956-8f4d-1935af408fe2","Type":"ContainerStarted","Data":"7038b8db72e8f7f95514b83eb4f3d894a4498eef992b6f96fb293308a40d8fcd"} Jun 11 17:05:11.373669 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:11.373632 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7c77f5f568-q7psn" event={"ID":"d11b5098-6e68-4b4e-8a3d-14e6af5d5f1c","Type":"ContainerStarted","Data":"c16217e42db445e12443b6e1da32bef536646331d34f44a1af76a0b481c64088"} Jun 11 17:05:16.399622 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:16.399584 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-n9rw7" event={"ID":"b1e8b720-d4a0-4956-8f4d-1935af408fe2","Type":"ContainerStarted","Data":"aa3a43d2888414de5e42e86c68f24759bf5aa5cd159915fc5ac1225547aec3eb"} Jun 11 17:05:16.400091 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:16.399651 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-n9rw7" Jun 11 17:05:16.401096 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:16.401070 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7c77f5f568-q7psn" event={"ID":"d11b5098-6e68-4b4e-8a3d-14e6af5d5f1c","Type":"ContainerStarted","Data":"5ca49edb01cf49f93819d01e5d36e2c8f68d02d5e8d0959b19a0132da84f2f10"} Jun 11 17:05:16.426400 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:16.426323 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-n9rw7" podStartSLOduration=1.3402893630000001 podStartE2EDuration="6.426305297s" totalImagesPullingTime="5.086015934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:05:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:05:16.424580236 +0000 UTC m=+653.684835142" watchObservedRunningTime="2026-06-11 17:05:16.426305297 +0000 UTC m=+653.686560202" Jun 11 17:05:16.444985 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:16.444937 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7c77f5f568-q7psn" podStartSLOduration=1.388056785 podStartE2EDuration="6.444921009s" totalImagesPullingTime="5.056864224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:05:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:05:16.444086297 +0000 UTC m=+653.704341203" watchObservedRunningTime="2026-06-11 17:05:16.444921009 +0000 UTC m=+653.705175914" Jun 11 17:05:21.722120 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:21.722082 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-c2rqq"] Jun 11 17:05:21.727258 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:21.727240 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2rqq" Jun 11 17:05:21.731857 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:21.731834 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 11 17:05:21.732146 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:21.732127 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 17:05:21.732212 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:21.732127 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 11 17:05:21.732259 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:21.732217 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-gk5tm\"" Jun 11 17:05:21.733358 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:21.733338 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 11 17:05:21.737434 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:21.737413 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e2abb1f-c0ba-481a-8a24-5738e383842b-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-c2rqq\" (UID: \"6e2abb1f-c0ba-481a-8a24-5738e383842b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2rqq" Jun 11 17:05:21.737533 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:21.737451 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6e2abb1f-c0ba-481a-8a24-5738e383842b-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-c2rqq\" (UID: \"6e2abb1f-c0ba-481a-8a24-5738e383842b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2rqq" Jun 11 17:05:21.737533 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:21.737476 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e2abb1f-c0ba-481a-8a24-5738e383842b-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-c2rqq\" (UID: \"6e2abb1f-c0ba-481a-8a24-5738e383842b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2rqq" Jun 11 17:05:21.737612 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:21.737543 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6e2abb1f-c0ba-481a-8a24-5738e383842b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-c2rqq\" (UID: \"6e2abb1f-c0ba-481a-8a24-5738e383842b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2rqq" Jun 11 17:05:21.737612 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:21.737577 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9hmx\" (UniqueName: \"kubernetes.io/projected/6e2abb1f-c0ba-481a-8a24-5738e383842b-kube-api-access-x9hmx\") pod \"istiod-openshift-gateway-75c67f8887-c2rqq\" (UID: \"6e2abb1f-c0ba-481a-8a24-5738e383842b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2rqq" Jun 11 17:05:21.737612 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:21.737600 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6e2abb1f-c0ba-481a-8a24-5738e383842b-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-c2rqq\" (UID: \"6e2abb1f-c0ba-481a-8a24-5738e383842b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2rqq" Jun 11 17:05:21.737701 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:21.737626 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6e2abb1f-c0ba-481a-8a24-5738e383842b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-c2rqq\" (UID: \"6e2abb1f-c0ba-481a-8a24-5738e383842b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2rqq" Jun 11 17:05:21.752242 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:21.752208 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-c2rqq"] Jun 11 17:05:21.838153 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:21.838119 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6e2abb1f-c0ba-481a-8a24-5738e383842b-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-c2rqq\" (UID: \"6e2abb1f-c0ba-481a-8a24-5738e383842b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2rqq" Jun 11 17:05:21.838153 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:21.838154 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e2abb1f-c0ba-481a-8a24-5738e383842b-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-c2rqq\" (UID: \"6e2abb1f-c0ba-481a-8a24-5738e383842b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2rqq" Jun 11 17:05:21.838365 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:21.838193 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6e2abb1f-c0ba-481a-8a24-5738e383842b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-c2rqq\" (UID: \"6e2abb1f-c0ba-481a-8a24-5738e383842b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2rqq" Jun 11 17:05:21.838365 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:21.838311 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9hmx\" (UniqueName: \"kubernetes.io/projected/6e2abb1f-c0ba-481a-8a24-5738e383842b-kube-api-access-x9hmx\") pod \"istiod-openshift-gateway-75c67f8887-c2rqq\" (UID: \"6e2abb1f-c0ba-481a-8a24-5738e383842b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2rqq" Jun 11 17:05:21.838365 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:21.838355 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6e2abb1f-c0ba-481a-8a24-5738e383842b-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-c2rqq\" (UID: \"6e2abb1f-c0ba-481a-8a24-5738e383842b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2rqq" Jun 11 17:05:21.838537 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:21.838405 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6e2abb1f-c0ba-481a-8a24-5738e383842b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-c2rqq\" (UID: \"6e2abb1f-c0ba-481a-8a24-5738e383842b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2rqq" Jun 11 17:05:21.838537 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:21.838459 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e2abb1f-c0ba-481a-8a24-5738e383842b-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-c2rqq\" (UID: \"6e2abb1f-c0ba-481a-8a24-5738e383842b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2rqq" Jun 11 17:05:21.838793 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:21.838768 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6e2abb1f-c0ba-481a-8a24-5738e383842b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-c2rqq\" (UID: \"6e2abb1f-c0ba-481a-8a24-5738e383842b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2rqq" Jun 11 17:05:21.840611 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:21.840583 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6e2abb1f-c0ba-481a-8a24-5738e383842b-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-c2rqq\" (UID: \"6e2abb1f-c0ba-481a-8a24-5738e383842b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2rqq" Jun 11 17:05:21.840611 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:21.840603 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6e2abb1f-c0ba-481a-8a24-5738e383842b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-c2rqq\" (UID: \"6e2abb1f-c0ba-481a-8a24-5738e383842b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2rqq" Jun 11 17:05:21.840759 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:21.840677 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e2abb1f-c0ba-481a-8a24-5738e383842b-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-c2rqq\" (UID: \"6e2abb1f-c0ba-481a-8a24-5738e383842b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2rqq" Jun 11 17:05:21.840759 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:21.840720 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6e2abb1f-c0ba-481a-8a24-5738e383842b-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-c2rqq\" (UID: \"6e2abb1f-c0ba-481a-8a24-5738e383842b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2rqq" Jun 11 17:05:21.851556 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:21.851522 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e2abb1f-c0ba-481a-8a24-5738e383842b-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-c2rqq\" (UID: \"6e2abb1f-c0ba-481a-8a24-5738e383842b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2rqq" Jun 11 17:05:21.853613 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:21.853590 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9hmx\" (UniqueName: \"kubernetes.io/projected/6e2abb1f-c0ba-481a-8a24-5738e383842b-kube-api-access-x9hmx\") pod \"istiod-openshift-gateway-75c67f8887-c2rqq\" (UID: \"6e2abb1f-c0ba-481a-8a24-5738e383842b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2rqq" Jun 11 17:05:22.036655 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:22.036553 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2rqq" Jun 11 17:05:22.180604 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:22.180511 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-c2rqq"] Jun 11 17:05:22.183281 ip-10-0-130-110 kubenswrapper[2565]: W0611 17:05:22.183257 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e2abb1f_c0ba_481a_8a24_5738e383842b.slice/crio-7db7c4474529743024725f622e7eca98623c738cd2b8b98e7a10b8ff6f005b95 WatchSource:0}: Error finding container 7db7c4474529743024725f622e7eca98623c738cd2b8b98e7a10b8ff6f005b95: Status 404 returned error can't find the container with id 7db7c4474529743024725f622e7eca98623c738cd2b8b98e7a10b8ff6f005b95 Jun 11 17:05:22.426594 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:22.426559 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2rqq" event={"ID":"6e2abb1f-c0ba-481a-8a24-5738e383842b","Type":"ContainerStarted","Data":"7db7c4474529743024725f622e7eca98623c738cd2b8b98e7a10b8ff6f005b95"} Jun 11 17:05:27.407682 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:27.407654 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-n9rw7" Jun 11 17:05:30.329480 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:30.329452 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-jwqpb" Jun 11 17:05:31.330222 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:31.330192 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8r2wk" Jun 11 17:05:34.614082 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:34.614043 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 17:05:34.614360 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:34.614113 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 17:05:35.485477 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:35.485440 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2rqq" event={"ID":"6e2abb1f-c0ba-481a-8a24-5738e383842b","Type":"ContainerStarted","Data":"5f075c507da3b27e8ab83fbd97126acad80873257fb314ecc2b917c6eeabc7b3"} Jun 11 17:05:35.485774 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:35.485632 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2rqq" Jun 11 17:05:35.487241 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:35.487210 2565 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-c2rqq container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 11 17:05:35.487377 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:35.487273 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2rqq" podUID="6e2abb1f-c0ba-481a-8a24-5738e383842b" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 17:05:35.538740 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:35.538676 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2rqq" podStartSLOduration=2.110025582 podStartE2EDuration="14.538654573s" totalImagesPullingTime="12.428628991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:05:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:05:35.538479171 +0000 UTC m=+672.798734077" watchObservedRunningTime="2026-06-11 17:05:35.538654573 +0000 UTC m=+672.798909482" Jun 11 17:05:36.490534 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:05:36.490504 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2rqq" Jun 11 17:06:28.262875 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:28.262769 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ksp6r"] Jun 11 17:06:28.267100 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:28.267077 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ksp6r" Jun 11 17:06:28.269523 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:28.269503 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 17:06:28.270280 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:28.270262 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-znm69\"" Jun 11 17:06:28.270368 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:28.270293 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 17:06:28.281024 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:28.280987 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ksp6r"] Jun 11 17:06:28.293777 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:28.293742 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2btm\" (UniqueName: \"kubernetes.io/projected/fd9aee8d-1e4b-4360-a3b5-ad46df759bee-kube-api-access-v2btm\") pod \"authorino-operator-75cc8d5cb7-ksp6r\" (UID: \"fd9aee8d-1e4b-4360-a3b5-ad46df759bee\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ksp6r" Jun 11 17:06:28.395176 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:28.395146 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2btm\" (UniqueName: \"kubernetes.io/projected/fd9aee8d-1e4b-4360-a3b5-ad46df759bee-kube-api-access-v2btm\") pod \"authorino-operator-75cc8d5cb7-ksp6r\" (UID: \"fd9aee8d-1e4b-4360-a3b5-ad46df759bee\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ksp6r" Jun 11 17:06:28.404520 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:28.404497 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2btm\" (UniqueName: \"kubernetes.io/projected/fd9aee8d-1e4b-4360-a3b5-ad46df759bee-kube-api-access-v2btm\") pod \"authorino-operator-75cc8d5cb7-ksp6r\" (UID: \"fd9aee8d-1e4b-4360-a3b5-ad46df759bee\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ksp6r" Jun 11 17:06:28.576601 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:28.576568 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ksp6r" Jun 11 17:06:28.704552 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:28.704530 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ksp6r"] Jun 11 17:06:28.707485 ip-10-0-130-110 kubenswrapper[2565]: W0611 17:06:28.707459 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd9aee8d_1e4b_4360_a3b5_ad46df759bee.slice/crio-09d630f724bd26130194a6b4e5a56bb87d18305a1f02b587401898f2d1180567 WatchSource:0}: Error finding container 09d630f724bd26130194a6b4e5a56bb87d18305a1f02b587401898f2d1180567: Status 404 returned error can't find the container with id 09d630f724bd26130194a6b4e5a56bb87d18305a1f02b587401898f2d1180567 Jun 11 17:06:28.709773 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:28.709757 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 17:06:29.712082 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:29.712030 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ksp6r" event={"ID":"fd9aee8d-1e4b-4360-a3b5-ad46df759bee","Type":"ContainerStarted","Data":"09d630f724bd26130194a6b4e5a56bb87d18305a1f02b587401898f2d1180567"} Jun 11 17:06:31.723921 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:31.723805 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ksp6r" event={"ID":"fd9aee8d-1e4b-4360-a3b5-ad46df759bee","Type":"ContainerStarted","Data":"17e1c7dc40f0569dd6f1f6304d1c2ff738ae2976a67f0c24244fd422e8dd85a1"} Jun 11 17:06:31.724261 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:31.723949 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ksp6r" Jun 11 17:06:31.748985 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:31.748937 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ksp6r" podStartSLOduration=1.023239842 podStartE2EDuration="3.748921376s" totalImagesPullingTime="2.725681534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:06:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:06:31.748043688 +0000 UTC m=+729.008298595" watchObservedRunningTime="2026-06-11 17:06:31.748921376 +0000 UTC m=+729.009176281" Jun 11 17:06:42.730600 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:42.730570 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ksp6r" Jun 11 17:06:44.908094 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:44.908063 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g55cv"] Jun 11 17:06:44.911034 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:44.911013 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g55cv" Jun 11 17:06:44.913571 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:44.913552 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7z75q\"" Jun 11 17:06:44.925392 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:44.925365 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g55cv"] Jun 11 17:06:45.037526 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:45.037491 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5k8n\" (UniqueName: \"kubernetes.io/projected/3b35ec1c-2caa-4184-88b3-e0590ee72ca5-kube-api-access-c5k8n\") pod \"kuadrant-operator-controller-manager-55467d9f7-g55cv\" (UID: \"3b35ec1c-2caa-4184-88b3-e0590ee72ca5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g55cv" Jun 11 17:06:45.037526 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:45.037529 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b35ec1c-2caa-4184-88b3-e0590ee72ca5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-g55cv\" (UID: \"3b35ec1c-2caa-4184-88b3-e0590ee72ca5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g55cv" Jun 11 17:06:45.037975 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:45.037956 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g55cv"] Jun 11 17:06:45.038167 ip-10-0-130-110 kubenswrapper[2565]: E0611 17:06:45.038149 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-c5k8n], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g55cv" podUID="3b35ec1c-2caa-4184-88b3-e0590ee72ca5" Jun 11 17:06:45.138064 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:45.138034 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5k8n\" (UniqueName: \"kubernetes.io/projected/3b35ec1c-2caa-4184-88b3-e0590ee72ca5-kube-api-access-c5k8n\") pod \"kuadrant-operator-controller-manager-55467d9f7-g55cv\" (UID: \"3b35ec1c-2caa-4184-88b3-e0590ee72ca5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g55cv" Jun 11 17:06:45.138064 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:45.138069 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b35ec1c-2caa-4184-88b3-e0590ee72ca5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-g55cv\" (UID: \"3b35ec1c-2caa-4184-88b3-e0590ee72ca5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g55cv" Jun 11 17:06:45.138420 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:45.138400 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b35ec1c-2caa-4184-88b3-e0590ee72ca5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-g55cv\" (UID: \"3b35ec1c-2caa-4184-88b3-e0590ee72ca5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g55cv" Jun 11 17:06:45.142309 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:45.142284 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g55cv"] Jun 11 17:06:45.146705 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:45.146680 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g55cv"] Jun 11 17:06:45.153268 ip-10-0-130-110 kubenswrapper[2565]: E0611 17:06:45.153248 2565 projected.go:196] Error preparing data for projected volume kube-api-access-c5k8n for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g55cv: failed to fetch token: pods "kuadrant-operator-controller-manager-55467d9f7-g55cv" not found Jun 11 17:06:45.153380 ip-10-0-130-110 kubenswrapper[2565]: E0611 17:06:45.153312 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b35ec1c-2caa-4184-88b3-e0590ee72ca5-kube-api-access-c5k8n podName:3b35ec1c-2caa-4184-88b3-e0590ee72ca5 nodeName:}" failed. No retries permitted until 2026-06-11 17:06:45.653296253 +0000 UTC m=+742.913551138 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-c5k8n" (UniqueName: "kubernetes.io/projected/3b35ec1c-2caa-4184-88b3-e0590ee72ca5-kube-api-access-c5k8n") pod "kuadrant-operator-controller-manager-55467d9f7-g55cv" (UID: "3b35ec1c-2caa-4184-88b3-e0590ee72ca5") : failed to fetch token: pods "kuadrant-operator-controller-manager-55467d9f7-g55cv" not found Jun 11 17:06:45.226097 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:45.226013 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fjxb9"] Jun 11 17:06:45.229082 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:45.229062 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fjxb9" Jun 11 17:06:45.259472 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:45.259441 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fjxb9"] Jun 11 17:06:45.339380 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:45.339346 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/13bd1048-d89a-49d3-95ec-df5b949f7fb9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fjxb9\" (UID: \"13bd1048-d89a-49d3-95ec-df5b949f7fb9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fjxb9" Jun 11 17:06:45.339548 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:45.339445 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm77g\" (UniqueName: \"kubernetes.io/projected/13bd1048-d89a-49d3-95ec-df5b949f7fb9-kube-api-access-nm77g\") pod \"kuadrant-operator-controller-manager-86878c769f-fjxb9\" (UID: \"13bd1048-d89a-49d3-95ec-df5b949f7fb9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fjxb9" Jun 11 17:06:45.440654 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:45.440619 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm77g\" (UniqueName: \"kubernetes.io/projected/13bd1048-d89a-49d3-95ec-df5b949f7fb9-kube-api-access-nm77g\") pod \"kuadrant-operator-controller-manager-86878c769f-fjxb9\" (UID: \"13bd1048-d89a-49d3-95ec-df5b949f7fb9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fjxb9" Jun 11 17:06:45.440782 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:45.440667 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/13bd1048-d89a-49d3-95ec-df5b949f7fb9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fjxb9\" (UID: \"13bd1048-d89a-49d3-95ec-df5b949f7fb9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fjxb9" Jun 11 17:06:45.441058 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:45.441041 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/13bd1048-d89a-49d3-95ec-df5b949f7fb9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fjxb9\" (UID: \"13bd1048-d89a-49d3-95ec-df5b949f7fb9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fjxb9" Jun 11 17:06:45.454201 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:45.454180 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm77g\" (UniqueName: \"kubernetes.io/projected/13bd1048-d89a-49d3-95ec-df5b949f7fb9-kube-api-access-nm77g\") pod \"kuadrant-operator-controller-manager-86878c769f-fjxb9\" (UID: \"13bd1048-d89a-49d3-95ec-df5b949f7fb9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fjxb9" Jun 11 17:06:45.539940 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:45.539814 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fjxb9" Jun 11 17:06:45.701441 ip-10-0-130-110 kubenswrapper[2565]: W0611 17:06:45.701414 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13bd1048_d89a_49d3_95ec_df5b949f7fb9.slice/crio-76823357956a4342fce117a0d5a666c9fdea65a43ec32607ac027f54acc7062e WatchSource:0}: Error finding container 76823357956a4342fce117a0d5a666c9fdea65a43ec32607ac027f54acc7062e: Status 404 returned error can't find the container with id 76823357956a4342fce117a0d5a666c9fdea65a43ec32607ac027f54acc7062e Jun 11 17:06:45.706753 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:45.706727 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fjxb9"] Jun 11 17:06:45.744132 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:45.744093 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5k8n\" (UniqueName: \"kubernetes.io/projected/3b35ec1c-2caa-4184-88b3-e0590ee72ca5-kube-api-access-c5k8n\") pod \"kuadrant-operator-controller-manager-55467d9f7-g55cv\" (UID: \"3b35ec1c-2caa-4184-88b3-e0590ee72ca5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g55cv" Jun 11 17:06:45.748445 ip-10-0-130-110 kubenswrapper[2565]: E0611 17:06:45.748423 2565 projected.go:196] Error preparing data for projected volume kube-api-access-c5k8n for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g55cv: failed to fetch token: pod "kuadrant-operator-controller-manager-55467d9f7-g55cv" not found Jun 11 17:06:45.748561 ip-10-0-130-110 kubenswrapper[2565]: E0611 17:06:45.748485 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b35ec1c-2caa-4184-88b3-e0590ee72ca5-kube-api-access-c5k8n podName:3b35ec1c-2caa-4184-88b3-e0590ee72ca5 nodeName:}" failed. No retries permitted until 2026-06-11 17:06:46.748467718 +0000 UTC m=+744.008722609 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-c5k8n" (UniqueName: "kubernetes.io/projected/3b35ec1c-2caa-4184-88b3-e0590ee72ca5-kube-api-access-c5k8n") pod "kuadrant-operator-controller-manager-55467d9f7-g55cv" (UID: "3b35ec1c-2caa-4184-88b3-e0590ee72ca5") : failed to fetch token: pod "kuadrant-operator-controller-manager-55467d9f7-g55cv" not found Jun 11 17:06:45.784052 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:45.784023 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g55cv" Jun 11 17:06:45.784052 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:45.784040 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fjxb9" event={"ID":"13bd1048-d89a-49d3-95ec-df5b949f7fb9","Type":"ContainerStarted","Data":"76823357956a4342fce117a0d5a666c9fdea65a43ec32607ac027f54acc7062e"} Jun 11 17:06:45.791456 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:45.791392 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g55cv" Jun 11 17:06:45.794064 ip-10-0-130-110 kubenswrapper[2565]: E0611 17:06:45.794037 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-g55cv\" is forbidden: User \"system:node:ip-10-0-130-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-110.ec2.internal' and this object" podUID="3b35ec1c-2caa-4184-88b3-e0590ee72ca5" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g55cv" Jun 11 17:06:45.945921 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:45.945885 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b35ec1c-2caa-4184-88b3-e0590ee72ca5-extensions-socket-volume\") pod \"3b35ec1c-2caa-4184-88b3-e0590ee72ca5\" (UID: \"3b35ec1c-2caa-4184-88b3-e0590ee72ca5\") " Jun 11 17:06:45.946282 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:45.946091 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5k8n\" (UniqueName: \"kubernetes.io/projected/3b35ec1c-2caa-4184-88b3-e0590ee72ca5-kube-api-access-c5k8n\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\"" Jun 11 17:06:45.946282 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:45.946150 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b35ec1c-2caa-4184-88b3-e0590ee72ca5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3b35ec1c-2caa-4184-88b3-e0590ee72ca5" (UID: "3b35ec1c-2caa-4184-88b3-e0590ee72ca5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:06:46.047312 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:46.047232 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b35ec1c-2caa-4184-88b3-e0590ee72ca5-extensions-socket-volume\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\"" Jun 11 17:06:46.789699 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:46.789665 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g55cv" Jun 11 17:06:46.792226 ip-10-0-130-110 kubenswrapper[2565]: E0611 17:06:46.792188 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-g55cv\" is forbidden: User \"system:node:ip-10-0-130-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-110.ec2.internal' and this object" podUID="3b35ec1c-2caa-4184-88b3-e0590ee72ca5" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g55cv" Jun 11 17:06:46.799558 ip-10-0-130-110 kubenswrapper[2565]: E0611 17:06:46.799525 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-g55cv\" is forbidden: User \"system:node:ip-10-0-130-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-110.ec2.internal' and this object" podUID="3b35ec1c-2caa-4184-88b3-e0590ee72ca5" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g55cv" Jun 11 17:06:47.191395 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:47.191351 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b35ec1c-2caa-4184-88b3-e0590ee72ca5" path="/var/lib/kubelet/pods/3b35ec1c-2caa-4184-88b3-e0590ee72ca5/volumes" Jun 11 17:06:50.808232 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:50.808198 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fjxb9" event={"ID":"13bd1048-d89a-49d3-95ec-df5b949f7fb9","Type":"ContainerStarted","Data":"8a06a99a775407bae02be7d2325e2049541768dc50443fef2ca9e1cdcdc2b180"} Jun 11 17:06:50.808601 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:50.808294 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fjxb9" Jun 11 17:06:50.861847 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:06:50.861760 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fjxb9" podStartSLOduration=0.922680037 podStartE2EDuration="5.861742071s" totalImagesPullingTime="4.939062034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:06:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:06:50.860885061 +0000 UTC m=+748.121139969" watchObservedRunningTime="2026-06-11 17:06:50.861742071 +0000 UTC m=+748.121996976" Jun 11 17:07:01.814773 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:07:01.814741 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fjxb9" Jun 11 17:08:21.085912 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:08:21.085872 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 17:08:21.088948 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:08:21.088931 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 17:08:21.091180 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:08:21.091154 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 17:08:21.091336 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:08:21.091297 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-gxncb\"" Jun 11 17:08:21.091382 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:08:21.091339 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 17:08:21.091942 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:08:21.091925 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 17:08:21.098014 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:08:21.097991 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 17:08:21.159626 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:08:21.159597 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jw2q\" (UniqueName: \"kubernetes.io/projected/a0fbe9d1-c235-4b76-9262-0350e4ec389e-kube-api-access-5jw2q\") pod \"maas-keycloak-0\" (UID: \"a0fbe9d1-c235-4b76-9262-0350e4ec389e\") " pod="keycloak-system/maas-keycloak-0" Jun 11 17:08:21.259954 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:08:21.259923 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jw2q\" (UniqueName: \"kubernetes.io/projected/a0fbe9d1-c235-4b76-9262-0350e4ec389e-kube-api-access-5jw2q\") pod \"maas-keycloak-0\" (UID: \"a0fbe9d1-c235-4b76-9262-0350e4ec389e\") " pod="keycloak-system/maas-keycloak-0" Jun 11 17:08:21.269304 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:08:21.269275 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jw2q\" (UniqueName: \"kubernetes.io/projected/a0fbe9d1-c235-4b76-9262-0350e4ec389e-kube-api-access-5jw2q\") pod \"maas-keycloak-0\" (UID: \"a0fbe9d1-c235-4b76-9262-0350e4ec389e\") " pod="keycloak-system/maas-keycloak-0" Jun 11 17:08:21.399241 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:08:21.399157 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 17:08:21.529967 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:08:21.529943 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 17:08:21.532029 ip-10-0-130-110 kubenswrapper[2565]: W0611 17:08:21.532003 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0fbe9d1_c235_4b76_9262_0350e4ec389e.slice/crio-eabc2d465f0366c69ab95d0d17ea477efa4ae6e34e2c2e5feda8d14cdef6eedb WatchSource:0}: Error finding container eabc2d465f0366c69ab95d0d17ea477efa4ae6e34e2c2e5feda8d14cdef6eedb: Status 404 returned error can't find the container with id eabc2d465f0366c69ab95d0d17ea477efa4ae6e34e2c2e5feda8d14cdef6eedb Jun 11 17:08:22.208687 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:08:22.208609 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a0fbe9d1-c235-4b76-9262-0350e4ec389e","Type":"ContainerStarted","Data":"eabc2d465f0366c69ab95d0d17ea477efa4ae6e34e2c2e5feda8d14cdef6eedb"} Jun 11 17:08:29.795849 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:08:29.795805 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 17:08:30.249573 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:08:30.249531 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a0fbe9d1-c235-4b76-9262-0350e4ec389e","Type":"ContainerStarted","Data":"0762065120b1953c8c9997a3eb868dc1f0a94121d293446f7de172976859dd86"} Jun 11 17:08:30.270619 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:08:30.270569 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.01057779 podStartE2EDuration="9.270553522s" totalImagesPullingTime="8.259975732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:08:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:08:30.269031058 +0000 UTC m=+847.529285965" watchObservedRunningTime="2026-06-11 17:08:30.270553522 +0000 UTC m=+847.530808432" Jun 11 17:08:30.399972 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:08:30.399937 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 17:08:30.401929 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:08:30.401889 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a0fbe9d1-c235-4b76-9262-0350e4ec389e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused" Jun 11 17:08:31.399624 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:08:31.399560 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 17:08:31.400194 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:08:31.399960 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a0fbe9d1-c235-4b76-9262-0350e4ec389e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused" Jun 11 17:08:32.399986 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:08:32.399939 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a0fbe9d1-c235-4b76-9262-0350e4ec389e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused" Jun 11 17:08:33.400023 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:08:33.399971 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a0fbe9d1-c235-4b76-9262-0350e4ec389e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused" Jun 11 17:08:34.399914 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:08:34.399865 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a0fbe9d1-c235-4b76-9262-0350e4ec389e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused" Jun 11 17:08:35.400021 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:08:35.399986 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a0fbe9d1-c235-4b76-9262-0350e4ec389e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused" Jun 11 17:08:36.400203 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:08:36.400137 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a0fbe9d1-c235-4b76-9262-0350e4ec389e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused" Jun 11 17:08:37.400226 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:08:37.400179 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a0fbe9d1-c235-4b76-9262-0350e4ec389e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused" Jun 11 17:08:38.399981 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:08:38.399927 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a0fbe9d1-c235-4b76-9262-0350e4ec389e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused" Jun 11 17:08:39.399621 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:08:39.399567 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a0fbe9d1-c235-4b76-9262-0350e4ec389e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused" Jun 11 17:08:40.400351 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:08:40.400303 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a0fbe9d1-c235-4b76-9262-0350e4ec389e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused" Jun 11 17:08:41.400639 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:08:41.400589 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a0fbe9d1-c235-4b76-9262-0350e4ec389e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused" Jun 11 17:08:42.400458 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:08:42.400418 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a0fbe9d1-c235-4b76-9262-0350e4ec389e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused" Jun 11 17:08:43.505893 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:08:43.505842 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 17:08:43.520269 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:08:43.520223 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="a0fbe9d1-c235-4b76-9262-0350e4ec389e" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 17:08:53.512234 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:08:53.512198 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 17:09:23.178925 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:23.178889 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7hbj_a30425b4-3b27-4ae1-af09-384473269d18/ovn-acl-logging/0.log" Jun 11 17:09:23.180994 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:23.180971 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7hbj_a30425b4-3b27-4ae1-af09-384473269d18/ovn-acl-logging/0.log" Jun 11 17:09:34.395873 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:34.395839 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-chtlw"] Jun 11 17:09:34.398101 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:34.398086 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-chtlw" Jun 11 17:09:34.407349 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:34.407332 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 11 17:09:34.449609 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:34.449578 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-chtlw"] Jun 11 17:09:34.477619 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:34.477590 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-ld2zc"] Jun 11 17:09:34.479728 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:34.479711 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-ld2zc" Jun 11 17:09:34.483281 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:34.483253 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-g52g9\"" Jun 11 17:09:34.484414 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:34.484386 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzxhh\" (UniqueName: \"kubernetes.io/projected/65223fd9-e6a0-4f3a-8949-7651ff04a9f5-kube-api-access-lzxhh\") pod \"payload-pre-processing-579785bc64-ld2zc\" (UID: \"65223fd9-e6a0-4f3a-8949-7651ff04a9f5\") " pod="openshift-ingress/payload-pre-processing-579785bc64-ld2zc" Jun 11 17:09:34.484610 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:34.484592 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwnhn\" (UniqueName: \"kubernetes.io/projected/e381ba95-f38a-414f-8c00-f7c74d1ff26a-kube-api-access-dwnhn\") pod \"payload-processing-699b6cd6c-chtlw\" (UID: \"e381ba95-f38a-414f-8c00-f7c74d1ff26a\") " pod="openshift-ingress/payload-processing-699b6cd6c-chtlw" Jun 11 17:09:34.510412 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:34.510384 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-ld2zc"] Jun 11 17:09:34.585231 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:34.585179 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzxhh\" (UniqueName: \"kubernetes.io/projected/65223fd9-e6a0-4f3a-8949-7651ff04a9f5-kube-api-access-lzxhh\") pod \"payload-pre-processing-579785bc64-ld2zc\" (UID: \"65223fd9-e6a0-4f3a-8949-7651ff04a9f5\") " pod="openshift-ingress/payload-pre-processing-579785bc64-ld2zc" Jun 11 17:09:34.585526 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:34.585489 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwnhn\" (UniqueName: \"kubernetes.io/projected/e381ba95-f38a-414f-8c00-f7c74d1ff26a-kube-api-access-dwnhn\") pod \"payload-processing-699b6cd6c-chtlw\" (UID: \"e381ba95-f38a-414f-8c00-f7c74d1ff26a\") " pod="openshift-ingress/payload-processing-699b6cd6c-chtlw" Jun 11 17:09:34.603753 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:34.603728 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwnhn\" (UniqueName: \"kubernetes.io/projected/e381ba95-f38a-414f-8c00-f7c74d1ff26a-kube-api-access-dwnhn\") pod \"payload-processing-699b6cd6c-chtlw\" (UID: \"e381ba95-f38a-414f-8c00-f7c74d1ff26a\") " pod="openshift-ingress/payload-processing-699b6cd6c-chtlw" Jun 11 17:09:34.615781 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:34.615756 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzxhh\" (UniqueName: \"kubernetes.io/projected/65223fd9-e6a0-4f3a-8949-7651ff04a9f5-kube-api-access-lzxhh\") pod \"payload-pre-processing-579785bc64-ld2zc\" (UID: \"65223fd9-e6a0-4f3a-8949-7651ff04a9f5\") " pod="openshift-ingress/payload-pre-processing-579785bc64-ld2zc" Jun 11 17:09:34.708278 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:34.708201 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-chtlw" Jun 11 17:09:34.791268 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:34.791238 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-ld2zc" Jun 11 17:09:34.880926 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:34.880849 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-chtlw"] Jun 11 17:09:34.885332 ip-10-0-130-110 kubenswrapper[2565]: W0611 17:09:34.885301 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode381ba95_f38a_414f_8c00_f7c74d1ff26a.slice/crio-2d94e2e50bf388eadd60e441f1fa2e049a1968eb5764a420c8d4a1eabac4d94e WatchSource:0}: Error finding container 2d94e2e50bf388eadd60e441f1fa2e049a1968eb5764a420c8d4a1eabac4d94e: Status 404 returned error can't find the container with id 2d94e2e50bf388eadd60e441f1fa2e049a1968eb5764a420c8d4a1eabac4d94e Jun 11 17:09:34.971496 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:34.971419 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-ld2zc"] Jun 11 17:09:34.975205 ip-10-0-130-110 kubenswrapper[2565]: W0611 17:09:34.975179 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65223fd9_e6a0_4f3a_8949_7651ff04a9f5.slice/crio-1c32f23f15f3ed49d7a8665746252dbd707b1fca80bc657509b9b407615b8319 WatchSource:0}: Error finding container 1c32f23f15f3ed49d7a8665746252dbd707b1fca80bc657509b9b407615b8319: Status 404 returned error can't find the container with id 1c32f23f15f3ed49d7a8665746252dbd707b1fca80bc657509b9b407615b8319 Jun 11 17:09:35.564198 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:35.564160 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-chtlw" event={"ID":"e381ba95-f38a-414f-8c00-f7c74d1ff26a","Type":"ContainerStarted","Data":"2d94e2e50bf388eadd60e441f1fa2e049a1968eb5764a420c8d4a1eabac4d94e"} Jun 11 17:09:35.565668 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:35.565642 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-ld2zc" event={"ID":"65223fd9-e6a0-4f3a-8949-7651ff04a9f5","Type":"ContainerStarted","Data":"1c32f23f15f3ed49d7a8665746252dbd707b1fca80bc657509b9b407615b8319"} Jun 11 17:09:37.579097 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:37.579054 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-ld2zc" event={"ID":"65223fd9-e6a0-4f3a-8949-7651ff04a9f5","Type":"ContainerStarted","Data":"257d79faa4ada2e65dd33733639b2f17b3f4b7c1bf8bc4e801ee09df059f6762"} Jun 11 17:09:37.579502 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:37.579224 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-ld2zc" Jun 11 17:09:37.599292 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:37.599243 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-ld2zc" podStartSLOduration=1.350983776 podStartE2EDuration="3.599224114s" totalImagesPullingTime="2.248240338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:09:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:09:37.597140298 +0000 UTC m=+914.857395204" watchObservedRunningTime="2026-06-11 17:09:37.599224114 +0000 UTC m=+914.859478998" Jun 11 17:09:38.584859 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:38.584811 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-chtlw" event={"ID":"e381ba95-f38a-414f-8c00-f7c74d1ff26a","Type":"ContainerStarted","Data":"b1c6da68b35b642f19a7556c8becffc003ac4eb4f0965a1d4ca7eec094e0e7f7"} Jun 11 17:09:38.585241 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:38.585048 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-chtlw" Jun 11 17:09:38.603482 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:38.603434 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-chtlw" podStartSLOduration=1.737386329 podStartE2EDuration="4.603419652s" totalImagesPullingTime="2.866033323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:09:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:09:38.601886768 +0000 UTC m=+915.862141673" watchObservedRunningTime="2026-06-11 17:09:38.603419652 +0000 UTC m=+915.863674557" Jun 11 17:09:45.701668 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:45.701638 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 17:09:45.702067 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:45.701857 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="a0fbe9d1-c235-4b76-9262-0350e4ec389e" containerName="keycloak" containerID="cri-o://0762065120b1953c8c9997a3eb868dc1f0a94121d293446f7de172976859dd86" gracePeriod=30 Jun 11 17:09:47.627807 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:47.627775 2565 generic.go:356] "Generic (PLEG): container finished" podID="a0fbe9d1-c235-4b76-9262-0350e4ec389e" containerID="0762065120b1953c8c9997a3eb868dc1f0a94121d293446f7de172976859dd86" exitCode=143 Jun 11 17:09:47.628150 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:47.627864 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a0fbe9d1-c235-4b76-9262-0350e4ec389e","Type":"ContainerDied","Data":"0762065120b1953c8c9997a3eb868dc1f0a94121d293446f7de172976859dd86"} Jun 11 17:09:47.746912 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:47.746890 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 17:09:47.790632 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:47.790607 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jw2q\" (UniqueName: \"kubernetes.io/projected/a0fbe9d1-c235-4b76-9262-0350e4ec389e-kube-api-access-5jw2q\") pod \"a0fbe9d1-c235-4b76-9262-0350e4ec389e\" (UID: \"a0fbe9d1-c235-4b76-9262-0350e4ec389e\") " Jun 11 17:09:47.792928 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:47.792895 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0fbe9d1-c235-4b76-9262-0350e4ec389e-kube-api-access-5jw2q" (OuterVolumeSpecName: "kube-api-access-5jw2q") pod "a0fbe9d1-c235-4b76-9262-0350e4ec389e" (UID: "a0fbe9d1-c235-4b76-9262-0350e4ec389e"). InnerVolumeSpecName "kube-api-access-5jw2q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:09:47.891517 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:47.891445 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jw2q\" (UniqueName: \"kubernetes.io/projected/a0fbe9d1-c235-4b76-9262-0350e4ec389e-kube-api-access-5jw2q\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\"" Jun 11 17:09:48.587309 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:48.587275 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-ld2zc" Jun 11 17:09:48.633766 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:48.633736 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a0fbe9d1-c235-4b76-9262-0350e4ec389e","Type":"ContainerDied","Data":"eabc2d465f0366c69ab95d0d17ea477efa4ae6e34e2c2e5feda8d14cdef6eedb"} Jun 11 17:09:48.633766 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:48.633760 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 17:09:48.634222 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:48.633790 2565 scope.go:117] "RemoveContainer" containerID="0762065120b1953c8c9997a3eb868dc1f0a94121d293446f7de172976859dd86" Jun 11 17:09:48.656313 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:48.656289 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 17:09:48.661117 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:48.661096 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 17:09:48.685426 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:48.685401 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 17:09:48.685732 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:48.685720 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0fbe9d1-c235-4b76-9262-0350e4ec389e" containerName="keycloak" Jun 11 17:09:48.685773 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:48.685735 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0fbe9d1-c235-4b76-9262-0350e4ec389e" containerName="keycloak" Jun 11 17:09:48.685841 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:48.685811 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0fbe9d1-c235-4b76-9262-0350e4ec389e" containerName="keycloak" Jun 11 17:09:48.690003 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:48.689989 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 17:09:48.692442 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:48.692419 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 17:09:48.692442 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:48.692433 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 11 17:09:48.692581 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:48.692439 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 17:09:48.692730 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:48.692713 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 17:09:48.692855 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:48.692838 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-gxncb\"" Jun 11 17:09:48.699137 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:48.699120 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 17:09:48.797488 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:48.797451 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/62015733-eb99-4a3b-a1c2-77d9ed8e9e86-test-realms\") pod \"maas-keycloak-0\" (UID: \"62015733-eb99-4a3b-a1c2-77d9ed8e9e86\") " pod="keycloak-system/maas-keycloak-0" Jun 11 17:09:48.797663 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:48.797529 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm7ng\" (UniqueName: \"kubernetes.io/projected/62015733-eb99-4a3b-a1c2-77d9ed8e9e86-kube-api-access-vm7ng\") pod \"maas-keycloak-0\" (UID: \"62015733-eb99-4a3b-a1c2-77d9ed8e9e86\") " pod="keycloak-system/maas-keycloak-0" Jun 11 17:09:48.898784 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:48.898687 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm7ng\" (UniqueName: \"kubernetes.io/projected/62015733-eb99-4a3b-a1c2-77d9ed8e9e86-kube-api-access-vm7ng\") pod \"maas-keycloak-0\" (UID: \"62015733-eb99-4a3b-a1c2-77d9ed8e9e86\") " pod="keycloak-system/maas-keycloak-0" Jun 11 17:09:48.898784 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:48.898754 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/62015733-eb99-4a3b-a1c2-77d9ed8e9e86-test-realms\") pod \"maas-keycloak-0\" (UID: \"62015733-eb99-4a3b-a1c2-77d9ed8e9e86\") " pod="keycloak-system/maas-keycloak-0" Jun 11 17:09:48.899450 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:48.899429 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/62015733-eb99-4a3b-a1c2-77d9ed8e9e86-test-realms\") pod \"maas-keycloak-0\" (UID: \"62015733-eb99-4a3b-a1c2-77d9ed8e9e86\") " pod="keycloak-system/maas-keycloak-0" Jun 11 17:09:48.912897 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:48.912872 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm7ng\" (UniqueName: \"kubernetes.io/projected/62015733-eb99-4a3b-a1c2-77d9ed8e9e86-kube-api-access-vm7ng\") pod \"maas-keycloak-0\" (UID: \"62015733-eb99-4a3b-a1c2-77d9ed8e9e86\") " pod="keycloak-system/maas-keycloak-0" Jun 11 17:09:49.000452 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:49.000418 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 17:09:49.133563 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:49.133529 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 17:09:49.134033 ip-10-0-130-110 kubenswrapper[2565]: W0611 17:09:49.134009 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62015733_eb99_4a3b_a1c2_77d9ed8e9e86.slice/crio-954f9f2d6069200b7d53060591341a5c3f6e3d1e2dddcc1a4402acfb1696b077 WatchSource:0}: Error finding container 954f9f2d6069200b7d53060591341a5c3f6e3d1e2dddcc1a4402acfb1696b077: Status 404 returned error can't find the container with id 954f9f2d6069200b7d53060591341a5c3f6e3d1e2dddcc1a4402acfb1696b077 Jun 11 17:09:49.193024 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:49.191351 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0fbe9d1-c235-4b76-9262-0350e4ec389e" path="/var/lib/kubelet/pods/a0fbe9d1-c235-4b76-9262-0350e4ec389e/volumes" Jun 11 17:09:49.591740 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:49.591718 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-chtlw" Jun 11 17:09:49.641056 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:49.641022 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"62015733-eb99-4a3b-a1c2-77d9ed8e9e86","Type":"ContainerStarted","Data":"a7281620ad618702cff0ea869d53e4f8ea91939ce74b689324d3684a95148771"} Jun 11 17:09:49.641738 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:49.641086 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"62015733-eb99-4a3b-a1c2-77d9ed8e9e86","Type":"ContainerStarted","Data":"954f9f2d6069200b7d53060591341a5c3f6e3d1e2dddcc1a4402acfb1696b077"} Jun 11 17:09:50.668696 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:50.668636 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.227097257 podStartE2EDuration="2.668616744s" totalImagesPullingTime="441.519487ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:09:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:09:50.667388921 +0000 UTC m=+927.927643828" watchObservedRunningTime="2026-06-11 17:09:50.668616744 +0000 UTC m=+927.928871650" Jun 11 17:09:51.000946 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:51.000847 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 17:09:51.002857 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:51.002798 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="62015733-eb99-4a3b-a1c2-77d9ed8e9e86" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 11 17:09:52.001262 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:52.001210 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="62015733-eb99-4a3b-a1c2-77d9ed8e9e86" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 11 17:09:53.001842 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:53.001771 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="62015733-eb99-4a3b-a1c2-77d9ed8e9e86" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 11 17:09:54.001134 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:54.001083 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="62015733-eb99-4a3b-a1c2-77d9ed8e9e86" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 11 17:09:55.001879 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:55.001836 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="62015733-eb99-4a3b-a1c2-77d9ed8e9e86" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 11 17:09:56.001196 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:56.001134 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="62015733-eb99-4a3b-a1c2-77d9ed8e9e86" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 11 17:09:57.001590 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:57.001536 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="62015733-eb99-4a3b-a1c2-77d9ed8e9e86" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 11 17:09:58.001299 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:58.001254 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="62015733-eb99-4a3b-a1c2-77d9ed8e9e86" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 11 17:09:59.000951 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:59.000913 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 17:09:59.001476 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:09:59.001166 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="62015733-eb99-4a3b-a1c2-77d9ed8e9e86" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 11 17:10:00.001307 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:00.001260 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="62015733-eb99-4a3b-a1c2-77d9ed8e9e86" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 11 17:10:01.001769 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:01.001719 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="62015733-eb99-4a3b-a1c2-77d9ed8e9e86" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 11 17:10:02.001109 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:02.001054 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="62015733-eb99-4a3b-a1c2-77d9ed8e9e86" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 11 17:10:03.128874 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:03.128807 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 17:10:03.146993 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:03.146927 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="62015733-eb99-4a3b-a1c2-77d9ed8e9e86" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 17:10:13.136381 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:13.136334 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 17:10:43.827123 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:43.827085 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt"] Jun 11 17:10:43.832165 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:43.832120 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt" Jun 11 17:10:43.834877 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:43.834852 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 17:10:43.835027 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:43.834852 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 11 17:10:43.835985 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:43.835964 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9k2vn\"" Jun 11 17:10:43.836085 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:43.835989 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 17:10:43.846415 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:43.846392 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt"] Jun 11 17:10:43.878927 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:43.878893 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0bcdea16-28ac-4b3b-a736-41ffd5b32021-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt\" (UID: \"0bcdea16-28ac-4b3b-a736-41ffd5b32021\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt" Jun 11 17:10:43.879096 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:43.878941 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0bcdea16-28ac-4b3b-a736-41ffd5b32021-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt\" (UID: \"0bcdea16-28ac-4b3b-a736-41ffd5b32021\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt" Jun 11 17:10:43.879096 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:43.879030 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7m24\" (UniqueName: \"kubernetes.io/projected/0bcdea16-28ac-4b3b-a736-41ffd5b32021-kube-api-access-g7m24\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt\" (UID: \"0bcdea16-28ac-4b3b-a736-41ffd5b32021\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt" Jun 11 17:10:43.879096 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:43.879065 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0bcdea16-28ac-4b3b-a736-41ffd5b32021-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt\" (UID: \"0bcdea16-28ac-4b3b-a736-41ffd5b32021\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt" Jun 11 17:10:43.879096 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:43.879083 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0bcdea16-28ac-4b3b-a736-41ffd5b32021-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt\" (UID: \"0bcdea16-28ac-4b3b-a736-41ffd5b32021\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt" Jun 11 17:10:43.879236 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:43.879122 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0bcdea16-28ac-4b3b-a736-41ffd5b32021-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt\" (UID: \"0bcdea16-28ac-4b3b-a736-41ffd5b32021\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt" Jun 11 17:10:43.979560 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:43.979518 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0bcdea16-28ac-4b3b-a736-41ffd5b32021-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt\" (UID: \"0bcdea16-28ac-4b3b-a736-41ffd5b32021\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt" Jun 11 17:10:43.979750 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:43.979572 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0bcdea16-28ac-4b3b-a736-41ffd5b32021-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt\" (UID: \"0bcdea16-28ac-4b3b-a736-41ffd5b32021\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt" Jun 11 17:10:43.979750 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:43.979606 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0bcdea16-28ac-4b3b-a736-41ffd5b32021-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt\" (UID: \"0bcdea16-28ac-4b3b-a736-41ffd5b32021\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt" Jun 11 17:10:43.979750 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:43.979646 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7m24\" (UniqueName: \"kubernetes.io/projected/0bcdea16-28ac-4b3b-a736-41ffd5b32021-kube-api-access-g7m24\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt\" (UID: \"0bcdea16-28ac-4b3b-a736-41ffd5b32021\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt" Jun 11 17:10:43.979750 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:43.979686 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0bcdea16-28ac-4b3b-a736-41ffd5b32021-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt\" (UID: \"0bcdea16-28ac-4b3b-a736-41ffd5b32021\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt" Jun 11 17:10:43.979750 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:43.979710 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0bcdea16-28ac-4b3b-a736-41ffd5b32021-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt\" (UID: \"0bcdea16-28ac-4b3b-a736-41ffd5b32021\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt" Jun 11 17:10:43.980071 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:43.980048 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0bcdea16-28ac-4b3b-a736-41ffd5b32021-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt\" (UID: \"0bcdea16-28ac-4b3b-a736-41ffd5b32021\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt" Jun 11 17:10:43.980131 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:43.980093 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0bcdea16-28ac-4b3b-a736-41ffd5b32021-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt\" (UID: \"0bcdea16-28ac-4b3b-a736-41ffd5b32021\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt" Jun 11 17:10:43.980131 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:43.980121 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0bcdea16-28ac-4b3b-a736-41ffd5b32021-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt\" (UID: \"0bcdea16-28ac-4b3b-a736-41ffd5b32021\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt" Jun 11 17:10:43.981977 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:43.981954 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0bcdea16-28ac-4b3b-a736-41ffd5b32021-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt\" (UID: \"0bcdea16-28ac-4b3b-a736-41ffd5b32021\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt" Jun 11 17:10:43.982339 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:43.982317 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0bcdea16-28ac-4b3b-a736-41ffd5b32021-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt\" (UID: \"0bcdea16-28ac-4b3b-a736-41ffd5b32021\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt" Jun 11 17:10:43.991032 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:43.991012 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7m24\" (UniqueName: \"kubernetes.io/projected/0bcdea16-28ac-4b3b-a736-41ffd5b32021-kube-api-access-g7m24\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt\" (UID: \"0bcdea16-28ac-4b3b-a736-41ffd5b32021\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt" Jun 11 17:10:44.144117 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:44.144019 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt" Jun 11 17:10:44.279002 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:44.278964 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt"] Jun 11 17:10:44.282500 ip-10-0-130-110 kubenswrapper[2565]: W0611 17:10:44.282465 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bcdea16_28ac_4b3b_a736_41ffd5b32021.slice/crio-e9aae8b9f0ee41d3a3514fae02248e0e944020815b10df3b79d4560a4b8f2c72 WatchSource:0}: Error finding container e9aae8b9f0ee41d3a3514fae02248e0e944020815b10df3b79d4560a4b8f2c72: Status 404 returned error can't find the container with id e9aae8b9f0ee41d3a3514fae02248e0e944020815b10df3b79d4560a4b8f2c72 Jun 11 17:10:44.926863 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:44.926811 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt" event={"ID":"0bcdea16-28ac-4b3b-a736-41ffd5b32021","Type":"ContainerStarted","Data":"e9aae8b9f0ee41d3a3514fae02248e0e944020815b10df3b79d4560a4b8f2c72"} Jun 11 17:10:48.949070 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:48.949032 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt" event={"ID":"0bcdea16-28ac-4b3b-a736-41ffd5b32021","Type":"ContainerStarted","Data":"2e0e8ef2e9c6a1e56360f9abdb9d3da1672a38a2ba98c746a73a4f1613e100a0"} Jun 11 17:10:49.955009 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:49.954973 2565 generic.go:356] "Generic (PLEG): container finished" podID="0bcdea16-28ac-4b3b-a736-41ffd5b32021" containerID="2e0e8ef2e9c6a1e56360f9abdb9d3da1672a38a2ba98c746a73a4f1613e100a0" exitCode=0 Jun 11 17:10:49.955410 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:49.955047 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt" event={"ID":"0bcdea16-28ac-4b3b-a736-41ffd5b32021","Type":"ContainerDied","Data":"2e0e8ef2e9c6a1e56360f9abdb9d3da1672a38a2ba98c746a73a4f1613e100a0"} Jun 11 17:10:51.965414 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:51.965380 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt" event={"ID":"0bcdea16-28ac-4b3b-a736-41ffd5b32021","Type":"ContainerStarted","Data":"a1529bbd95db5679147477d0ef7bacd7c39804834487656a2091e1496f6ed065"} Jun 11 17:10:51.986763 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:51.986713 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt" podStartSLOduration=2.598968951 podStartE2EDuration="8.986697843s" totalImagesPullingTime="5.124330878s" totalInitContainerRuntime="1.263398014s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:10:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:10:51.985063005 +0000 UTC m=+989.245317911" watchObservedRunningTime="2026-06-11 17:10:51.986697843 +0000 UTC m=+989.246952749" Jun 11 17:10:54.144366 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:54.144328 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt" Jun 11 17:10:54.144777 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:54.144417 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt" Jun 11 17:10:54.158013 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:54.157978 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt" Jun 11 17:10:54.989811 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:10:54.989778 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt" Jun 11 17:11:09.787952 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:09.787914 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv"] Jun 11 17:11:09.790917 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:09.790884 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv" Jun 11 17:11:09.797598 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:09.797259 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 11 17:11:09.807410 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:09.807374 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv"] Jun 11 17:11:09.909693 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:09.909651 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3da8e74-85bf-4c9e-816a-057a7bfe0e88-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv\" (UID: \"b3da8e74-85bf-4c9e-816a-057a7bfe0e88\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv" Jun 11 17:11:09.909940 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:09.909708 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3da8e74-85bf-4c9e-816a-057a7bfe0e88-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv\" (UID: \"b3da8e74-85bf-4c9e-816a-057a7bfe0e88\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv" Jun 11 17:11:09.909940 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:09.909740 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b3da8e74-85bf-4c9e-816a-057a7bfe0e88-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv\" (UID: \"b3da8e74-85bf-4c9e-816a-057a7bfe0e88\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv" Jun 11 17:11:09.909940 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:09.909767 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3da8e74-85bf-4c9e-816a-057a7bfe0e88-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv\" (UID: \"b3da8e74-85bf-4c9e-816a-057a7bfe0e88\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv" Jun 11 17:11:09.909940 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:09.909794 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jvgq\" (UniqueName: \"kubernetes.io/projected/b3da8e74-85bf-4c9e-816a-057a7bfe0e88-kube-api-access-2jvgq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv\" (UID: \"b3da8e74-85bf-4c9e-816a-057a7bfe0e88\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv" Jun 11 17:11:09.910095 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:09.909938 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3da8e74-85bf-4c9e-816a-057a7bfe0e88-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv\" (UID: \"b3da8e74-85bf-4c9e-816a-057a7bfe0e88\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv" Jun 11 17:11:10.010574 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:10.010537 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3da8e74-85bf-4c9e-816a-057a7bfe0e88-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv\" (UID: \"b3da8e74-85bf-4c9e-816a-057a7bfe0e88\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv" Jun 11 17:11:10.010747 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:10.010588 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3da8e74-85bf-4c9e-816a-057a7bfe0e88-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv\" (UID: \"b3da8e74-85bf-4c9e-816a-057a7bfe0e88\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv" Jun 11 17:11:10.010747 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:10.010620 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b3da8e74-85bf-4c9e-816a-057a7bfe0e88-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv\" (UID: \"b3da8e74-85bf-4c9e-816a-057a7bfe0e88\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv" Jun 11 17:11:10.010747 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:10.010657 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3da8e74-85bf-4c9e-816a-057a7bfe0e88-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv\" (UID: \"b3da8e74-85bf-4c9e-816a-057a7bfe0e88\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv" Jun 11 17:11:10.010747 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:10.010721 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jvgq\" (UniqueName: \"kubernetes.io/projected/b3da8e74-85bf-4c9e-816a-057a7bfe0e88-kube-api-access-2jvgq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv\" (UID: \"b3da8e74-85bf-4c9e-816a-057a7bfe0e88\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv" Jun 11 17:11:10.010938 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:10.010798 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3da8e74-85bf-4c9e-816a-057a7bfe0e88-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv\" (UID: \"b3da8e74-85bf-4c9e-816a-057a7bfe0e88\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv" Jun 11 17:11:10.011063 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:10.011038 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3da8e74-85bf-4c9e-816a-057a7bfe0e88-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv\" (UID: \"b3da8e74-85bf-4c9e-816a-057a7bfe0e88\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv" Jun 11 17:11:10.011127 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:10.011063 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3da8e74-85bf-4c9e-816a-057a7bfe0e88-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv\" (UID: \"b3da8e74-85bf-4c9e-816a-057a7bfe0e88\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv" Jun 11 17:11:10.011182 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:10.011125 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b3da8e74-85bf-4c9e-816a-057a7bfe0e88-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv\" (UID: \"b3da8e74-85bf-4c9e-816a-057a7bfe0e88\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv" Jun 11 17:11:10.012924 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:10.012902 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3da8e74-85bf-4c9e-816a-057a7bfe0e88-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv\" (UID: \"b3da8e74-85bf-4c9e-816a-057a7bfe0e88\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv" Jun 11 17:11:10.013349 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:10.013328 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3da8e74-85bf-4c9e-816a-057a7bfe0e88-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv\" (UID: \"b3da8e74-85bf-4c9e-816a-057a7bfe0e88\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv" Jun 11 17:11:10.020091 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:10.020068 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jvgq\" (UniqueName: \"kubernetes.io/projected/b3da8e74-85bf-4c9e-816a-057a7bfe0e88-kube-api-access-2jvgq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv\" (UID: \"b3da8e74-85bf-4c9e-816a-057a7bfe0e88\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv" Jun 11 17:11:10.102024 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:10.101998 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv" Jun 11 17:11:10.246869 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:10.246838 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv"] Jun 11 17:11:10.248204 ip-10-0-130-110 kubenswrapper[2565]: W0611 17:11:10.248173 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3da8e74_85bf_4c9e_816a_057a7bfe0e88.slice/crio-7e70eaa1792ed276af5f8518e9ad1d088f4b920ba9ec7d7adac249c772231bf4 WatchSource:0}: Error finding container 7e70eaa1792ed276af5f8518e9ad1d088f4b920ba9ec7d7adac249c772231bf4: Status 404 returned error can't find the container with id 7e70eaa1792ed276af5f8518e9ad1d088f4b920ba9ec7d7adac249c772231bf4 Jun 11 17:11:11.051977 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:11.051936 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv" event={"ID":"b3da8e74-85bf-4c9e-816a-057a7bfe0e88","Type":"ContainerStarted","Data":"6f7b2a8765da1db07c6da60e19befeb1e86495430117eed8708207ae50a472f2"} Jun 11 17:11:11.052425 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:11.052001 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv" event={"ID":"b3da8e74-85bf-4c9e-816a-057a7bfe0e88","Type":"ContainerStarted","Data":"7e70eaa1792ed276af5f8518e9ad1d088f4b920ba9ec7d7adac249c772231bf4"} Jun 11 17:11:28.116986 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:28.116944 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc"] Jun 11 17:11:28.120148 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:28.120125 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc" Jun 11 17:11:28.123198 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:28.123175 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 11 17:11:28.145319 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:28.145288 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc"] Jun 11 17:11:28.158713 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:28.158678 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/834ce73a-cf09-4560-be42-6f553e46051c-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc\" (UID: \"834ce73a-cf09-4560-be42-6f553e46051c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc" Jun 11 17:11:28.158911 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:28.158726 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/834ce73a-cf09-4560-be42-6f553e46051c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc\" (UID: \"834ce73a-cf09-4560-be42-6f553e46051c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc" Jun 11 17:11:28.158911 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:28.158798 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/834ce73a-cf09-4560-be42-6f553e46051c-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc\" (UID: \"834ce73a-cf09-4560-be42-6f553e46051c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc" Jun 11 17:11:28.158911 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:28.158873 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/834ce73a-cf09-4560-be42-6f553e46051c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc\" (UID: \"834ce73a-cf09-4560-be42-6f553e46051c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc" Jun 11 17:11:28.158911 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:28.158895 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/834ce73a-cf09-4560-be42-6f553e46051c-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc\" (UID: \"834ce73a-cf09-4560-be42-6f553e46051c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc" Jun 11 17:11:28.159050 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:28.158962 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm954\" (UniqueName: \"kubernetes.io/projected/834ce73a-cf09-4560-be42-6f553e46051c-kube-api-access-hm954\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc\" (UID: \"834ce73a-cf09-4560-be42-6f553e46051c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc" Jun 11 17:11:28.259720 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:28.259674 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/834ce73a-cf09-4560-be42-6f553e46051c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc\" (UID: \"834ce73a-cf09-4560-be42-6f553e46051c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc" Jun 11 17:11:28.259930 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:28.259732 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/834ce73a-cf09-4560-be42-6f553e46051c-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc\" (UID: \"834ce73a-cf09-4560-be42-6f553e46051c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc" Jun 11 17:11:28.259930 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:28.259777 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/834ce73a-cf09-4560-be42-6f553e46051c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc\" (UID: \"834ce73a-cf09-4560-be42-6f553e46051c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc" Jun 11 17:11:28.259930 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:28.259797 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/834ce73a-cf09-4560-be42-6f553e46051c-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc\" (UID: \"834ce73a-cf09-4560-be42-6f553e46051c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc" Jun 11 17:11:28.259930 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:28.259841 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm954\" (UniqueName: \"kubernetes.io/projected/834ce73a-cf09-4560-be42-6f553e46051c-kube-api-access-hm954\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc\" (UID: \"834ce73a-cf09-4560-be42-6f553e46051c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc" Jun 11 17:11:28.259930 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:28.259901 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/834ce73a-cf09-4560-be42-6f553e46051c-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc\" (UID: \"834ce73a-cf09-4560-be42-6f553e46051c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc" Jun 11 17:11:28.260403 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:28.260368 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/834ce73a-cf09-4560-be42-6f553e46051c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc\" (UID: \"834ce73a-cf09-4560-be42-6f553e46051c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc" Jun 11 17:11:28.260481 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:28.260377 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/834ce73a-cf09-4560-be42-6f553e46051c-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc\" (UID: \"834ce73a-cf09-4560-be42-6f553e46051c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc" Jun 11 17:11:28.260481 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:28.260424 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/834ce73a-cf09-4560-be42-6f553e46051c-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc\" (UID: \"834ce73a-cf09-4560-be42-6f553e46051c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc" Jun 11 17:11:28.262365 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:28.262342 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/834ce73a-cf09-4560-be42-6f553e46051c-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc\" (UID: \"834ce73a-cf09-4560-be42-6f553e46051c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc" Jun 11 17:11:28.262960 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:28.262936 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/834ce73a-cf09-4560-be42-6f553e46051c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc\" (UID: \"834ce73a-cf09-4560-be42-6f553e46051c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc" Jun 11 17:11:28.269029 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:28.269008 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm954\" (UniqueName: \"kubernetes.io/projected/834ce73a-cf09-4560-be42-6f553e46051c-kube-api-access-hm954\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc\" (UID: \"834ce73a-cf09-4560-be42-6f553e46051c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc" Jun 11 17:11:28.431533 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:28.431436 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc" Jun 11 17:11:28.574751 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:28.574721 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc"] Jun 11 17:11:28.576248 ip-10-0-130-110 kubenswrapper[2565]: W0611 17:11:28.576215 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod834ce73a_cf09_4560_be42_6f553e46051c.slice/crio-95e0301d10acde47cfd88bb1e84b128620adc2e4867a9574b1d699769e19b3f4 WatchSource:0}: Error finding container 95e0301d10acde47cfd88bb1e84b128620adc2e4867a9574b1d699769e19b3f4: Status 404 returned error can't find the container with id 95e0301d10acde47cfd88bb1e84b128620adc2e4867a9574b1d699769e19b3f4 Jun 11 17:11:29.137794 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:29.137758 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc" event={"ID":"834ce73a-cf09-4560-be42-6f553e46051c","Type":"ContainerStarted","Data":"d69ceccc4e6836736f56869b99a76fc8f3c7ab48aa1b778e5be56b526b5df384"} Jun 11 17:11:29.138214 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:11:29.137814 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc" event={"ID":"834ce73a-cf09-4560-be42-6f553e46051c","Type":"ContainerStarted","Data":"95e0301d10acde47cfd88bb1e84b128620adc2e4867a9574b1d699769e19b3f4"} Jun 11 17:12:22.384694 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:12:22.384660 2565 generic.go:356] "Generic (PLEG): container finished" podID="834ce73a-cf09-4560-be42-6f553e46051c" containerID="d69ceccc4e6836736f56869b99a76fc8f3c7ab48aa1b778e5be56b526b5df384" exitCode=0 Jun 11 17:12:22.385113 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:12:22.384722 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc" event={"ID":"834ce73a-cf09-4560-be42-6f553e46051c","Type":"ContainerDied","Data":"d69ceccc4e6836736f56869b99a76fc8f3c7ab48aa1b778e5be56b526b5df384"} Jun 11 17:12:22.385378 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:12:22.385362 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 17:12:23.391045 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:12:23.391011 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc" event={"ID":"834ce73a-cf09-4560-be42-6f553e46051c","Type":"ContainerStarted","Data":"cda5fa99068e6209661a67177526eb2e7933fc1cf52e4d265b34a5b03f9cf38d"} Jun 11 17:12:23.419413 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:12:23.419366 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc" podStartSLOduration=1.563723371 podStartE2EDuration="55.419347319s" totalImagesPullingTime="234.949001ms" totalInitContainerRuntime="53.620674947s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:11:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:12:23.415262093 +0000 UTC m=+1080.675516998" watchObservedRunningTime="2026-06-11 17:12:23.419347319 +0000 UTC m=+1080.679602226" Jun 11 17:12:28.432369 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:12:28.432319 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc" Jun 11 17:12:28.432897 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:12:28.432408 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc" Jun 11 17:12:28.445160 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:12:28.445137 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc" Jun 11 17:12:29.429033 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:12:29.429007 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc" Jun 11 17:14:23.205833 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:14:23.205782 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7hbj_a30425b4-3b27-4ae1-af09-384473269d18/ovn-acl-logging/0.log" Jun 11 17:14:23.208610 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:14:23.208587 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7hbj_a30425b4-3b27-4ae1-af09-384473269d18/ovn-acl-logging/0.log" Jun 11 17:17:31.540292 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:17:31.540254 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv_b3da8e74-85bf-4c9e-816a-057a7bfe0e88/storage-initializer/0.log" Jun 11 17:17:37.610159 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:17:37.610127 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7c77f5f568-q7psn_d11b5098-6e68-4b4e-8a3d-14e6af5d5f1c/nginx/0.log" Jun 11 17:17:37.870911 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:17:37.870810 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-jwqpb_5873dfb7-b042-465a-a480-ed0aaa195ca7/manager/0.log" Jun 11 17:17:37.999847 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:17:37.999808 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-8r2wk_9335727b-3eec-4b79-9b6b-981cb67cbe2e/manager/0.log" Jun 11 17:17:38.663146 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:17:38.663114 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-hwtcf_c2cd6b12-2658-45e0-a432-cd9f705aa11c/manager/0.log" Jun 11 17:17:39.071559 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:17:39.071533 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dbfc5486d-zlj6k_bf2f24e7-50fb-4fd0-849f-f9cee3637dca/copy-manifests/0.log" Jun 11 17:17:39.085695 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:17:39.085674 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dbfc5486d-zlj6k_bf2f24e7-50fb-4fd0-849f-f9cee3637dca/manager/0.log" Jun 11 17:17:40.807489 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:17:40.807458 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-ksp6r_fd9aee8d-1e4b-4360-a3b5-ad46df759bee/manager/0.log" Jun 11 17:17:41.299548 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:17:41.299520 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fjxb9_13bd1048-d89a-49d3-95ec-df5b949f7fb9/manager/0.log" Jun 11 17:17:42.044154 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:17:42.044120 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-c2rqq_6e2abb1f-c0ba-481a-8a24-5738e383842b/discovery/0.log" Jun 11 17:17:42.307838 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:17:42.307752 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5968bff7d8-pm9xh_b482be0e-6df3-4947-b806-6b653d23dc71/kube-auth-proxy/0.log" Jun 11 17:17:42.560809 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:17:42.560729 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-ld2zc_65223fd9-e6a0-4f3a-8949-7651ff04a9f5/payload-pre-processing/0.log" Jun 11 17:17:42.679247 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:17:42.679220 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-chtlw_e381ba95-f38a-414f-8c00-f7c74d1ff26a/payload-processing/0.log" Jun 11 17:17:43.161213 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:17:43.161182 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt_0bcdea16-28ac-4b3b-a736-41ffd5b32021/storage-initializer/0.log" Jun 11 17:17:43.190837 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:17:43.190796 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-5tnwt_0bcdea16-28ac-4b3b-a736-41ffd5b32021/main/0.log" Jun 11 17:17:43.628835 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:17:43.628791 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmpmvv_b3da8e74-85bf-4c9e-816a-057a7bfe0e88/storage-initializer/0.log" Jun 11 17:17:43.782208 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:17:43.782183 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc_834ce73a-cf09-4560-be42-6f553e46051c/storage-initializer/0.log" Jun 11 17:17:43.792211 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:17:43.792189 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-lvhjc_834ce73a-cf09-4560-be42-6f553e46051c/main/0.log" Jun 11 17:17:52.720918 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:17:52.720886 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bmvr9_183fce84-80c4-4c1d-aa51-e962fdd8b887/global-pull-secret-syncer/0.log" Jun 11 17:17:52.956679 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:17:52.956651 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pqrvn_286b1d27-5581-44ce-b5d6-309dad57b6c9/konnectivity-agent/0.log" Jun 11 17:17:52.982128 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:17:52.982058 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-110.ec2.internal_52b07f939a17d866fffc845ba62c423b/haproxy/0.log" Jun 11 17:17:56.537986 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:17:56.537956 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-n9rw7_b1e8b720-d4a0-4956-8f4d-1935af408fe2/sail-operator/0.log" Jun 11 17:17:58.713147 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:17:58.713115 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-ksp6r_fd9aee8d-1e4b-4360-a3b5-ad46df759bee/manager/0.log" Jun 11 17:17:58.864960 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:17:58.864928 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fjxb9_13bd1048-d89a-49d3-95ec-df5b949f7fb9/manager/0.log" Jun 11 17:18:01.531422 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:01.531390 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4slfc_7f1f613d-1774-4b6b-8734-470d28645519/node-exporter/0.log" Jun 11 17:18:01.593959 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:01.593930 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4slfc_7f1f613d-1774-4b6b-8734-470d28645519/kube-rbac-proxy/0.log" Jun 11 17:18:01.644093 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:01.644066 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4slfc_7f1f613d-1774-4b6b-8734-470d28645519/init-textfile/0.log" Jun 11 17:18:02.587343 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:02.587306 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dvddx/perf-node-gather-daemonset-v76xr"] Jun 11 17:18:02.589834 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:02.589803 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-v76xr" Jun 11 17:18:02.592369 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:02.592349 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dvddx\"/\"kube-root-ca.crt\"" Jun 11 17:18:02.593104 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:02.593083 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dvddx\"/\"default-dockercfg-q5hw5\"" Jun 11 17:18:02.593228 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:02.593121 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dvddx\"/\"openshift-service-ca.crt\"" Jun 11 17:18:02.608429 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:02.608405 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dvddx/perf-node-gather-daemonset-v76xr"] Jun 11 17:18:02.707147 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:02.707114 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smpzf\" (UniqueName: \"kubernetes.io/projected/fc064355-68fe-4f9e-a345-df02b2820e4f-kube-api-access-smpzf\") pod \"perf-node-gather-daemonset-v76xr\" (UID: \"fc064355-68fe-4f9e-a345-df02b2820e4f\") " pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-v76xr" Jun 11 17:18:02.707314 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:02.707157 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fc064355-68fe-4f9e-a345-df02b2820e4f-podres\") pod \"perf-node-gather-daemonset-v76xr\" (UID: \"fc064355-68fe-4f9e-a345-df02b2820e4f\") " pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-v76xr" Jun 11 17:18:02.707314 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:02.707180 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc064355-68fe-4f9e-a345-df02b2820e4f-sys\") pod \"perf-node-gather-daemonset-v76xr\" (UID: \"fc064355-68fe-4f9e-a345-df02b2820e4f\") " pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-v76xr" Jun 11 17:18:02.707314 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:02.707209 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fc064355-68fe-4f9e-a345-df02b2820e4f-proc\") pod \"perf-node-gather-daemonset-v76xr\" (UID: \"fc064355-68fe-4f9e-a345-df02b2820e4f\") " pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-v76xr" Jun 11 17:18:02.707314 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:02.707252 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc064355-68fe-4f9e-a345-df02b2820e4f-lib-modules\") pod \"perf-node-gather-daemonset-v76xr\" (UID: \"fc064355-68fe-4f9e-a345-df02b2820e4f\") " pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-v76xr" Jun 11 17:18:02.808499 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:02.808465 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fc064355-68fe-4f9e-a345-df02b2820e4f-podres\") pod \"perf-node-gather-daemonset-v76xr\" (UID: \"fc064355-68fe-4f9e-a345-df02b2820e4f\") " pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-v76xr" Jun 11 17:18:02.808499 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:02.808509 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc064355-68fe-4f9e-a345-df02b2820e4f-sys\") pod \"perf-node-gather-daemonset-v76xr\" (UID: \"fc064355-68fe-4f9e-a345-df02b2820e4f\") " pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-v76xr" Jun 11 17:18:02.808754 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:02.808537 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fc064355-68fe-4f9e-a345-df02b2820e4f-proc\") pod \"perf-node-gather-daemonset-v76xr\" (UID: \"fc064355-68fe-4f9e-a345-df02b2820e4f\") " pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-v76xr" Jun 11 17:18:02.808754 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:02.808595 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc064355-68fe-4f9e-a345-df02b2820e4f-lib-modules\") pod \"perf-node-gather-daemonset-v76xr\" (UID: \"fc064355-68fe-4f9e-a345-df02b2820e4f\") " pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-v76xr" Jun 11 17:18:02.808754 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:02.808599 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc064355-68fe-4f9e-a345-df02b2820e4f-sys\") pod \"perf-node-gather-daemonset-v76xr\" (UID: \"fc064355-68fe-4f9e-a345-df02b2820e4f\") " pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-v76xr" Jun 11 17:18:02.808754 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:02.808643 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fc064355-68fe-4f9e-a345-df02b2820e4f-podres\") pod \"perf-node-gather-daemonset-v76xr\" (UID: \"fc064355-68fe-4f9e-a345-df02b2820e4f\") " pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-v76xr" Jun 11 17:18:02.808754 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:02.808666 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smpzf\" (UniqueName: \"kubernetes.io/projected/fc064355-68fe-4f9e-a345-df02b2820e4f-kube-api-access-smpzf\") pod \"perf-node-gather-daemonset-v76xr\" (UID: \"fc064355-68fe-4f9e-a345-df02b2820e4f\") " pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-v76xr" Jun 11 17:18:02.808754 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:02.808645 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fc064355-68fe-4f9e-a345-df02b2820e4f-proc\") pod \"perf-node-gather-daemonset-v76xr\" (UID: \"fc064355-68fe-4f9e-a345-df02b2820e4f\") " pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-v76xr" Jun 11 17:18:02.808754 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:02.808725 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc064355-68fe-4f9e-a345-df02b2820e4f-lib-modules\") pod \"perf-node-gather-daemonset-v76xr\" (UID: \"fc064355-68fe-4f9e-a345-df02b2820e4f\") " pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-v76xr" Jun 11 17:18:02.818050 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:02.818025 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smpzf\" (UniqueName: \"kubernetes.io/projected/fc064355-68fe-4f9e-a345-df02b2820e4f-kube-api-access-smpzf\") pod \"perf-node-gather-daemonset-v76xr\" (UID: \"fc064355-68fe-4f9e-a345-df02b2820e4f\") " pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-v76xr" Jun 11 17:18:02.900356 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:02.900269 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-v76xr" Jun 11 17:18:03.042088 ip-10-0-130-110 kubenswrapper[2565]: W0611 17:18:03.042056 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfc064355_68fe_4f9e_a345_df02b2820e4f.slice/crio-5f022ba994b420f469a682d92dad2964a0b609edef9ba4ca65616a93f18ad9f9 WatchSource:0}: Error finding container 5f022ba994b420f469a682d92dad2964a0b609edef9ba4ca65616a93f18ad9f9: Status 404 returned error can't find the container with id 5f022ba994b420f469a682d92dad2964a0b609edef9ba4ca65616a93f18ad9f9 Jun 11 17:18:03.042234 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:03.042147 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dvddx/perf-node-gather-daemonset-v76xr"] Jun 11 17:18:03.965094 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:03.965043 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-v76xr" event={"ID":"fc064355-68fe-4f9e-a345-df02b2820e4f","Type":"ContainerStarted","Data":"d36ec9e967d5eecd4bc38188e53bd5f89626ac1a7e46e1d49ca56576502b5574"} Jun 11 17:18:03.965481 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:03.965230 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-v76xr" Jun 11 17:18:03.965481 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:03.965255 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-v76xr" event={"ID":"fc064355-68fe-4f9e-a345-df02b2820e4f","Type":"ContainerStarted","Data":"5f022ba994b420f469a682d92dad2964a0b609edef9ba4ca65616a93f18ad9f9"} Jun 11 17:18:03.990664 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:03.990587 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-v76xr" podStartSLOduration=1.9905686999999999 podStartE2EDuration="1.9905687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 17:18:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:18:03.989214616 +0000 UTC m=+1421.249469522" watchObservedRunningTime="2026-06-11 17:18:03.9905687 +0000 UTC m=+1421.250823607" Jun 11 17:18:04.346428 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:04.346400 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-6skv7_2d7567f4-2d0c-4979-b2fe-a59eae95b974/networking-console-plugin/0.log" Jun 11 17:18:07.918979 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:07.918884 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x4w9j_e56370ed-2f52-42f7-aa1f-ec213d8d14a1/dns/0.log" Jun 11 17:18:07.954479 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:07.954449 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x4w9j_e56370ed-2f52-42f7-aa1f-ec213d8d14a1/kube-rbac-proxy/0.log" Jun 11 17:18:08.034728 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:08.034694 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mb5bm_b0a87b53-941e-4917-b0a7-8459458b8b25/dns-node-resolver/0.log" Jun 11 17:18:08.882593 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:08.882564 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h4cjk_5f24a441-bff5-4a1f-bff7-92b60f4a2394/node-ca/0.log" Jun 11 17:18:09.980196 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:09.980169 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-v76xr" Jun 11 17:18:10.129339 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:10.129299 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-c2rqq_6e2abb1f-c0ba-481a-8a24-5738e383842b/discovery/0.log" Jun 11 17:18:10.210559 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:10.210529 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5968bff7d8-pm9xh_b482be0e-6df3-4947-b806-6b653d23dc71/kube-auth-proxy/0.log" Jun 11 17:18:10.282439 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:10.282341 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-ld2zc_65223fd9-e6a0-4f3a-8949-7651ff04a9f5/payload-pre-processing/0.log" Jun 11 17:18:10.311659 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:10.311632 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-chtlw_e381ba95-f38a-414f-8c00-f7c74d1ff26a/payload-processing/0.log" Jun 11 17:18:11.217798 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:11.217767 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qxl9m_26915d24-6b82-41d7-9d72-e4846076e9da/serve-healthcheck-canary/0.log" Jun 11 17:18:11.944920 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:11.944876 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fc8kc_6b7f52e2-5d32-4c18-9483-549621c0a42e/kube-rbac-proxy/0.log" Jun 11 17:18:11.968809 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:11.968783 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fc8kc_6b7f52e2-5d32-4c18-9483-549621c0a42e/exporter/0.log" Jun 11 17:18:11.996756 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:11.996724 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fc8kc_6b7f52e2-5d32-4c18-9483-549621c0a42e/extractor/0.log" Jun 11 17:18:15.025402 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:15.025356 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7c77f5f568-q7psn_d11b5098-6e68-4b4e-8a3d-14e6af5d5f1c/nginx/0.log" Jun 11 17:18:15.094395 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:15.094363 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-jwqpb_5873dfb7-b042-465a-a480-ed0aaa195ca7/manager/0.log" Jun 11 17:18:15.163313 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:15.163279 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-8r2wk_9335727b-3eec-4b79-9b6b-981cb67cbe2e/manager/0.log" Jun 11 17:18:15.383137 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:15.383110 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-hwtcf_c2cd6b12-2658-45e0-a432-cd9f705aa11c/manager/0.log" Jun 11 17:18:15.718117 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:15.718043 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dbfc5486d-zlj6k_bf2f24e7-50fb-4fd0-849f-f9cee3637dca/manager/0.log" Jun 11 17:18:15.834768 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:15.834737 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dbfc5486d-zlj6k_bf2f24e7-50fb-4fd0-849f-f9cee3637dca/copy-manifests/0.log" Jun 11 17:18:17.775717 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:17.775675 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-nmfkv_f2ffc2c0-7768-46f2-b0a7-3c8e7dd34a05/openshift-lws-operator/0.log" Jun 11 17:18:17.984963 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:17.984913 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-c2rqq_6e2abb1f-c0ba-481a-8a24-5738e383842b/discovery/0.log" Jun 11 17:18:18.064209 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:18.064183 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5968bff7d8-pm9xh_b482be0e-6df3-4947-b806-6b653d23dc71/kube-auth-proxy/0.log" Jun 11 17:18:18.116192 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:18.116156 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-ld2zc_65223fd9-e6a0-4f3a-8949-7651ff04a9f5/payload-pre-processing/0.log" Jun 11 17:18:18.143096 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:18.143066 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-chtlw_e381ba95-f38a-414f-8c00-f7c74d1ff26a/payload-processing/0.log" Jun 11 17:18:19.573189 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:19.573159 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-c2rqq_6e2abb1f-c0ba-481a-8a24-5738e383842b/discovery/0.log" Jun 11 17:18:19.650351 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:19.650313 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5968bff7d8-pm9xh_b482be0e-6df3-4947-b806-6b653d23dc71/kube-auth-proxy/0.log" Jun 11 17:18:19.736207 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:19.736179 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-ld2zc_65223fd9-e6a0-4f3a-8949-7651ff04a9f5/payload-pre-processing/0.log" Jun 11 17:18:19.776595 ip-10-0-130-110 kubenswrapper[2565]: I0611 17:18:19.776569 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-chtlw_e381ba95-f38a-414f-8c00-f7c74d1ff26a/payload-processing/0.log"